Visual Tracker Benchmark

Datasets

The full benchmark contains 100 sequences from recent literatures.

  • The sequence names are in CamelCase without any blanks or underscores (_).

  • When there exist multiple targets each target is identified as dot+id_number (e.g. Jogging.1 and Jogging.2).

  • Each row in the ground-truth files represents the bounding box of the target in that frame,
    (x, y, box-width, box-height).

  • In most sequences the first row corresponds to the first frame and the last row to the last frame, except the following sequences:

    • David(300:770), Football1(1:74), Freeman3(1:460), Freeman4(1:283).

TB-50 Sequences.


Basketball
IV, OCC, DEF, OPR, BC

Biker
SV, OCC, MB, FM, OPR, OV, LR

Bird1
DEF, FM, OV

BlurBody
SV, DEF, MB, FM, IPR

BlurCar2
SV, MB, FM

BlurFace
MB, FM, IPR

BlurOwl
SV, MB, FM, IPR

Bolt
OCC, DEF, IPR, OPR

Box
IV, SV, OCC, MB, IPR, OPR, OV, BC, LR

Car1
IV, SV, MB, FM, BC, LR

Car4
IV, SV

CarDark
IV, BC

CarScale
SV, OCC, FM, IPR, OPR

ClifBar
SV, OCC, MB, FM, IPR, OV, BC

Couple
SV, DEF, FM, OPR, BC

Crowds
IV, DEF, BC

David
IV, SV, OCC, DEF, MB, IPR, OPR

Deer
MB, FM, IPR, BC, LR

Diving
SV, DEF, IPR

DragonBaby
SV, OCC, MB, FM, IPR, OPR, OV

Dudek
SV, OCC, DEF, FM, IPR, OPR, OV, BC

Football
OCC, IPR, OPR, BC

Freeman4
SV, OCC, IPR, OPR

Girl
SV, OCC, IPR, OPR

Human3
SV, OCC, DEF, OPR, BC

Human4
IV, SV, OCC, DEF

Human6
SV, OCC, DEF, FM, OPR, OV

Human9
IV, SV, DEF, MB, FM

Ironman
IV, SV, OCC, MB, FM, IPR, OPR, OV, BC, LR

Jump
SV, OCC, DEF, MB, FM, IPR, OPR

Jumping
MB, FM

Liquor
IV, SV, OCC, MB, FM, OPR, OV, BC

Matrix
IV, SV, OCC, FM, IPR, OPR, BC

MotorRolling
IV, SV, MB, FM, IPR, BC, LR

Panda
SV, OCC, DEF, IPR, OPR, OV, LR

RedTeam
SV, OCC, IPR, OPR, LR

Shaking
IV, SV, IPR, OPR, BC

Singer2
IV, DEF, IPR, OPR, BC

Skating1
IV, SV, OCC, DEF, OPR, BC

Skating2 [1,2]
SV, OCC, DEF, FM, OPR

Skiing
IV, SV, DEF, IPR, OPR

Soccer
IV, SV, OCC, MB, FM, IPR, OPR, BC

Surfer
SV, FM, IPR, OPR, LR

Sylvester
IV, IPR, OPR

Tiger2
IV, OCC, DEF, MB, FM, IPR, OPR, OV

Trellis
IV, SV, IPR, OPR, BC

Walking
SV, OCC, DEF

Walking2
SV, OCC, LR

Woman
IV, SV, OCC, DEF, MB, FM, OPR

The rest of TB-100 Sequences


Bird2
OCC, DEF, FM, IPR, OPR

BlurCar1
MB, FM

BlurCar3
MB, FM

BlurCar4
MB, FM

Board
SV, MB, FM, OPR, OV, BC

Bolt2
DEF, BC

Boy
SV, MB, FM, IPR, OPR

Car2
IV, SV, MB, FM, BC

Car24
IV, SV, BC

Coke
IV, OCC, FM, IPR, OPR, BC

Coupon
OCC, BC

Crossing
SV, DEF, FM, OPR, BC

Dancer
SV, DEF, IPR, OPR

Dancer2
DEF

David2
IPR, OPR

David3
OCC, DEF, OPR, BC

Dog
SV, DEF, OPR

Dog1
SV, IPR, OPR

Doll
IV, SV, OCC, IPR, OPR

FaceOcc1
OCC

FaceOcc2
IV, OCC, IPR, OPR

Fish
IV

FleetFace
SV, DEF, MB, FM, IPR, OPR

Football1
IPR, OPR, BC

Freeman1
SV, IPR, OPR

Freeman3
SV, IPR, OPR

Girl2
SV, OCC, DEF, MB, OPR

Gym
SV, DEF, IPR, OPR

Human2
IV, SV, MB, OPR

Human5
SV, OCC, DEF

Human7
IV, SV, OCC, DEF, MB, FM

Human8
IV, SV, DEF

Jogging [1,2]
OCC, DEF, OPR

KiteSurf
IV, OCC, IPR, OPR

Lemming
IV, SV, OCC, FM, OPR, OV

Man
IV

Mhyang
IV, DEF, OPR, BC

MountainBike
IPR, OPR, BC

Rubik
SV, OCC, IPR, OPR

Singer1
IV, SV, OCC, OPR

Skater
SV, DEF, IPR, OPR

Skater2
SV, DEF, FM, IPR, OPR

Subway
OCC, DEF, BC

Suv
OCC, IPR, OV

Tiger1
IV, OCC, DEF, MB, FM, IPR, OPR

Toy
SV, FM, IPR, OPR

Trans
IV, SV, OCC, DEF

Twinnings
SV, OPR

Vase
SV, FM, IPR

Attributes

We have manually tagged the test sequences with 9 attributes, which represents the challenging aspects in visual tracking.

NAME DESCRIPTION
IV Illumination Variation - the illumination in the target region is significantly changed.
Basketball, Box, Car1, Car2, Car24, Car4, CarDark, Coke, Crowds, David, Doll, FaceOcc2, Fish, Human2, Human4.2, Human7, Human8, Human9, Ironman, KiteSurf, Lemming, Liquor, Man, Matrix, Mhyang, MotorRolling, Shaking, Singer1, Singer2, Skating1, Skiing, Soccer, Sylvester, Tiger1, Tiger2, Trans, Trellis, Woman
SV Scale Variation – the ratio of the bounding boxes of the first frame and the current frame is out of the range ts, ts > 1 (ts=2).
Biker, BlurBody, BlurCar2, BlurOwl, Board, Box, Boy, Car1, Car24, Car4, CarScale, ClifBar, Couple, Crossing, Dancer, David, Diving, Dog, Dog1, Doll, DragonBaby, Dudek, FleetFace, Freeman1, Freeman3, Freeman4, Girl, Girl2, Gym, Human2, Human3, Human4.2, Human5, Human6, Human7, Human8, Human9, Ironman, Jump, Lemming, Liquor, Matrix, MotorRolling, Panda, RedTeam, Rubik, Shaking, Singer1, Skater, Skater2, Skating1, Skating2.1, Skating2.2, Skiing, Soccer, Surfer, Toy, Trans, Trellis, Twinnings, Vase, Walking, Walking2, Woman
OCC Occlusion – the target is partially or fully occluded.
Basketball, Biker, Bird2, Bolt, Box, CarScale, ClifBar, Coke, Coupon, David, David3, Doll, DragonBaby, Dudek, FaceOcc1, FaceOcc2, Football, Freeman4, Girl, Girl2, Human3, Human4.2, Human5, Human6, Human7, Ironman, Jogging.1, Jogging.2, Jump, KiteSurf, Lemming, Liquor, Matrix, Panda, RedTeam, Rubik, Singer1, Skating1, Skating2.1, Skating2.2, Soccer, Subway, Suv, Tiger1, Tiger2, Trans, Walking, Walking2, Woman
DEF Deformation – non-rigid object deformation.
Basketball, Bird1, Bird2, BlurBody, Bolt, Bolt2, Couple, Crossing, Crowds, Dancer, Dancer2, David, David3, Diving, Dog, Dudek, FleetFace, Girl2, Gym, Human3, Human4.2, Human5, Human6, Human7, Human8, Human9, Jogging.1, Jogging.2, Jump, Mhyang, Panda, Singer2, Skater, Skater2, Skating1, Skating2.1, Skating2.2, Skiing, Subway, Tiger1, Tiger2, Trans, Walking, Woman
MB Motion Blur – the target region is blurred due to the motion of target or camera.
Biker, BlurBody, BlurCar1, BlurCar2, BlurCar3, BlurCar4, BlurFace, BlurOwl, Board, Box, Boy, ClifBar, David, Deer, DragonBaby, FleetFace, Girl2, Human2, Human7, Human9, Ironman, Jump, Jumping, Liquor, MotorRolling, Soccer, Tiger1, Tiger2, Woman
FM Fast Motion – the motion of the ground truth is larger than tm pixels (tm=20).
Biker, Bird1, Bird2, BlurBody, BlurCar1, BlurCar2, BlurCar3, BlurCar4, BlurFace, BlurOwl, Board, Boy, CarScale, ClifBar, Coke, Couple, Deer, DragonBaby, Dudek, FleetFace, Human6, Human7, Human9, Ironman, Jumping, Lemming, Liquor, Matrix, MotorRolling, Skater2, Skating2.1, Skating2.2, Soccer, Surfer, Tiger1, Tiger2, Toy, Vase, Woman
IPR In-Plane Rotation – the target rotates in the image plane.
Bird2, BlurBody, BlurFace, BlurOwl, Bolt, Box, Boy, CarScale, ClifBar, Coke, Dancer, David, David2, Deer, Diving, Dog1, Doll, DragonBaby, Dudek, FaceOcc2, FleetFace, Football, Football1, Freeman1, Freeman3, Freeman4, Girl, Gym, Ironman, Jump, KiteSurf, Matrix, MotorRolling, MountainBike, Panda, RedTeam, Rubik, Shaking, Singer2, Skater, Skater2, Skiing, Soccer, Surfer, Suv, Sylvester, Tiger1, Tiger2, Toy, Trellis, Vase
OPR Out-of-Plane Rotation – the target rotates out of the image plane.
Basketball, Biker, Bird2, Board, Bolt, Box, Boy, CarScale, Coke, Couple, Dancer, David, David2, David3, Dog, Dog1, Doll, DragonBaby, Dudek, FaceOcc2, FleetFace, Football, Football1, Freeman1, Freeman3, Freeman4, Girl, Girl2, Gym, Human2, Human3, Human6, Ironman, Jogging.1, Jogging.2, Jump, KiteSurf, Lemming, Liquor, Matrix, Mhyang, MountainBike, Panda, RedTeam, Rubik, Shaking, Singer1, Singer2, Skater, Skater2, Skating1, Skating2.1, Skating2.2, Skiing, Soccer, Surfer, Sylvester, Tiger1, Tiger2, Toy, Trellis, Twinnings, Woman
OV Out-of-View – some portion of the target leaves the view.
Biker, Bird1, Board, Box, ClifBar, DragonBaby, Dudek, Human6, Ironman, Lemming, Liquor, Panda, Suv, Tiger2
BC Background Clutters – the background near the target has the similar color or texture as the target.
Basketball, Board, Bolt2, Box, Car1, Car2, Car24, CarDark, ClifBar, Couple, Coupon, Crossing, Crowds, David3, Deer, Dudek, Football, Football1, Human3, Ironman, Liquor, Matrix, Mhyang, MotorRolling, MountainBike, Shaking, Singer2, Skating1, Soccer, Subway, Trellis
LR Low Resolution – the number of pixels inside the ground-truth bounding box is less than tr (tr =400).
Biker, Car1, Freeman3, Freeman4, Panda, RedTeam, Skiing, Surfer, Walking