Papers with Code 아카이브

Object Tracking

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

하위 태스크
10
평가표
10
보존된 평가 기록
43

Object tracking is the task of taking an initial set of object detections, creating a unique ID for each of the initial detections, and then tracking each of the objects as they move around frames in a video, maintaining the ID assignment. State-of-the-art methods involve fusing data from RGB and event-based cameras to produce more reliable object tracking. CNN-based models using only RGB images as input are also effective. The most popular benchmark is OTB. There are several evaluation metrics specific to object tracking, including HOTA, MOTA, IDF1, and Track-mAP.

<span style="color:grey; opacity: 0.6">( Image credit: Towards-Realtime-MOT )</span>

데이터셋

출처에 같은 태스크 이름으로 연결된 데이터셋입니다. 동명 태스크가 포함될 수 있으므로, 비교할 때는 평가 결과의 조건도 확인하세요.

BuckTales

The first and large scale dataset to solve multi-object tracking and Re-identification problem with wild animals using UAVs. The dataset provides annotations for object detection, multi-object tracking and re-identification. Object detection dataset is specific for MOT problem : 320 Images MOT : 12 videos (21K frames) of 5.4K resolution, avg length 66 sec (Total : 1.2 Million) Longest video in MOT is 3 min (5800) Each video has 30-130 animals with different types of clusters and fast/slow movements. Total tracks : 680 Re-Identification (video) : 730 Individuals records from two different drones simultaneuously in 11 video pairs. Video length = 600 - 1100 frames.

COPE-119

DynOPETs is a real-world RGB-D dataset designed for object pose estimation and tracking in dynamic scenes with moving cameras. COPE119 119 sequences covering 6 common categories from the COPE benchmark: bottles, bowls, cameras, cans, laptops, mugs. Designed for COPE (Category-level Pose Estimation) methods.

FISHTRAC

A dataset of real-world underwater videos annotated with multi-object tracking labels. The data was collected of the coast of the Big Island of Hawaii and the primary goal is to help scientists studying fish behavior, with the goal of conserving rare and beautiful fish species. Features: * Real-world video collected primarily by divers : Results in complex camera motion and complex background effects (coral), which poses a challenge for many tracking systems. * Limited training data: Only 3 videos reserved for training, the other 11 are reserved for testing. This allows one to examine how approaches cope with little training data. * Provided deep detections: Unfiltered deep detections are provided from RetinaNet. These detections are reasonable but imperfect, allowing one to examine how to cope with unfiltered predictions. * Complete labels: Every frame is annotated, and every fish that can be identified with 100% certainty from a single frame is marked.

HA-ViD

Understanding comprehensive assembly knowledge from videos is critical for futuristic ultra-intelligent industry. To enable technological breakthrough, we present HA-ViD – an assembly video dataset that features representative industrial assembly scenarios, natural procedural knowledge acquisition process, and consistent human-robot shared annotations. Specifically, HA-ViD captures diverse collaboration patterns of real-world assembly, natural human behaviors and learning progression during assembly, and granulate action annotations to subject, action verb, manipulated object, target object, and tool. We provide 3222 multi-view and multi-modality videos, 1.5M frames, 96K temporal labels and 2M spatial labels. We benchmark four foundational video understanding tasks: action recognition, action segmentation, object detection and multi-object tracking. Importantly, we analyze their performance and the further reasoning steps for comprehending knowledge in assembly progress, process efficiency, task collaboration, skill parameters and human intention. Details of HA-ViD is available at: https://iai-hrc.github.io/ha-vid.

HT1080WT cells - 3D collagen type I matrices

Human fibrosarcoma HT1080WT (ATCC) cells at low cell densities embedded in 3D collagen type I matrices [1]. The time-lapse videos were recorded every 2 minutes for 16.7 hours and covered a field of view of 1002 pixels × 1004 pixels with a pixel size of 0.802 μm/pixel The videos were pre-processed to correct frame-to-frame drift artifacts, resulting in a final size of 983 pixels × 985 pixels pixels. [1] Hasini Jayatilaka, Anjil Giri, Michelle Karl, Ivie Aifuwa, Nicholaus J Trenton, Jude M Phillip, Shyam Khatau, and Denis Wirtz. EB1 and cytoplasmic dynein mediate protrusion dynamics for efficient 3-dimensional cell migration. FASEB J., 32(3):1207–1221, 2018. ISSN 0892-6638. doi: 10.1096/fj.201700444RR.

INI-30

A representative event-based eye-tracking dataset, collected with two event cameras mounted on a glass frame. It features variable recording lengths and event counts from 30 volunteers, providing an ideal benchmark for modeling the heterogeneity of event-based eye tracking in real-world scenarios.

LTFT

Dataset originally conceived for multi-face tracking/detection for highly crowded scenarios. In these scenarios, the face is the only part that can be used to track the individuals. All our videos present novel crowd scenes recorded at near-eye level, where faces are visible enough to be analysed at the microscopic level, while also benefiting from a macroscopic view of the crowd. It includes: - Face detections of 715 unique subjects along with instructions to download the synchronized video. - More than 75k face detections annotated. - A density ranging from 3 to 13 people/frame. - 6 indoor and 4 outdoor videos. 8/10 videos are totally unconstrained, 2/10 feature 3 re-appearances per subject. Our dataset may be useful for: - Face tracking, especially relevant for crowded scenarios (typically from video-surveillance cameras). - Heavily occluded body tracking (in many videos, only the face is mostly visible). - Face recognition. - Face detection for partially occluded faces.

MobiFace

MobiFace is the first dataset for single face tracking in mobile situations. It consists of 80 unedited live-streaming mobile videos captured by 70 different smartphone users in fully unconstrained environments. Over 95K bounding boxes are manually labelled. The videos are carefully selected to cover typical smartphone usage. The videos are also annotated with 14 attributes, including 6 newly proposed attributes and 8 commonly seen in object tracking. Source: MobiFace

Omni-MOT

The Omni-MOT is realistic CARLA based large-scale dataset with over 14M frames for multiple vehicle tracking . The dataset comprises 14M+ frames, 250K tracks, 110 million bounding boxes, three weather conditions, three crowd levels and three camera views in five simulated towns. Source: Simultaneous Detection and Tracking with Motion Modelling for Multiple Object Tracking

RMOT-223

In this dataset, various objects are arranged on a white table. A UR5e robot picks and place a target object specified on the title of the video/image sequence. Videos under auto- folder are collected with automatic operation of the robot. Videos under human- folders are collected with the tele-operation of the robot. Ground-truth tracking bounding boxes are generated with STARK, and when the target exits the camera frame, the bounding box estimation is switched to [-1, -1, -1, -1], indicating target not shown.

S-ODv2

SeaDronesSee-Object Detection v2 (S-ODv2) dataset contains 14,227 RGB images (training: 8,930; validation: 1,547; testing: 3,750). The images are captured from various altitudes and viewing angles ranging from 5 to 260 meters and 0 to 90° degrees (gimbal pitch angle) while providing the respective meta information for altitude, viewing angle and other meta data for almost all frames. Source: 1st Workshop on Maritime Computer Vision (MaCVi) 2023: Challenge Results Image Source: https://seadronessee.cs.uni-tuebingen.de/home

SFU-HW-Tracks

SFU-HW-Tracks is a dataset for Object Tracking on raw video sequences that contains object annotations with unique object identities (IDs) for the High Efficiency Video Coding (HEVC) v1 Common Test Conditions (CTC) sequences. It is the tracking extension of the dataset called SFU-HW-Objects-v1.

SoccerTrack Dataset

The SoccerTrack dataset comprises top-view and wide-view video footage annotated with bounding boxes. GNSS coordinates of each player are also provided. We hope that the SoccerTrack dataset will help advance the state of the art in multi-object tracking, especially in team sports. ## Dataset Details <div> <a href='https://openaccess.thecvf.com/content/CVPR2022W/CVSports/papers/Scott_SoccerTrack_A_Dataset_and_Tracking_Algorithm_for_Soccer_With_Fish-Eye_CVPRW_2022_paper.pdf'> <img src='https://img.shields.io/badge/Paper-PDF-red?style=for-the-badge&logo=adobe-acrobat-reader'/> </a> <a href='https://github.com/AtomScott/SoccerTrack'> <img src='https://img.shields.io/badge/Code-Page-blue?style=for-the-badge&logo=github'/> </a> <a href='https://soccertrack.readthedocs.io/'> <img src='https://img.shields.io/badge/Documentation-Page-blue?style=for-the-badge&logo=read-the-docs'/> </a> </div> **** | Wide-View Camera | Top-View Camera | GNSS ---|---|---|--- Device | Z CAM E2-F8 | DJI Mavic 3 | STATSPORTS APEX 10 Hz Resolution | 8K (7,680 × 4,320 pixel) | 4K (3,840 × 2,160 pixesl) | Abs. err. in 20-m run: 0.22 ± 0.20 m FPS | 30 | 30 | 10 Player tracking | ✅ | ✅ | ✅ Ball tracking | ✅ | ✅ | - Bounding box | ✅ | ✅ | - Location data | ✅ | ✅ | ✅ Player ID | ✅ | ✅ | ✅ All data in SoccerTrack was obtained from 11-vs-11 soccer games between college-aged athletes. Measurements were conducted after we received the approval of Tsukuba university’s ethics committee, and all participants provided signed informed permission. After recording several soccer matches, the videos were semi-automatically annotated based on the GNSS coordinates of each player. ## Citation @inproceedings{scott2022soccertrack, title={SoccerTrack: A Dataset and Tracking Algorithm for Soccer With Fish-Eye and Drone Videos}, author={Scott, Atom and Uchida, Ikuma and Onishi, Masaki and Kameda, Yoshinari and Fukui, Kazuhiro and Fujii, Keisuke}, booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition}, pages={3569--3579}, year={2022} }

SOMPT22

SOMPT22 is a multi-object tracking (MOT) benchmark focused on surveillance-style pedestrian tracking. * 22 long video sequences (static pole-mounted cameras, 6 – 8 m height) * ~51 k annotated frames with bounding boxes + unique track IDs * Outdoor scenes with illumination changes, partial occlusions and appearance similarity * Single class: person * Split files ready for training/validation and standard MOT evaluation tools SOMPT22 aims to complement generic MOTChallenge-style datasets by stressing long-term ID maintenance under sparse-to-medium crowd density instead of dense, short clips. Homepage → https://sompt22.github.io Download → Google Drive link in the homepage Citation → ```bibtex @misc{simsek2022sompt22, author = {Simsek, Fatih Emre and Cigla, Cevahir and Kayabol, Koray}, title = {SOMPT22: A Surveillance Oriented Multi-Pedestrian Tracking Dataset}, year = {2022}, eprint = {2208.02580}, archivePrefix = {arXiv}, primaryClass = {cs.CV} }

SOTVerse

SOTVerse is a user-defined task space of single object tracking. It allows users to customize SOT tasks according to their research purposes, which on the one hand makes research more targeted, and on the other hand can significantly improve the efficiency of research.

SynoClip

SynoClip Dataset The SynoClip dataset is a comprehensive and standard dataset specifically designed for the video synopsis task. It consists of six videos, ranging from 8 to 45 minutes, captured from outdoor-mounted surveillance cameras. This dataset is annotated with tracking information, making it an ideal resource not only for video synopsis but also for related tasks such as object detection in videos and multi-object tracking. ### Key Features: - Outdoor Surveillance Footage: Captured from outdoor-mounted cameras, the dataset reflects real-world surveillance conditions. - Tracking Annotations: Each video comes with detailed tracking annotations, enabling a fair comparison of video synopsis models' performance. - Multi-Purpose Utility: While primarily intended for video synopsis, the dataset can also be used for training and evaluating object detection and tracking models in videos. ### Download the Dataset You can download the SynoClip dataset from the following Google Drive link: Download SynoClip Dataset

TAO-Amodal

Our dataset augments the TAO dataset with amodal bounding box annotations for fully invisible, out-of-frame, and occluded objects. Note that this implies TAO-Amodal also includes modal segmentation masks (as visualized in the color overlays above). Our dataset encompasses 880 categories, aimed at assessing the occlusion reasoning capabilities of current trackers through the paradigm of Tracking Any Object with Amodal perception (TAO-Amodal).

TimberVision

The TimberVision dataset consists of more than 2k annotated RGB images and contains a total of 51k trunk components including cut and lateral surfaces, thereby surpassing any existing dataset in this domain in terms of both quantity and detail by a large margin. The dataset can be used to train oriented object detection and instance segmentation and evaluate the influence of multiple scene parameters on model performance. Additionally, a generic framework is provided to fuse the components detected by the models for both tasks into unified trunk representations. Furthermore, geometric properties are derived automatically and multi-object tracking is applied to further enhance robustness.

TREK-100

The dataset is composed of 100 video sequences densely annotated with 60K bounding boxes, 17 sequence attributes, 13 action verb attributes and 29 target object attributes. Source: Is First Person Vision Challenging for Object Tracking? The TREK-100 Benchmark Dataset

VETRA

VETRA is a dataset for vehicle tracking in aerial image sequences and presents unique challenges such as low frame rates, small and fast-moving objects, as well as high camera movement. These characteristics allow for extended tracking of numerous vehicles with varying motion behaviors over large areas and pose new challenges for MOT algorithms. VETRA consists of 52 image sequences captured by airplanes and helicopters using DLR’s 3k and 4k camera systems. The acquisition sites are located in Germany and Austria. In addition to the classical training, validation and test sets, VETRA offers a second test set specifically designed for the application of large area monitoring (LAM). The LAM sequences are recorded over 7 rural roads and motorways with a fixed camera speed and configuration. Each road section is captured at 4 different times of the day, enabling the performance of MOT algorithms to be evaluated under different traffic loads in a static environment. Furthermore, the features extracted from the LAM sequences can be utilized in transport research applications.

VISEM-Tracking

VISEM-Tracking is a dataset consisting of 20 video recordings of 30s of spermatozoa with manually annotated bounding-box coordinates and a set of sperm characteristics analyzed by experts in the domain. It is an extension of the previously published VISEM dataset. In addition to the annotated data, unlabeled video clips are provided for easy-to-use access and analysis of the data. Source: VISEM-Tracking: Human Spermatozoa Tracking Dataset Image Source: https://arxiv.org/pdf/2212.02842v1.pdf

YouTube-Hands

YouTube-Hands includes 240 videos which are annotated with hand trajectories.

ALFI

ALFI (Annotations for Label-Free Images) is a dataset of images and annotations for label-free microscopy imaging. It consists of 29 time-lapse image sequences with various annotations (pixel-wise segmentation masks, object-wise bounding boxes, and tracking information), made publicly available to the scientific community through figshare. For a detailed description, see "L. Antonelli, F. Polverino, A. Albu, A. Hada, I.A. Asteriti, F. Degrassi, G. Guarguaglini, L. Maddalena, M.R. Guarracino, ALFI: Cell cycle phenotype annotations of label-free time-lapse imaging data from cultured human cells, Scientific Data 10(677), 2023". https://www.nature.com/articles/s41597-023-02540-1

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.