[October 22] All technical reports of top teams in four challenges are available now ! Thanks for their sharing.

[July 11] UVO Challenge is open today ! [Dataset Download] [Evaluation Server Image] [Evaluation Server Video]

[July 10] YouTubeVIS: Long Video Challenge is open today ! [Dataset Download] [Evaluation Server]

[July 5] OVIS Challenge is open today ! [Dataset Download] [Evaluation Server]

[July 4] DanceTrack Challenge is open today ! [Dataset Download] [Evaluation Server]

[July 3] Competition Phase 1 is postponed to July 11, 2022 (00:01am UTC Time). Apology for this delay.

Abstract

Multiple object tracking and segmentation aims to localize and associate objects of interest along time, and serves as fundamental technologies in many practical applications, such as visual surveillance, public security, video analysis, and human-computer interaction.

Computer vision systems nowadays have achieved great performance in simple tracking and segmentation scenes, such as MOT dataset and DAVIS dataset, but are not as robust as the human vision system, especially in complex environments.

To advance current vision systems performance in complex environments, our workshop explores four settings of multiple object tracking and segmentation: (a) long video (b) occluded object (c) diverse motion (d) open-world.

Four challenges consist of:

• 4th YouTubeVIS and Long Video Instance Segmentation Challenge
• 2nd Occluded Video Instance Segmentation Challenge
• 1st Multiple People Tracking in Group Dance Challenge
• 2nd Open-World Video Object Detection and Segmentation Challenge

YouTubeVIS: Long Video

• 141 additional long videos, 71 in validation, 70 in test
• 259 additional unique video instances with average duration of 49.8s
• 9304 additional high-quality instance masks

The additional long videos (L) are separately evaluated from previous short videos. We use average precision (AP_L) at different intersection-over-union (IoU) thresholds and average recall (AR_L) as our evaluation metrics. The IoU in video instance segmentation is the sum of intersection area over the sum of union area across the video. For more details about the dataset, please refer to our paper or website.

OVIS

• 901 videos with severe object occlusions
• 25 commonly seen semantic categories
• 5,223 unique instances with average duration of 10.05s
• 296k high-quality instance masks

We use average precision (AP) at different intersection-over-union (IoU) thresholds and average recall (AR) as our evaluation metrics. The IoU in video instance segmentation is the sum of intersection area over the sum of union area across the video. For more details about the dataset, please refer to our paper or website.

DanceTrack

• 100 videos of group dance, 40 training videos, 25 validation videos and 35 test videos
• 990 unique instances with average duration of 52.9s
• 877k high-quality bounding boxes

We use Higher Order Tracking Accuracy (HOTA) as the main metric, AssA and IDF1 to measure association performance, DetA and MOTA for detection quality. For more details about the dataset, please refer to our paper or website.

UVO

• high quality instance masks annotated at 30 fps on 1024 YouTube videos and 1fps on 10337 videos from Kinetics dataset
• annotating ALL objects in each video, 13.5 objects per video on average
• 57% of objects are not covered by COCO categories

We use average precision (AP) at different intersection-over-union (IoU) thresholds and average recall (AR) as our evaluation metrics. The IoU in video instance segmentation is the sum of intersection area over the sum of union area across the video. For more details about the dataset, please refer to our paper or website.