Leveraging Action Affinity and Continuity for Semi-supervised Temporal Action Segmentation
원문 초록
We present a semi-supervised learning approach to the temporal action segmentation task. The goal of the task is to temporally detect and segment actions in long, untrimmed procedural videos, where only a small set of videos are densely labelled, and a large collection of videos are unlabelled. To this end, we propose two novel loss functions for the unlabelled data: an action affinity loss and an action continuity loss. The action affinity loss guides the unlabelled samples learning by imposing the action priors induced from the labelled set. Action continuity loss enforces the temporal continuity of actions, which also provides frame-wise classification supervision. In addition, we propose an Adaptive Boundary Smoothing (ABS) approach to build coarser action boundaries for more robust and reliable learning. The proposed loss functions and ABS were evaluated on three benchmarks. Results show that they significantly improved action segmentation performance with a low amount (5% and 10%) of labelled data and achieved comparable results to full supervision with 50% labelled data. Furthermore, ABS succeeded in boosting performance when integrated into fully-supervised learning.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Cost-Sensitive Learning for Long-Tailed Temporal Action Segmentation
Hierarchical Vector Quantization for Unsupervised Action Segmentation
OnlineTAS: An Online Baseline for Temporal Action Segmentation
ProMQA: Question Answering Dataset for Multimodal Procedural Activity Understanding
Language-Assisted Human Part Motion Learning for Skeleton-Based Temporal Action Segmentation
3D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation Approach
토론
이 논문과 연결된 포럼 글이 아직 없습니다.