Self-Sufficient Framework for Continuous Sign Language Recognition
원문 초록
The goal of this work is to develop self-sufficient framework for Continuous Sign Language Recognition (CSLR) that addresses key issues of sign language recognition. These include the need for complex multi-scale features such as hands, face, and mouth for understanding, and absence of frame-level annotations. To this end, we propose (1) Divide and Focus Convolution (DFConv) which extracts both manual and non-manual features without the need for additional networks or annotations, and (2) Dense Pseudo-Label Refinement (DPLR) which propagates non-spiky frame-level pseudo-labels by combining the ground truth gloss sequence labels with the predicted sequence. We demonstrate that our model achieves state-of-the-art performance among RGB-based methods on large-scale CSLR benchmarks, PHOENIX-2014 and PHOENIX-2014-T, while showing comparable results with better efficiency when compared to other approaches that use multi-modality or extra annotations.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Bukva: Russian Sign Language Alphabet
HandReader: Advanced Techniques for Efficient Fingerspelling Recognition
Hierarchical Sub-action Tree for Continuous Sign Language Recognition
SignBart -- New approach with the skeleton sequence for Isolated Sign language Recognition
QUEST: Quality-aware Semi-supervised Table Extraction for Business Documents
SRPL-SFDA: SAM-Guided Reliable Pseudo-Labels for Source-Free Domain Adaptation in Medical Image Segmentation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.