Sequential Visual and Semantic Consistency for Semi-supervised Text Recognition
원문 초록
Scene text recognition (STR) is a challenging task that requires large-scale annotated data for training. However, collecting and labeling real text images is expensive and time-consuming, which limits the availability of real data. Therefore, most existing STR methods resort to synthetic data, which may introduce domain discrepancy and degrade the performance of STR models. To alleviate this problem, recent semi-supervised STR methods exploit unlabeled real data by enforcing character-level consistency regularization between weakly and strongly augmented views of the same image. However, these methods neglect word-level consistency, which is crucial for sequence recognition tasks. This paper proposes a novel semi-supervised learning method for STR that incorporates word-level consistency regularization from both visual and semantic aspects. Specifically, we devise a shortest path alignment module to align the sequential visual features of different views and minimize their distance. Moreover, we adopt a reinforcement learning framework to optimize the semantic similarity of the predicted strings in the embedding space. We conduct extensive experiments on several standard and challenging STR benchmarks and demonstrate the superiority of our proposed method over existing semi-supervised STR methods.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Temporally-Grounded Language Generation: Towards Real-Time Vision-Language Models
FA: Forced Prompt Learning of Vision-Language Models for Out-of-Distribution Detection
ImpliRet: Benchmarking the Implicit Fact Retrieval Challenge
Inv-Entropy: A Fully Probabilistic Framework for Uncertainty Quantification in Language Models
Trend-Aware Fashion Recommendation with Visual Segmentation and Semantic Similarity
KNN-Defense: Defense against 3D Adversarial Point Clouds using Nearest-Neighbor Search
토론
이 논문과 연결된 포럼 글이 아직 없습니다.