Towards Open-Set Text Recognition via Label-to-Prototype Learning
원문 초록
Scene text recognition is a popular topic and extensively used in the industry. Although many methods have achieved satisfactory performance for the close-set text recognition challenges, these methods lose feasibility in open-set scenarios, where collecting data or retraining models for novel characters could yield a high cost. For example, annotating samples for foreign languages can be expensive, whereas retraining the model each time when a novel character is discovered from historical documents costs both time and resources. In this paper, we introduce and formulate a new open-set text recognition task which demands the capability to spot and recognize novel characters without retraining. A label-to-prototype learning framework is also proposed as a baseline for the proposed task. Specifically, the framework introduces a generalizable label-to-prototype mapping function to build prototypes (class centers) for both seen and unseen classes. An open-set predictor is then utilized to recognize or reject samples according to the prototypes. The implementation of rejection capability over out-of-set characters allows automatic spotting of unknown characters in the incoming data stream. Extensive experiments show that our method achieves promising performance on a variety of zero-shot, close-set, and open-set text recognition datasets
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Linguistics-aware Masked Image Modeling for Self-supervised Scene Text Recognition
EventSTR: A Benchmark Dataset and Baselines for Event Stream based Scene Text Recognition
Ocean-OCR: Towards General OCR Application via a Vision-Language Model
TextSSR: Diffusion-based Data Synthesis for Scene Text Recognition
SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognition
Boosting Semi-Supervised Scene Text Recognition via Viewing and Summarizing
토론
이 논문과 연결된 포럼 글이 아직 없습니다.