Scene Text Recognition with Semantics
원문 초록
Scene Text Recognition (STR) models have achieved high performance in recent years on benchmark datasets where text images are presented with minimal noise. Traditional STR recognition pipelines take a cropped image as sole input and attempt to identify the characters present. This infrastructure can fail in instances where the input image is noisy or the text is partially obscured. This paper proposes using semantic information from the greater scene to contextualise predictions. We generate semantic vectors using object tags and fuse this information into a transformer-based architecture. The results demonstrate that our multimodal approach yields higher performance than traditional benchmark models, particularly on noisy instances.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Linguistics-aware Masked Image Modeling for Self-supervised Scene Text Recognition
EventSTR: A Benchmark Dataset and Baselines for Event Stream based Scene Text Recognition
Ocean-OCR: Towards General OCR Application via a Vision-Language Model
TextSSR: Diffusion-based Data Synthesis for Scene Text Recognition
SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognition
Boosting Semi-Supervised Scene Text Recognition via Viewing and Summarizing
토론
이 논문과 연결된 포럼 글이 아직 없습니다.