ReLayout: Towards Real-World Document Understanding via Layout-enhanced Pre-training
원문 초록
Recent approaches for visually-rich document understanding (VrDU) uses manually annotated semantic groups, where a semantic group encompasses all semantically relevant but not obviously grouped words. As OCR tools are unable to automatically identify such grouping, we argue that current VrDU approaches are unrealistic. We thus introduce a new variant of the VrDU task, real-world visually-rich document understanding (ReVrDU), that does not allow for using manually annotated semantic groups. We also propose a new method, ReLayout, compliant with the ReVrDU scenario, which learns to capture semantic grouping through arranging words and bringing the representations of words that belong to the potential same semantic group closer together. Our experimental results demonstrate the performance of existing methods is deteriorated with the ReVrDU task, while ReLayout shows superiour performance.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
PaddleOCR 3.0 Technical Report
DrishtiKon: Multi-Granular Visual Grounding for Text-Rich Document Images
ARB: A Comprehensive Arabic Multimodal Reasoning Benchmark
Evaluating Menu OCR and Translation: A Benchmark for Aligning Human and Automated Evaluations in Large Vision-Language Models
Relation-Rich Visual Document Generator for Visual Information Extraction
BiblioPage: A Dataset of Scanned Title Pages for Bibliographic Metadata Extraction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.