arXiv:2109.00442
Position Masking for Improved Layout-Aware Document Understanding
원문 초록
Natural language processing for document scans and PDFs has the potential to enormously improve the efficiency of business processes. Layout-aware word embeddings such as LayoutLM have shown promise for classification of and information extraction from such documents. This paper proposes a new pre-training task called that can improve performance of layout-aware word embeddings that incorporate 2-D position embeddings. We compare models pre-trained with only language masking against models pre-trained with both language masking and position masking, and we find that position masking improves performance by over 5% on a form understanding task.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Simple yet Effective Layout Token in Large Language Models for Document Understanding
Car Object Counting and Position Estimation via Extension of the CLIP-EBC Framework
PaddleOCR 3.0 Technical Report
GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning
Class-Agnostic Region-of-Interest Matching in Document Images
DrishtiKon: Multi-Granular Visual Grounding for Text-Rich Document Images
토론
이 논문과 연결된 포럼 글이 아직 없습니다.