HAUR: Human Annotation Understanding and Recognition Through Text-Heavy Images
원문 초록
Vision Question Answering (VQA) tasks use images to convey critical information to answer text-based questions, which is one of the most common forms of question answering in real-world scenarios. Numerous vision-text models exist today and have performed well on certain VQA tasks. However, these models exhibit significant limitations in understanding human annotations on text-heavy images. To address this, we propose the Human Annotation Understanding and Recognition (HAUR) task. As part of this effort, we introduce the Human Annotation Understanding and Recognition-5 (HAUR-5) dataset, which encompasses five common types of human annotations. Additionally, we developed and trained our model, OCR-Mix. Through comprehensive cross-model comparisons, our results demonstrate that OCR-Mix outperforms other models in this task. Our dataset and model will be released soon .
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
DrishtiKon: Multi-Granular Visual Grounding for Text-Rich Document Images
Synthetic Document Question Answering in Hungarian
Describe Anything Model for Visual Question Answering on Text-rich Images
Decoupled Seg Tokens Make Stronger Reasoning Video Segmenter and Grounder
HRIBench: Benchmarking Vision-Language Models for Real-Time Human Perception in Human-Robot Interaction
Adapting Lightweight Vision Language Models for Radiological Visual Question Answering
토론
이 논문과 연결된 포럼 글이 아직 없습니다.