Table Caption Generation in Scholarly Documents Leveraging Pre-trained Language Models
원문 초록
This paper addresses the problem of generating table captions for scholarly documents, which often require additional information outside the table. To this end, we propose a method of retrieving relevant sentences from the paper body, and feeding the table content as well as the retrieved sentences into pre-trained language models (e.g. T5 and GPT-2) for generating table captions. The contributions of this paper are: (1) discussion on the challenges in table captioning for scholarly documents; (2) development of a dataset DocBank-TB, which is publicly available; and (3) comparison of caption generation methods for scholarly documents with different strategies to retrieve relevant sentences from the paper body. Our experimental results showed that T5 is the better generation model for this task, as it outperformed GPT-2 in BLEU and METEOR implying that the generated text are clearer and more precise. Moreover, inputting relevant sentences matching the row header or whole table is effective.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World
SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning
FusionAudio-1.2M: Towards Fine-grained Audio Captioning with Multimodal Contextual Fusion
VCapsBench: A Large-scale Fine-grained Benchmark for Video Caption Quality Evaluation
LoVR: A Benchmark for Long Video Retrieval in Multimodal Contexts
VideoMultiAgents: A Multi-Agent Framework for Video Question Answering
토론
이 논문과 연결된 포럼 글이 아직 없습니다.