Multimodal Misinformation Detection by Learning from Synthetic Data with Multimodal LLMs
원문 초록
Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic datasets generated by AI technologies. However, the generalizability of detectors trained on synthetic data to real-world scenarios remains unclear due to the distribution gap. To address this, we propose learning from synthetic data for detecting real-world multimodal misinformation through two model-agnostic data selection methods that match synthetic and real-world data distributions. Experiments show that our method enhances the performance of a small MLLM (13B) on real-world fact-checking datasets, enabling it to even surpass GPT-4V~\cite{GPT-4V}.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking
SUCEA: Reasoning-Intensive Retrieval for Adversarial Fact-checking through Claim Decomposition and Editing
Entity-aware Cross-lingual Claim Detection for Automated Fact-checking
When Claims Evolve: Evaluating and Enhancing the Robustness of Embedding Models Against Misinformation Edits
SemViQA: A Semantic Question Answering System for Vietnamese Information Fact-Checking
Beyond Translation: LLM-Based Data Generation for Multilingual Fact-Checking
토론
이 논문과 연결된 포럼 글이 아직 없습니다.