Mining the Explainability and Generalization: Fact Verification Based on Self-Instruction
원문 초록
Fact-checking based on commercial LLMs has become mainstream. Although these methods offer high explainability, it falls short in accuracy compared to traditional fine-tuning approaches, and data security is also a significant concern. In this paper, we propose a self-instruction based fine-tuning approach for fact-checking that balances accuracy and explainability. Our method consists of Data Augmentation and Improved DPO fine-tuning. The former starts by instructing the model to generate both positive and negative explanations based on claim-evidence pairs and labels, then sampling the dataset according to our customized difficulty standards. The latter employs our proposed improved DPO to fine-tune the model using the generated samples. We fine-tune the smallest-scale LLaMA-7B model and evaluate it on the challenging fact-checking datasets FEVEROUS and HOVER, utilizing four fine-tuning methods and three few-shot learning methods for comparison. The experiments demonstrate that our approach not only retains accuracy comparable to, or even surpassing, traditional fine-tuning methods, but also generates fluent explanation text. Moreover, it also exhibit high generalization performance. Our method is the first to leverage self-supervised learning for fact-checking and innovatively combines contrastive learning and improved DPO in fine-tuning LLMs, as shown in the experiments.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
DS@GT at CheckThat! 2025: Evaluating Context and Tokenization Strategies for Numerical Fact Verification
Verifying the Verifiers: Unveiling Pitfalls and Potentials in Fact Verifiers
ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Charts
Enhancing Contrastive Learning-based Electrocardiogram Pretrained Model with Patient Memory Queue
Overview of the TalentCLEF 2025: Skill and Job Title Intelligence for Human Capital Management
Similarity-Guided Diffusion for Contrastive Sequential Recommendation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.