Hypothesis Testing Prompting Improves Deductive Reasoning in Large Language Models
원문 초록
Combining different forms of prompts with pre-trained large language models has yielded remarkable results on reasoning tasks (e.g. Chain-of-Thought prompting). However, along with testing on more complex reasoning, these methods also expose problems such as invalid reasoning and fictional reasoning paths. In this paper, we develop \textit{Hypothesis Testing Prompting}, which adds conclusion assumptions, backward reasoning, and fact verification during intermediate reasoning steps. \textit{Hypothesis Testing prompting} involves multiple assumptions and reverses validation of conclusions leading to its unique correct answer. Experiments on two challenging deductive reasoning datasets ProofWriter and RuleTaker show that hypothesis testing prompting not only significantly improves the effect, but also generates a more reasonable and standardized reasoning process.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
DS@GT at CheckThat! 2025: Evaluating Context and Tokenization Strategies for Numerical Fact Verification
Verifying the Verifiers: Unveiling Pitfalls and Potentials in Fact Verifiers
ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Charts
Reasoning-Table: Exploring Reinforcement Learning for Table Reasoning
Table-R1: Inference-Time Scaling for Table Reasoning
SemViQA: A Semantic Question Answering System for Vietnamese Information Fact-Checking
토론
이 논문과 연결된 포럼 글이 아직 없습니다.