Dynamic MOdularized Reasoning for Compositional Structured Explanation Generation
원문 초록
Despite the success of neural models in solving reasoning tasks, their compositional generalization capabilities remain unclear. In this work, we propose a new setting of the structured explanation generation task to facilitate compositional reasoning research. Previous works found that symbolic methods achieve superior compositionality by using pre-defined inference rules for iterative reasoning. But these approaches rely on brittle symbolic transfers and are restricted to well-defined tasks. Hence, we propose a dynamic modularized reasoning model, MORSE, to improve the compositional generalization of neural models. MORSE factorizes the inference process into a combination of modules, where each module represents a functional unit. Specifically, we adopt modularized self-attention to dynamically select and route inputs to dedicated heads, which specializes them to specific functions. We conduct experiments for increasing lengths and shapes of reasoning trees on two benchmarks to test MORSE's compositional generalization abilities, and find it outperforms competitive baselines. Model ablation and deeper analyses show the effectiveness of dynamic reasoning modules and their generalization abilities.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking
LiTEx: A Linguistic Taxonomy of Explanations for Understanding Within-Label Variation in Natural Language Inference
Does Rationale Quality Matter? Enhancing Mental Disorder Detection via Selective Reasoning Distillation
SNAPE-PM: Building and Utilizing Dynamic Partner Models for Adaptive Explanation Generation
Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector
Target-Augmented Shared Fusion-based Multimodal Sarcasm Explanation Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.