https://github.com/anthonywchen/MOCHA
공식 코드MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.
( Image credit: SQuAD )
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics
RARR: Researching and Revising What Language Models Say, Using Language Models
Question Decomposition Improves the Faithfulness of Model-Generated Reasoning
Zero-Shot Video Question Answering via Frozen Bidirectional Language Models
Just Ask: Learning to Answer Questions from Millions of Narrated Videos
CBench: Towards Better Evaluation of Question Answering Over Knowledge Graphs
CSS: Contrastive Semantic Similarity for Uncertainty Quantification of LLMs
Crake: Causal-Enhanced Table-Filler for Question Answering over Large Scale Knowledge Base
Sequence-to-Sequence Knowledge Graph Completion and Question Answering
RangeAugment: Efficient Online Augmentation with Range Learning
Increasing Coverage and Precision of Textual Information in Multilingual Knowledge Graphs
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering
Open-Domain Question Answering Goes Conversational via Question Rewriting
SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models
Superposition Prompting: Improving and Accelerating Retrieval-Augmented Generation
Action Recognition based on Cross-Situational Action-object Statistics
Rephrase, Augment, Reason: Visual Grounding of Questions for Vision-Language Models
TurkishMMLU: Measuring Massive Multitask Language Understanding in Turkish
DragonVerseQA: Open-Domain Long-Form Context-Aware Question-Answering
Are NLP Models really able to Solve Simple Math Word Problems?
Can Language Models Solve Graph Problems in Natural Language?
Active Learning to Guide Labeling Efforts for Question Difficulty Estimation
Code-Style In-Context Learning for Knowledge-Based Question Answering
DRESSing Up LLM: Efficient Stylized Question-Answering via Style Subspace Editing
ArxivBench: Can LLMs Assist Researchers in Conducting Research?
DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinations
Understanding Figurative Meaning through Explainable Visual Entailment
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.