https://github.com/google-research-datasets/MultiReQA
공식 코드MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.
( Image credit: SQuAD )
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models
QED: A Framework and Dataset for Explanations in Question Answering
Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation
AQuaMuSe: Automatically Generating Datasets for Query-Based Multi-Document Summarization
Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts
Disfl-QA: A Benchmark Dataset for Understanding Disfluencies in Question Answering
Omnia de EgoTempo: Benchmarking Temporal Understanding of Multi-Modal LLMs in Egocentric Videos
ScreenAI: A Vision-Language Model for UI and Infographics Understanding
ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
ByT5: Towards a token-free future with pre-trained byte-to-byte models
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
Measuring Compositional Generalization: A Comprehensive Method on Realistic Data
Thieves on Sesame Street! Model Extraction of BERT-based APIs
Mention Memory: incorporating textual knowledge into Transformers through entity mention attention
Sparse, Dense, and Attentional Representations for Text Retrieval
Latent Retrieval for Weakly Supervised Open Domain Question Answering
LongT5: Efficient Text-To-Text Transformer for Long Sequences
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.