https://github.com/PolyU-ChenLab/ETBench
공식 코드E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.
( Image credit: SQuAD )
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding
V-RoAst: Visual Road Assessment. Can VLM be a Road Safety Assessor Using the iRAP Standard?
Semantically-Aligned Universal Tree-Structured Solver for Math Word Problems
TextBox 2.0: A Text Generation Library with Pre-trained Language Models
METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanation
Online Class-Incremental Continual Learning with Adversarial Shapley Value
Towards Better Question Generation in QA-based Event Extraction
RIRAG: Regulatory Information Retrieval and Answer Generation
Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signals
RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark
Falcon 2.0: An Entity and Relation Linking Tool over Wikidata
GUIDEQ: Framework for Guided Questioning for progressive informational collection and classification
QA4IE: A Question Answering based Framework for Information Extraction
BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense Evaluation
Unlocking Anticipatory Text Generation: A Constrained Approach for Large Language Models Decoding
Improving Retrieval-Based Question Answering with Deep Inference Models
RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content
Multimodal Explanations: Justifying Decisions and Pointing to the Evidence
A Dataset for Statutory Reasoning in Tax Law Entailment and Question Answering
Attention on Attention: Architectures for Visual Question Answering (VQA)
JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension
AnyAnomaly: Zero-Shot Customizable Video Anomaly Detection with LVLM
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.