https://github.com/opengvlab/multi-modality-arena
공식 코드LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.
( Image credit: SQuAD )
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models
Foundation Model is Efficient Multimodal Multitask Model Selector
CLIFT: Analysing Natural Distribution Shift on Question Answering Models in Clinical Domain
ActiveRAG: Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents
MMScan: A Multi-Modal 3D Scene Dataset with Hierarchical Grounded Language Annotations
KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generation
Science Checker: Extractive-Boolean Question Answering For Scientific Fact Checking
Defending Against Disinformation Attacks in Open-Domain Question Answering
Answering Questions by Meta-Reasoning over Multiple Chains of Thought
Making Retrieval-Augmented Language Models Robust to Irrelevant Context
Automatic Evaluation of Attribution by Large Language Models
HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models
Multimodal Question Answering for Unified Information Extraction
Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractors
ClinKD: Cross-Modal Clinical Knowledge Distiller For Multi-Task Medical Images
Enhancing Visual Question Answering through Question-Driven Image Captions as Prompts
PersonaRAG: Enhancing Retrieval-Augmented Generation Systems with User-Centric Agents
SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Models
CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worlds
VideoMultiAgents: A Multi-Agent Framework for Video Question Answering
emrQA: A Large Corpus for Question Answering on Electronic Medical Records
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.