https://github.com/ccychongyanchen/vqatherapycrowdsourcing
공식 코드VQA Therapy: Exploring Answer Differences by Visually Grounding Answers
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.
( Image credit: SQuAD )
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
VQA Therapy: Exploring Answer Differences by Visually Grounding Answers
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering
Question Decomposition Tree for Answering Complex Questions over Knowledge Bases
A Simple LLM Framework for Long-Range Video Question-Answering
A Neural-Symbolic Approach to Natural Language Understanding
VIGNETTE: Socially Grounded Bias Evaluation for Vision-Language Models
PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Finance
EpiK-Eval: Evaluation for Language Models as Epistemic Models
Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators
Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reporting
PMC-LLaMA: Towards Building Open-source Language Models for Medicine
Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Data
Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers
SmartPilot: A Multiagent CoPilot for Adaptive and Intelligent Manufacturing
SEER: Facilitating Structured Reasoning and Explanation via Reinforcement Learning
GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoning
XplainLLM: A Knowledge-Augmented Dataset for Reliable Grounded Explanations in LLMs
Time Series Contrastive Learning with Information-Aware Augmentations
Property Enhanced Instruction Tuning for Multi-task Molecule Generation with Large Language Models
Weak-eval-Strong: Evaluating and Eliciting Lateral Thinking of LLMs with Situation Puzzles
Improving Retrieval-Augmented Generation through Multi-Agent Reinforcement Learning
DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
Towards Medical Artificial General Intelligence via Knowledge-Enhanced Multimodal Pretraining
RuleRAG: Rule-guided retrieval-augmented generation with language models for question answering
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.