https://github.com/nikbpetrov/llms-simulate-humans
공식 코드Limited Ability of LLMs to Simulate Human Psychological Behaviours: a Psychometric Analysis
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.
( Image credit: SQuAD )
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Limited Ability of LLMs to Simulate Human Psychological Behaviours: a Psychometric Analysis
H-STAR: LLM-driven Hybrid SQL-Text Adaptive Reasoning on Tables
EfficientRAG: Efficient Retriever for Multi-Hop Question Answering
SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning
Specialty-Oriented Generalist Medical AI for Chest CT Screening
Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrieval
FormulaReasoning: A Dataset for Formula-Based Numerical Reasoning
FormulaReasoning: A Dataset for Formula-Based Numerical Reasoning
Clues Before Answers: Generation-Enhanced Multiple-Choice QA
When Retriever-Reader Meets Scenario-Based Multiple-Choice Questions
$μ\text{KG}$: A Library for Multi-source Knowledge Graph Embeddings and Applications
Evaluating LLM Reasoning in the Operations Research Domain with ORQA
LEGAL-UQA: A Low-Resource Urdu-English Dataset for Legal Question Answering
CleanGraph: Human-in-the-loop Knowledge Graph Refinement and Completion
Traveling Across Languages: Benchmarking Cross-Lingual Consistency in Multimodal LLMs
TUBench: Benchmarking Large Vision-Language Models on Trustworthiness with Unanswerable Questions
Evidence Sentence Extraction for Machine Reading Comprehension
Improving Machine Reading Comprehension with General Reading Strategies
CommVQA: Situating Visual Question Answering in Communicative Contexts
Context-VQA: Towards Context-Aware and Purposeful Visual Question Answering
A Dataset and Baselines for Visual Question Answering on Art
Knowledge-Based Video Question Answering with Unsupervised Scene Descriptions
Implicit Regularization in Deep Learning May Not Be Explainable by Norms
Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning
Benchmarking Multimodal RAG through a Chart-based Document Question-Answering Generation Framework
Improving the Cross-Lingual Generalisation in Visual Question Answering
BERT-kNN: Adding a kNN Search Component to Pretrained Language Models for Better QA
Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Fly
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.