https://github.com/METR/ai-rd-tasks
공식 코드RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
Reasoning-Table: Exploring Reinforcement Learning for Table Reasoning
Valid Text-to-SQL Generation with Unification-based DeepStochLog
Avoiding $\mathbf{exp(R_{max})}$ scaling in RLHF through Preference-based Exploration
EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Models
Expanding the Vocabulary of BERT for Knowledge Base Construction
Robustness Analysis of Video-Language Models Against Visual and Language Perturbations
Can Generative LLMs Create Query Variants for Test Collections? An Exploratory Study
From Tokens to Materials: Leveraging Language Models for Scientific Discovery
Text2App: A Framework for Creating Android Apps from Text Descriptions
Harnessing Event Sensory Data for Error Pattern Prediction in Vehicles: A Language Model Approach
A Touch, Vision, and Language Dataset for Multimodal Alignment
Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering
DetectBench: Can Large Language Model Detect and Piece Together Implicit Evidence?
Enhancing Vision-Language Model Pre-training with Image-text Pair Pruning Based on Word Frequency
MF-LLM: Simulating Population Decision Dynamics via a Mean-Field Large Language Model Framework
Learning Spoken Language Representations with Neural Lattice Language Modeling
Learning Spoken Language Representations with Neural Lattice Language Modeling
Towards Understanding of Medical Randomized Controlled Trials by Conclusion Generation
Prevent the Language Model from being Overconfident in Neural Machine Translation
Optimizing Deep Neural Networks using Safety-Guided Self Compression
Direction is what you need: Improving Word Embedding Compression in Large Language Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.