https://github.com/elliottyan/refutebench
공식 코드RefuteBench: Evaluating Refuting Instruction-Following for Large Language Models
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
RefuteBench: Evaluating Refuting Instruction-Following for Large Language Models
OmniGenBench: A Benchmark for Omnipotent Multimodal Generation across 50+ Tasks
TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Data
Internal Causal Mechanisms Robustly Predict Language Model Out-of-Distribution Behaviors
Multi-IF: Benchmarking LLMs on Multi-Turn and Multilingual Instructions Following
Meta SecAlign: A Secure Foundation LLM Against Prompt Injection Attacks
Understanding the Effects of RLHF on LLM Generalisation and Diversity
Sloth: scaling laws for LLM skills to predict multi-benchmark performance across families
TextGames: Learning to Self-Play Text-Based Puzzle Games via Language Model Reasoning
Diversify and Conquer: Diversity-Centric Data Selection with Iterative Refinement
Dancing in Chains: Reconciling Instruction Following and Faithfulness in Language Models
Language-Conditioned Reinforcement Learning to Solve Misunderstandings with Action Corrections
Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models
NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models
NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Models
RS-GPT4V: A Unified Multimodal Instruction-Following Dataset for Remote Sensing Image Understanding
Factorizing Perception and Policy for Interactive Instruction Following
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning
From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces
Language as an Abstraction for Hierarchical Deep Reinforcement Learning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.