MMLU
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 3
- 보존된 평가 기록
- 1
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/23japhone/halo
공식 코드HALO: Hierarchical Autonomous Logic-Oriented Orchestration for Multi-Agent LLM Systems
https://github.com/8188zq/Inference-Time-Decontamination
공식 코드Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation
https://github.com/AVBochkov/Embeddings
공식 코드https://github.com/EleutherAI/lm-evaluation-harness
공식 코드SCORE: Systematic COnsistency and Robustness Evaluation for Large Language Models
https://github.com/InstituteforDiseaseModeling/Bridging-the-Gap-Low-Resource-African-Languages
공식 코드https://github.com/LAB-FLAIR/Constrained-Unlearning-for-LLM
공식 코드https://github.com/LabARSS/question-complextiy-estimation
공식 코드When an LLM is apprehensive about its answers -- and when its uncertainty is justified
https://github.com/Lumen-Laboratory/OpenGrok
공식 코드OpenGrok: Enhancing SNS Data Processing with Distilled Knowledge and Mask-like Mechanisms
https://github.com/NVIDIA/Megatron-LM
공식 코드https://github.com/NVIDIA/NeMo
공식 코드https://github.com/Rain9876/ShareLoRA
공식 코드https://github.com/SeffiCohen/CBOD
공식 코드Forget What You Know about LLMs Evaluations - LLMs are Like a Chameleon
https://github.com/WangRongsheng/Aurora
공식 코드https://github.com/adkipnis/metabench
공식 코드$\texttt{metabench}$ -- A Sparse Benchmark to Measure General Ability in Large Language Models
https://github.com/ahmedselhady/wicked-benchmarks
공식 코드WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging
https://github.com/alexandrasouly/strongreject
공식 코드https://github.com/apple/axlearn
공식 코드Revisiting MoE and Dense Speed-Accuracy Comparisons for LLM Training
https://github.com/aryopg/mmlu-redux
공식 코드https://github.com/asgsaeid/eqt
공식 코드Explain-Query-Test: Self-Evaluating LLMs Via Explanation and Comprehension Discrepancy
https://github.com/asgsaeid/mmlu-pro-plus
공식 코드MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs
https://github.com/baichuan-inc/baichuan2
공식 코드https://github.com/camtice/sandbagdetect
공식 코드Noise Injection Reveals Hidden Capabilities of Sandbagging Language Models
https://github.com/case-lab-umd/llm-drop
공식 코드https://github.com/ceezh/silvr
공식 코드https://github.com/ceferisbarov/TUMLU
공식 코드TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages
https://github.com/chengez/DyePack
공식 코드DyePack: Provably Flagging Test Set Contamination in LLMs Using Backdoors
https://github.com/chengsong-huang/lara
공식 코드Divide, Reweight, and Conquer: A Logit Arithmetic Approach for In-Context Learning
https://github.com/chenjux/afce
공식 코드https://github.com/chuangtaochen-tum/livemind
공식 코드LiveMind: Low-latency Large Language Models with Simultaneous Inference
https://github.com/cisnlp/mexa
공식 코드MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment
https://github.com/convergence-ai/lm2
공식 코드https://github.com/data-dream-gdsp/Multiplex-CoT
공식 코드https://github.com/debrup-61/mathsensei
공식 코드MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical Reasoning
https://github.com/declare-lab/red-instruct
공식 코드Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
https://github.com/disi-unibo-nlp/medgenie
공식 코드출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.