← Arithmetic Reasoning
평가 기록
과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.
표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.
| 모델 | 원본 지표·값 | 논문 | 구현 |
|---|---|---|---|
| Claude 3.5 Sonnet (HPT) |
|
Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive Principles 2024-06-18 |
코드 1 |
| DUP prompt upon GPT-4 |
|
Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Better Solvers for Math Word Problems 2024-04-23 |
코드 1 |
| Qwen2-Math-72B-Instruct (greedy) |
|
Qwen2 Technical Report 2024-07-15 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 |
| SFT-Mistral-7B (Metamath, OVM, Smart Ensemble) |
|
연결 없음 논문 날짜 미기재 |
연결 없음 |
| OpenMath2-Llama3.1-70B (majority@256) |
|
OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data 2024-10-02 |
코드 1 |
| Jiutian-大模型 |
|
연결 없음 논문 날짜 미기재 |
연결 없음 |
| DAMOMath-7B(MetaMath, OVM, BS, Ensemble) |
|
연결 없음 논문 날짜 미기재 |
연결 없음 |
| Claude 3 Opus (0-shot chain-of-thought) |
|
The Claude 3 Model Family: Opus, Sonnet, Haiku 2024-03-04 |
연결 없음 |
| OpenMath2-Llama3.1-70B |
|
OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data 2024-10-02 |
코드 1 |
| GPT-4 (Teaching-Inspired) |
|
Teaching-Inspired Integrated Prompting Framework: A Novel Approach for Enhancing Reasoning in Large Language Models 2024-10-10 |
코드 1 |
| SFT-Mistral-7B (Metamath + ovm +ensemble) |
|
연결 없음 논문 날짜 미기재 |
연결 없음 |
| OpenMath2-Llama3.1-8B (majority@256) |
|
OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data 2024-10-02 |
코드 1 |
| Qwen2-72B-Instruct-Step-DPO (0-shot CoT) |
|
Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs 2024-06-26 |
코드 1 |
| DAMOMath-7B(MetaMath, OVM, Ensemble) |
|
연결 없음 논문 날짜 미기재 |
연결 없음 |
| Claude 3 Sonnet (0-shot chain-of-thought) |
|
The Claude 3 Model Family: Opus, Sonnet, Haiku 2024-03-04 |
연결 없음 |
| AlphaLLM (with MCTS) |
|
Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing 2024-04-18 |
코드 1 |
| OpenMath2-Llama3.1-8B |
|
OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data 2024-10-02 |
코드 1 |
| PaLM 2 (few-shot, k=8, SC) |
|
PaLM 2 Technical Report 2023-05-17 |
코드 1 |
| GaC(Qwen2-72B-Instruct + Llama-3-70B-Instruct) |
|
Breaking the Ceiling of the LLM Community by Treating Token Generation as a Classification for Ensembling 2024-06-18 |
코드 1 |
| OpenMath-CodeLlama-70B (w/ code, SC, k=50) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| DART-Math-Llama3-70B-Uniform (0-shot CoT, w/o code) |
|
DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 2024-06-18 |
코드 1 |
| OpenMath-Llama2-70B (w/ code, SC, k=50) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| DART-Math-Llama3-70B-Prop2Diff (0-shot CoT, w/o code) |
|
DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 2024-06-18 |
코드 1 |
| Shepherd+Mistral-7B (SFT on MetaMATH + PRM RL+ PRM rerank, k=256) |
|
Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations 2023-12-14 |
코드 1 · 코드 2 · 코드 3 |
| Llama SFT (Metamath ToRA Ensemble) |
|
연결 없음 논문 날짜 미기재 |
연결 없음 |
| Minerva 62B (maj5@100) |
|
Solving Quantitative Reasoning Problems with Language Models 2022-06-29 |
코드 1 |
| Claude 3 Haiku (0-shot chain-of-thought) |
|
The Claude 3 Model Family: Opus, Sonnet, Haiku 2024-03-04 |
연결 없음 |
| ToRA-70B (SC, k=50) |
|
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving 2023-09-29 |
코드 1 |
| DeepSeekMATH-RL-7B |
|
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models 2024-02-05 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 |
| DART-Math-DSMath-7B-Uniform (0-shot CoT, w/o code) |
|
DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 2024-06-18 |
코드 1 |