← Arithmetic Reasoning
평가 기록
과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.
표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.
| 모델 | 원본 지표·값 | 논문 | 구현 |
|---|---|---|---|
| MuggleMATH 70B |
|
MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning 2023-10-09 |
코드 1 |
| PaLM 540B (Self Improvement, Self Consistency) |
|
Large Language Models Can Self-Improve 2022-10-20 |
연결 없음 |
| MathCoder-CL-34B |
|
MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning 2023-10-05 |
코드 1 |
| WizardMath-70B-V1.0 |
|
WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct 2023-08-18 |
코드 1 |
| Phi-GSM+V 1.3B+1.3B (verify48@1) |
|
TinyGSM: achieving >80% on GSM8k with small language models 2023-12-14 |
연결 없음 |
| DART-Math-Mistral-7B-Prop2Diff (0-shot CoT, w/o code) |
|
DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 2024-06-18 |
코드 1 |
| DART-Math-Llama3-8B-Prop2Diff (0-shot CoT, w/o code) |
|
DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 2024-06-18 |
코드 1 |
| Claude Instant 1.1 (0-shot chain-of-thought) |
|
Model Card and Evaluations for Claude Models 2023-07-11 |
연결 없음 |
| ToRA-Code 34B |
|
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving 2023-09-29 |
코드 1 |
| OpenMath-CodeLlama-34B (w/ code) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| PaLM 2 (few-shot, k=8, CoT) |
|
PaLM 2 Technical Report 2023-05-17 |
코드 1 |
| MMOS-DeepSeekMath-7B(0-shot) |
|
An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning 2024-02-23 |
코드 1 |
| MMOS-CODE-34B(0-shot) |
|
An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning 2024-02-23 |
코드 1 |
| OpenMath-Mistral-7B (w/ code) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| Self-Evaluation Guided Decoding (Codex, PAL, single reasoning chain, 9-shot gen, 5-shot eval) |
|
연결 없음 논문 날짜 미기재 |
연결 없음 |
| OpenMath-CodeLlama-13B (w/ code) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| Minerva 540B (CoT) |
|
Solving Quantitative Reasoning Problems with Language Models 2022-06-29 |
코드 1 |
| Camelidae-8×34B (5-shot) |
|
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks 2024-01-05 |
코드 1 · 코드 2 |
| Qwen2idae-16x14B (5-shot) |
|
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks 2024-01-05 |
코드 1 · 코드 2 |
| MetaMath-Mistral-7B |
|
MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models 2023-09-21 |
코드 1 |
| OpenChat-3.5 7B |
|
OpenChat: Advancing Open-source Language Models with Mixed-Quality Data 2023-09-20 |
코드 1 |
| DeepMind 70B Model (STaR, maj1@96) |
|
Solving math word problems with process- and outcome-based feedback 2022-11-25 |
연결 없음 |
| Arithmo2-Mistral-7B |
|
연결 없음 논문 날짜 미기재 |
연결 없음 |
| OpenMath-CodeLlama-7B (w/ code) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| ToRA-Code 13B |
|
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving 2023-09-29 |
코드 1 |
| Arithmo-Mistral-7B |
|
연결 없음 논문 날짜 미기재 |
연결 없음 |
| PaLM 540B maj1@40 (8-shot) |
|
Self-Consistency Improves Chain of Thought Reasoning in Language Models 2022-03-21 |
코드 1 · 코드 2 · 코드 3 |
| PaLM 540B (Self Consistency) |
|
Large Language Models Can Self-Improve 2022-10-20 |
연결 없음 |
| Phi-GSM 2.7B (fine-tuned) |
|
TinyGSM: achieving >80% on GSM8k with small language models 2023-12-14 |
연결 없음 |
| MathCoder-CL-13B |
|
MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning 2023-10-05 |
코드 1 |