← Math Word Problem Solving
평가 기록
과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.
표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.
| 모델 | 원본 지표·값 | 논문 | 구현 |
|---|---|---|---|
| OpenMath-CodeLlama-13B (w/ code, SC, k=50) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| OpenMath-Mistral-7B (w/ code, SC, k=50) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| ToRA 70B (w/ code, SC, k=50) |
|
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving 2023-09-29 |
코드 1 |
| SKiC (GPT-4 model) |
|
Skills-in-Context Prompting: Unlocking Compositionality in Large Language Models 2023-08-01 |
연결 없음 |
| DART-Math-Llama3-70B-Prop2Diff (0-shot CoT, w/o code) |
|
DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 2024-06-18 |
코드 1 |
| OpenMath-CodeLlama-7B (w/ code, SC, k=50) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| MMOS-DeepSeekMath-7B(0-shot) |
|
An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning 2024-02-23 |
코드 1 |
| DART-Math-Llama3-70B-Uniform (0-shot CoT, w/o code) |
|
DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 2024-06-18 |
코드 1 |
| PHP (GPT-4 model) |
|
Progressive-Hint Prompting Improves Reasoning in Large Language Models 2023-04-19 |
코드 1 |
| DART-Math-DSMath-7B-Prop2Diff (0-shot CoT, w/o code) |
|
DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 2024-06-18 |
코드 1 |
| Gemini Ultra (4-shot) |
|
Gemini: A Family of Highly Capable Multimodal Models 2023-12-19 |
코드 1 |
| DART-Math-DSMath-7B-Uniform (0-shot CoT, w/o code) |
|
DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 2024-06-18 |
코드 1 |
| GPT-4 model (w/ code, PAL) |
|
PAL: Program-aided Language Models 2022-11-18 |
코드 1 · 코드 2 · 코드 3 |
| DeepSeekMATH-RL-7B (greedy decoding) |
|
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models 2024-02-05 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 |
| AlphaLLM (with MCTS) |
|
Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing 2024-04-18 |
코드 1 |
| ToRA-Code 34B (w/ code) |
|
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving 2023-09-29 |
코드 1 |
| OpenMath-CodeLlama-70B (w/ code) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| Minerva 540B (maj1@k, k=64) |
|
Solving Quantitative Reasoning Problems with Language Models 2022-06-29 |
코드 1 |
| ToRA 70B (w/ code) |
|
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving 2023-09-29 |
코드 1 |
| MMOS-CODE-34B(0-shot) |
|
An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning 2024-02-23 |
코드 1 |
| DeepSeekMath-7B-KPMath-Plus |
|
Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning 2024-03-04 |
연결 없음 |
| PaLM 2 (few-shot, k=4, SC) |
|
PaLM 2 Technical Report 2023-05-17 |
코드 1 |
| Llemma-34B-KPMath-Plus |
|
Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning 2024-03-04 |
연결 없음 |
| OpenMath-CodeLlama-34B (w/ code) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |
| Shepherd + DeepSeek-67B (SFT on MetaMATH + PRM rerank, k=256) |
|
Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations 2023-12-14 |
코드 1 · 코드 2 · 코드 3 |
| ToRA-Code 13B (w/ code) |
|
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving 2023-09-29 |
코드 1 |
| Minerva 8B (maj5@256) |
|
Solving Quantitative Reasoning Problems with Language Models 2022-06-29 |
코드 1 |
| Mistral-7B-KPMath-Plus |
|
Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning 2024-03-04 |
연결 없음 |
| DART-Math-Llama3-8B-Prop2Diff (0-shot CoT, w/o code) |
|
DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 2024-06-18 |
코드 1 |
| OpenMath-Llama2-70B (w/ code) |
|
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset 2024-02-15 |
코드 1 |