arXiv:2505.14852
EasyMath: A 0-shot Math Benchmark for SLMs
원문 초록
EasyMath is a compact benchmark for practical math reasoning in small language models. It covers thirteen categories, from basic arithmetic and order of operations to word problems, algebraic expressions, edge cases, and omits specialist topics. We tested 23 models (14M to 4B parameters) using exact, numerical, and symbolic checks on free-form answers in a zero-shot setting. Accuracy rises with size and training, chain-of-thought adds modest gains, and consistency improves at scale.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Personalized Exercise Recommendation with Semantically-Grounded Knowledge Tracing
Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination
A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learning
The Delta Learning Hypothesis: Preference Tuning on Weak Data can Yield Strong Gains
LLMThinkBench: Towards Basic Math Reasoning and Overthinking in Large Language Models
EvoAgentX: An Automated Framework for Evolving Agentic Workflows
토론
이 논문과 연결된 포럼 글이 아직 없습니다.