PolyMath is a multilingual mathematical reasoning benchmark covering 18 languages and 4 easy-to-hard difficulty levels. Our benchmark ensures difficulty comprehensiveness, language diversity, and high-quality translation, making it a highly discriminative multilingual mathematical benchmark in the era of reasoning LLMs.

• 📈 Broad Difficulty Range: PolyMath defines and partitions mathematical difficulty across four levels using two core dimensions: Thought Depth and Knowledge Breadth, ranging from K-12 to Olympiad and advanced frontier mathematics, with 125 problems per language at each level.

• 🌍 Language Diversity: Each problem in PolyMath is available in 18 parallel language versions, encompassing over 75% of the world’s native speakers and major language families, ensuring diversity across both high-resource and low-resource languages.

• 🧑‍🏫 High-Quality Annotation: Each problem translation is calibrated by language experts, avoiding direct use of LLM-generated outputs and ensuring precise term and logical clarity.

---

📊 Main Results

The leaderboard is continuously updated! See https://qwen-polymath.github.io/#leaderboard

---

📄 Citation

If you use PolyMath in your research, please cite us:

@article{wang2025polymath,
  title={PolyMath: Evaluating Mathematical Reasoning in Multilingual Contexts},
  author={Yiming Wang and Pei Zhang and Jialong Tang and Haoran Wei and Baosong Yang and Rui Wang and Chenshu Sun and Feitong Sun and Jiran Zhang and Junxuan Wu and Qiqian Cang and Yichang Zhang and Fei Huang and Junyang Lin and Fei Huang and Jingren Zhou},
  journal={arXiv preprint arXiv:2504.18428},
  year={2025},
  primaryClass={cs.CL},
  url={https://arxiv.org/abs/2504.18428}, 
}