open-r1/OpenR1-Math-Raw

Dataset

OpenR1-Math-Raw

77

3 commits

2 linked in READMEs

updated Feb 24, 2025

See the code

README

OpenR1-Math-Raw

Dataset description

OpenR1-Math-Raw is a large-scale dataset for mathematical reasoning. It consists of 516k math problems sourced from AI-MO/NuminaMath-1.5 with 1 to 8 reasoning traces generated by DeepSeek R1. The traces were verified using Math Verify and LLM-as-Judge based verifier (Llama-3.3-70B-Instruct)

The dataset contains:

  • 516,499 problems
  • 1,209,403 R1-generated solutions, with 2.3 solutions per problem on average
  • re-parsed answers (reparsed_answers) using Llama-3.3-70B-Instruct

With following distribution of correct answers:

MetricCorrect - GenerationTotal - GenerationCorrect - ProblemTotal - Problem
Math Verify Reparsed Answer679,358944,106266,654376,956
LLaMA Verification602,766944,106308,391376,956
Math Verify Answer613,535944,106238,951376,956

You can load the dataset as follows:

from datasets import load_dataset

ds = load_dataset("open-r1/OpenR1-Math-Raw", split="train")

Dataset curation

We only keep the solutions that fit in the 16k-token budget, and follow the <think>...</think> reasoning format. Only the non-synthetic problems from NuminaMath-1.5 were used.

For a more curated sample of this dataset and more details please see open-r1/OpenR1-Math-220k.

Changelog

[1.1]

  • Added reparsed_answers column, created by meta-llama/Meta-Llama-3.3-70B-Instruct prompted to extract answer from $solution$ column.
  • Added correctness column, which contains verification results computed by math-verify on the reparsed_answers/answer column, as well as llama-based verification using meta-llama/Meta-Llama-3.3-70B-Instruct

License

The dataset is licensed under Apache 2.0

Contributors

hynky

2 commits

anton-l

1 commits

open-r1/OpenR1-Math-Raw

Dataset

OpenR1-Math-Raw

77

3 commits

2 linked in READMEs

updated Feb 24, 2025

See the code

README

OpenR1-Math-Raw

Dataset description

OpenR1-Math-Raw is a large-scale dataset for mathematical reasoning. It consists of 516k math problems sourced from AI-MO/NuminaMath-1.5 with 1 to 8 reasoning traces generated by DeepSeek R1. The traces were verified using Math Verify and LLM-as-Judge based verifier (Llama-3.3-70B-Instruct)

The dataset contains:

  • 516,499 problems
  • 1,209,403 R1-generated solutions, with 2.3 solutions per problem on average
  • re-parsed answers (reparsed_answers) using Llama-3.3-70B-Instruct

With following distribution of correct answers:

MetricCorrect - GenerationTotal - GenerationCorrect - ProblemTotal - Problem
Math Verify Reparsed Answer679,358944,106266,654376,956
LLaMA Verification602,766944,106308,391376,956
Math Verify Answer613,535944,106238,951376,956

You can load the dataset as follows:

from datasets import load_dataset

ds = load_dataset("open-r1/OpenR1-Math-Raw", split="train")

Dataset curation

We only keep the solutions that fit in the 16k-token budget, and follow the <think>...</think> reasoning format. Only the non-synthetic problems from NuminaMath-1.5 were used.

For a more curated sample of this dataset and more details please see open-r1/OpenR1-Math-220k.

Changelog

[1.1]

  • Added reparsed_answers column, created by meta-llama/Meta-Llama-3.3-70B-Instruct prompted to extract answer from $solution$ column.
  • Added correctness column, which contains verification results computed by math-verify on the reparsed_answers/answer column, as well as llama-based verification using meta-llama/Meta-Llama-3.3-70B-Instruct

License

The dataset is licensed under Apache 2.0

Contributors

hynky

2 commits

anton-l

1 commits