gair-prox/open-web-math-pro

Dataset

πŸ“š Open-Web-Math-Pro

12

7 commits

2 linked in READMEs

updated Sep 26, 2024

See the code

README

πŸ“š Open-Web-Math-Pro

ArXiv | Models | Code

Open-Web-Math-Pro is refined from open-web-math using the ProX refining framework. It contains about 5B high quality math related tokens, ready for pre-training.

License

Open-Web-Math-Pro is based on open-web-math, which is made available under an ODC-By 1.0 license; users should also abide by the CommonCrawl ToU: https://commoncrawl.org/terms-of-use/. We do not alter the license of any of the underlying data.

Citation

@article{zhou2024programming,
  title={Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale},
  author={Zhou, Fan and Wang, Zengzhi and Liu, Qian and Li, Junlong and Liu, Pengfei},
  journal={arXiv preprint arXiv:2409.17115},
  year={2024}
}
math
reasoning

Contributors

koalazf99

7 commits

gair-prox/open-web-math-pro

Dataset

πŸ“š Open-Web-Math-Pro

12

7 commits

2 linked in READMEs

updated Sep 26, 2024

See the code

README

πŸ“š Open-Web-Math-Pro

ArXiv | Models | Code

Open-Web-Math-Pro is refined from open-web-math using the ProX refining framework. It contains about 5B high quality math related tokens, ready for pre-training.

License

Open-Web-Math-Pro is based on open-web-math, which is made available under an ODC-By 1.0 license; users should also abide by the CommonCrawl ToU: https://commoncrawl.org/terms-of-use/. We do not alter the license of any of the underlying data.

Citation

@article{zhou2024programming,
  title={Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale},
  author={Zhou, Fan and Wang, Zengzhi and Liu, Qian and Li, Junlong and Liu, Pengfei},
  journal={arXiv preprint arXiv:2409.17115},
  year={2024}
}
math
reasoning

Contributors

koalazf99

7 commits