bigcode-project/the-stack-v2

Code for the curation of The Stack v2 and StarCoder2 training data

Jupyter Notebook

146

21 commits

updated Apr 11, 2024

See the code

README

The Stack v2 & StarCoder2Data

In this repository you can find the code for building The Stack v2 dataset, as well as the extra sources used to make StarCoder2data: the training corpus of the StarCoder2 family of models.

This reposirory is a follow-up of on the work in bigcode-dataset used for The Stack v1 and StarCoderData.

Significant stargazers

bigeagle

1,269 followers · starred Feb 2024

Similar repos

bigcode-project/bigcode-dataset

499

same org

naver-clova-ix/cord-v2

Dataset

127

HuggingFaceH4/CodeAlpaca_20K

Dataset

This dataset splits the original [CodeAlpaca dataset](https://huggingface.co/datasets/sahil2801/Cod…

112

tokyotech-llm/swallow-code-v2

Dataset

SwallowCode-v2

HuggingFaceTB/issues-kaggle-notebooks

Dataset

GitHub Issues & Kaggle Notebooks

zjsd/RedStone

Dataset

RedStone

OpenCoder-LLM/opc-sft-stage2

Dataset

OpenCoder Dataset

105

zjsd/RedStone-Code-python

Dataset

RedStone

Languages

Jupyter Notebook

50.0%

Python

47.6%

Shell

2.4%

bigcode-project/the-stack-v2

Code for the curation of The Stack v2 and StarCoder2 training data

Jupyter Notebook

146

21 commits

updated Apr 11, 2024

See the code

README

The Stack v2 & StarCoder2Data

In this repository you can find the code for building The Stack v2 dataset, as well as the extra sources used to make StarCoder2data: the training corpus of the StarCoder2 family of models.

This reposirory is a follow-up of on the work in bigcode-dataset used for The Stack v1 and StarCoderData.