jtatman/python-code-dataset-500k

Dataset

81

stars

7

commits

1

linked in READMEs

Jan 23, 2024

updated

code
instructional
python

README

Attention: This dataset is a summary and reformat pulled from github code.

You should make your own assumptions based on this. In fact, there is another dataset I formed through parsing that addresses several points:

  • out of 500k python related items, most of them are python-ish, not pythonic
  • the majority of the items here contain excessive licensing inclusion of original code
  • the items here are sometimes not even python but have references
  • There's a whole lot of gpl summaries floating on the code responses or instructions

As such, you are probably not getting good data to begin with, but this should be used as a starting point at best. You have been warned.

Contributors

jtatman

7 commits

jtatman/python-code-dataset-500k

Dataset

81

stars

7

commits

1

linked in READMEs

Jan 23, 2024

updated

code
instructional
python

README

Attention: This dataset is a summary and reformat pulled from github code.

You should make your own assumptions based on this. In fact, there is another dataset I formed through parsing that addresses several points:

  • out of 500k python related items, most of them are python-ish, not pythonic
  • the majority of the items here contain excessive licensing inclusion of original code
  • the items here are sometimes not even python but have references
  • There's a whole lot of gpl summaries floating on the code responses or instructions

As such, you are probably not getting good data to begin with, but this should be used as a starting point at best. You have been warned.

Contributors

jtatman

7 commits