README
Datasets used for datatrove testing. Each split contains the same data:
dst = [
{"text": "hello"},
{"text": "world"},
{"text": "how"},
{"text": "are"},
{"text": "you"},
]
But based on the split name the data are sharded into n-bins
Contributors
hynky
4 commits
Similar repos
README
Datasets used for datatrove testing. Each split contains the same data:
dst = [
{"text": "hello"},
{"text": "world"},
{"text": "how"},
{"text": "are"},
{"text": "you"},
]
But based on the split name the data are sharded into n-bins
Similar repos
Contributors
hynky
4 commits