THU-KEG/LongWriter-Zero-RLData

Dataset

LongWriter-Zero RL Data

24

stars

10

commits

1

linked in READMEs

Jul 10, 2025

updated

length control
long-form generation
reinforcement learning

README

LongWriter-Zero RL Data

🤗 [Model] • 📃 [Paper] • 💾 [Dataset Card]

LongWriter-Zero RL Data is designed for ultra-long text generation via reinforcement learning. The dataset consists of conversational queries paired with length-range tags, which specify the desired output span (measured in words or Chinese characters). These annotations are used to train the LongWriter-Zero model, enabling it to consistently generate passages exceeding 10,000 words.

PS: We also included some general QA query to improve the model’s generalization ability. You can remove them based on the label range [0, 14000].

Dataset at a Glance

FieldTypeDescription
idxintUnique example identifier
querystringUser instruction / prompt (English or Chinese)
labelobjectJSON dict {"range": [low, high]} denoting the target word‑count interval

Happy long-form writing!

Contributors

mozhu

6 commits

bys0318

3 commits

nielsr

1 commits

THU-KEG/LongWriter-Zero-RLData

Dataset

LongWriter-Zero RL Data

24

stars

10

commits

1

linked in READMEs

Jul 10, 2025

updated

length control
long-form generation
reinforcement learning

README

LongWriter-Zero RL Data

🤗 [Model] • 📃 [Paper] • 💾 [Dataset Card]

LongWriter-Zero RL Data is designed for ultra-long text generation via reinforcement learning. The dataset consists of conversational queries paired with length-range tags, which specify the desired output span (measured in words or Chinese characters). These annotations are used to train the LongWriter-Zero model, enabling it to consistently generate passages exceeding 10,000 words.

PS: We also included some general QA query to improve the model’s generalization ability. You can remove them based on the label range [0, 14000].

Dataset at a Glance

FieldTypeDescription
idxintUnique example identifier
querystringUser instruction / prompt (English or Chinese)
labelobjectJSON dict {"range": [low, high]} denoting the target word‑count interval

Happy long-form writing!

Contributors

mozhu

6 commits

bys0318

3 commits

nielsr

1 commits