LongCite-45k

🤗 [LongCite Dataset] • 💻 [Github Repo] • 📃 [LongCite Paper]

LongCite-45k dataset contains 44,600 long-context QA instances paired with sentence-level citations (both English and Chinese, up to 128,000 words). The data can support training long-context LLMs to generate response and fine-grained citations within a single output.

Data Example

Each instance in LongCite-45k consists of an instruction, a long context (divided into sentences), a user query, and an answer with sentence-level citations.

All Models

We open-sourced following two models trained on LongCite-45k:

Citation

If you find our work useful, please consider citing LongCite:

@article{zhang2024longcite,
  title = {LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA} 
  author={Jiajie Zhang and Yushi Bai and Xin Lv and Wanjun Gu and Danqing Liu and Minhao Zou and Shulin Cao and Lei Hou and Yuxiao Dong and Ling Feng and Juanzi Li},
  journal={arXiv preprint arXiv:2409.02897},
  year={2024}
}