ScholarIdeas

ScholarIdeas/ contains 117 research ideas and their reviews spanning AI, neuroscience, biochemistry, and ecology. Each review is composed of multiple rubrics, for a total of 1076 rubrics across the dataset.

Each folder in ScholarIdeas/ includes:

• {discipline}_{number}.txt — the research idea text
• {discipline}_{number}.jsonl — review rubrics (one rubric per line)
• cutoff.txt — cutoff date for literature search (i.e., publication date of the original paper)

---

Cite Our Work

If you find ScholarEval or ScholarIdeas useful in your work, please cite our paper:

@misc{moussa2025scholarevalresearchideaevaluation,
      title={ScholarEval: Research Idea Evaluation Grounded in Literature}, 
      author={Hanane Nour Moussa and Patrick Queiroz Da Silva and Daniel Adu-Ampratwum and Alyson East and Zitong Lu and Nikki Puccetti and Mingyi Xue and Huan Sun and Bodhisattwa Prasad Majumder and Sachin Kumar},
      year={2025},
      eprint={2510.16234},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2510.16234}, 
}