Shadowgraph
TrendingAbout
Sign in

ying-hui-he/Hi-ToM_dataset

[EMNLP 2023] Hi-ToM benchmark

Jupyter Notebook

21

65 commits

updated Oct 11, 2025

See the code

See what people are saying

SourceMessageScoreDate

Difficult reasoning competition for LLMs - Hi-ToM (r/ClaudeAI)

Source: [https://github.com/ying-hui-he/Hi-ToM\_dataset](https://github.com/ying-hui-he/Hi-ToM_dataset) I asked several LLMs to solve this Hi-ToM puzzle: The following story happens in chronological order. You will be given a multiple-choice question and a note at the end. Directly output the…

7

Oct 1, 2026

README

Hi-ToM Dataset

This is the dataset for the paper "Hi-ToM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Models".

<img src=media/Picture1.png height=430>

Hi-ToM dataset

Hi-ToM_data/Hi-ToM_data.json contains 1.2k higher-order ToM question-answer pairs.

Generate new data and prompts

Please run the script generate_tomh.sh to automatically generate new stories along questions and answers.

Similar repos

SeacowX/OpenToM

Dataset

OpenToM is a new benchmark for assessing LLMs' Neural Theory-of-Mind (N-ToM) with the following key…

7

seacowx/OpenToM

The official repository of the OpenToM dataset

34

sled-umich/2D-ATOMS

Dataset

2D-ATOMS: 2D Abilities in Theory of Mind Space dataset

1

facebookresearch/ToMi

Code accompanying our EMNLP 2019 paper: "Revisiting the Evaluation of Theory of Mind through…

28

zhuohang/HiBench

Dataset

This repository contains the data presented in [HiBench: Benchmarking LLMs Capability on…

3

Mars-tin/awesome-theory-of-mind

Machine Theory of Mind Reading List. Built upon EMNLP Findings 2023 Paper: Towards A Holistic…

154

noewangjy/SP-CoT

The GitHub repository for the paper "Self-prompted Chain-of-Thought on Large Language Models for…

33

Lyte/Reasoner-1o1-v0.3-HQ

Dataset

Dataset Details

8

Languages

Jupyter Notebook

97.9%

Python

2.0%

ying-hui-he/Hi-ToM_dataset

[EMNLP 2023] Hi-ToM benchmark

Jupyter Notebook

21

65 commits

updated Oct 11, 2025

See the code

See what people are saying

SourceMessageScoreDate

Difficult reasoning competition for LLMs - Hi-ToM (r/ClaudeAI)

Source: [https://github.com/ying-hui-he/Hi-ToM\_dataset](https://github.com/ying-hui-he/Hi-ToM_dataset) I asked several LLMs to solve this Hi-ToM puzzle: The following story happens in chronological order. You will be given a multiple-choice question and a note at the end. Directly output the…

7

Oct 1, 2026

README

Hi-ToM Dataset

This is the dataset for the paper "Hi-ToM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Models".

<img src=media/Picture1.png height=430>

Hi-ToM dataset

Hi-ToM_data/Hi-ToM_data.json contains 1.2k higher-order ToM question-answer pairs.

Generate new data and prompts

Please run the script generate_tomh.sh to automatically generate new stories along questions and answers.

Similar repos

SeacowX/OpenToM

Dataset

OpenToM is a new benchmark for assessing LLMs' Neural Theory-of-Mind (N-ToM) with the following key…

7

seacowx/OpenToM

The official repository of the OpenToM dataset

34

sled-umich/2D-ATOMS

Dataset

2D-ATOMS: 2D Abilities in Theory of Mind Space dataset

1

facebookresearch/ToMi

Code accompanying our EMNLP 2019 paper: "Revisiting the Evaluation of Theory of Mind through…

28

zhuohang/HiBench

Dataset

This repository contains the data presented in [HiBench: Benchmarking LLMs Capability on…

3

Mars-tin/awesome-theory-of-mind

Machine Theory of Mind Reading List. Built upon EMNLP Findings 2023 Paper: Towards A Holistic…

154

noewangjy/SP-CoT

The GitHub repository for the paper "Self-prompted Chain-of-Thought on Large Language Models for…

33

Lyte/Reasoner-1o1-v0.3-HQ

Dataset

Dataset Details

8

Languages

Jupyter Notebook

97.9%

Python

2.0%