varib/H2HMEM

Dataset

πŸ“Š H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactions

1

31 commits

2 linked in READMEs

updated Jun 22, 2026

See the code

README

πŸ“Š H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactions

πŸ“„ Paper

This dataset is introduced in the following research work:

H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactions

-πŸ“„ arXiv: https://arxiv.org/abs/2606.09461v1
-πŸ’» Code: https://github.com/varib1/H2HMEM
-πŸ“Š Dataset: https://huggingface.co/datasets/varib/H2HMEM
-🌐 Project Page: https://h2hmemprojectpage.vercel.app/
-πŸ† Leaderboard: https://h2hmemleaderboard1.vercel.app/
-πŸ“€ Leaderboard Submission: https://huggingface.co/spaces/varib/H2HMEM-Submit


H2HMem is a benchmark designed to evaluate multimodal memory and reasoning capabilities in LLM-based agents across dyadic and multi-party human-human conversations.


πŸ“Š Dataset Overview

AspectDyadicMulti-partyTotal
Dialogues20525
Sessions28425309
Dialogue Rounds5,3161,7627,078
Images9513491,300
QA Pairs2,0461902,236

🏷️ Task Taxonomy

The benchmark includes three major categories of memory evaluation tasks:

🧠 Memory Recall

Sub-taskAbbreviation
Unimodal Precise RecallUPR
Cross-modal Related RetrievalCRR
Knowledge ResolutionKR

🧩 Memory Reasoning

Sub-taskAbbreviation
Temporal ReasoningTR
Multimodal Causal ReasoningMCR
Reference & Evolution TrackingRET

βš™οΈ Memory Application

Sub-taskAbbreviation
Test-Time LearningTTL
Conflict DetectionCD
Answer RefusalAR
agent
agent-memory

varib/H2HMEM

Dataset

πŸ“Š H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactions

1

31 commits

2 linked in READMEs

updated Jun 22, 2026

See the code

README

πŸ“Š H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactions

πŸ“„ Paper

This dataset is introduced in the following research work:

H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactions

-πŸ“„ arXiv: https://arxiv.org/abs/2606.09461v1
-πŸ’» Code: https://github.com/varib1/H2HMEM
-πŸ“Š Dataset: https://huggingface.co/datasets/varib/H2HMEM
-🌐 Project Page: https://h2hmemprojectpage.vercel.app/
-πŸ† Leaderboard: https://h2hmemleaderboard1.vercel.app/
-πŸ“€ Leaderboard Submission: https://huggingface.co/spaces/varib/H2HMEM-Submit


H2HMem is a benchmark designed to evaluate multimodal memory and reasoning capabilities in LLM-based agents across dyadic and multi-party human-human conversations.


πŸ“Š Dataset Overview

AspectDyadicMulti-partyTotal
Dialogues20525
Sessions28425309
Dialogue Rounds5,3161,7627,078
Images9513491,300
QA Pairs2,0461902,236

🏷️ Task Taxonomy

The benchmark includes three major categories of memory evaluation tasks:

🧠 Memory Recall

Sub-taskAbbreviation
Unimodal Precise RecallUPR
Cross-modal Related RetrievalCRR
Knowledge ResolutionKR

🧩 Memory Reasoning

Sub-taskAbbreviation
Temporal ReasoningTR
Multimodal Causal ReasoningMCR
Reference & Evolution TrackingRET

βš™οΈ Memory Application

Sub-taskAbbreviation
Test-Time LearningTTL
Conflict DetectionCD
Answer RefusalAR
agent
agent-memory