SeniorTalk: A Chinese Conversation Dataset with Rich Annotations for Super-Aged Seniors

Introduction

SeniorTalk is a comprehensive, open-source Mandarin Chinese speech dataset specifically designed for research on elderly aged 75 to 85. This dataset addresses the critical lack of publicly available resources for this age group, enabling advancements in automatic speech recognition (ASR), speaker verification (SV), speaker dirazation (SD), speech editing and other related fields. The dataset is released under a CC BY-NC-SA 4.0 license, meaning it is available for non-commercial use.

Dataset Details

This dataset contains 55.53 hours of high-quality speech data collected from 202 elderly across 16 provinces in China. Key features of the dataset include:

• Age Range: 75-85 years old (inclusive). This is a crucial age range often overlooked in speech datasets.
• Speakers: 202 unique elderly speakers.
• Geographic Diversity: Speakers from 16 of China's 34 provincial-level administrative divisions, capturing a range of regional accents.
• Gender Balance: Approximately 7:13 representation of male and female speakers, largely attributed to the differing average ages of males and females among the elderly.
• Recording Conditions: Recordings were made in quiet environments using a variety of smartphones (both Android and iPhone devices) to ensure real-world applicability.
• Content: Natural, conversational speech during age-appropriate activities. The content is unrestricted, promoting spontaneous and natural interactions.
• Audio Format: WAV files with a 16kHz sampling rate.
• Transcriptions: Carefully crafted, character-level manual transcriptions.
• Annotations: The dataset includes annotations for each utterance, and for the speakers level.
  • Session-level: sentence_start_time,sentence_end_time,overlapped speech
  • Utterance-level: id, accent_level, text (transcription).
  • Token-level: special token([SONANT],[MUSIC],[NOISE]....)
  • Speaker-level: speaker_id, age, gender, location (province), device.

Dataset Structure

Dialogue Dataset

The dataset is split into two subsets:

The dataset file structure is as follows.

dialogue_data/  
├── wav  
│   ├── train/*.tar   
│   └── test/*.tar   
└── transcript/*.txt
UTTERANCEINFO.txt  # annotation of topics and duration
SPKINFO.txt   # annotation of location , age , gender and device

Each WAV file has a corresponding TXT file with the same name, containing its annotations.

For more details, please refer to our paper SeniorTalk.

ASR Dataset

The dataset is split into three subsets:

The dataset file structure is as follows.

sentence_data/  
├── wav  
│   ├── train/*.tar
│   ├── dev/*.tar 
│   └── test/*.tar   
└── transcript/*.txt   
UTTERANCEINFO.txt  # annotation of topics and duration
SPKINFO.txt   # annotation of location , age , gender and device

Each WAV file has a corresponding TXT, containing its annotations.

For more details, please refer to our paper SeniorTalk.

📐 Experiments

We conducted experiments on Automatic Speech Recognition (ASR) , Speaker Verification (SV) tasks , Speaker Dirazation (SD) tasks and Speech Editing tasks to evaluate the dataset.

1️⃣ ASR Results

Models Trained from Scratch

Fine-tuned Pre-trained Models

2️⃣ SV Results

3️⃣ SD Results

4️⃣ Speech Editing Results

🤗 Dataset Download

You can access the SeniorTalk dataset on HuggingFace Datasets:

https://huggingface.co/datasets/BAAI/SeniorTalk

Code Access Control

This code and dataset is available to researchers upon request for academic and non-commercial use. To request access, please follow these steps:

Submit Application via Email: Send an email to 2120230617@mail.nankai.edu.cn with the following information:

• Subject: Dataset Access Request: [Your Name/Institution]
• Body:
  • Your Hugging Face Username.
  • Your full name, title, and academic/institutional affiliation.
  • A link to your professional profile (e.g., university page, Google Scholar, LinkedIn).
  • A brief description of your research project and how you intend to use the dataset.

We will review your application and grant access on Hugging Face upon approval. Please allow 3-5 business days for processing.

📚 Cite me

@misc{chen2025seniortalkchineseconversationdataset,
      title={SeniorTalk: A Chinese Conversation Dataset with Rich Annotations for Super-Aged Seniors}, 
      author={Yang Chen and Hui Wang and Shiyao Wang and Junyang Chen and Jiabei He and Jiaming Zhou and Xi Yang and Yequan Wang and Yonghua Lin and Yong Qin},
      year={2025},
      eprint={2503.16578},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2503.16578}, 
}