ductai199x/dictation-speech

Dataset

Dictation Speech

2

6 commits

1 linked in READMEs

updated Oct 12, 2026

See the code

README

Dictation Speech

103,486 clips (563 hours) of dictation: people's kinds of text, spoken the way people dictate (fillers, false starts, self-corrections, editing commands, spoken punctuation, lists, grammar slips), each with what was said word for word and the text the speaker meant to type. 16 kHz mono, stored losslessly as FLAC. All speech is synthetic (Kokoro-82M and Chatterbox).

It is the speech side of Utter's data:

  • the corpus* collections are the audio behind ductai199x/dictation-to-text, one clip per text pair (join rendition_id to its id), each in its pair's split;
  • the other collections are the eval sets Utter's models are measured on, all test, including voices (Chatterbox) no training clip uses.

Dataset structure

splitclipshours
train79,246435
test24,240128

Configs: all (the default: every collection, train and test) and one per collection:

collectiontraintesthourscategories
corpus15,8571,992122.1command, correction, disfluent, explicit, natural, restate
corpus-v224,4193,081150.7command, correction, disfluent, explicit, natural, restate
corpus-messages11,0801,39866.6amend, command, correction, disfluent, explicit, grammar, natural, restate
corpus-amend7,49994746.2amend
corpus-grammar7,7591,01840.1grammar
corpus-grammar29,1021,11346.0grammar
corpus-lists3,53044617.5list
kokoro4,64224.7command, correction, disfluent, explicit, natural
kokoro-amend1,1666.4amend
kokoro-directed2921.4disfluent, natural
kokoro-grammar6763.2grammar
kokoro-lists8033.5list
kokoro-real9374.1amend, command, correction, disfluent, explicit, grammar, natural
kokoro-restate5634.5restate
chatterbox4,22921.8command, correction, disfluent, explicit, natural
chatterbox-real9373.8amend, command, correction, disfluent, explicit, grammar, natural

The same rendition can be in more than one test collection (spoken by both engines, or in a focused set and the main one); id is unique, rendition_id is shared. No rendition and no passage is in both splits.

columntypemeaning
idstring<collection>/<rendition id>, unique
rendition_idstring<passage id>-<category>; the id of the same row in dictation-to-text
audioAudio (16 kHz)the clip, FLAC
duration_sfloat32its length
languagestringen
transcriptstringexactly what was said, as spoken (numbers and symbols in words)
final_textstringthe text the speaker meant to type
categorystringhow it was spoken (below)
domainstringwhat the passage is
annotationslist of stringswhat the rendition contains, as key=value (e.g. fillers=2, false_start=1, errors=VERB:SVA, op=value)
tts_enginestringkokoro-82m (98,320), chatterbox-0.1.7 (5,166)
tts_voicestringthe voice (Kokoro's voice name, or a numbered donated reference voice for Chatterbox)
tts_settingslist of stringsspeed= (Kokoro) or exaggeration= (Chatterbox); audio=regenerated on clips spoken again (below)
collectionstringthe set it belongs to
sourcestringwhere the passage came from
source_urlstringthe passage's page (for passages Utter's tools wrote, the script that wrote them)
licensestringthe passage's license

Categories:

categoryspokenclips
grammarwith the grammar slips of real speakers, to be corrected21,131
disfluentwith fillers, repeats and false starts11,901
commandwith a spoken editing command ("scratch that")11,826
naturalthe passage said plainly11,669
amendwith a later edit to something said earlier11,533
correctionwith a spoken self-correction ("three, no, four")11,522
explicitwith spoken punctuation ("comma", "new paragraph")11,408
restatesaid again in other words partway through7,717
lista list, spoken item by item4,779

Sources and licensing

sourceclips
common-pile/stackexchange36,354
synthetic19,690
common-pile/arxiv_abstracts17,740
common-pile/ubuntu_irc15,133
wikimedia/wikipedia14,569
licenseclips
cc-by-sa-4.042,611
cc-by-sa-3.020,888
cc0-1.017,740
public-domain15,133
cc-by-sa-2.57,114

The dataset is CC BY-SA 4.0, as most of its text requires; each row keeps its passage's license and source URL (the page with the passage and its author).

The speech: Kokoro-82M is Apache-2.0, and its output is unrestricted; Chatterbox (MIT) cloned voices from kyutai/tts-voices (voice-donations, CC0: recordings people donated to the public domain).

Dataset creation

  1. Passages (Common Pile, Wikipedia, and everyday messages written for the dataset), rewritten as spoken renditions by a language model (Gemma 4 26B) in the categories above.
  2. Spoken by Kokoro-82M (twelve English voices, rate 0.9-1.1, chosen per rendition by a hash of its id) or Chatterbox (voice-cloned from Kyutai's CC0 donated voices, exaggeration varied), resampled to 16 kHz, with 0.25 s of silence around.
  3. 6,135 corpus clips (audio=regenerated) are a second synthesis with the same text, voice and speed: the same content and length to within a few hundredths of a second, not the same samples as the audio dictation-to-text's transcripts were made from.
  4. Final texts: the passage, with grammar corrected for the grammar category and mechanical punctuation slips fixed; the same as dictation-to-text's.

Personal and sensitive information

All speech is synthetic; no recording of a real person is included. The Chatterbox voices imitate recordings people donated to the public domain (kyutai/tts-voices); they are numbered here, not named, and must not be used to identify or impersonate the donors. Passage text from public posts can contain the usernames their writers published.

Bias, risks and limitations

  • English only; synthetic voices (twelve Kokoro voices and a small set of donated ones), so real accents, rooms and microphones are not represented. Use it for dictation formatting and cleanup, and as an ASR stress test, not as a substitute for real speech.
  • Technical forums are overrepresented next to everyday writing.

Use

from datasets import load_dataset

test = load_dataset("ductai199x/dictation-speech", split="test")             # every eval collection
amend = load_dataset("ductai199x/dictation-speech", "kokoro-amend", split="test")
row = test[0]; row["audio"]["array"], row["transcript"], row["final_text"]

Citation

@misc{nguyen2026dictationspeech,
  author       = {Tai Duc Nguyen},
  title        = {Dictation Speech},
  year         = {2026},
  publisher    = {Hugging Face},
  howpublished = {\url{https://huggingface.co/datasets/ductai199x/dictation-speech}}
}
audio
dictation
disfluency
self-correction
speech
synthetic-speech

ductai199x/dictation-speech

Dataset

Dictation Speech

2

6 commits

1 linked in READMEs

updated Oct 12, 2026

See the code

README

Dictation Speech

103,486 clips (563 hours) of dictation: people's kinds of text, spoken the way people dictate (fillers, false starts, self-corrections, editing commands, spoken punctuation, lists, grammar slips), each with what was said word for word and the text the speaker meant to type. 16 kHz mono, stored losslessly as FLAC. All speech is synthetic (Kokoro-82M and Chatterbox).

It is the speech side of Utter's data:

  • the corpus* collections are the audio behind ductai199x/dictation-to-text, one clip per text pair (join rendition_id to its id), each in its pair's split;
  • the other collections are the eval sets Utter's models are measured on, all test, including voices (Chatterbox) no training clip uses.

Dataset structure

splitclipshours
train79,246435
test24,240128

Configs: all (the default: every collection, train and test) and one per collection:

collectiontraintesthourscategories
corpus15,8571,992122.1command, correction, disfluent, explicit, natural, restate
corpus-v224,4193,081150.7command, correction, disfluent, explicit, natural, restate
corpus-messages11,0801,39866.6amend, command, correction, disfluent, explicit, grammar, natural, restate
corpus-amend7,49994746.2amend
corpus-grammar7,7591,01840.1grammar
corpus-grammar29,1021,11346.0grammar
corpus-lists3,53044617.5list
kokoro4,64224.7command, correction, disfluent, explicit, natural
kokoro-amend1,1666.4amend
kokoro-directed2921.4disfluent, natural
kokoro-grammar6763.2grammar
kokoro-lists8033.5list
kokoro-real9374.1amend, command, correction, disfluent, explicit, grammar, natural
kokoro-restate5634.5restate
chatterbox4,22921.8command, correction, disfluent, explicit, natural
chatterbox-real9373.8amend, command, correction, disfluent, explicit, grammar, natural

The same rendition can be in more than one test collection (spoken by both engines, or in a focused set and the main one); id is unique, rendition_id is shared. No rendition and no passage is in both splits.

columntypemeaning
idstring<collection>/<rendition id>, unique
rendition_idstring<passage id>-<category>; the id of the same row in dictation-to-text
audioAudio (16 kHz)the clip, FLAC
duration_sfloat32its length
languagestringen
transcriptstringexactly what was said, as spoken (numbers and symbols in words)
final_textstringthe text the speaker meant to type
categorystringhow it was spoken (below)
domainstringwhat the passage is
annotationslist of stringswhat the rendition contains, as key=value (e.g. fillers=2, false_start=1, errors=VERB:SVA, op=value)
tts_enginestringkokoro-82m (98,320), chatterbox-0.1.7 (5,166)
tts_voicestringthe voice (Kokoro's voice name, or a numbered donated reference voice for Chatterbox)
tts_settingslist of stringsspeed= (Kokoro) or exaggeration= (Chatterbox); audio=regenerated on clips spoken again (below)
collectionstringthe set it belongs to
sourcestringwhere the passage came from
source_urlstringthe passage's page (for passages Utter's tools wrote, the script that wrote them)
licensestringthe passage's license

Categories:

categoryspokenclips
grammarwith the grammar slips of real speakers, to be corrected21,131
disfluentwith fillers, repeats and false starts11,901
commandwith a spoken editing command ("scratch that")11,826
naturalthe passage said plainly11,669
amendwith a later edit to something said earlier11,533
correctionwith a spoken self-correction ("three, no, four")11,522
explicitwith spoken punctuation ("comma", "new paragraph")11,408
restatesaid again in other words partway through7,717
lista list, spoken item by item4,779

Sources and licensing

sourceclips
common-pile/stackexchange36,354
synthetic19,690
common-pile/arxiv_abstracts17,740
common-pile/ubuntu_irc15,133
wikimedia/wikipedia14,569
licenseclips
cc-by-sa-4.042,611
cc-by-sa-3.020,888
cc0-1.017,740
public-domain15,133
cc-by-sa-2.57,114

The dataset is CC BY-SA 4.0, as most of its text requires; each row keeps its passage's license and source URL (the page with the passage and its author).

The speech: Kokoro-82M is Apache-2.0, and its output is unrestricted; Chatterbox (MIT) cloned voices from kyutai/tts-voices (voice-donations, CC0: recordings people donated to the public domain).

Dataset creation

  1. Passages (Common Pile, Wikipedia, and everyday messages written for the dataset), rewritten as spoken renditions by a language model (Gemma 4 26B) in the categories above.
  2. Spoken by Kokoro-82M (twelve English voices, rate 0.9-1.1, chosen per rendition by a hash of its id) or Chatterbox (voice-cloned from Kyutai's CC0 donated voices, exaggeration varied), resampled to 16 kHz, with 0.25 s of silence around.
  3. 6,135 corpus clips (audio=regenerated) are a second synthesis with the same text, voice and speed: the same content and length to within a few hundredths of a second, not the same samples as the audio dictation-to-text's transcripts were made from.
  4. Final texts: the passage, with grammar corrected for the grammar category and mechanical punctuation slips fixed; the same as dictation-to-text's.

Personal and sensitive information

All speech is synthetic; no recording of a real person is included. The Chatterbox voices imitate recordings people donated to the public domain (kyutai/tts-voices); they are numbered here, not named, and must not be used to identify or impersonate the donors. Passage text from public posts can contain the usernames their writers published.

Bias, risks and limitations

  • English only; synthetic voices (twelve Kokoro voices and a small set of donated ones), so real accents, rooms and microphones are not represented. Use it for dictation formatting and cleanup, and as an ASR stress test, not as a substitute for real speech.
  • Technical forums are overrepresented next to everyday writing.

Use

from datasets import load_dataset

test = load_dataset("ductai199x/dictation-speech", split="test")             # every eval collection
amend = load_dataset("ductai199x/dictation-speech", "kokoro-amend", split="test")
row = test[0]; row["audio"]["array"], row["transcript"], row["final_text"]

Citation

@misc{nguyen2026dictationspeech,
  author       = {Tai Duc Nguyen},
  title        = {Dictation Speech},
  year         = {2026},
  publisher    = {Hugging Face},
  howpublished = {\url{https://huggingface.co/datasets/ductai199x/dictation-speech}}
}
audio
dictation
disfluency
self-correction
speech
synthetic-speech