music-arena/music-arena-dataset

Dataset

7

stars

100

commits

1

linked in READMEs

Aug 9, 2026

updated

audio
human-feedback
music
preference-data
text-to-music
Browse cluster: Music Audio and Synthesis Tools

README

Music Arena Dataset

This is the official dataset from Music Arena, an open platform for evaluating text-to-music (TTM) models.

The most reliable way to get a complete local copy of all files, including the entire audio collection, is to clone the repository directly using Git. This method is ideal for offline access and workflows that require direct file manipulation.

Note: This repository uses Git LFS (Large File Storage) to manage the audio files. You must have Git LFS installed to download the audio files correctly.

# First, install Git LFS if you haven't already
# On Debian/Ubuntu: sudo apt-get install git-lfs
# On macOS: brew install git-lfs
git lfs install

# Clone the repository
git clone https://huggingface.co/datasets/music-arena/music-arena-dataset

⚠️ Note on Audio File Availability

Audio files generated by the following models are not included in this public data release due to specific release agreements:

  • sao
  • sao-small

The JSON metadata for battles involving these models is still included, but the audio_a and audio_b fields will be empty (null) for these specific files.

Dataset Structure

The dataset consists of a series of JSON files, each representing a single user battle. The data is stored in a flat (non-nested) structure for easy parsing.

Each row corresponds to one .json file with the following fields:

Basic Information

  • battle_uuid (string): The unique ID for the battle.
  • date (string): The ISO 8601 timestamp of when the battle occurred.
  • timestamp (float): The Unix timestamp of the battle, useful for precise sorting.
  • prompt (string): The text prompt provided by the user.
  • lyrics (string): Lyrics extracted from the prompt (if applicable).
  • is_instrumental (bool): Whether the prompt was determined to imply an instrumental track.
  • is_prebaked (bool): Whether the prompt was selected from a pre-defined list (True) or written by the user (False).
  • user_pseudonym (string): Anonymized user ID (salted and hashed IP) allowing for longitudinal analysis.

Model & Audio A

  • system_a (string): The name of the model that generated audio_a.
  • hardware_a (string): The hardware or API environment used for generation (e.g., "A6000", "A5000", or "Unknown (API)").
  • system_time_a (float): Pure GPU/compute time in seconds (model inference only).
  • gateway_time_a (float): User-perceived generation time in seconds (includes network overhead, queue wait). Used for leaderboard RTF calculation.
  • audio_a (audio): The path to the audio file for model A. Will be null if the audio is not publicly released.
  • duration_a (float): Duration of the audio track for model A in seconds.
  • total_listening_time_a (float): The total time in seconds the user spent listening to audio_a.
  • listen_data_a (string): A JSON-formatted string containing detailed logs of play/pause/seek events for audio_a.
  • sample_rate_a (int): The sampling rate of the generated audio_a.

Model & Audio B

  • system_b (string): The name of the model that generated audio_b.
  • hardware_b (string): The hardware or API environment used for generation (e.g., "A6000", "A5000", or "Unknown (API)").
  • system_time_b (float): Pure GPU/compute time in seconds (model inference only).
  • gateway_time_b (float): User-perceived generation time in seconds (includes network overhead, queue wait). Used for leaderboard RTF calculation.
  • audio_b (audio): The path to the audio file for model B. Will be null if the audio is not publicly released.
  • duration_b (float): Duration of the audio track for model B in seconds.
  • total_listening_time_b (float): The total time in seconds the user spent listening to audio_b.
  • listen_data_b (string): A JSON-formatted string containing detailed logs of play/pause/seek events for audio_b.
  • sample_rate_b (int): The sampling rate of the generated audio_b.

Evaluation & Tech Specs

  • preference (string): The user's vote, one of: "A", "B", "TIE", or "BOTH_BAD".
  • feedback (string): Optional text feedback provided by the user (can be an empty string).

Platform and Resources

Music Arena is fully open-source. You can find more information through the links below:

Citation

If you use this dataset in your research, please cite the following paper:

@inproceedings{kim2025musicarena,
    title={Music Arena: Live Evaluation for Text-to-Music},
    author={Yonghyun Kim and Wayne Chi and Anastasios Angelopoulos and Wei-Lin Chiang and Koichi Saito and Shinji Watanabe and Yuki Mitsufuji and Chris Donahue},
    booktitle={Advances in Neural Information Processing Systems 38 (NeurIPS 2025)},
    year={2025},
    note={Creative AI Track},
    eprint={2507.20900},
    archiveprefix={arXiv}
}

Acknowledgements and Disclosure of Funding Music Arena is supported by funding from Sony AI, with informal and pro-bono assistance provided by LMArena. We extend our sincere thanks to our commercial contacts at Producer.ai (ex-Riffusion), Stability AI, Google DeepMind, and Suno for productive discussions that informed the key features and policies of Music Arena. Music Arena is approved by CMU's Institutional Review Board under Protocol STUDY2024_00000489.

Contributors

yonghyunk1m

95 commits

chrisdonahue

5 commits

music-arena/music-arena-dataset

Dataset

7

stars

100

commits

1

linked in READMEs

Aug 9, 2026

updated

audio
human-feedback
music
preference-data
text-to-music
Browse cluster: Music Audio and Synthesis Tools

README

Music Arena Dataset

This is the official dataset from Music Arena, an open platform for evaluating text-to-music (TTM) models.

The most reliable way to get a complete local copy of all files, including the entire audio collection, is to clone the repository directly using Git. This method is ideal for offline access and workflows that require direct file manipulation.

Note: This repository uses Git LFS (Large File Storage) to manage the audio files. You must have Git LFS installed to download the audio files correctly.

# First, install Git LFS if you haven't already
# On Debian/Ubuntu: sudo apt-get install git-lfs
# On macOS: brew install git-lfs
git lfs install

# Clone the repository
git clone https://huggingface.co/datasets/music-arena/music-arena-dataset

⚠️ Note on Audio File Availability

Audio files generated by the following models are not included in this public data release due to specific release agreements:

  • sao
  • sao-small

The JSON metadata for battles involving these models is still included, but the audio_a and audio_b fields will be empty (null) for these specific files.

Dataset Structure

The dataset consists of a series of JSON files, each representing a single user battle. The data is stored in a flat (non-nested) structure for easy parsing.

Each row corresponds to one .json file with the following fields:

Basic Information

  • battle_uuid (string): The unique ID for the battle.
  • date (string): The ISO 8601 timestamp of when the battle occurred.
  • timestamp (float): The Unix timestamp of the battle, useful for precise sorting.
  • prompt (string): The text prompt provided by the user.
  • lyrics (string): Lyrics extracted from the prompt (if applicable).
  • is_instrumental (bool): Whether the prompt was determined to imply an instrumental track.
  • is_prebaked (bool): Whether the prompt was selected from a pre-defined list (True) or written by the user (False).
  • user_pseudonym (string): Anonymized user ID (salted and hashed IP) allowing for longitudinal analysis.

Model & Audio A

  • system_a (string): The name of the model that generated audio_a.
  • hardware_a (string): The hardware or API environment used for generation (e.g., "A6000", "A5000", or "Unknown (API)").
  • system_time_a (float): Pure GPU/compute time in seconds (model inference only).
  • gateway_time_a (float): User-perceived generation time in seconds (includes network overhead, queue wait). Used for leaderboard RTF calculation.
  • audio_a (audio): The path to the audio file for model A. Will be null if the audio is not publicly released.
  • duration_a (float): Duration of the audio track for model A in seconds.
  • total_listening_time_a (float): The total time in seconds the user spent listening to audio_a.
  • listen_data_a (string): A JSON-formatted string containing detailed logs of play/pause/seek events for audio_a.
  • sample_rate_a (int): The sampling rate of the generated audio_a.

Model & Audio B

  • system_b (string): The name of the model that generated audio_b.
  • hardware_b (string): The hardware or API environment used for generation (e.g., "A6000", "A5000", or "Unknown (API)").
  • system_time_b (float): Pure GPU/compute time in seconds (model inference only).
  • gateway_time_b (float): User-perceived generation time in seconds (includes network overhead, queue wait). Used for leaderboard RTF calculation.
  • audio_b (audio): The path to the audio file for model B. Will be null if the audio is not publicly released.
  • duration_b (float): Duration of the audio track for model B in seconds.
  • total_listening_time_b (float): The total time in seconds the user spent listening to audio_b.
  • listen_data_b (string): A JSON-formatted string containing detailed logs of play/pause/seek events for audio_b.
  • sample_rate_b (int): The sampling rate of the generated audio_b.

Evaluation & Tech Specs

  • preference (string): The user's vote, one of: "A", "B", "TIE", or "BOTH_BAD".
  • feedback (string): Optional text feedback provided by the user (can be an empty string).

Platform and Resources

Music Arena is fully open-source. You can find more information through the links below:

Citation

If you use this dataset in your research, please cite the following paper:

@inproceedings{kim2025musicarena,
    title={Music Arena: Live Evaluation for Text-to-Music},
    author={Yonghyun Kim and Wayne Chi and Anastasios Angelopoulos and Wei-Lin Chiang and Koichi Saito and Shinji Watanabe and Yuki Mitsufuji and Chris Donahue},
    booktitle={Advances in Neural Information Processing Systems 38 (NeurIPS 2025)},
    year={2025},
    note={Creative AI Track},
    eprint={2507.20900},
    archiveprefix={arXiv}
}

Acknowledgements and Disclosure of Funding Music Arena is supported by funding from Sony AI, with informal and pro-bono assistance provided by LMArena. We extend our sincere thanks to our commercial contacts at Producer.ai (ex-Riffusion), Stability AI, Google DeepMind, and Suno for productive discussions that informed the key features and policies of Music Arena. Music Arena is approved by CMU's Institutional Review Board under Protocol STUDY2024_00000489.

Contributors

yonghyunk1m

95 commits

chrisdonahue

5 commits