Datasets

62 records·Datasets, corpora and benchmarks for music and audio AI — with license, provenance and known limitations.

NameTypeGeographyStatusChecked
AcousticBrainz
Crowdsourced low- and high-level acoustic descriptors indexed by MusicBrainz recording identifiers.
crowdsourced music featuresSpainactive0d ago
AcousticBrainz Genre Dataset
Four genre-annotation datasets joining AcousticBrainz features with AllMusic, Discogs, Last.fm and Tagtraum labels.
genre benchmarkSpainactive0d ago
AudioCaps
Crowdsourced natural-language captions paired with AudioSet-derived audio clips.
audio captionsSouth Koreaactive0d ago
AudioSet
Human-labeled ten-second YouTube segments spanning music, speech and environmental sound classes.
audio event labelsUnited Statesactive0d ago
Bach Doodle Dataset
User-entered melodies and model-generated four-voice harmonizations contributed through the 2019 Bach Doodle.
user contributed symbolic musicUnited Statesactive0d ago
CMI-Bench
A test-only benchmark converting diverse MIR tasks into standardized music instruction-following evaluation.
music instruction followingGlobalactive0d ago
CMI-RewardBench
Preference data and evaluation for reward models scoring musicality, text alignment and compositional instruction following.
music reward modelingGlobalactive0d ago
Cadenza Lyric Intelligibility Prediction Dataset
Popular-music signals with lyrics and listener-derived intelligibility scores for the ICASSP 2026 Cadenza Challenge.
lyric intelligibilityUnited Kingdomactive0d ago
CocoChorales
Synthetic four-part chamber-ensemble music with mixtures, stems, MIDI and fine-grained performance annotations.
synthetic multitrack musicUnited Statesactive0d ago
CtrSVDD
Controlled singing-voice deepfake corpus generated from public singing data with synthesis and voice-conversion systems.
controlled singing deepfakeGlobalactive0d ago
DALI
Full-song lyric, vocal-note and audio alignments at note, word, line and paragraph granularity.
aligned lyrics notesFranceactive0d ago
DEAM
Music excerpts and full songs with continuous and song-level valence and arousal annotations.
music emotionEuropeactive0d ago
EMOPIA
Pop-piano audio and MIDI clips labeled for perceived emotion, supporting recognition and emotion-conditioned generation.
music emotion audio midiTaiwanactive0d ago
Expanded Groove MIDI Dataset
Expanded human drum-performance corpus with MIDI-aligned audio rendered across 43 drum kits.
aligned drum audio midiUnited Statesactive0d ago
FSD50K
Open human-labeled Freesound clips across 200 AudioSet-ontology classes, including many musical sounds.
sound event audioSpainactive0d ago
FakeMusicCaps
MusicCaps prompts regenerated with multiple text-to-music systems for synthetic-music detection and generator attribution.
synthetic music detectionItalyactive0d ago
Free Music Archive Dataset
Full-length Creative Commons music with audio, features, metadata and hierarchical genre labels for MIR.
creative commons music audioGlobalactive0d ago
GAPS
Classical-guitar audio, scores and high-resolution MIDI alignments for transcription research.
guitar audio score alignmentUnited Kingdomactive0d ago
GiantMIDI-Piano
Machine-transcribed solo-piano MIDI derived from web recordings and IMSLP work metadata.
machine transcribed piano midiGlobalactive0d ago
Groove MIDI Dataset
Human-performed expressive drum MIDI with aligned synthesized audio and performance metadata.
drum performance midiUnited Statesactive0d ago
GuitarSet
Acoustic-guitar recordings with hexaphonic audio and time-aligned note, chord, beat and technique annotations.
guitar transcriptionUnited Statesactive0d ago
HEAR 2021
A NeurIPS challenge and evaluation suite for general-purpose audio representations across speech, sound and music tasks.
general audio representationUnited Statesactive0d ago
ICASSP 2026 Automatic Song Aesthetics Evaluation Challenge
A completed grand challenge for predicting overall and five fine-grained human aesthetic ratings of AI-generated songs.
song aesthetics predictionGlobalclosed0d ago
ICASSP 2026 Cadenza Challenge
A completed challenge to predict lyric intelligibility for popular music, including listeners with hearing loss.
lyric intelligibility predictionUnited Kingdomclosed0d ago
Lakh MIDI Dataset
Large deduplicated MIDI collection with matched and aligned subsets linked to the Million Song Dataset.
symbolic musicUnited Statesactive0d ago
M6
Multi-generator, multi-domain, multilingual, multicultural, multi-genre and multi-instrument music-detection databases.
machine generated music detectionGlobalactive0d ago
MADB
Large music-aesthetics benchmark with multi-dimensional professional ratings and textual comments.
music aestheticsGlobalactive0d ago
MAESTRO
Paired piano audio and high-precision MIDI from International Piano-e-Competition performances.
aligned piano audio midiUnited Statesactive0d ago
MARBLE
A unified evaluation suite for pretrained music-audio representations across acoustic, performance, score and high-level tasks.
music audio representationGlobalactive0d ago
MIREX 2025 Music Description and Captioning
A MIREX task evaluating systems that generate natural-language descriptions for music audio.
music description captioningUnited Statessuperseded0d ago
MMAU
A multi-domain benchmark of expert audio understanding and reasoning spanning speech, environmental sound and music.
general audio reasoningUnited Statesactive0d ago
MMAU-Pro
Expert-created audio questions covering speech, sound, music, mixtures, spatial audio and long-form reasoning.
general audio reasoningUnited Statesactive0d ago
MTG-Jamendo Datasetaudio tagsunknownactive1d ago
MUSDB18
Full-length stereo music mixtures with isolated drums, bass, vocals and other stems for source separation.
music source separationGlobalactive0d ago
MagnaTagATune
Magnatune audio clips with human tags collected through the TagATune game for music auto-tagging research.
music autotaggingGlobalactive0d ago
McGill Billboard Project
Chord, structure and feature annotations for a sampled set of Billboard-chart songs.
chord structure annotationsCanadaactive0d ago
MedleyDB
Annotated royalty-free multitrack recordings supporting melody, pitch, instrument and source-separation research.
multitrack musicUnited Statesactive0d ago
Million Song Dataset
Audio features and metadata for one million contemporary popular-music tracks, without distributed audio.
music features metadataUnited Statesactive0d ago
MuChoMusic
Human-validated multiple-choice questions for evaluating music understanding and reasoning in audio-language models.
music audio language qaGlobalactive0d ago
Music Arena
A live pairwise evaluation platform and rolling leaderboard for text-to-music generation systems.
live text to music preferenceUnited Statesactive0d ago
Music Arena Dataset
Rolling human preference data from live pairwise comparisons of text-to-music model outputs.
human music preferencesUnited Statesactive0d ago
Music4All-Onion
Multimodal music features and large-scale Last.fm listening histories extending Music4All.
multimodal music recommendationEuropeactive0d ago
MusicBench
Music audio-text pairs expanding MusicCaps with extracted musical features and augmentation for controllable generation.
text to music trainingSingaporeactive0d ago
MusicCaps
Dataset of 5.5k music clips with expert-written text captions
audio captionsunknownactive1d ago
MusicNet
Classical recordings aligned to score-derived note, instrument and metrical-position labels.
classical note annotationUnited Statesactive0d ago
NSynth Dataset
Annotated four-second musical-note audio for timbre modeling, synthesis, and audio representation research.
instrument note audioUnited Statesactive0d ago
OpenMIC-2018
Creative Commons music excerpts partially labeled for presence or absence of 20 instrument classes.
instrument recognitionUnited Statesactive0d ago
PDMX
Large MusicXML collection of scores labeled public domain, with score and user-interaction metadata.
public domain musicxmlUnited Statesactive0d ago
POP909
Professional piano arrangements of 909 popular songs with aligned MIDI and structural annotations.
symbolic pop arrangementChinaactive0d ago
SALAMI
Hierarchical expert structural annotations for a large and stylistically diverse music collection.
music structure annotationsCanadaactive0d ago
SVDD Challenge 2024
The inaugural controlled and in-the-wild singing-voice deepfake detection challenge held with IEEE SLT 2024.
singing voice deepfake detectionGlobalclosed0d ago
SingFake
In-the-wild real and deepfake singing data for singing-voice authenticity detection.
singing voice deepfakeUnited Statesactive0d ago
Slakh2100
Synthetic multitrack audio and aligned MIDI rendered from Lakh MIDI files for separation and transcription.
synthetic multitrack musicUnited Statesactive0d ago
Song Describer Dataset
Crowdsourced human descriptions of Creative Commons music for music-language evaluation.
music captionsGlobalactive0d ago
SongEval
Full-length real and generated songs with expert ratings across five aesthetic dimensions.
song aestheticsChinaactive0d ago
Sound Demixing Challenge 2023
A completed AIcrowd challenge with music and cinematic source-separation tracks and hidden evaluation sets.
sound demixingGlobalclosed0d ago
Spotify Million Playlist Dataset
One million anonymized public playlists released for automatic playlist continuation research.
playlist recommendationUnited Statesactive0d ago
Suno Music Generation Dataset
Metadata and downloadable links for 659,788 Suno-generated songs discovered through systematic search queries.
ai generated music linksGlobalactive0d ago
URMP Dataset
Coordinated multi-instrument classical performances with separated audio, assembled video, scores and pitch annotations.
multimodal music performanceUnited Statesactive0d ago
VocalSet
A cappella singing recordings across singers, vowels, registers and vocal techniques, with a corrected annotated derivative.
singing voiceUnited Statesactive0d ago
WavCaps
Large weakly labeled audio-caption corpus assembled from web sound libraries and AudioSet, with ChatGPT-assisted caption cleaning.
weak audio captionsUnited Kingdomactive0d ago
WildSVDD
In-the-wild singing voice deepfake detection data extending SingFake for the SVDD 2024 challenge.
in the wild singing deepfakeUnited Statesactive0d ago