Datasets
62 records·Datasets, corpora and benchmarks for music and audio AI — with license, provenance and known limitations.
| Name | Type | Geography | Status | Checked |
|---|---|---|---|---|
| AcousticBrainz Crowdsourced low- and high-level acoustic descriptors indexed by MusicBrainz recording identifiers. | crowdsourced music features | Spain | active | 0d ago |
| AcousticBrainz Genre Dataset Four genre-annotation datasets joining AcousticBrainz features with AllMusic, Discogs, Last.fm and Tagtraum labels. | genre benchmark | Spain | active | 0d ago |
| AudioCaps Crowdsourced natural-language captions paired with AudioSet-derived audio clips. | audio captions | South Korea | active | 0d ago |
| AudioSet Human-labeled ten-second YouTube segments spanning music, speech and environmental sound classes. | audio event labels | United States | active | 0d ago |
| Bach Doodle Dataset User-entered melodies and model-generated four-voice harmonizations contributed through the 2019 Bach Doodle. | user contributed symbolic music | United States | active | 0d ago |
| CMI-Bench A test-only benchmark converting diverse MIR tasks into standardized music instruction-following evaluation. | music instruction following | Global | active | 0d ago |
| CMI-RewardBench Preference data and evaluation for reward models scoring musicality, text alignment and compositional instruction following. | music reward modeling | Global | active | 0d ago |
| Cadenza Lyric Intelligibility Prediction Dataset Popular-music signals with lyrics and listener-derived intelligibility scores for the ICASSP 2026 Cadenza Challenge. | lyric intelligibility | United Kingdom | active | 0d ago |
| CocoChorales Synthetic four-part chamber-ensemble music with mixtures, stems, MIDI and fine-grained performance annotations. | synthetic multitrack music | United States | active | 0d ago |
| CtrSVDD Controlled singing-voice deepfake corpus generated from public singing data with synthesis and voice-conversion systems. | controlled singing deepfake | Global | active | 0d ago |
| DALI Full-song lyric, vocal-note and audio alignments at note, word, line and paragraph granularity. | aligned lyrics notes | France | active | 0d ago |
| DEAM Music excerpts and full songs with continuous and song-level valence and arousal annotations. | music emotion | Europe | active | 0d ago |
| EMOPIA Pop-piano audio and MIDI clips labeled for perceived emotion, supporting recognition and emotion-conditioned generation. | music emotion audio midi | Taiwan | active | 0d ago |
| Expanded Groove MIDI Dataset Expanded human drum-performance corpus with MIDI-aligned audio rendered across 43 drum kits. | aligned drum audio midi | United States | active | 0d ago |
| FSD50K Open human-labeled Freesound clips across 200 AudioSet-ontology classes, including many musical sounds. | sound event audio | Spain | active | 0d ago |
| FakeMusicCaps MusicCaps prompts regenerated with multiple text-to-music systems for synthetic-music detection and generator attribution. | synthetic music detection | Italy | active | 0d ago |
| Free Music Archive Dataset Full-length Creative Commons music with audio, features, metadata and hierarchical genre labels for MIR. | creative commons music audio | Global | active | 0d ago |
| GAPS Classical-guitar audio, scores and high-resolution MIDI alignments for transcription research. | guitar audio score alignment | United Kingdom | active | 0d ago |
| GiantMIDI-Piano Machine-transcribed solo-piano MIDI derived from web recordings and IMSLP work metadata. | machine transcribed piano midi | Global | active | 0d ago |
| Groove MIDI Dataset Human-performed expressive drum MIDI with aligned synthesized audio and performance metadata. | drum performance midi | United States | active | 0d ago |
| GuitarSet Acoustic-guitar recordings with hexaphonic audio and time-aligned note, chord, beat and technique annotations. | guitar transcription | United States | active | 0d ago |
| HEAR 2021 A NeurIPS challenge and evaluation suite for general-purpose audio representations across speech, sound and music tasks. | general audio representation | United States | active | 0d ago |
| ICASSP 2026 Automatic Song Aesthetics Evaluation Challenge A completed grand challenge for predicting overall and five fine-grained human aesthetic ratings of AI-generated songs. | song aesthetics prediction | Global | closed | 0d ago |
| ICASSP 2026 Cadenza Challenge A completed challenge to predict lyric intelligibility for popular music, including listeners with hearing loss. | lyric intelligibility prediction | United Kingdom | closed | 0d ago |
| Lakh MIDI Dataset Large deduplicated MIDI collection with matched and aligned subsets linked to the Million Song Dataset. | symbolic music | United States | active | 0d ago |
| M6 Multi-generator, multi-domain, multilingual, multicultural, multi-genre and multi-instrument music-detection databases. | machine generated music detection | Global | active | 0d ago |
| MADB Large music-aesthetics benchmark with multi-dimensional professional ratings and textual comments. | music aesthetics | Global | active | 0d ago |
| MAESTRO Paired piano audio and high-precision MIDI from International Piano-e-Competition performances. | aligned piano audio midi | United States | active | 0d ago |
| MARBLE A unified evaluation suite for pretrained music-audio representations across acoustic, performance, score and high-level tasks. | music audio representation | Global | active | 0d ago |
| MIREX 2025 Music Description and Captioning A MIREX task evaluating systems that generate natural-language descriptions for music audio. | music description captioning | United States | superseded | 0d ago |
| MMAU A multi-domain benchmark of expert audio understanding and reasoning spanning speech, environmental sound and music. | general audio reasoning | United States | active | 0d ago |
| MMAU-Pro Expert-created audio questions covering speech, sound, music, mixtures, spatial audio and long-form reasoning. | general audio reasoning | United States | active | 0d ago |
| MTG-Jamendo Dataset | audio tags | unknown | active | 1d ago |
| MUSDB18 Full-length stereo music mixtures with isolated drums, bass, vocals and other stems for source separation. | music source separation | Global | active | 0d ago |
| MagnaTagATune Magnatune audio clips with human tags collected through the TagATune game for music auto-tagging research. | music autotagging | Global | active | 0d ago |
| McGill Billboard Project Chord, structure and feature annotations for a sampled set of Billboard-chart songs. | chord structure annotations | Canada | active | 0d ago |
| MedleyDB Annotated royalty-free multitrack recordings supporting melody, pitch, instrument and source-separation research. | multitrack music | United States | active | 0d ago |
| Million Song Dataset Audio features and metadata for one million contemporary popular-music tracks, without distributed audio. | music features metadata | United States | active | 0d ago |
| MuChoMusic Human-validated multiple-choice questions for evaluating music understanding and reasoning in audio-language models. | music audio language qa | Global | active | 0d ago |
| Music Arena A live pairwise evaluation platform and rolling leaderboard for text-to-music generation systems. | live text to music preference | United States | active | 0d ago |
| Music Arena Dataset Rolling human preference data from live pairwise comparisons of text-to-music model outputs. | human music preferences | United States | active | 0d ago |
| Music4All-Onion Multimodal music features and large-scale Last.fm listening histories extending Music4All. | multimodal music recommendation | Europe | active | 0d ago |
| MusicBench Music audio-text pairs expanding MusicCaps with extracted musical features and augmentation for controllable generation. | text to music training | Singapore | active | 0d ago |
| MusicCaps Dataset of 5.5k music clips with expert-written text captions | audio captions | unknown | active | 1d ago |
| MusicNet Classical recordings aligned to score-derived note, instrument and metrical-position labels. | classical note annotation | United States | active | 0d ago |
| NSynth Dataset Annotated four-second musical-note audio for timbre modeling, synthesis, and audio representation research. | instrument note audio | United States | active | 0d ago |
| OpenMIC-2018 Creative Commons music excerpts partially labeled for presence or absence of 20 instrument classes. | instrument recognition | United States | active | 0d ago |
| PDMX Large MusicXML collection of scores labeled public domain, with score and user-interaction metadata. | public domain musicxml | United States | active | 0d ago |
| POP909 Professional piano arrangements of 909 popular songs with aligned MIDI and structural annotations. | symbolic pop arrangement | China | active | 0d ago |
| SALAMI Hierarchical expert structural annotations for a large and stylistically diverse music collection. | music structure annotations | Canada | active | 0d ago |
| SVDD Challenge 2024 The inaugural controlled and in-the-wild singing-voice deepfake detection challenge held with IEEE SLT 2024. | singing voice deepfake detection | Global | closed | 0d ago |
| SingFake In-the-wild real and deepfake singing data for singing-voice authenticity detection. | singing voice deepfake | United States | active | 0d ago |
| Slakh2100 Synthetic multitrack audio and aligned MIDI rendered from Lakh MIDI files for separation and transcription. | synthetic multitrack music | United States | active | 0d ago |
| Song Describer Dataset Crowdsourced human descriptions of Creative Commons music for music-language evaluation. | music captions | Global | active | 0d ago |
| SongEval Full-length real and generated songs with expert ratings across five aesthetic dimensions. | song aesthetics | China | active | 0d ago |
| Sound Demixing Challenge 2023 A completed AIcrowd challenge with music and cinematic source-separation tracks and hidden evaluation sets. | sound demixing | Global | closed | 0d ago |
| Spotify Million Playlist Dataset One million anonymized public playlists released for automatic playlist continuation research. | playlist recommendation | United States | active | 0d ago |
| Suno Music Generation Dataset Metadata and downloadable links for 659,788 Suno-generated songs discovered through systematic search queries. | ai generated music links | Global | active | 0d ago |
| URMP Dataset Coordinated multi-instrument classical performances with separated audio, assembled video, scores and pitch annotations. | multimodal music performance | United States | active | 0d ago |
| VocalSet A cappella singing recordings across singers, vowels, registers and vocal techniques, with a corrected annotated derivative. | singing voice | United States | active | 0d ago |
| WavCaps Large weakly labeled audio-caption corpus assembled from web sound libraries and AudioSet, with ChatGPT-assisted caption cleaning. | weak audio captions | United Kingdom | active | 0d ago |
| WildSVDD In-the-wild singing voice deepfake detection data extending SingFake for the SVDD 2024 challenge. | in the wild singing deepfake | United States | active | 0d ago |
