Research

70 records·Papers, projects and labs in AI music research — linked to the models, datasets and people they involve.

NameTypeGeographyStatusChecked
A Foundation Model for Music Informatics
Research work examining music retrieval, music/audio understanding.
research paperGlobalactive0d ago
A Lightweight Instrument-Agnostic Model for Polyphonic Note Transcription and Multipitch Estimation
Research work examining evaluation benchmark, music transcription.
research paperGlobalactive0d ago
AVATAR
Machine-learning-aided performance system that listens to live audio and plays collaboratively with a human musician.
interactive music research projectUnited Statesactive0d ago
AnyAudio-Judge: A Dynamic Rubric-Based Benchmark and Evaluator for Audio Instruction Following
Research work examining audio generation, evaluation benchmark.
benchmark studyGlobalactive0d ago
AudioCraft
Meta research library for deep-learning audio processing and generation, including MusicGen, AudioGen, EnCodec, and MAGNeT.
research code frameworkUnited Statesactive0d ago
AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining
Research work examining audio generation, evaluation benchmark.
research paperGlobalactive0d ago
AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
Research work examining audio generation, music/audio representation learning.
research paperGlobalactive0d ago
Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Features
Research work examining evaluation benchmark, music/audio representation learning.
provenance detection paperGlobalactive0d ago
CLAP: Learning Audio Concepts From Natural Language Supervision
Research work examining music/audio AI research.
research paperGlobalactive0d ago
ChatMusician: Understanding and Generating Music Intrinsically with LLM
Research work examining evaluation benchmark, music/audio representation learning.
research paperGlobalactive0d ago
ComMU: Dataset for Combinatorial Music Generation
Research work examining music generation, symbolic music.
dataset paperGlobalactive0d ago
DeRA-MOS: Optimizing Text-to-Music Evaluation via Decoupled Listwise Ranking and Modality Alignment
Research work examining text-to-music generation.
research paperGlobalactive0d ago
Efficient Neural Music Generation
Research work examining music generation.
research paperGlobalactive0d ago
FIGARO: Generating Symbolic Music with Fine-Grained Artistic Control
Research work examining music generation, symbolic music.
research paperGlobalactive0d ago
Fast Timing-Conditioned Latent Audio Diffusion
Research work examining evaluation benchmark, text-to-music generation.
research paperGlobalactive0d ago
GETMusic: Generating Any Music Tracks with a Unified Representation and Diffusion Framework
Research work examining music generation, music/audio representation learning.
research paperGlobalactive0d ago
HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmark
Research work examining evaluation benchmark, synthetic-audio detection.
benchmark studyGlobalactive0d ago
Improving Text-to-Music Generation with Human Preference Rewards
Research work examining music generation, text-to-music generation.
research paperGlobalactive0d ago
Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning
Research work examining music/audio editing, text-to-music generation.
research paperGlobalactive0d ago
JEN-1: Text-Guided Universal Music Generation with Omnidirectional Diffusion Models
Research work examining music generation, text-to-music generation.
research paperGlobalactive0d ago
LLark: A Multimodal Instruction-Following Language Model for Music
Research work examining music/audio understanding.
research paperGlobalactive0d ago
Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentation
Research work examining music retrieval, music/audio representation learning.
research paperGlobalactive0d ago
Libretto: Giving LLM Agents a Sense of Musical Structure
Research work examining music generation, music retrieval.
research paperGlobalactive0d ago
LiveBand: Live Accompaniment Generation in the Audio Domain
Research work examining automatic accompaniment, evaluation benchmark.
research paperGlobalactive0d ago
Local Multimodal Music Alignment from Global Supervision
Research work examining music retrieval, music/audio understanding.
research paperGlobalactive0d ago
Loop Copilot: Conducting AI Ensembles for Music Generation and Iterative Editing
Research work examining music generation, music/audio editing.
research paperGlobalactive0d ago
MADB: A Large-Scale Music Aesthetics Dataset with Professional and Multi-Dimensional Annotations
Research work examining evaluation benchmark, music/audio understanding.
dataset paperGlobalactive0d ago
MAP-Music2Vec: A Simple and Effective Baseline for Self-Supervised Music Audio Representation Learning
Research work examining music/audio representation learning.
research paperGlobalactive0d ago
MARBLE: Music Audio Representation Benchmark for Universal Evaluation
Research work examining evaluation benchmark, music retrieval.
benchmark studyGlobalactive0d ago
MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training
Research work examining music/audio understanding.
research paperGlobalactive0d ago
MMAE: A Massive Multitask Audio Editing Benchmark
Research work examining evaluation benchmark, music/audio editing.
benchmark studyGlobalactive0d ago
MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark
Research work examining evaluation benchmark, music/audio understanding.
benchmark studyGlobalactive0d ago
MT3: Multi-Task Multitrack Music Transcription
Research work examining music transcription, music/audio understanding.
research paperGlobalactive0d ago
Magenta
Open-source Google research project exploring machine learning as a tool in creative music and art processes.
open source research projectUnited Statesactive0d ago
Magenta RealTime 2
Open-weights live music model and framework for low-latency, on-device interactive music generation.
open music model frameworkUnited Statesactive0d ago
Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models
Research work examining audio generation, evaluation benchmark.
research paperGlobalactive0d ago
Masked Audio Generation using a Single Non-Autoregressive Transformer
Research work examining audio generation, text-to-audio generation.
research paperGlobalactive0d ago
Missing Melodies: AI Music Generation and its "Nearly" Complete Omission of the Global South
Research work examining music generation, music/audio representation learning.
research paperGlobalactive0d ago
Moûsai: Text-to-Music Generation with Long-Context Latent Diffusion
Research work examining music generation, text-to-music generation.
research paperGlobalactive0d ago
MuChoMusic: Evaluating Music Understanding in Multimodal Audio-Language Models
Research work examining evaluation benchmark, music/audio understanding.
research paperGlobalactive0d ago
MuLan: A Joint Embedding of Music Audio and Natural Language
Research work examining music retrieval, music/audio representation learning.
research paperGlobalactive0d ago
MuScriptor: An Open Model for Multi-Instrument Music Transcription
Research work examining music transcription.
research paperGlobalactive0d ago
MusTBENCH: Benchmarking and Advancing Temporal Grounding in Music LLMs
Research work examining evaluation benchmark, music/audio understanding.
benchmark studyGlobalactive0d ago
MuseCoco: Generating Symbolic Music from Text
Research work examining audio generation, music generation.
research paperGlobalactive0d ago
Museformer: Transformer with Fine- and Coarse-Grained Attention for Music Generation
Research work examining music generation, symbolic music.
research paperGlobalactive0d ago
Music ControlNet: Multiple Time-varying Controls for Music Generation
Research work examining evaluation benchmark, music generation.
research paperGlobalactive0d ago
Music I Care About: Automated Multimodal Benchmarking of LLM Music Perception Skills on (Almost) Any Music
Research work examining evaluation benchmark, music/audio representation learning.
benchmark studyGlobalactive0d ago
MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategies
Research work examining audio generation, music generation.
research paperGlobalactive0d ago
MusicLM: Generating Music From Text
Research work examining music generation.
research paperGlobalactive0d ago
MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models
Research work examining music generation, music/audio editing.
research paperGlobalactive0d ago
MusicMark: A Robust Generative Watermarking Framework for Music Generation
Research work examining music generation, music provenance and watermarking.
provenance detection paperGlobalactive0d ago
Mustango: Toward Controllable Text-to-Music Generation
Research work examining music generation, music retrieval.
research paperGlobalactive0d ago
Noise2Music: Text-conditioned Music Generation with Diffusion Models
Research work examining music generation, music/audio representation learning.
research paperGlobalactive0d ago
Pop2Piano : Pop Audio-based Piano Cover Generation
Research work examining music/audio AI research.
research paperGlobalactive0d ago
Probing Token Spaces under Generator Shift in AI-Generated Music Detection
Research work examining evaluation benchmark, music/audio representation learning.
provenance detection paperGlobalactive0d ago
Qwen-Music Technical Report
Research work examining music generation, singing voice.
technical reportGlobalactive0d ago
Real-Time Interactive Music Generation via Data-Free Streaming Consistency Distillation
Research work examining music generation, text-to-music generation.
research paperGlobalactive0d ago
Real-Time Language Model Jamming: A Case Study for Live Music Accompaniment Generation
Research work examining automatic accompaniment.
research paperGlobalactive0d ago
SONICS: Synthetic Or Not -- Identifying Counterfeit Songs
Research work examining singing voice, synthetic-audio detection.
provenance detection paperGlobalactive0d ago
Simple and Controllable Music Generation
Research work examining evaluation benchmark, music generation.
research paperGlobalactive0d ago
SingFake: Singing Voice Deepfake Detection
Research work examining singing voice, synthetic-audio detection.
provenance detection paperGlobalactive0d ago
SingSong: Generating musical accompaniments from singing
Research work examining audio generation, automatic accompaniment.
research paperGlobalactive0d ago
SongComposer: A Large Language Model for Lyric and Melody Generation in Song Composition
Research work examining music/audio understanding.
research paperGlobalactive0d ago
Stable Audio Open
Research work examining text-to-audio generation.
research paperGlobalactive0d ago
Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model
Research work examining audio generation, text-to-audio generation.
research paperGlobalactive0d ago
The Interpretation Gap in Text-to-Music Generation Models
Research work examining music generation, music retrieval.
research paperGlobalactive0d ago
Toward Universal Text-to-Music Retrieval
Research work examining evaluation benchmark, music retrieval.
research paperGlobalactive0d ago
TuneJury: An Open Metric for Improving Music Generation Preference Alignment
Research work examining evaluation benchmark, music generation.
research paperGlobalactive0d ago
UniAudio: An Audio Foundation Model Toward Universal Audio Generation
Research work examining audio generation, singing voice.
research paperGlobalactive0d ago
WavJourney: Compositional Audio Creation with Large Language Models
Research work examining audio generation, evaluation benchmark.
research paperGlobalactive0d ago