Deep Learning Tools for Audacity
Hugo Flores Garcia, Aldo Aguilar, Ethan Manilow, Dmitry Vedenko and Bryan Pardo
Toward an Ecosystem of Artificial-intelligence-powered Music Production (TEAMuP)
This work supported by NSF Award Number 2222369
We provide a software framework that lets deep learning practitioners easily integrate their own PyTorch models into the open-source Audacity DAW. This lets ML audio researchers put tools in the hands of sound artists without doing DAW-specific development work.
Our software framework lets ML developers easily integrate new deep-models into Audacity, a free and open-source DAW that has logged over 100 million downloads since 2015. Developers upload their trained PyTorch model to HuggingFace’s Model Hub. The model becomes accessible through Audacity’s UI and loads in a manner similar to traditional plugins.
Download Audacity with Deep Learning
Our work has not yet been merged to the main build of Audacity, though it will be soon. You can keep track of its progress by viewing our pull request. In the meantime, you can download an alpha version of Audacity + Deep Learning here:
Note: This is a nightly build, so you may encounter issues. If something breaks, make sure to stay updated with the latest build using the download link below. If that doesn’t fix it, start an issue on our issue tracker.
Download Using Google Drive
last updated: 3/16/2023
If you encounter any issues while using this nightly build, please report them on our issue tracker.
Share your model with the Audacity community
Contributing a model to audacity only requires familiarity with PyTorch. See
audacitorch on Github for instructions on how to contribute your model to Audacity.
Usage Example - Upmixing and Remixing with Source Separation
Here, we use the source separation models built-in with Audacity to create a collage of pop songs, taking instruments and vocals from different artists, and remixing them to create a new work.
[pdf] H. Flores Garcia, A. Aguilar, E. Manilow, D. Vedenko, and B. Pardo. Deep learning tools for audacity: Helping researchers expand the artist’s toolkit. In 5th Workshop on Machine Learning for Creativity and Design at NeurIPS 2021, 2021