Deep Learning Tools for Audacity

Hugo Flores Garcia, Aldo Aguilar, Ethan Manilow, Dmitry Vedenko and Bryan Pardo

Toward an Ecosystem of Artificial-intelligence-powered Music Production (TEAMuP)

This work supported by NSF Award Number 2222369

We provide a software framework that lets deep learning practitioners easily integrate their own PyTorch models into the open-source Audacity DAW. This lets ML audio researchers put tools in the hands of sound artists without doing DAW-specific development work.

Our software framework lets ML developers easily integrate new deep-models into Audacity, a free and open-source DAW that has logged over 100 million downloads since 2015. Developers upload their trained PyTorch model to HuggingFace’s Model Hub. The model becomes accessible through Audacity’s UI and loads in a manner similar to traditional plugins.

Download Audacity with Deep Learning

Our work has not yet been merged to the main build of Audacity, though it will be soon. You can keep track of its progress by viewing our pull request. In the meantime, you can download an alpha version of Audacity + Deep Learning here:

Note: This is a nightly build, so you may encounter issues. If something breaks, make sure to stay updated with the latest build using the download link below. If that doesn’t fix it, start an issue on our issue tracker.

Download Using Google Drive

last updated: 6/26/2023

Mac OS

Issues?

If you encounter any issues while using this nightly build, please report them on our issue tracker.

Contributing a model to audacity only requires familiarity with PyTorch. See audacitorch on Github for instructions on how to contribute your model to Audacity.

Usage Example - Upmixing and Remixing with Source Separation

Here, we use the source separation models built-in with Audacity to create a collage of pop songs, taking instruments and vocals from different artists, and remixing them to create a new work.

[pdf] H. Flores Garcia, A. Aguilar, E. Manilow, D. Vedenko, and B. Pardo. Deep learning tools for audacity: Helping researchers expand the artist’s toolkit. In 5th Workshop on Machine Learning for Creativity and Design at NeurIPS 2021, 2021