Skip to main content

Deep Learning Tools for Audacity

Audacity logo

Hugo Flores Garcia, Aldo Aguilar, Ethan Manilow, Dmitry Vedenko and Bryan Pardo

We provide a software framework that lets deep learning practitioners easily integrate their own PyTorch models into the open-source Audacity DAW. This lets ML audio researchers put tools in the hands of sound artists without doing DAW-specific development work.

Our software framework lets ML developers easily integrate new deep-models into Audacity, a free and open-source DAW that has logged over 100 million downloads since 2015. Developers upload their trained PyTorch model to HuggingFace’s Model Hub. The model becomes accessible through Audacity’s UI and loads in a manner similar to traditional plugins.

Download Audacity with Deep Learning

Our work has not yet been merged to the main build of Audacity, though it will be soon. You can keep track of its progress by viewing our pull request. In the meantime, you can download an alpha version of Audacity + Deep Learning here:

If you encounter any issues while using this nightly build, please report them on our issue tracker.

Share your model with the Audacity community

Contributing a model to audacity only requires familiarity with PyTorch. See torchaudacity on Github for instructions on how to contribute your model to Audacity.

Usage Example - Upmixing and Remixing with Source Separation

Here, we use the source separation models built-in with Audacity to create a collage of pop songs, taking instruments and vocals from different artists, and remixing them to create a new work.