Neura Market
AudioCraft logo

AudioCraft

Free

A single-stop code base for generative audio needs, by Meta. Includes MusicGen for music and AudioGen for sounds. #opensource

FreeFree tier
Inputs: textOutputs: audio
Type
Open Source
Company
Meta AI
Visit Website GitHub (40 stars)

About AudioCraft

AudioCraft is a single-stop code base for all generative audio needs: music, sound effects, and compression. Developed by Meta AI, it includes MusicGen for text-to-music generation and AudioGen for text-to-sound generation. The underlying models leverage the EnCodec neural audio codec to learn discrete audio tokens from raw waveforms and use a single autoregressive Language Model (LM) to generate high-quality audio. By introducing a simple token interleaving pattern, AudioCraft efficiently models audio sequences while capturing long-term dependencies. It is open source and designed to simplify research and development in generative audio.

Key Features

Single code base for music, sound effects, and compression
MusicGen – text-to-music generation using a language model
AudioGen – text-to-sound generation for environmental sounds
EnCodec neural audio codec for learning discrete audio tokens
Autoregressive Language Model (LM) operating over compressed audio tokens
Elegant token interleaving pattern to capture long-term audio dependencies
Open source and available for research and development

Pros & Cons

Pros
  • Open source and free to use
  • Unified framework for multiple audio generation tasks
  • Leverages state-of-the-art Meta AI research (MusicGen, AudioGen, EnCodec)
  • Simplified design compared to prior generative audio models
  • Generates high-quality audio with long-term coherence
Cons
  • Requires technical expertise to set up and run (code base, not a web application)
  • May demand significant computational resources for training and inference
  • Primarily intended for research and development, not as a polished end-user tool

Best For

Generating music from text descriptionsCreating sound effects for videos, games, or applications from textAudio compression using the EnCodec codecAI research in generative audio and language modeling for audioPrototyping audio generation models for production

FAQ

What models are included in AudioCraft?
AudioCraft includes MusicGen for text-to-music generation, AudioGen for text-to-sound generation, and EnCodec for audio compression.
Is AudioCraft open source?
Yes, AudioCraft is open source and available on GitHub for research and development.
What can I do with AudioCraft?
You can generate music and sound effects from text inputs, compress audio using EnCodec, and explore generative audio research in a unified code base.