audiocraft-audio-generation

Generate music from text prompts using AudioCraft by leveraging the MusicGen model for text-to-music generation, which supports melody conditioning to guide the composition process.

Create sound effects from text descriptions using AudioGen, a text-to-sound generation model within AudioCraft designed to produce high-fidelity audio from natural language prompts.

AudioCraft supports stereo audio outputs with two channels and batch generation, allowing you to produce multiple audio segments simultaneously across desktop Linux and macOS environments.

Melody conditioning in text-to-music generation allows you to provide an existing audio melody as a reference, enabling MusicGen to generate new music that aligns with the provided melodic structure.

You need PyTorch and torchaudio to run AudioCraft models, along with access to pretrained models like MusicGen, AudioGen, and EnCodec for executing text-to-audio generation workflows.

MusicGen generates music from text, AudioGen generates sound effects from text, and EnCodec handles high-fidelity audio encoding and decoding within the AudioCraft framework.