{
  "video_id": "reddit_1um2tbf",
  "channel_slug": "LocalLLaMA",
  "channel_handle": "r/LocalLLaMA",
  "title": "[audio.cpp] The Sound of GGML — C++/GGML native ACE-Step, Stable Audio, HeartMuLa, RoFormer, HTDemucs released. 10-Minute Music in 60 Seconds!",
  "url": "https://www.reddit.com/r/LocalLLaMA/comments/1um2tbf/audiocpp_the_sound_of_ggml_cggml_native_acestep/",
  "external_url": null,
  "upload_date": "20260703",
  "published_at": "2026-07-03T03:12:14+00:00",
  "transcript": "https://preview.redd.it/yxa9dlzquxah1.png?width=2000&format=png&auto=webp&s=b07c74b8832b26b46531e2fddba19fd2437ce4c6\n\nI just released a big music/audio expansion in `audio.cpp`.\n\nThis batch adds **music generation**, **SFX generation**, and **source separation** to the released framework surface:\n\n    Newly released:\n    - ACE-Step 1.5 Turbo / Base\n    - HeartMuLa\n    - Stable Audio 3 Small Music / SFX\n    - Stable Audio 3 Medium\n    - Mel-Band RoFormer\n    - HTDemucs\n\n**Bonus:** HeartMuLa is no longer capped at the old short limit. It can now generate around 10 minutes of audio in one run.\n\nCurrent framework progress: 21 / 28 (75%)\n\nThis is no longer just “TTS in C++.” `audio.cpp` release can now cover speech, voice, ASR/VAD/diarization, voice conversion, music/SFX generation, and source separation through the same native C++/ggml framework path.\n\n    ACE-Step Turbo, 600s music generation\n    \n    audio.cpp: 60.16s wall time, RTF 0.100, 9.97x real-time\n    Python:    88.52s wall time, RTF 0.148, 6.78x real-time\n\n**Not everything is magically faster yet.** HTDemucs is currently slower than the Python path in my test, and Stable Audio warm runs are mixed. I’m not trying to hide that. The current release is about getting the end-to-end paths into the shared framework first, then tightening backend-specific performance.\n\nThere is a `mem_saver` mode for long-lived/server-style usage for these models. It does not always reduce the absolute peak during inference, but it can reduce resident VRAM after the run without hurting speed much.\n\nRepo: [https://github.com/0xShug0/audio.cpp](https://github.com/0xShug0/audio.cpp)\n\nI’d love feedback from people trying these on different GPUs/CPUs, especially long generations, weird prompts, stem separation quality, backend issues, performance numbers, and anything that breaks.\n\n\n\n--- Top Comments ---\n\n\n[7 upvotes] Warm request speedup vs the Python baseline:\n\n* \\- ACE-Step Turbo: 1.74x faster, warm RTF 0.0540\n* \\- ACE-Step Base: 1.30x faster, warm RTF 0.2078\n* \\- HeartMuLa: 1.63x faster, warm RTF 0.3371\n* \\- Mel-Band RoFormer: 1.41x faster, warm RTF 0.0694\n* \\- Stable Audio SFX: 1.52x faster, warm RTF 0.0125\n\n[4 upvotes] Previous posts: [https://www.reddit.com/r/LocalLLaMA/s/AVftbf1WgE](https://www.reddit.com/r/LocalLLaMA/s/AVftbf1WgE)\n\n[https://www.reddit.com/r/LocalLLaMA/s/xefCRuTMiU](https://www.reddit.com/r/LocalLLaMA/s/xefCRuTMiU)\n\nSome other updates!\n\n\\- VibeVoice now support 7B and LoRA\n\n\\- If you want to try kokoro, a preview version is released at [https://github.com/0xShug0/audio.cpp/tree/kokoro-preview](https://github.com/0xShug0/audio.cpp/tree/kokoro-preview)\n\n[4 upvotes] I'm right now building audio.cpp with cuda. It definitely should support modular build . I have to compile and link all the supported models for only one model I need.\n\n[4 upvotes] Nice, but please add gguf load support ..... being built on ggml that would allow to run faster and with less memory",
  "transcript_chars": 2960,
  "ingested_at": "2026-07-03T13:30:30.897919+00:00",
  "source": "reddit",
  "yt_meta": {
    "score": 83,
    "upvote_ratio": 0.96,
    "num_comments": 34,
    "author": "Acceptable-Cycle4645",
    "is_self": true
  }
}