VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

★ 42,520⑂ 4,861👁 164⑃ 117● 341▤ 14
PythonApache-2.0Created 2025-09-16voxcpm.com
Download: v2.0.3: fine-tuning validation, runtime stability, and streaming improvementsv2.0.3 ↓2.0.32026-05-11
+41
Daily
+548
Weekly
+3,360
Monthly
42,520
stars
4,861
forks
164
watchers
117
prs
341
issues
14
releases

README

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning


  English | 中文



  
  
  
  
  
  
  



  
  
  





  👋 Join our community for discussion and support!
  
  
     Feishu
  
   | 
  
     Discord
  
   | 
  
    📚 MiniCPM Wiki
  


VoxCPM is a tokenizer-free Text-to-Speech system that directly generates continuous speech representations via an end-to-end diffusion autoregressive architecture, bypassing discrete tokenization to achieve highly natural and expressive synthesis.

VoxCPM2 is the latest major release — a 2B parameter model trained on over 2 million hours of multilingual speech data, now supporting 30 languages, Voice Design, Controllable Voice Cloning, and 48kHz studio-quality audio output. Built on a MiniCPM-4 backbone.

 ✨ Highlights

- 🌍 30-Language Multilingual — Input text in any of the 30 supported languages and synthesize directly, no language tag needed
- 🎨 Voice Design — Create a brand-new voice from a natural-language description alone (gender, age, tone, emotion, pace …), no reference audio required
- 🎛️ Controllable Cloning — Clone any voice from a short reference clip, with optional style guidance to steer emotion, pace, and expression while preserving the original timbre
- 🎙️ Ultimate Cloning — Reproduce every vocal nuance: provide both reference audio and its transcript, and the model continues seamlessly from the reference, faithfully preserving every vocal detail — timbre, rhythm, emotion, and style (same as VoxCPM1.5)
- 🔊 48kHz High-Quality Audio — Accepts 16kHz reference audio and directly outputs 48kHz studio-quality audio via AudioVAE V2's asymmetric encode/decode design, with built-in super-resolution — no external upsampler needed
- 🧠 Context-Aware Synthesis — Automatically infers appropriate prosody and expressiveness from text content
- ⚡ Real-Time Streaming — RTF as low as ~0.3 on NVIDIA RTX 4090, and ~0.13 accelerated by Nano-vLLM or vLLM-Omni — official vLLM omni-modal serving for VoxCPM2 with PagedAttention and an OpenAI-compatible API
- 📜 Fully Open-Source & Commercial-Ready — Weights and code released under the Apache-2.0 license, free for commercial use

🌍 Supported Languages (30)  
Arabic, Burmese, Chinese, Danish, Dutch, English, Finnish, French, German, Greek, Hebrew, Hindi, Indonesian, Italian, Japanese, Khmer, Korean, Lao, Malay, Norwegian, Polish, Portuguese, Russian, Spanish, Swahili, Swedish, Tagalog, Thai, Turkish, Vietnamese

Chinese Dialect: 四川话, 粤语, 吴语, 东北话, 河南话, 陕西话, 山东话, 天津话, 闽南话

 News

- [2026.04] 🔥 We release VoxCPM2 — 2B, 30 languages, Voice Design & Controllable Voice Cloning, 48kHz audio output! Weights | Docs | Playground | Technical Report
- [2025.12] 🎉 Open-source VoxCPM1.5 weights with SFT & LoRA fine-tuning. (🏆 1 GitHub Trending)
- [2025.09] 🔥 Release VoxCPM Technical Report.
- [2025.09] 🎉 Open-source VoxCPM-0.5B weights (🏆 1 HuggingFace Trending)

---

 Contents

- Quick Start
  - Installatio

Top issues

Latest release

v2.0.3: fine-tuning validation, runtime stability, and streaming improvements 2.0.3 2026-05-11
VoxCPM v2.0.3

This release focuses on fine-tuning usability, runtime stability, safer LoRA loading, and faster streaming inference.

 Highlights

- Added voxcpm validate for pre-flight JSONL training manifest validation.
- Added optional ref_audio support in the fine-tuning data pipeline.
- Improved runtime device handling with explicit --device support and safer MPS dtype behavior.
- Improved VoxCPM2 streaming VAE decoding by avoiding redundant overlap decoding.
- Hardened legacy LoRA checkpoint loading with weights_only=True.
- Fixed LoRA rank mismatch handling in lora_ft_webui.py.

 New Fe

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON