TorToiSe logo

TorToiSe

Free

A multi-voice text-to-speech system trained with an emphasis on quality. #opensource

FreeFree tier
Inputs: textOutputs: audio
Type
Open Source

About TorToiSe

TorToiSe (Tortoise TTS) is an open-source text-to-speech system built with a strong emphasis on multi-voice capabilities and highly realistic prosody and intonation. It combines an autoregressive decoder with a diffusion decoder to generate natural-sounding speech. The repository provides all code needed for inference, supports voice customization, and offers a Hugging Face demo. Despite being computationally intensive (originally very slow on older GPUs), recent optimizations enable real-time streaming with as low as 500 ms latency on 4GB VRAM. Installation is via pip, and the model requires an NVIDIA GPU.

Key Features

Multi-voice support for diverse speaker characteristics
Highly realistic prosody and intonation through autoregressive and diffusion decoders
Inference-ready code with no training required
Streaming support with latency as low as 500 ms on 4GB VRAM
Voice customization via dedicated guide
Hugging Face demo space for quick testing
Installable via pip (pip install tortoise-tts)
Open-source (MIT license inferred from repository)

Pros & Cons

Pros
  • Produces natural-sounding speech with realistic intonation
  • Supports multiple distinct voices out of the box
  • Open-source and free to use, modify, and distribute
  • Active community with 14,900+ GitHub stars
  • Recent optimizations allow near-real-time performance on modest GPUs
Cons
  • Requires an NVIDIA GPU; no CPU inference support
  • Original model is extremely slow on older hardware (e.g., K80 takes ~2 minutes per sentence)
  • Repository only includes inference code, not training scripts
  • Can be memory-intensive (though optimizations reduce requirements)

Best For

Generating high-quality speech for audiobooks and voiceoversEnhancing accessibility tools with natural-sounding TTSCreating virtual assistants or chatbots with expressive voicesRapid prototyping of speech-driven applications

FAQ

What hardware is required to run Tortoise TTS?
A computer with an NVIDIA GPU is required. CPU-only installations are not supported.
Is Tortoise TTS free to use?
Yes, it is open-source and freely available under an MIT license (inferred from the repository). No costs or subscriptions are needed.
How fast is Tortoise TTS?
Originally very slow (~2 minutes per sentence on a K80), but optimizations now allow a real-time factor of 0.25–0.3 on 4GB VRAM, and streaming can achieve 500 ms latency.
Can I use my own voice or train the model?
The repository provides voice customization via a guide but does not include training scripts. It is designed for inference only.