Models
Get your startup command
Choose your operating system and enter a model repository. Launch support is checked separately from performance results.
Speech synthesis · RTX PRO 6000 Blackwell Server Edition · 96 GB
IndexTTS-2.5
IndexTeam · 1 tested configuration
- Native · Not recorded → Audio · tts_prompts · Test duration 9 s
- Throughput · Batch 1
- 4.2audio-sec/sec
- Observed GPU occupancy
- 6.5GiB
- P95 latency
- Not recorded
Test details
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- indextts · PyTorch 2.8.0+cu128
- Protocol
- audio-native-v1
- Dataset
- tts_prompts
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 4.24 — — 6.48 221.7 1 a46ec2c4 ↗
Qwen3-TTS-12Hz-0.6B-CustomVoice
Qwen · 1 tested configuration
- Native · Not recorded → Audio · tts_prompts · Test duration 43 s
- Throughput · Batch 1
- 1.6audio-sec/sec
- Best measured · Batch 4
- 5.2audio-sec/sec
- Observed GPU occupancy
- 3.3GiB
- P95 latency
- Not recorded
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- qwen-tts · PyTorch 2.14.1
- Protocol
- audio-native-v1
- Dataset
- tts_prompts
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 1.6 — — 3.34 154.4 1 ebb272f8 ↗ B4 5.22 — — 4.92 161 1 ebb272f8 ↗
magpie_tts_multilingual_357m
nvidia · 1 tested configuration
- Native · Not recorded → Audio · tts_prompts · Test duration 19 s
- Throughput · Batch 1
- 3.6audio-sec/sec
- Observed GPU occupancy
- 4GiB
- P95 latency
- Not recorded
Test details
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- nemo-magpie · PyTorch 2.13.0
- Protocol
- audio-native-v1
- Dataset
- tts_prompts
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 3.57 — — 4.01 178.8 1 666efb0f ↗
Kokoro-82M
hexgrad · 1 tested configuration
- fp32 · Text → Audio · kokoro-english-v1 · Test duration 6 s
- Throughput · Batch 1
- 120audio-sec/sec
- Best measured · Batch 4
- 125audio-sec/sec
- Observed GPU occupancy
- 2GiB
- P95 latency
- 29 ms
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- kokoro · PyTorch 2.13.0+cu130
- Protocol
- audio-native-v1
- Dataset
- kokoro-english-v1
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 120.3 29 ms — 2 152.1 2 061d047a ↗ B4 125.19 124 ms — 2.03 169.7 2 061d047a ↗
Sortable tables by exact test condition · 6 rows
| Model | Hardware | Format | Engine | Mean throughput (audio-sec/sec) | P95 | TTFT | Observed occupancy (GiB) | GPU power (W) | Reports combined | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| IndexTTS-2.5 | RTX PRO 6000 Blackwell Server Edition · 96 GB | Native | indexttsPyTorch 2.8.0+cu128 | 4.24 | — | — | 6.48 | 221.7 | 1 | a46ec2c4 ↗ |
| Model | Hardware | Format | Engine | Mean throughput (audio-sec/sec) | P95 | TTFT | Observed occupancy (GiB) | GPU power (W) | Reports combined | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| magpie_tts_multilingual_357m | RTX PRO 6000 Blackwell Server Edition · 96 GB | Native | nemo-magpiePyTorch 2.13.0 | 3.57 | — | — | 4.01 | 178.8 | 1 | 666efb0f ↗ |
| Model | Hardware | Format | Engine | Mean throughput (audio-sec/sec) | P95 | TTFT | Observed occupancy (GiB) | GPU power (W) | Reports combined | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-TTS-12Hz-0.6B-CustomVoice | RTX PRO 6000 Blackwell Server Edition · 96 GB | Native | qwen-ttsPyTorch 2.14.1 | 1.6 | — | — | 3.34 | 154.4 | 1 | ebb272f8 ↗ |
| Model | Hardware | Format | Engine | Mean throughput (audio-sec/sec) | P95 | TTFT | Observed occupancy (GiB) | GPU power (W) | Reports combined | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-TTS-12Hz-0.6B-CustomVoice | RTX PRO 6000 Blackwell Server Edition · 96 GB | Native | qwen-ttsPyTorch 2.14.1 | 5.22 | — | — | 4.92 | 161 | 1 | ebb272f8 ↗ |
| Model | Hardware | Format | Engine | Mean throughput (audio-sec/sec) | P95 | TTFT | Observed occupancy (GiB) | GPU power (W) | Reports combined | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| Kokoro-82M | RTX PRO 6000 Blackwell Server Edition · 96 GB | fp32 | kokoroPyTorch 2.13.0+cu130 | 120.3 | 29 ms | — | 2 | 152.1 | 2 | 061d047a ↗ |
| Model | Hardware | Format | Engine | Mean throughput (audio-sec/sec) | P95 | TTFT | Observed occupancy (GiB) | GPU power (W) | Reports combined | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| Kokoro-82M | RTX PRO 6000 Blackwell Server Edition · 96 GB | fp32 | kokoroPyTorch 2.13.0+cu130 | 125.19 | 124 ms | — | 2.03 | 169.7 | 2 | 061d047a ↗ |