RTX PRO 6000 Blackwell Server Edition · 96 GB
Speech synthesis · Qualified results
IndexTTS-2.5
IndexTeam · 1 tested configuration
- Native · Not recorded → Audio · tts_prompts · Test duration 9 s
- Throughput · Batch 1
- 4.2audio-sec/sec
- Observed GPU occupancy
- 6.5GiB
- P95 latency
- Not recorded
Test details
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- indextts · PyTorch 2.8.0+cu128
- Protocol
- audio-native-v1
- Dataset
- tts_prompts
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 4.24 — — 6.48 221.7 1 a46ec2c4 ↗
Qwen3-TTS-12Hz-0.6B-CustomVoice
Qwen · 1 tested configuration
- Native · Not recorded → Audio · tts_prompts · Test duration 43 s
- Throughput · Batch 1
- 1.6audio-sec/sec
- Best measured · Batch 4
- 5.2audio-sec/sec
- Observed GPU occupancy
- 3.3GiB
- P95 latency
- Not recorded
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- qwen-tts · PyTorch 2.14.1
- Protocol
- audio-native-v1
- Dataset
- tts_prompts
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 1.6 — — 3.34 154.4 1 ebb272f8 ↗ B4 5.22 — — 4.92 161 1 ebb272f8 ↗
magpie_tts_multilingual_357m
nvidia · 1 tested configuration
- Native · Not recorded → Audio · tts_prompts · Test duration 19 s
- Throughput · Batch 1
- 3.6audio-sec/sec
- Observed GPU occupancy
- 4GiB
- P95 latency
- Not recorded
Test details
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- nemo-magpie · PyTorch 2.13.0
- Protocol
- audio-native-v1
- Dataset
- tts_prompts
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 3.57 — — 4.01 178.8 1 666efb0f ↗
Kokoro-82M
hexgrad · 1 tested configuration
- fp32 · Text → Audio · kokoro-english-v1 · Test duration 6 s
- Throughput · Batch 1
- 120audio-sec/sec
- Best measured · Batch 4
- 125audio-sec/sec
- Observed GPU occupancy
- 2GiB
- P95 latency
- 29 ms
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- kokoro · PyTorch 2.13.0+cu130
- Protocol
- audio-native-v1
- Dataset
- kokoro-english-v1
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 120.3 29 ms — 2 152.1 2 061d047a ↗ B4 125.19 124 ms — 2.03 169.7 2 061d047a ↗
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Sortable tables by exact test condition · 6 rows
C: concurrency · B: batch · —: not measured
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| IndexTeam/IndexTTS-2.5Scaling curves ↗ | Native | indextts | ttsaudio-native-v1 | B1 | 4.24 | 4.24 | — | — | 6.48 | 221.7 | 4.24 | 0.02 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| nvidia/magpie_tts_multilingual_357mScaling curves ↗ | Native | nemo-magpie | ttsaudio-native-v1 | B1 | 3.57 | 3.57 | — | — | 4.01 | 178.8 | 3.57 | 0.02 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-TTS-12Hz-0.6B-CustomVoiceScaling curves ↗ | Native | qwen-tts | ttsaudio-native-v1 | B1 | 1.6 | 1.6 | — | — | 3.34 | 154.4 | 1.6 | 0.01 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-TTS-12Hz-0.6B-CustomVoiceScaling curves ↗ | Native | qwen-tts | ttsaudio-native-v1 | B4 | 5.22 | 5.22 | — | — | 4.92 | 161 | 5.22 | 0.03 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| hexgrad/Kokoro-82MScaling curves ↗ | fp32 | kokoro | ttsaudio-native-v1 | B1 | 120.3 | 121.58 | — | 0.029 | 2 | 152.1 | 119.01 | 0.79 | 2 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| hexgrad/Kokoro-82MScaling curves ↗ | fp32 | kokoro | ttsaudio-native-v1 | B4 | 125.19 | 129.48 | — | 0.124 | 2.03 | 169.7 | 120.9 | 0.74 | 2 ↗ |
Scaling curves and individual runs
One model and test protocol per curve; different workloads are never joined into one line.
IndexTeam/IndexTTS-2.5 · Native · indextts · tts · audio-native-v1
One measured point; more levels are needed for a curve.
Not measured
One measured point; more levels are needed for a curve.
Each point is the mean of recorded runs at that level. A source report may differ from the mean; all runs are listed below.
| Batch size | Throughput | Decode (tok/s) | Uncached prefill (tok/s) | GPU power (W) | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | Test date | View report |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 4.24 audio-sec/sec | — | Uncached prefill unavailableView report | 221.73 | — | — | 6.48 | 10/19/2026, 8:09:44 AM | a46ec2c4 ↗ |
Original reports
| Model | Test task | Format | Engine | Workload | Protocol | Quality score | Test date |
|---|---|---|---|---|---|---|---|
| IndexTTS-2.5 ↗ | Speech synthesis | Native | indextts | tts | audio-native-v1 | — | 10/19/2026, 8:09:44 AM |
| Kokoro-82M ↗ | Speech synthesis | fp32 | kokoro | tts | audio-native-v1 | — | 10/14/2026, 8:25:11 AM |
| Kokoro-82M ↗ | Speech synthesis | fp32 | kokoro | tts | audio-native-v1 | — | 10/14/2026, 6:23:39 AM |
| magpie_tts_multilingual_357m ↗ | Speech synthesis | Native | nemo-magpie | tts | audio-native-v1 | — | 10/19/2026, 6:57:57 AM |
| magpie_tts_multilingual_357m ↗ | Speech synthesis | fp16 | nemo-magpie | tts | audio-native-v1 | — | 10/19/2026, 6:48:05 AM |
| Qwen3-TTS-12Hz-0.6B-CustomVoice ↗ | Speech synthesis | Native | qwen-tts | tts | audio-native-v1 | — | 10/19/2026, 8:09:31 AM |
Running benchmarks
0Updates automaticallyNo benchmarks are currently reported as running.
RTX PRO 6000 Blackwell Server Edition · 96 GB · 403 queued · 0 running · 0 awaiting reassignment · 6 succeeded · 3 failed or exhausted
Methodology
Average of error-free runs for the selected recorded configuration. Missing methods and fallback runs are not ranked. Performance index = average / fastest matching hardware × 100. Value index = performance per purchase cost / best comparable value × 100. Quality is separate by dataset and protocol. Prices are dated seller listings, not completed transactions or market averages.
Updated 11/5/2026, 11:01:27 PM