- Find a configuration
- vGPU-32GB · 32 GB
vGPU-32GB · 32 GB
Task · models with qualified results on this GPU
Speech synthesis · Qualified results
Kokoro-82M
hexgrad · 3 tested configurations
- fp32 · Text → Audio · kokoro-english-v1 · Test duration 6 s
- Throughput · Batch 1
- 76.7audio-sec/sec
- Best measured · Batch 2
- 79.8audio-sec/sec
- Observed GPU occupancy
- 1GiB
- P95 latency
- 45 ms
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- kokoro · PyTorch 2.13.0+cu130
- Protocol
- audio-native-v1
- Dataset
- kokoro-english-v1
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 76.72 45 ms — 1 83.5 1 d90a5c29 ↗ B2 79.84 100 ms — 1.03 100.8 1 d90a5c29 ↗ 2 other test configurations on this GPU
- fp32 · Text → Audio · kokoro-english-v1 · Test duration 6 s
- Throughput · Batch 1
- 40.4audio-sec/sec
- Best measured · Batch 4
- 41.8audio-sec/sec
- Observed GPU occupancy
- 1GiB
- P95 latency
- 104 ms
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- kokoro · PyTorch 2.13.0+cu130
- Protocol
- audio-native-v1
- Dataset
- kokoro-english-v1
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 40.36 104 ms — 0.99 60.5 1 c0488108 ↗ B4 41.8 426 ms — 1.03 65.9 1 c0488108 ↗ - fp32 · Text → Audio · kokoro-english-v1 · Test duration 6 s
- Throughput · Batch 1
- 43.4audio-sec/sec
- Best measured · Batch 4
- 44.9audio-sec/sec
- Observed GPU occupancy
- 1GiB
- P95 latency
- 101 ms
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- kokoro
- Protocol
- audio-native-v1
- Dataset
- kokoro-english-v1
- Workload
- tts
Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 43.43 101 ms — 0.99 64.1 1 d8e4b3ce ↗ B4 44.88 396 ms — 1.03 69.1 1 d8e4b3ce ↗
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Sortable tables by exact test condition · 6 rows
C: concurrency · B: batch · —: not measured
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| hexgrad/Kokoro-82MScaling curves ↗ | fp32 | kokoro | ttsaudio-native-v1 | B1 | 76.72 | 76.72 | — | 0.045 | 1 | 83.5 | 76.72 | 0.92 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| hexgrad/Kokoro-82MScaling curves ↗ | fp32 | kokoro | ttsaudio-native-v1 | B1 | 40.36 | 40.36 | — | 0.104 | 0.99 | 60.5 | 40.36 | 0.67 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| hexgrad/Kokoro-82MScaling curves ↗ | fp32 | kokoro | ttsaudio-native-v1 | B1 | 43.43 | 43.43 | — | 0.101 | 0.99 | 64.1 | 43.43 | 0.68 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| hexgrad/Kokoro-82MScaling curves ↗ | fp32 | kokoro | ttsaudio-native-v1 | B2 | 79.84 | 79.84 | — | 0.1 | 1.03 | 100.8 | 79.84 | 0.79 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| hexgrad/Kokoro-82MScaling curves ↗ | fp32 | kokoro | ttsaudio-native-v1 | B4 | 41.8 | 41.8 | — | 0.426 | 1.03 | 65.9 | 41.8 | 0.63 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| hexgrad/Kokoro-82MScaling curves ↗ | fp32 | kokoro | ttsaudio-native-v1 | B4 | 44.88 | 44.88 | — | 0.396 | 1.03 | 69.1 | 44.88 | 0.65 | 1 ↗ |
Scaling curves and individual runs
One model and test protocol per curve; different workloads are never joined into one line.
hexgrad/Kokoro-82M · fp32 · kokoro · tts · audio-native-v1
Measured points only. Select a point to open its source report.
Measured points only. Select a point to open its source report.
Measured points only. Select a point to open its source report.
Each point is the mean of recorded runs at that level. A source report may differ from the mean; all runs are listed below.
| Batch size | Throughput | Decode (tok/s) | Uncached prefill (tok/s) | GPU power (W) | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | Test date | View report |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 40.36 audio-sec/sec | — | Uncached prefill unavailableView report | 60.45 | — | 0.104 | 0.99 | 10/7/2026, 12:54:04 PM | c0488108 ↗ |
| 4 | 41.8 audio-sec/sec | — | Uncached prefill unavailableView report | 65.94 | — | 0.426 | 1.03 | 10/7/2026, 12:54:04 PM | c0488108 ↗ |
Original reports
| Model | Test task | Format | Engine | Workload | Protocol | Quality score | Test date |
|---|---|---|---|---|---|---|---|
| Kokoro-82M ↗ | Speech synthesis | fp32 | kokoro | tts | audio-native-v1 | — | 10/8/2026, 3:30:29 AM |
| Kokoro-82M ↗ | Speech synthesis | fp32 | kokoro | tts | audio-native-v1 | — | 10/7/2026, 12:54:04 PM |
| Kokoro-82M ↗ | Speech synthesis | fp32 | kokoro | tts | audio-native-v1 | — | 10/7/2026, 10:23:16 AM |
| Kokoro-82M ↗ | Speech synthesis | fp32 | vLLM | tts | audio-native-v1 | — | 10/7/2026, 9:40:16 AM |
Running benchmarks
0Updates automaticallyNo benchmarks are currently reported as running.
Methodology
Average of error-free runs for the selected recorded configuration. Missing methods and fallback runs are not ranked. Performance index = average / fastest matching hardware × 100. Value index = performance per purchase cost / best comparable value × 100. Quality is separate by dataset and protocol. Prices are dated seller listings, not completed transactions or market averages.
Updated 11/5/2026, 11:07:29 PM