1 GPU on the selected test

Kokoro-82M

GPUs are compared only on one exact test of this model. Change the test to see other conditions.

Run this model

Choose your operating system and enter a model repository. Launch support is checked separately from performance results.

Test conditions

Every GPU below ran exactly these conditions.
Task
Speech synthesis · Text → Audio
Workload
Text → Audio · kokoro-english-v1 · Test duration 6 s
Batch size
Batch 4
Format · Engine
fp32 · kokoro · PyTorch 2.13.0+cu130
Unit
audio-sec/sec

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Protocol details

audio-native-v1 · kokoro-english-v1 · tts

GPUs on this test

Only one GPU configuration has matching measurements; a cross-hardware comparison is not yet available.

  1. vGPU-32GB · 32 GBPyTorch 2.13.0+cu130
    Mean throughput
    41.8audio-sec/sec
    Observed GPU occupancy
    1GiB
    P95 latency
    426 ms
    Reports combined
    1
3 more GPUs ran this model under other tests
Sortable table
Hardware ranking · 4 rows
HardwareMean throughput (audio-sec/sec)P95 (s)TTFT (ms)Observed occupancy (GiB)GPU power (W)Throughput / WVRAM per GPU (GB)Reports combined
#1vGPU-32GB · 32 GBPyTorch 2.13.0+cu130Runs, parameters and setup ↗41.80.426—1.0365.940.63321
RTX 3080 Ti · 12 GBNo matching measurements——————12—
RTX PRO 6000 Blackwell Server Edition · 96 GBNo matching measurements——————96—
V100-PCIE-32GB · 32 GBNo matching measurements——————32—

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

How results are grouped

Results merge successful runs of the same model, precision and workload. CPU thread counts and CUDA wheel builds may differ; actual PyTorch builds are shown. Other recorded protocol settings remain separate.

Updated 11/5/2026, 11:05:29 PM