RTX PRO 6000 Blackwell Server Edition · 96 GB

Kokoro-82M

Open a report for complete measurements.
Task
Speech synthesis · Text → Audio
Workload
Text → Audio · kokoro-english-v1 · Test duration 6 s
Batch size
Batch 4
Format · Engine
fp32 · kokoro · PyTorch 2.13.0+cu130
Unit
audio-sec/sec
Mean throughput
125audio-sec/sec
Observed GPU occupancy
2 GiB
P95 latency
124 ms
Reports combined
2
View configuration and run options ↗

Launch this model

This engine does not yet have an executable serving recipe.

Individual tests

Text → Audio · Speech synthesis · fp32 · kokoro · tts · audio-sec/sec
Sortable table
Individual tests · 2 rows
Test dateThroughputConcurrency / batchP95 (s)TTFT (ms)Observed occupancy (GiB)GPU power (W)Decode (tok/s)Uncached prefill (tok/s)ParametersView report
10/14/2026, 6:23:39 AM120.9 audio-sec/sec40.132—2.02165.09—Uncached prefill unavailableView reportParameters ↗19dd15a2 ↗
10/14/2026, 8:25:11 AM129.48 audio-sec/sec40.116—2.03174.26—Uncached prefill unavailableView reportParameters ↗061d047a ↗

Recorded test parameters

Configuration 1 · Parameters
model
hexgrad/Kokoro-82M
engine
kokoro
quant
fp32
method
audio-native-v1
task
tts
dataset
kokoro-english-v1
context
tts
input_tokens
0
output_tokens
0
duration
6
concurrency
4
unit
audio-sec/sec
software
{ "torch": "2.13.0+cu130", "transformers": "5.14.1", "kokoro": "0.9.4", "OMP_NUM_THREADS": "8", "MKL_NUM_THREADS": "8", "OPENBLAS_NUM_THREADS": "8", "NUMEXPR_NUM_THREADS": "8" }
engine_provenance
—
kernel_settings
—
precision
—
resolution
—
performance_task
—
performance_scope
—
batch_size
—
dimensions
—
weight_quantization
—
max_sequence_length
—
model_scope
—
performance_dataset
—
workload_mode
—
graph_mode
—
model_revision
—
client_version
python-native-bench-1.1.3