Run an AI model on your computer

Measured alternatives on other GPUs

Measured on different GPUs with the same or smaller listed capacity. These are references for choosing hardware, not performance or compatibility evidence for your selected GPU.

1. Kokoro-82M

   hexgrad · 5 tested configurations · 3 GPUs

   • RTX 3080 Ti · 12 GBfp32 · Text → Audio · kokoro-english-v1 · Test duration 6 s

     Throughput · Batch 1

     49.2audio-sec/sec

     Best measured · Batch 2

     52.8audio-sec/sec

     Observed GPU occupancy

     1GiB

     P95 latency

     73 ms

     Evidence report and run availability ↗Same test on other GPUs
     Test details · 2 batch sizes

     Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

     Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

     Engine

     kokoro · PyTorch 2.12.1+cu130

     Protocol

     audio-native-v1

     Dataset

     kokoro-english-v1

     Workload

     tts

     Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
     B1	49.18	73 ms	—	1	158.9	1	3c7db092 ↗
     B2	52.8	140 ms	—	1.06	194.7	1	3c7db092 ↗

   Show 2 more GPUs

   • V100-PCIE-32GB · 32 GBfp32 · Text → Audio · kokoro-english-v1 · Test duration 6 s

     Throughput · Batch 1

     36audio-sec/sec

     Best measured · Batch 2

     37.8audio-sec/sec

     Observed GPU occupancy

     1.4GiB

     P95 latency

     105 ms

     Evidence report and run availability ↗Same test on other GPUs
     Test details · 2 batch sizes

     Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

     Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

     Engine

     kokoro · PyTorch 2.12.1+cu126

     Protocol

     audio-native-v1

     Dataset

     kokoro-english-v1

     Workload

     tts

     Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
     B1	35.95	105 ms	—	1.45	76.3	11	b40f8533 ↗
     B2	37.83	237 ms	—	1.45	82.6	11	b40f8533 ↗

   • vGPU-32GB · 32 GBfp32 · Text → Audio · kokoro-english-v1 · Test duration 6 s

     Throughput · Batch 1

     43.4audio-sec/sec

     Best measured · Batch 4

     44.9audio-sec/sec

     Observed GPU occupancy

     1GiB

     P95 latency

     101 ms

     Evidence report and run availability ↗Same test on other GPUs
     Test details · 2 batch sizes

     Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

     Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

     Engine

     kokoro

     Protocol

     audio-native-v1

     Dataset

     kokoro-english-v1

     Workload

     tts

     Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
     B1	43.43	101 ms	—	0.99	64.1	1	d8e4b3ce ↗
     B4	44.88	396 ms	—	1.03	69.1	1	d8e4b3ce ↗

   • 2 other test configurations on this GPU

     • fp32 · Text → Audio · kokoro-english-v1 · Test duration 6 s

       Throughput · Batch 1

       40.4audio-sec/sec

       Best measured · Batch 4

       41.8audio-sec/sec

       Observed GPU occupancy

       1GiB

       P95 latency

       104 ms

       Evidence report and run availability ↗Same test on other GPUs
       Test details · 2 batch sizes

       Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

       Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

       Engine

       kokoro · PyTorch 2.13.0+cu130

       Protocol

       audio-native-v1

       Dataset

       kokoro-english-v1

       Workload

       tts

       Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
       B1	40.36	104 ms	—	0.99	60.5	1	c0488108 ↗
       B4	41.8	426 ms	—	1.03	65.9	1	c0488108 ↗

     • fp32 · Text → Audio · kokoro-english-v1 · Test duration 6 s

       Throughput · Batch 1

       76.7audio-sec/sec

       Best measured · Batch 2

       79.8audio-sec/sec

       Observed GPU occupancy

       1GiB

       P95 latency

       45 ms

       Evidence report and run availability ↗Same test on other GPUs
       Test details · 2 batch sizes

       Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

       Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

       Engine

       kokoro · PyTorch 2.13.0+cu130

       Protocol

       audio-native-v1

       Dataset

       kokoro-english-v1

       Workload

       tts

       Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
       B1	76.72	45 ms	—	1	83.5	1	d90a5c29 ↗
       B2	79.84	100 ms	—	1.03	100.8	1	d90a5c29 ↗