Run an AI model on your computer

1. IndexTTS-2.5

   IndexTeam · 1 tested configuration · 1 GPU

   • RTX PRO 6000 Blackwell Server Edition · 96 GBNative · Not recorded → Audio · tts_prompts · Test duration 9 s

     Throughput · Batch 1

     4.2audio-sec/sec

     Observed GPU occupancy

     6.5GiB

     P95 latency

     Not recorded

     Evidence report and run availability ↗Same test on other GPUs
     Test details

     Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

     Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

     Engine

     indextts · PyTorch 2.8.0+cu128

     Protocol

     audio-native-v1

     Dataset

     tts_prompts

     Workload

     tts

     Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
     B1	4.24	—	—	6.48	221.7	1	a46ec2c4 ↗

2. Qwen3-TTS-12Hz-0.6B-CustomVoice

   Qwen · 1 tested configuration · 1 GPU

   • RTX PRO 6000 Blackwell Server Edition · 96 GBNative · Not recorded → Audio · tts_prompts · Test duration 43 s

     Throughput · Batch 1

     1.6audio-sec/sec

     Best measured · Batch 4

     5.2audio-sec/sec

     Observed GPU occupancy

     3.3GiB

     P95 latency

     Not recorded

     Evidence report and run availability ↗Same test on other GPUs
     Test details · 2 batch sizes

     Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

     Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

     Engine

     qwen-tts · PyTorch 2.14.1

     Protocol

     audio-native-v1

     Dataset

     tts_prompts

     Workload

     tts

     Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
     B1	1.6	—	—	3.34	154.4	1	ebb272f8 ↗
     B4	5.22	—	—	4.92	161	1	ebb272f8 ↗

3. magpie_tts_multilingual_357m

   nvidia · 1 tested configuration · 1 GPU

   • RTX PRO 6000 Blackwell Server Edition · 96 GBNative · Not recorded → Audio · tts_prompts · Test duration 19 s

     Throughput · Batch 1

     3.6audio-sec/sec

     Observed GPU occupancy

     4GiB

     P95 latency

     Not recorded

     Evidence report and run availability ↗Same test on other GPUs
     Test details

     Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

     Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

     Engine

     nemo-magpie · PyTorch 2.13.0

     Protocol

     audio-native-v1

     Dataset

     tts_prompts

     Workload

     tts

     Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
     B1	3.57	—	—	4.01	178.8	1	666efb0f ↗

Models shown: 3 / 4

Recipe availability is checked on each report against the published recipe executor.

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.