96 GB · 196 reports

RTX PRO 6000 Blackwell Server Edition · 96 GB

Qualified results first; original reports and full tables stay below.

Speech recognition · Qualified results

Speeds compare only within one exact test. Recipe availability is checked on each report against the published recipe executor.

granite-speech-5.0-470m-turboctc

ibm-granite · 2 tested configurations

Native · Audio → Text · asr_prompts · Test duration 16 s

Throughput · Batch 1: 2,662audio-sec/sec
Best measured · Batch 32: 9,194audio-sec/sec
Observed GPU occupancy: 1.6GiB
P95 latency: Not recorded

Evidence report and run availability ↗Same test on other GPUs

Test details · 11 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: transformers-ctc · PyTorch 2.13.0
Protocol: audio-native-v1
Dataset: asr_prompts
Workload: asr

Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	2,662.33	—	—	1.64	122.1	1	3be7f67e ↗
B2	4,844.87	—	—	1.67	134.9	1	3be7f67e ↗
B4	6,237.58	—	—	1.75	148	1	3be7f67e ↗
B8	7,907.41	—	—	1.9	165.1	1	3be7f67e ↗
B16	9,083.29	—	—	2.33	194.8	1	3be7f67e ↗
B32	9,193.57	—	—	3.25	243.5	1	3be7f67e ↗
B64	8,622.98	—	—	5.09	345.5	1	3be7f67e ↗
B128	8,355.43	—	—	10.1	451	1	3be7f67e ↗
B256	8,343	—	—	20.09	477.6	1	3be7f67e ↗
B512	8,391.94	—	—	40.63	492.3	1	3be7f67e ↗
B1024	8,387.34	—	—	80.89	501.3	1	3be7f67e ↗

1 other test configurations on this GPU

Native · Audio → Text · asr_prompts

Throughput · Batch 1: 3,143audio-sec/sec
Best measured · Batch 16: 8,581audio-sec/sec
Observed GPU occupancy: 1.6GiB
P95 latency: Not recorded

Evidence report and run availability ↗Same test on other GPUs

Test details · 3 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: transformers-ctc · PyTorch 2.13.0
Protocol: audio-native-v1
Dataset: asr_prompts
Workload: asr

Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	3,143.16	—	—	1.64	95.8	1	d77a0cfd ↗
B8	8,162.53	—	—	1.64	105.2	1	d77a0cfd ↗
B16	8,581.45	—	—	1.92	111.9	1	d77a0cfd ↗

whisper-tiny
openai · 1 tested configuration
- fp16 · Audio → Text · asr_prompts · Test duration 2 s
  Throughput · Batch 1
  233audio-sec/sec
  Best measured · Batch 4
  364audio-sec/sec
  Observed GPU occupancy
  1.4GiB
  P95 latency
  Not recorded
  Evidence report and run availability ↗Same test on other GPUs
  Test details · 2 batch sizes
  Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
  Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
  Engine
  faster-whisper · PyTorch 2.14.1
  Protocol
  audio-native-v1
  Dataset
  asr_prompts
  Workload
  asr
  Batch size Mean throughput (audio-sec/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report
  B1 232.81 — — 1.42 113.5 2 ba5a45ac ↗
  B4 364.19 — — 1.43 115.8 2 ba5a45ac ↗

Batch size	Mean throughput (audio-sec/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	232.81	—	—	1.42	113.5	2	ba5a45ac ↗
B4	364.19	—	—	1.43	115.8	2	ba5a45ac ↗

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Sortable tables by exact test condition · 16 rows

C: concurrency · B: batch · —: not measured

Speech recognition · Audio → Text · asr_prompts · Batch 1 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B1	3,143.16	3,143.16	—	—	1.64	95.8	3,143.16	32.81	1 ↗

Speech recognition · Audio → Text · asr_prompts · Batch 8 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B8	8,162.53	8,162.53	—	—	1.64	105.2	8,162.53	77.59	1 ↗

Speech recognition · Audio → Text · asr_prompts · Batch 16 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B16	8,581.45	8,581.45	—	—	1.92	111.9	8,581.45	76.69	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 2 s · Batch 1 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
openai/whisper-tinyScaling curves ↗	fp16	faster-whisper	asraudio-native-v1	B1	232.81	234.75	—	—	1.42	113.5	230.87	2.05	2 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 2 s · Batch 4 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
openai/whisper-tinyScaling curves ↗	fp16	faster-whisper	asraudio-native-v1	B4	364.19	365.89	—	—	1.43	115.8	362.48	3.15	2 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 1 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B1	2,662.33	2,662.33	—	—	1.64	122.1	2,662.33	21.8	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 2 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B2	4,844.87	4,844.87	—	—	1.67	134.9	4,844.87	35.91	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 4 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B4	6,237.58	6,237.58	—	—	1.75	148	6,237.58	42.14	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 8 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B8	7,907.41	7,907.41	—	—	1.9	165.1	7,907.41	47.89	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 16 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B16	9,083.29	9,083.29	—	—	2.33	194.8	9,083.29	46.64	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 32 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B32	9,193.57	9,193.57	—	—	3.25	243.5	9,193.57	37.76	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 64 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B64	8,622.98	8,622.98	—	—	5.09	345.5	8,622.98	24.96	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 128 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B128	8,355.43	8,355.43	—	—	10.1	451	8,355.43	18.53	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 256 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B256	8,343	8,343	—	—	20.09	477.6	8,343	17.47	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 512 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B512	8,391.94	8,391.94	—	—	40.63	492.3	8,391.94	17.05	1 ↗

Speech recognition · Audio → Text · asr_prompts · Test duration 16 s · Batch 1024 · audio-sec/sec · 1 rows
Model	Format	Engine	Workload	Concurrency / batch	Mean throughput	Best measured	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	GPU power (W)	Lowest measured	Throughput / W	Reports combined
ibm-granite/granite-speech-5.0-470m-turboctcScaling curves ↗	Native	transformers-ctc	asraudio-native-v1	B1024	8,387.34	8,387.34	—	—	80.89	501.3	8,387.34	16.73	1 ↗

Scaling curves and individual runs

One model and test protocol per curve; different workloads are never joined into one line.

ibm-granite/granite-speech-5.0-470m-turboctc · Native · transformers-ctc · asr · audio-native-v1

Mean throughput audio-sec/sec

Measured points only. Select a point to open its source report.

Mean run P95 latency s

Not measured

Mean GPU memory used GB

Measured points only. Select a point to open its source report.

Each point is the mean of recorded runs at that level. A source report may differ from the mean; all runs are listed below.

Runs behind the curve · ibm-granite/granite-speech-5.0-470m-turboctc · audio-sec/sec · 11 rows
Batch size	Throughput	Decode (tok/s)	Uncached prefill (tok/s)	GPU power (W)	TTFT (ms)	P95 (s)	Observed occupancy (GiB)	Test date	View report
1	2,662.33 audio-sec/sec	—	Uncached prefill unavailableView report	122.13	—	—	1.64	10/19/2026, 8:09:36 AM	3be7f67e ↗
2	4,844.87 audio-sec/sec	—	Uncached prefill unavailableView report	134.93	—	—	1.67	10/19/2026, 8:09:36 AM	3be7f67e ↗
4	6,237.58 audio-sec/sec	—	Uncached prefill unavailableView report	148.03	—	—	1.75	10/19/2026, 8:09:36 AM	3be7f67e ↗
8	7,907.41 audio-sec/sec	—	Uncached prefill unavailableView report	165.1	—	—	1.9	10/19/2026, 8:09:36 AM	3be7f67e ↗
16	9,083.29 audio-sec/sec	—	Uncached prefill unavailableView report	194.77	—	—	2.33	10/19/2026, 8:09:36 AM	3be7f67e ↗
32	9,193.57 audio-sec/sec	—	Uncached prefill unavailableView report	243.5	—	—	3.25	10/19/2026, 8:09:36 AM	3be7f67e ↗
64	8,622.98 audio-sec/sec	—	Uncached prefill unavailableView report	345.53	—	—	5.09	10/19/2026, 8:09:36 AM	3be7f67e ↗
128	8,355.43 audio-sec/sec	—	Uncached prefill unavailableView report	450.97	—	—	10.1	10/19/2026, 8:09:36 AM	3be7f67e ↗
256	8,343 audio-sec/sec	—	Uncached prefill unavailableView report	477.57	—	—	20.09	10/19/2026, 8:09:36 AM	3be7f67e ↗
512	8,391.94 audio-sec/sec	—	Uncached prefill unavailableView report	492.3	—	—	40.63	10/19/2026, 8:09:36 AM	3be7f67e ↗
1024	8,387.34 audio-sec/sec	—	Uncached prefill unavailableView report	501.3	—	—	80.89	10/19/2026, 8:09:36 AM	3be7f67e ↗

Original reports

Every report for this task, including quality, diagnostic and legacy runs that do not enter comparisons.

Original reports · 5 rows
Model	Test task	Format	Engine	Workload	Protocol	Quality score	Test date
whisper-tiny ↗	Speech recognition	fp16	faster-whisper	asr	audio-native-v1	—	10/14/2026, 6:18:59 AM
whisper-tiny ↗	Speech recognition	fp16	faster-whisper	asr	audio-native-v1	—	10/14/2026, 8:24:13 AM
granite-speech-5.0-470m-turboctc ↗	Speech recognition	fp16	transformers-ctc	asr	audio-native-v1	—	10/19/2026, 6:48:01 AM
granite-speech-5.0-470m-turboctc ↗	Speech recognition	Native	transformers-ctc	asr	audio-native-v1	—	10/19/2026, 6:57:47 AM
granite-speech-5.0-470m-turboctc ↗	Speech recognition	Native	transformers-ctc	asr	audio-native-v1	—	10/19/2026, 8:09:36 AM

Running benchmarks

0Updates automatically

No benchmarks are currently reported as running.

RTX PRO 6000 Blackwell Server Edition · 96 GB · 403 queued · 0 running · 0 awaiting reassignment · 6 succeeded · 3 failed or exhausted

Methodology

Average of error-free runs for the selected recorded configuration. Missing methods and fallback runs are not ranked. Performance index = average / fastest matching hardware × 100. Value index = performance per purchase cost / best comparable value × 100. Quality is separate by dataset and protocol. Prices are dated seller listings, not completed transactions or market averages.

Updated 11/5/2026, 11:07:29 PM

Speech recognition · Qualified results

granite-speech-5.0-470m-turboctc

whisper-tiny

Original reports

Running benchmarks