96 GB · 196 reports

RTX PRO 6000 Blackwell Server Edition · 96 GB

Qualified results first; original reports and full tables stay below.

Text generation · Qualified results

Speeds compare only within one exact test. Recipe availability is checked on each report against the published recipe executor.

No qualified results yet · Text generation · RTX PRO 6000 Blackwell Server Edition · 96 GB

1 original reports are kept as evidence but do not qualify for comparison; each report states why. This does not show that the model or GPU cannot run it.

Check model launch support View original reports Measured alternatives for this task Test your own GPU

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Measurements without a comparable protocol · 8 rows

These measured rates remain visible, but are excluded from comparison curves because the protocol is unknown.

Measurements without a comparable protocol · 8 rows
Model	Format	Engine	Workload	Concurrency	Throughput	GPU power (W)
Qwen3-VL-4B-FP8 ↗	FP8	vLLM	2K	1	102.15 tok/s	229.98
Qwen3-VL-4B-FP8 ↗	FP8	vLLM	2K	8	703.94 tok/s	229.64
Qwen3-VL-4B-FP8 ↗	FP8	vLLM	2K	16	1,204.74 tok/s	244.82
Qwen3-VL-4B-FP8 ↗	FP8	vLLM	2K	32	2,001.12 tok/s	238.55
Qwen3-VL-4B-FP8 ↗	FP8	vLLM	2K	64	3,432.74 tok/s	255.4
Qwen3-VL-4B-FP8 ↗	FP8	vLLM	2K	128	5,021.53 tok/s	289.06
Qwen3-VL-4B-FP8 ↗	FP8	vLLM	2K	256	6,345.02 tok/s	340.49
Qwen3-VL-4B-FP8 ↗	FP8	vLLM	2K	512	7,385.79 tok/s	366.12

Original reports

Every report for this task, including quality, diagnostic and legacy runs that do not enter comparisons.

Original reports · 1 rows
Model	Test task	Format	Engine	Workload	Protocol	Quality score	Test date
Qwen3-VL-4B-FP8 ↗	Text generation	FP8	vLLM	2K	Method unknown	—	1/12/2026, 8:13:21 PM

Running benchmarks

0Updates automatically

No benchmarks are currently reported as running.

RTX PRO 6000 Blackwell Server Edition · 96 GB · 403 queued · 0 running · 0 awaiting reassignment · 6 succeeded · 3 failed or exhausted

Methodology

Average of error-free runs for the selected recorded configuration. Missing methods and fallback runs are not ranked. Performance index = average / fastest matching hardware × 100. Value index = performance per purchase cost / best comparable value × 100. Quality is separate by dataset and protocol. Prices are dated seller listings, not completed transactions or market averages.

Updated 11/5/2026, 11:02:27 PM