B200 · 179 GB
All tasks · Qualified results
No qualified results yet · All tasks · B200 · 179 GB
No reports for this task have been recorded here. This does not show that the model or GPU cannot run it.
Measured alternatives on other GPUs
Measured on different GPUs with the same or smaller listed capacity. These are references for choosing hardware, not performance or compatibility evidence for your selected GPU.
Qwen3.8-Flash-Next-NVFP4-NVIDIA
Qwen/Qwen3.8-Flash-Next · 6 tested configurations · 1 GPU
- Output throughput · includes prefill · 1 request
- 125tok/s
- Observed GPU occupancy
- 79.7GiB
- First token
- 1.8 s
Test details
Total output tokens divided by the full request window, including prefill and queueing.
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- strata
- Protocol
- wbench-fixed-http-v1
- Dataset
- synthetic-tokenizer-v1:repeats=3
- Workload
- 8192in-2048out
Concurrency Mean throughput (tok/s) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report C1 125.06 23.75 s 1.8 s 79.71 279.5 1 18c8631f ↗ 5 other test configurations on this GPU
- NVFP4 · 8K → 2K tokensCPU + GPU hybrid
- Output throughput · includes prefill · 1 request
- 151tok/s
- Observed GPU occupancy
- 71.2GiB
- First token
- 1.1 s
Test details
Total output tokens divided by the full request window, including prefill and queueing.
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- strata
- Protocol
- wbench-fixed-http-v1
- Dataset
- synthetic-tokenizer-v1:repeats=3
- Workload
- 8192in-2048out
Concurrency Mean throughput (tok/s) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report C1 151.39 15.46 s 1.1 s 71.22 292.2 1 60a45fd1 ↗ - NVFP4 · 8K → 2K tokensCPU + GPU hybrid
- Output throughput · includes prefill · 1 request
- 135tok/s
- Observed GPU occupancy
- 71.2GiB
- First token
- 1.3 s
Test details
Total output tokens divided by the full request window, including prefill and queueing.
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- strata
- Protocol
- wbench-fixed-http-v1
- Dataset
- synthetic-tokenizer-v1:repeats=3
- Workload
- 8192in-2048out
Concurrency Mean throughput (tok/s) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report C1 134.63 19.87 s 1.3 s 71.22 280 1 f2b52c15 ↗ - NVFP4 · 32K → 2K tokensCPU + GPU hybrid
- Output throughput · includes prefill · 1 request
- 114tok/s
- Observed GPU occupancy
- 71.2GiB
- First token
- 4.8 s
Test details
Total output tokens divided by the full request window, including prefill and queueing.
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- strata
- Protocol
- wbench-fixed-http-v1
- Dataset
- synthetic-tokenizer-v1:repeats=3
- Workload
- 32768in-2048out
Concurrency Mean throughput (tok/s) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report C1 114.25 20.98 s 4.8 s 71.22 316.1 1 4342000e ↗ - Q4_K_XL · 32K → 2K tokensCPU + GPU hybrid
- Output throughput · includes prefill · 1 request
- 106tok/s
- Observed GPU occupancy
- 79.7GiB
- First token
- 6.7 s
Test details
Total output tokens divided by the full request window, including prefill and queueing.
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- strata
- Protocol
- wbench-fixed-http-v1
- Dataset
- synthetic-tokenizer-v1:repeats=3
- Workload
- 32768in-2048out
Concurrency Mean throughput (tok/s) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report C1 106.11 23.97 s 6.7 s 79.71 308 1 66369e97 ↗ - NVFP4 · 32K → 2K tokensCPU + GPU hybrid
- Output throughput · includes prefill · 1 request
- 124tok/s
- Observed GPU occupancy
- 71.2GiB
- First token
- 4.1 s
Test details
Total output tokens divided by the full request window, including prefill and queueing.
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- strata
- Protocol
- wbench-fixed-http-v1
- Dataset
- synthetic-tokenizer-v1:repeats=3
- Workload
- 32768in-2048out
Concurrency Mean throughput (tok/s) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report C1 124.44 18.26 s 4.1 s 71.22 319.5 1 4a41258c ↗
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Original reports
Running benchmarks
0Updates automaticallyNo benchmarks are currently reported as running.
Methodology
Average of error-free runs for the selected recorded configuration. Missing methods and fallback runs are not ranked. Performance index = average / fastest matching hardware × 100. Value index = performance per purchase cost / best comparable value × 100. Quality is separate by dataset and protocol. Prices are dated seller listings, not completed transactions or market averages.
Updated 11/7/2026, 11:45:23 PM