RTX PRO 6000 Blackwell Server Edition · 96 GB
Qwen3.8-Flash-Next-NVFP4-NVIDIA
Open a report for complete measurements.
- Task
- Text generation · Text → Text
- Workload
- 32K → 2K tokens
- Concurrency
- 1 request
- Format · Engine
- Q4_K_XL · strata
- Unit
- tok/s
- Mean throughput
- 106tok/s
- Observed GPU occupancy
- 79.7 GiB
- First token
- 6.7 s
- Reports combined
- 1
Launch this model
This engine does not yet have an executable serving recipe.
Individual tests
Text → Text · Text generation · Q4_K_XL · strata · 32768in-2048out · tok/s
Sortable table
Uncached prefill is unavailable when prompts reuse cache or reliable phase timings are missing. Open a report for its recorded phase timings and cache counts.
| Test date | Throughput | Concurrency / batch | P95 (s) | TTFT (ms) | Observed occupancy (GiB) | GPU power (W) | Decode (tok/s) | Uncached prefill (tok/s) | Parameters | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| 10/14/2026, 10:17:57 AM | 106.11 tok/s | 1 | 23.973 | 6,671 | 79.71 | 307.98 | 162.08 | 4,929.97 | Parameters ↗ | 66369e97 ↗ |
Recorded test parameters
Configuration 1 · Parameters
- model
- Qwen3.8-Flash-Next-UD-Q4_K_XL
- engine
- strata
- quant
- Q4_K_XL
- method
- wbench-fixed-http-v1
- task
- llm
- dataset
- synthetic-tokenizer-v1:repeats=3
- context
- 32768in-2048out
- input_tokens
- 32768
- output_tokens
- 2048
- duration
- 3600
- concurrency
- 1
- unit
- tok/s
- software
- 296b59d2f73c8f04a805df29c2fa97655adace78
- engine_provenance
- { "config_sha256": "5fee838ea5bcc0a0d44d6a696f4d4a4d7c3f7cbf7f3066d3b90c444f576998d8", "kernel_settings": { "STRATA_PREFILL_NVFP4": null, "STRATA_PREFILL_X2_MIN_K": null, "STRATA_ROUTE_TAIL_SKIP": "0" }, "revision": "296b59d2f73c8f04a805df29c2fa97655adace78" }
- kernel_settings
- { "STRATA_PREFILL_NVFP4": null, "STRATA_PREFILL_X2_MIN_K": null, "STRATA_ROUTE_TAIL_SKIP": "0" }
- precision
- —
- resolution
- —
- performance_task
- —
- performance_scope
- —
- batch_size
- —
- dimensions
- —
- weight_quantization
- —
- max_sequence_length
- —
- model_scope
- —
- performance_dataset
- —
- workload_mode
- —
- graph_mode
- —
- model_revision
- —
- client_version
- 1.1.5