RTX 3080 Ti · 12 GB
Qwen3.8-Flash-Next-NVFP4-NVIDIA
Open a report for complete measurements.
- Task
- Text generation · Text → Text
- Workload
- 32K → 2K tokens
- Concurrency
- 1 request
- Format · Engine
- Q4_K_XL · strata
- Unit
- tok/s
No qualified results yet · All tasks · RTX 3080 Ti · 12 GB
1 original reports are kept as evidence but do not qualify for comparison; each report states why. This does not show that the model or GPU cannot run it.
Launch this model
This engine does not yet have an executable serving recipe.
Individual tests
Text → Text · Text generation · Q4_K_XL · strata · 32768in-2048out · tok/s
Sortable table
Uncached prefill is unavailable when prompts reuse cache or reliable phase timings are missing. Open a report for its recorded phase timings and cache counts.
| Test date | Throughput | Concurrency / batch | P95 (s) | TTFT (ms) | Observed occupancy (GiB) | GPU power (W) | Decode (tok/s) | Uncached prefill (tok/s) | Parameters | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| No matching results | ||||||||||