RTX 5090 · 32 GB
Qwen3.8-27B-NVFP4
Open a report for complete measurements.
- Task
- Text generation · Text → Text
- Workload
- 128K → 2K tokens · Prefix cache reuse
- Concurrency
- 1 request
- Format · Engine
- NVFP4 · vllm · vLLM 0.28.0
- Unit
- tok/s
No qualified results yet · Text generation · RTX 5090 · 32 GB
11 original reports are kept as evidence but do not qualify for comparison; each report states why. This does not show that the model or GPU cannot run it.
Launch this model
Open the measured report recipe to preserve its engine and MoE settings.
Individual tests
Text → Text · Text generation · NVFP4 · vllm · 131072in-2048out · tok/s
Sortable table
Uncached prefill is unavailable when prompts reuse cache or reliable phase timings are missing. Open a report for its recorded phase timings and cache counts.
| Test date | Throughput | Concurrency / batch | P95 (s) | TTFT (ms) | Observed occupancy (GiB) | GPU power (W) | Decode (tok/s) | Uncached prefill (tok/s) | Parameters | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| No matching results | ||||||||||