RTX 4090D · 48 GB
Qwen3.8-27B-NVFP4
Open a report for complete measurements.
- Task
- Text generation · Text → Text
- Workload
- 128K → 2K tokens · Prefix cache reuse
- Concurrency
- 1 request
- Format · Engine
- NVFP4 · vllm · vLLM 0.28.0
- Unit
- tok/s
No qualified results yet · Text generation · RTX 4090D · 48 GB
7 original reports are kept as evidence but do not qualify for comparison; each report states why. This does not show that the model or GPU cannot run it.
Launch this model
A compatible model launch executor has not been published yet.
Individual tests
Text → Text · Text generation · NVFP4 · vllm · 131072in-2048out · tok/s
Sortable table
Uncached prefill is unavailable when prompts reuse cache or reliable phase timings are missing. Open a report for its recorded phase timings and cache counts.
| Test date | Throughput | Concurrency / batch | P95 (s) | TTFT (ms) | Observed occupancy (GiB) | GPU power (W) | Decode (tok/s) | Uncached prefill (tok/s) | Parameters | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| No matching results | ||||||||||