RTX 4090D · 48 GB
Qwen3.8-27B-NVFP4
Open a report for complete measurements.
- Task
- Text generation · Text → Text
- Workload
- 8K → 2K tokens
- Concurrency
- 1 request
- Format · Engine
- NVFP4 · vllm
- Unit
- tok/s
No qualified results yet · Text generation · RTX 4090D · 48 GB
7 original reports are kept as evidence but do not qualify for comparison; each report states why. This does not show that the model or GPU cannot run it.
Launch this model
The checkpoint precision is not recorded well enough to reproduce this configuration.
Individual tests
Text → Text · Text generation · NVFP4 · vllm · 8192in-2048out · tok/s
Sortable table
Uncached prefill is unavailable when prompts reuse cache or reliable phase timings are missing. Open a report for its recorded phase timings and cache counts.
| Test date | Throughput | Concurrency / batch | P95 (s) | TTFT (ms) | Observed occupancy (GiB) | GPU power (W) | Decode (tok/s) | Uncached prefill (tok/s) | Parameters | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| No matching results | ||||||||||