RTX PRO 6000 Blackwell Server Edition · 96 GB
clef-flash
Open a report for complete measurements.
- Task
- Decision · Text → Structured data
- Workload
- 1K → 1K tokens
- Batch size
- Batch 4
- Format · Engine
- bf16 · vLLM
- Unit
- decisions/sec
No qualified results yet · All tasks · RTX PRO 6000 Blackwell Server Edition · 96 GB
5 original reports are kept as evidence but do not qualify for comparison; each report states why. This does not show that the model or GPU cannot run it.
Launch this model
Select a measured decision report and batch.
Individual tests
Text → Structured data · Decision · bf16 · vLLM · decision · decisions/sec
Sortable table
| Test date | Throughput | Concurrency / batch | P95 (s) | TTFT (ms) | Observed occupancy (GiB) | GPU power (W) | Decode (tok/s) | Uncached prefill (tok/s) | Parameters | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| No matching results | ||||||||||