vGPU-32GB · 32 GB
clef-flash
Open a report for complete measurements.
- Task
- Decision · Text → Structured data
- Workload
- Text → Structured data · typed-invoices-v1 · Test duration 33 s
- Batch size
- Batch 16
- Format · Engine
- bf16 · clef-native · PyTorch 2.11.0
- Unit
- decisions/sec
No qualified results yet · Decision · vGPU-32GB · 32 GB
6 original reports are kept as evidence but do not qualify for comparison; each report states why. This does not show that the model or GPU cannot run it.
Launch this model
Select a measured decision report and batch.
Individual tests
Text → Structured data · Decision · bf16 · clef-native · decision · decisions/sec
Sortable table
| Test date | Throughput | Concurrency / batch | P95 (s) | TTFT (ms) | Observed occupancy (GiB) | GPU power (W) | Decode (tok/s) | Uncached prefill (tok/s) | Parameters | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| No matching results | ||||||||||