A100-SXM4-40GB · 40 GB
qwen2.5-1.5b-instruct-q4_k_m.gguf
Open a report for complete measurements.
No qualified results yet · All tasks · A100-SXM4-40GB · 40 GB
1 original reports are kept as evidence but do not qualify for comparison; each report states why. This does not show that the model or GPU cannot run it.
Launch this model
No measured configuration selected.
Individual tests
No comparable measurements
Sortable table
| Test date | Throughput | Concurrency / batch | P95 (s) | TTFT (ms) | Observed occupancy (GiB) | GPU power (W) | Decode (tok/s) | Uncached prefill (tok/s) | Parameters | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| No matching results | ||||||||||