48 GB · 445 reports
RTX 4090D · 48 GB
Qualified results first; original reports and full tables stay below.
Text generation · Qualified results
Speeds compare only within one exact test. Recipe availability is checked on each report against the published recipe executor.
No qualified results yet · Text generation · RTX 4090D · 48 GB
42 original reports are kept as evidence but do not qualify for comparison; each report states why. This does not show that the model or GPU cannot run it.
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Measurements without a comparable protocol · 110 rows
These measured rates remain visible, but are excluded from comparison curves because the protocol is unknown.
| Model | Format | Engine | Workload | Concurrency | Throughput | GPU power (W) |
|---|---|---|---|---|---|---|
| Gemma-3-270m ↗ | BF16 | vLLM | Mixed | 1 | 558.43 tok/s | 185.07 |
| Gemma-3-270m ↗ | BF16 | vLLM | Mixed | 2 | 861.15 tok/s | 164.61 |
| Gemma-3-270m ↗ | BF16 | vLLM | Mixed | 4 | 1,559.22 tok/s | 178.04 |
| Gemma-3-270m ↗ | BF16 | vLLM | Mixed | 8 | 2,479.12 tok/s | 161.51 |
| Gemma-3-270m ↗ | BF16 | vLLM | 32K | 1 | 532.47 tok/s | 189.12 |
| Gemma-3-270m ↗ | BF16 | vLLM | 32K | 2 | 827.48 tok/s | 173.12 |
| Gemma-3-270m ↗ | BF16 | vLLM | 32K | 4 | 1,522.33 tok/s | 192.63 |
| Gemma-3-270m ↗ | BF16 | vLLM | 32K | 8 | 1,458.27 tok/s | 157.46 |
| Gemma-3-270m ↗ | BF16 | vLLM | 16K | 1 | 546.4 tok/s | 186.78 |
| Gemma-3-270m ↗ | BF16 | vLLM | 16K | 2 | 856.9 tok/s | 169.84 |
| Gemma-3-270m ↗ | BF16 | vLLM | 16K | 4 | 1,630.3 tok/s | 187.19 |
| Gemma-3-270m ↗ | BF16 | vLLM | 16K | 8 | 1,552.35 tok/s | 149.86 |
| Gemma-3-270m ↗ | BF16 | vLLM | 8K | 1 | 553.45 tok/s | 184.86 |
| Gemma-3-270m ↗ | BF16 | vLLM | 8K | 8 | 1,651.81 tok/s | 146.62 |
| Gemma-3-270m ↗ | BF16 | vLLM | 8K | 32 | 5,116.35 tok/s | 192.84 |
| Gemma-3-270m ↗ | BF16 | vLLM | 8K | 128 | 8,584.2 tok/s | 252.28 |
| Gemma-3-270m ↗ | BF16 | vLLM | 8K | 512 | 8,452.13 tok/s | 267.55 |
| Gemma-3-270m ↗ | BF16 | vLLM | 4K | 1 | 566.15 tok/s | 185.97 |
| Gemma-3-270m ↗ | BF16 | vLLM | 4K | 8 | 1,602.47 tok/s | 142.08 |
| Gemma-3-270m ↗ | BF16 | vLLM | 4K | 32 | 5,431.31 tok/s | 184.86 |
| Gemma-3-270m ↗ | BF16 | vLLM | 4K | 128 | 8,967.4 tok/s | 240.86 |
| Gemma-3-270m ↗ | BF16 | vLLM | 4K | 512 | 9,211.88 tok/s | 261.53 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 1 | 566.41 tok/s | 184.31 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 8 | 1,649.66 tok/s | 141.18 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 32 | 5,509.22 tok/s | 179.5 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 128 | 9,516.01 tok/s | 234.75 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 512 | 9,785.93 tok/s | 260.17 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 1 | 566.96 tok/s | 184.81 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 8 | 1,687.01 tok/s | 140.83 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 32 | 5,586.19 tok/s | 178.08 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 128 | 9,836.61 tok/s | 232.35 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 512 | 10,434.61 tok/s | 262.5 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 1 | 598.27 tok/s | 189.67 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 8 | 1,695.08 tok/s | 138.95 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 32 | 5,829.92 tok/s | 171.14 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 128 | 10,407.53 tok/s | 218.17 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 512 | 11,978.52 tok/s | 250.64 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 1 | 640.38 tok/s | 195.23 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 8 | 1,917.24 tok/s | 142.39 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 32 | 6,067.09 tok/s | 161.77 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 128 | 12,576.67 tok/s | 211.73 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 512 | 14,801.51 tok/s | 230.89 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 1 | 682.05 tok/s | 200.71 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 8 | 2,330.32 tok/s | 153.08 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 32 | 6,305 tok/s | 155.19 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 128 | 14,741.29 tok/s | 209.43 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 1 | 648.15 tok/s | 196.02 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 8 | 2,667.02 tok/s | 161.76 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 32 | 6,590.82 tok/s | 162.13 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 128 | 14,844.36 tok/s | 218.56 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 512 | 18,775.66 tok/s | 242.81 |
| Gemma-3-270m ↗ | BF16 | vLLM | Mixed | 1 | 327.11 tok/s | 173.29 |
| Gemma-3-270m ↗ | BF16 | vLLM | Mixed | 2 | 358.96 tok/s | 184.1 |
| Gemma-3-270m ↗ | BF16 | vLLM | Mixed | 4 | 431.84 tok/s | 235.46 |
| Gemma-3-270m ↗ | BF16 | vLLM | Mixed | 8 | 331.25 tok/s | 228.1 |
| Gemma-3-270m ↗ | BF16 | vLLM | 4K | 1 | 447.36 tok/s | 174.14 |
| Gemma-3-270m ↗ | BF16 | vLLM | 4K | 8 | 1,552.03 tok/s | 149.96 |
| Gemma-3-270m ↗ | BF16 | vLLM | 4K | 32 | 4,736.15 tok/s | 188.5 |
| Gemma-3-270m ↗ | BF16 | vLLM | 4K | 128 | 7,607.28 tok/s | 243.69 |
| Gemma-3-270m ↗ | BF16 | vLLM | 4K | 512 | 5,229.81 tok/s | 252.58 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 1 | 562.52 tok/s | 185.58 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 32 | 5,235.34 tok/s | 181.53 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 128 | 8,913.21 tok/s | 243.45 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 512 | 7,885.21 tok/s | 266.09 |
| Gemma-3-270m ↗ | BF16 | vLLM | 32K | 1 | 536.84 tok/s | 190.17 |
| Gemma-3-270m ↗ | BF16 | vLLM | 16K | 1 | 260.85 tok/s | 152.74 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 8 | 1,599.27 tok/s | 149.04 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 32 | 5,070.66 tok/s | 185.03 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 128 | 9,108.9 tok/s | 248.31 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 1 | 37.2 tok/s | 269.12 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 8 | 1,339.85 tok/s | 185.83 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 32 | 5,806.54 tok/s | 172.88 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 128 | 10,299.83 tok/s | 228.27 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 512 | 8,939.01 tok/s | 261.82 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 1 | 436.43 tok/s | 170.53 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 8 | 1,445.3 tok/s | 164.85 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 32 | 5,480.34 tok/s | 181.78 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 128 | 6,609.37 tok/s | 263.43 |
| Gemma-3-270m ↗ | BF16 | vLLM | 2K | 512 | 9,695.96 tok/s | 263.99 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 8 | 1,632.06 tok/s | 141.7 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 32 | 5,676.02 tok/s | 176.12 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 128 | 6,102.07 tok/s | 253.16 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 512 | 14,312.31 tok/s | 236.52 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 1 | 565.84 tok/s | 184.72 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 8 | 1,665.74 tok/s | 141.35 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 32 | 5,519.73 tok/s | 177.48 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 128 | 9,781.99 tok/s | 237.32 |
| Gemma-3-270m ↗ | BF16 | vLLM | 1K | 512 | 10,115.03 tok/s | 263.25 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 1 | 608.88 tok/s | 191.83 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 8 | 1,713.17 tok/s | 140.12 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 32 | 2,851.12 tok/s | 205.79 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 128 | 10,816.18 tok/s | 219.66 |
| Gemma-3-270m ↗ | BF16 | vLLM | 512 | 512 | 12,144.95 tok/s | 252.42 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 1 | 267.49 tok/s | 146.51 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 8 | 1,699.55 tok/s | 158.78 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 32 | 6,225.67 tok/s | 157.92 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 128 | 12,831.27 tok/s | 199.11 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 512 | 14,492.99 tok/s | 231.59 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 8 | 1,747.17 tok/s | 143.73 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 32 | 6,119.2 tok/s | 169.44 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 128 | 12,219.3 tok/s | 205.72 |
| Gemma-3-270m ↗ | BF16 | vLLM | 256 | 512 | 14,354.97 tok/s | 230.05 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 1 | 681.68 tok/s | 200.79 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 8 | 1,846.76 tok/s | 138.58 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 32 | 6,287.08 tok/s | 156.81 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 1 | 692.79 tok/s | 202.09 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 8 | 2,225.08 tok/s | 146.97 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 32 | 6,494.38 tok/s | 156.56 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 128 | 15,588.69 tok/s | 212.36 |
| Gemma-3-270m ↗ | BF16 | vLLM | 128 | 512 | 18,723.26 tok/s | 227.31 |
Original reports
Every report for this task, including quality, diagnostic and legacy runs that do not enter comparisons.
| Model | Test task | Format | Engine | Workload | Protocol | Quality score | Test date |
|---|---|---|---|---|---|---|---|
| gemma-3-270m ↗ | Text generation | Native | vLLM | 2K | Method unknown | — | 1/25/2026, 4:47:46 AM |
| gemma-3-270m ↗ | Text generation | Native | vLLM | 1K | Method unknown | — | 1/25/2026, 4:33:01 AM |
| gemma-3-270m ↗ | Text generation | Native | vLLM | 512 | Method unknown | — | 1/25/2026, 4:23:12 AM |
| gemma-3-270m ↗ | Text generation | Native | vLLM | 256 | Method unknown | — | 1/25/2026, 4:14:45 AM |
| gemma-3-270m ↗ | Text generation | Native | vLLM | 128 | Method unknown | — | 1/25/2026, 4:07:02 AM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | Mixed | Method unknown | — | 3/6/2026, 10:54:28 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 128K | Method unknown | — | 3/6/2026, 10:51:17 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 64K | Method unknown | — | 3/6/2026, 10:47:54 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 32K | Method unknown | — | 3/6/2026, 10:43:08 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 16K | Method unknown | — | 3/6/2026, 10:39:20 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 8K | Method unknown | — | 3/6/2026, 10:29:22 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 4K | Method unknown | — | 3/6/2026, 10:21:36 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 2K | Method unknown | — | 3/6/2026, 10:15:08 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 1K | Method unknown | — | 3/6/2026, 10:08:36 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 512 | Method unknown | — | 3/6/2026, 10:01:36 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 256 | Method unknown | — | 3/6/2026, 9:50:42 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 128 | Method unknown | — | 3/6/2026, 9:25:21 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 128 | Method unknown | — | 3/6/2026, 9:06:52 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 8K | Method unknown | — | 3/6/2026, 9:01:54 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | Mixed | Method unknown | — | 3/6/2026, 8:55:56 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 4K | Method unknown | — | 3/6/2026, 8:55:28 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 128K | Method unknown | — | 3/6/2026, 8:51:38 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 64K | Method unknown | — | 3/6/2026, 8:48:24 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 2K | Method unknown | — | 3/6/2026, 8:46:56 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 32K | Method unknown | — | 3/6/2026, 8:45:10 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 16K | Method unknown | — | 3/6/2026, 8:40:32 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 1K | Method unknown | — | 3/6/2026, 8:39:50 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 8K | Method unknown | — | 3/6/2026, 8:34:40 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 512 | Method unknown | — | 3/6/2026, 8:31:13 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 4K | Method unknown | — | 3/6/2026, 8:26:23 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 2K | Method unknown | — | 3/6/2026, 8:17:37 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 256 | Method unknown | — | 3/6/2026, 8:16:37 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 1K | Method unknown | — | 3/6/2026, 8:09:47 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 512 | Method unknown | — | 3/6/2026, 8:02:55 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 128 | Method unknown | — | 3/6/2026, 7:53:02 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 256 | Method unknown | — | 3/6/2026, 7:52:24 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 128 | Method unknown | — | 3/6/2026, 7:43:39 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 128 | Method unknown | — | 3/6/2026, 4:29:01 PM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 1K | Method unknown | — | 1/25/2026, 6:03:52 AM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 512 | Method unknown | — | 1/25/2026, 5:25:46 AM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 256 | Method unknown | — | 1/25/2026, 5:16:21 AM |
| Gemma-3-270m ↗ | Text generation | BF16 | vLLM | 128 | Method unknown | — | 1/25/2026, 5:07:39 AM |
Running benchmarks
0Updates automaticallyNo benchmarks are currently reported as running.
Methodology
Average of error-free runs for the selected recorded configuration. Missing methods and fallback runs are not ranked. Performance index = average / fastest matching hardware × 100. Value index = performance per purchase cost / best comparable value × 100. Quality is separate by dataset and protocol. Prices are dated seller listings, not completed transactions or market averages.
Updated 11/5/2026, 11:02:27 PM