- Find a configuration
- B200 · 179 GB
B200 · 179 GB
Task · models with qualified results on this GPU
Decision · Qualified results
No qualified results yet · Decision · B200 · 179 GB
No reports for this task have been recorded here. This does not show that the model or GPU cannot run it.
Measured alternatives on other GPUs
Measured on different GPUs with the same or smaller listed capacity. These are references for choosing hardware, not performance or compatibility evidence for your selected GPU.
StartLux-Decision-v1-0.8B
startlux-models · 2 tested configurations · 1 GPU
- RTX PRO 6000 Blackwell Server Edition · 96 GBbf16 · Text → Structured data · typed-invoices-v1 · Test duration 6 s
- Throughput · Batch 1
- 50.3decisions/sec
- Observed GPU occupancy
- 3.2GiB
- P95 latency
- 20 ms
Test details
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- startlux-native · PyTorch 2.11.0+cu130
- Protocol
- native-forward-v1
- Dataset
- typed-invoices-v1
- Workload
- decision
Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 50.25 20 ms — 3.17 161.3 1 df141700 ↗ 1 other test configurations on this GPU
- bf16 · Text → Structured data · typed-invoices-v1 · Test duration 6 s
- Throughput · Batch 1
- 50.3decisions/sec
- Observed GPU occupancy
- 2.3GiB
- P95 latency
- 20 ms
Test details
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- startlux-native · PyTorch 2.11.0+cu130
- Protocol
- native-forward-v1
- Dataset
- typed-invoices-v1
- Workload
- decision
Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 50.28 20 ms — 2.29 165 1 8c1985ea ↗
Intern-Decision-0.8B
internlm · 4 tested configurations · 1 GPU
- RTX PRO 6000 Blackwell Server Edition · 96 GBbf16 · Text → Structured data · typed-invoices-v1 · Test duration 6 s
- Throughput · Batch 1
- 50.8decisions/sec
- Best measured · Batch 17
- 347decisions/sec
- Observed GPU occupancy
- 2.4GiB
- P95 latency
- 20 ms
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- intern-decision-native · PyTorch 2.11.0+cu130
- Protocol
- native-forward-v1
- Dataset
- typed-invoices-v1
- Workload
- decision
Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 50.83 20 ms — 2.36 169 2 18b06f63 ↗ B17 346.72 50 ms — 3.07 378 1 6ccb367c ↗ 3 other test configurations on this GPU
- bf16 · Text → Structured data · typed-invoices-v1 · Test duration 399 s
- Throughput · Batch 1
- 52decisions/sec
- Best measured · Batch 16
- 334decisions/sec
- Observed GPU occupancy
- 2.4GiB
- P95 latency
- 20 ms
Test details · 21 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- intern-decision-native · PyTorch 2.11.0
- Protocol
- native-forward-v1
- Dataset
- typed-invoices-v1
- Workload
- decision
Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 52.04 20 ms — 2.36 162.6 1 156910e7 ↗ B2 96.21 21 ms — 2.38 213.4 1 156910e7 ↗ B4 177.08 23 ms — 2.43 243.4 1 156910e7 ↗ B8 299.06 27 ms — 2.57 341.2 1 156910e7 ↗ B12 306.24 40 ms — 36.98 349.6 1 156910e7 ↗ B14 322.36 43 ms — 36.98 365.9 1 156910e7 ↗ B15 328.14 46 ms — 36.98 369.8 1 156910e7 ↗ B16 333.92 48 ms — 3.19 368.4 1 156910e7 ↗ B17 331.9 52 ms — 36.98 379.5 1 156910e7 ↗ B18 310.84 58 ms — 36.98 365.4 1 156910e7 ↗ B20 316.13 64 ms — 36.98 375.1 1 156910e7 ↗ B24 312.87 77 ms — 36.98 377.5 1 156910e7 ↗ B28 309.61 91 ms — 36.98 379.4 1 156910e7 ↗ B32 319.44 101 ms — 3.44 376.3 1 156910e7 ↗ B40 307.24 131 ms — 36.98 379.6 1 156910e7 ↗ B48 306.75 159 ms — 36.98 380.4 1 156910e7 ↗ B64 304.06 213 ms — 4.2 383.7 1 156910e7 ↗ B128 285.17 453 ms — 6.23 387.8 1 156910e7 ↗ B256 284.61 904 ms — 10.63 390.3 1 156910e7 ↗ B512 282.22 2.04 s — 19.42 390.1 1 156910e7 ↗ B1024 286.53 3.58 s — 36.98 396.2 1 156910e7 ↗ - bf16 · Text → Structured data · typed-invoices-v1 · Test duration 6 s
- Throughput · Batch 1
- 51.5decisions/sec
- Observed GPU occupancy
- 2.6GiB
- P95 latency
- 20 ms
Test details
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- intern-decision-native · PyTorch 2.11.0
- Protocol
- native-forward-v1
- Dataset
- typed-invoices-v1
- Workload
- decision
Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 51.51 20 ms — 2.6 164.2 1 7f2e07c0 ↗ - bf16 · Text → Structured data · typed-invoices-v1 · Test duration 396 s
- Throughput · Batch 1
- 52.8decisions/sec
- Best measured · Batch 17
- 350decisions/sec
- Observed GPU occupancy
- 2.4GiB
- P95 latency
- 19 ms
Test details · 21 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- intern-decision-native · PyTorch 2.11.0
- Protocol
- native-forward-v1
- Dataset
- typed-invoices-v1
- Workload
- decision
Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 52.8 19 ms — 2.36 172.8 1 5eef633e ↗ B2 95.72 21 ms — 2.38 186.5 1 5eef633e ↗ B4 177.64 23 ms — 2.43 242 1 5eef633e ↗ B8 306.42 26 ms — 2.57 344.2 1 5eef633e ↗ B12 322.68 37 ms — 37.46 371.9 1 5eef633e ↗ B13 336 39 ms — 37.46 380.8 1 5eef633e ↗ B14 344.61 41 ms — 37.46 392.6 1 5eef633e ↗ B15 345.75 44 ms — 37.46 389.5 1 5eef633e ↗ B16 345.28 47 ms — 2.85 383.9 1 5eef633e ↗ B17 349.83 49 ms — 37.46 397.8 1 5eef633e ↗ B18 327.34 55 ms — 37.46 383.4 1 5eef633e ↗ B20 333.21 60 ms — 37.46 402.6 1 5eef633e ↗ B24 331.98 73 ms — 37.46 401.2 1 5eef633e ↗ B28 327.01 86 ms — 37.46 399.2 1 5eef633e ↗ B32 331.67 97 ms — 3.41 397.7 1 5eef633e ↗ B48 326.46 148 ms — 37.46 405.9 1 5eef633e ↗ B64 318.22 202 ms — 4.51 403.2 1 5eef633e ↗ B128 298.77 430 ms — 6.71 405.8 1 5eef633e ↗ B256 298.58 859 ms — 11.11 407.3 1 5eef633e ↗ B512 299.67 1.71 s — 19.9 411.2 1 5eef633e ↗ B1024 297.46 3.64 s — 37.46 410.6 1 5eef633e ↗
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Original reports
Running benchmarks
0Updates automaticallyNo benchmarks are currently reported as running.
Methodology
Average of error-free runs for the selected recorded configuration. Missing methods and fallback runs are not ranked. Performance index = average / fastest matching hardware × 100. Value index = performance per purchase cost / best comparable value × 100. Quality is separate by dataset and protocol. Prices are dated seller listings, not completed transactions or market averages.
Updated 11/5/2026, 11:01:57 PM