1 models with qualified results

Models

Measured configurations by model. Open a model to compare GPUs on one exact test.

Run this model

Choose your operating system and enter a model repository. Launch support is checked separately from performance results.

Decision · All measured GPUs

Speeds compare only within one exact test. Recipe availability is checked on each report against the published recipe executor.

clef-flash

Cloudflare · 6 tested configurations · 2 GPUs

RTX PRO 6000 Blackwell Server Edition · 96 GBbf16 · Text → Structured data · typed-invoices-v1 · Test duration 33 s

Throughput · Batch 1: 31.8decisions/sec
Best measured · Batch 4: 39.3decisions/sec
Observed GPU occupancy: 18.9GiB
P95 latency: 32 ms

Use this recipe · Batch 4 ↗Evidence report and run availability ↗Same test on other GPUs

Test details · 4 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: clef-native · PyTorch 2.11.0
Protocol: native-forward-v1
Dataset: typed-invoices-v1
Workload: decision

Batch size	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	31.83	32 ms	—	18.95	388.5	1	10c64aff ↗
B4	39.27	93 ms	—	18.95	449.5	1	10c64aff ↗
B16	5.41	8.21 s	—	19.28	233.4	1	10c64aff ↗
B64	15.43	9.66 s	—	21.89	324.3	1	10c64aff ↗

1 other test configurations on this GPU
- bf16 · Text → Structured data · typed-invoices-v1 · Test duration 6 s
  Throughput · Batch 16
  47.7decisions/sec
  Observed GPU occupancy
  19.5GiB
  P95 latency
  338 ms
  Use this recipe · Batch 16 ↗Evidence report and run availability ↗Same test on other GPUs
  Test details
  Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
  Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
  Engine
  clef-native · PyTorch 2.11.0+cu130
  Protocol
  native-forward-v1
  Dataset
  typed-invoices-v1
  Workload
  decision
  Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report
  B16 47.71 338 ms — 19.55 499.5 2 82d98b36 ↗

Batch size	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B16	47.71	338 ms	—	19.55	499.5	2	82d98b36 ↗

vGPU-32GB · 32 GBbf16 · Text → Structured data · typed-invoices-v1 · Test duration 1 s
Throughput · Batch 1
10.3decisions/sec
Best measured · Batch 4
10.9decisions/sec
Observed GPU occupancy
18.2GiB
P95 latency
104 ms
Use this recipe · Batch 4 ↗Evidence report and run availability ↗Same test on other GPUs
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
Engine
clef-native
Protocol
native-forward-v1
Dataset
typed-invoices-v1
Workload
decision
Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report
B1 10.26 104 ms — 18.17 67.9 1 1d1661ad ↗
B4 10.89 389 ms — 18.49 156 1 1d1661ad ↗
3 other test configurations on this GPU
- bf16 · Text → Structured data · typed-invoices-v1 · Test duration 6 s
  Throughput · Batch 1
  10.6decisions/sec
  Best measured · Batch 4
  11decisions/sec
  Observed GPU occupancy
  18.2GiB
  P95 latency
  99 ms
  Use this recipe · Batch 4 ↗Evidence report and run availability ↗Same test on other GPUs
  Test details · 2 batch sizes
  Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
  Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
  Engine
  clef-native · PyTorch 2.13.0+cu130
  Protocol
  native-forward-v1
  Dataset
  typed-invoices-v1
  Workload
  decision
  Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report
  B1 10.56 99 ms — 18.17 206.1 2 63f44036 ↗
  B4 11.04 402 ms — 18.55 244.4 2 63f44036 ↗
- bf16 · Text → Structured data · typed-invoices-v1 · Test duration 6 s
  Throughput · Batch 1
  10.6decisions/sec
  Best measured · Batch 4
  11.1decisions/sec
  Observed GPU occupancy
  18.2GiB
  P95 latency
  103 ms
  Use this recipe · Batch 4 ↗Evidence report and run availability ↗Same test on other GPUs
  Test details · 2 batch sizes
  Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
  Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
  Engine
  clef-native
  Protocol
  native-forward-v1
  Dataset
  typed-invoices-v1
  Workload
  decision
  Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report
  B1 10.56 103 ms — 18.17 196.8 1 4eb73a4d ↗
  B4 11.1 390 ms — 18.56 235.9 1 4eb73a4d ↗
- bf16 · 1K → 1K tokens
  Throughput · Batch 1
  10.2decisions/sec
  Best measured · Batch 4
  10.9decisions/sec
  Observed GPU occupancy
  18.2GiB
  P95 latency
  104 ms
  Use this recipe · Batch 4 ↗Evidence report and run availability ↗Same test on other GPUs
  Test details · 2 batch sizes
  Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
  Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
  Engine
  vLLM
  Protocol
  native-forward-v1
  Dataset
  typed-invoices-v1
  Workload
  decision
  Batch size Mean throughput (decisions/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report
  B1 10.19 104 ms — 18.17 69.8 1 caef7154 ↗
  B4 10.88 388 ms — 18.49 152.8 1 caef7154 ↗

Batch size	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	10.26	104 ms	—	18.17	67.9	1	1d1661ad ↗
B4	10.89	389 ms	—	18.49	156	1	1d1661ad ↗

Batch size	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	10.56	99 ms	—	18.17	206.1	2	63f44036 ↗
B4	11.04	402 ms	—	18.55	244.4	2	63f44036 ↗

Batch size	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	10.56	103 ms	—	18.17	196.8	1	4eb73a4d ↗
B4	11.1	390 ms	—	18.56	235.9	1	4eb73a4d ↗

Batch size	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	10.19	104 ms	—	18.17	69.8	1	caef7154 ↗
B4	10.88	388 ms	—	18.49	152.8	1	caef7154 ↗

Sortable tables by exact test condition · 13 rows

Decision · 1K → 1K tokens · Batch 1 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	vGPU-32GB · 32 GB	bf16	vLLM	10.19	104 ms	—	18.17	69.8	1	caef7154 ↗

Decision · 1K → 1K tokens · Batch 4 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	vGPU-32GB · 32 GB	bf16	vLLM	10.88	388 ms	—	18.49	152.8	1	caef7154 ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 1 s · Batch 1 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	vGPU-32GB · 32 GB	bf16	clef-native	10.26	104 ms	—	18.17	67.9	1	1d1661ad ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 1 s · Batch 4 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	vGPU-32GB · 32 GB	bf16	clef-native	10.89	389 ms	—	18.49	156	1	1d1661ad ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 6 s · Batch 1 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	vGPU-32GB · 32 GB	bf16	clef-nativePyTorch 2.13.0+cu130	10.56	99 ms	—	18.17	206.1	2	63f44036 ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 6 s · Batch 1 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	vGPU-32GB · 32 GB	bf16	clef-native	10.56	103 ms	—	18.17	196.8	1	4eb73a4d ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 6 s · Batch 4 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	vGPU-32GB · 32 GB	bf16	clef-nativePyTorch 2.13.0+cu130	11.04	402 ms	—	18.55	244.4	2	63f44036 ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 6 s · Batch 4 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	vGPU-32GB · 32 GB	bf16	clef-native	11.1	390 ms	—	18.56	235.9	1	4eb73a4d ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 6 s · Batch 16 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	RTX PRO 6000 Blackwell Server Edition · 96 GB	bf16	clef-nativePyTorch 2.11.0+cu130	47.71	338 ms	—	19.55	499.5	2	82d98b36 ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 33 s · Batch 1 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	RTX PRO 6000 Blackwell Server Edition · 96 GB	bf16	clef-nativePyTorch 2.11.0	31.83	32 ms	—	18.95	388.5	1	10c64aff ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 33 s · Batch 4 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	RTX PRO 6000 Blackwell Server Edition · 96 GB	bf16	clef-nativePyTorch 2.11.0	39.27	93 ms	—	18.95	449.5	1	10c64aff ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 33 s · Batch 16 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	RTX PRO 6000 Blackwell Server Edition · 96 GB	bf16	clef-nativePyTorch 2.11.0	5.41	8.21 s	—	19.28	233.4	1	10c64aff ↗

Decision · Text → Structured data · typed-invoices-v1 · Test duration 33 s · Batch 64 · decisions/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (decisions/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
clef-flash	RTX PRO 6000 Blackwell Server Edition · 96 GB	bf16	clef-nativePyTorch 2.11.0	15.43	9.66 s	—	21.89	324.3	1	10c64aff ↗