1 models with qualified results

Models

Measured configurations by model. Open a model to compare GPUs on one exact test.

Run this model

Choose your operating system and enter a model repository. Launch support is checked separately from performance results.

Embedding · All measured GPUs

Speeds compare only within one exact test. Recipe availability is checked on each report against the published recipe executor.

embeddinggemma-2

google · 11 tested configurations · 4 GPUs

L4 · 24 GBnf4 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s

Throughput · Batch 1: 175vectors/sec
Best measured · Batch 16: 1,639vectors/sec
Observed GPU occupancy: 0.9GiB
P95 latency: 6 ms

Use this recipe · Batch 16 ↗Evidence report and run availability ↗Same test on other GPUs

Test details · 3 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: sentence-transformers · PyTorch 2.12.1+cu126
Protocol: native-forward-v1
Dataset: embedding-mteb-tasks-v1
Workload: embedding

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	174.88	6 ms	—	0.85	53.1	6	7ad6a821 ↗
B4	571.03	7 ms	—	0.85	57	6	7ad6a821 ↗
B16	1,639.08	10 ms	—	0.85	59.8	6	7ad6a821 ↗

1 other test configurations on this GPU

fp16 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s

Throughput · Batch 1: 177vectors/sec
Best measured · Batch 16: 2,039vectors/sec
Observed GPU occupancy: 1GiB
P95 latency: 6 ms

Use this recipe · Batch 16 ↗Evidence report and run availability ↗Same test on other GPUs

Test details · 3 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: sentence-transformers · PyTorch 2.12.1+cu126
Protocol: native-forward-v1
Dataset: embedding-mteb-tasks-v1
Workload: embedding

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	177.46	6 ms	—	0.99	49.8	6	e0700e04 ↗
B4	650.16	6 ms	—	0.99	56.9	6	e0700e04 ↗
B16	2,039.17	8 ms	—	0.99	58.4	6	e0700e04 ↗

RTX PRO 6000 Blackwell Server Edition · 96 GBnf4 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s

Throughput · Batch 1: 189vectors/sec
Best measured · Batch 16: 2,572vectors/sec
Observed GPU occupancy: 1.3GiB
P95 latency: 6 ms

Use this recipe · Batch 16 ↗Evidence report and run availability ↗Same test on other GPUs

Test details · 3 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: sentence-transformers · PyTorch 2.12.1+cu130
Protocol: native-forward-v1
Dataset: embedding-mteb-tasks-v1
Workload: embedding

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	189.23	6 ms	—	1.33	145.5	1	c673556b ↗
B4	713.32	6 ms	—	1.33	142.8	1	c673556b ↗
B16	2,571.53	7 ms	—	1.33	162.7	1	c673556b ↗

1 other test configurations on this GPU

fp16 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s

Throughput · Batch 1: 207vectors/sec
Best measured · Batch 16: 2,939vectors/sec
Observed GPU occupancy: 1.5GiB
P95 latency: 5 ms

Use this recipe · Batch 16 ↗Evidence report and run availability ↗Same test on other GPUs

Test details · 3 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: sentence-transformers · PyTorch 2.12.1+cu130
Protocol: native-forward-v1
Dataset: embedding-mteb-tasks-v1
Workload: embedding

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	206.79	5 ms	—	1.48	119.3	1	196678d3 ↗
B4	764.95	6 ms	—	1.48	141.4	1	196678d3 ↗
B16	2,938.63	6 ms	—	1.48	161.8	1	196678d3 ↗

T4 · 16 GBnf4 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s

Throughput · Batch 1: 90vectors/sec
Best measured · Batch 16: 815vectors/sec
Observed GPU occupancy: 0.7GiB
P95 latency: 11 ms

Use this recipe · Batch 16 ↗Evidence report and run availability ↗Same test on other GPUs

Test details · 3 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: sentence-transformers · PyTorch 2.12.1+cu126
Protocol: native-forward-v1
Dataset: embedding-mteb-tasks-v1
Workload: embedding

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	90.02	11 ms	—	0.75	54.6	2	43c67a74 ↗
B4	303.35	13 ms	—	0.75	60.1	2	43c67a74 ↗
B16	814.64	20 ms	—	0.75	64.1	2	43c67a74 ↗

1 other test configurations on this GPU

fp16 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s

Throughput · Batch 1: 109vectors/sec
Best measured · Batch 16: 1,004vectors/sec
Observed GPU occupancy: 0.9GiB
P95 latency: 9 ms

Use this recipe · Batch 16 ↗Evidence report and run availability ↗Same test on other GPUs

Test details · 3 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: sentence-transformers · PyTorch 2.12.1+cu126
Protocol: native-forward-v1
Dataset: embedding-mteb-tasks-v1
Workload: embedding

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	108.65	9 ms	—	0.89	49.3	2	2846de88 ↗
B4	365.65	11 ms	—	0.89	57.9	2	2846de88 ↗
B16	1,004.11	16 ms	—	0.89	63.9	2	2846de88 ↗

Show 1 more GPUs

vGPU-32GB · 32 GBbf16 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 9 s

Throughput · Batch 1: 251vectors/sec
Best measured · Batch 16: 2,710vectors/sec
Observed GPU occupancy: 1GiB
P95 latency: 4 ms

Use this recipe · Batch 16 ↗Evidence report and run availability ↗Same test on other GPUs

Test details · 3 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: sentence-transformers · PyTorch 2.13.0+cu130
Protocol: native-forward-v1
Dataset: embedding-mteb-tasks-v1
Workload: embedding

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	251.11	4 ms	—	1.05	99.4	1	f489c748 ↗
B4	924.83	4 ms	—	1.05	111.5	1	f489c748 ↗
B16	2,710.19	6 ms	—	1.05	114.9	1	f489c748 ↗

4 other test configurations on this GPU

bf16 · Text → Vectors · embedding-sanity-v1 · Test duration 6 s
Throughput · Batch 1
38.3vectors/sec
Best measured · Batch 4
139vectors/sec
Observed GPU occupancy
0.8GiB
P95 latency
31 ms
Use this recipe · Batch 4 ↗Evidence report and run availability ↗Same test on other GPUs
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
Engine
sentence-transformers · PyTorch 2.13.0+cu130
Protocol
native-forward-v1
Dataset
embedding-sanity-v1
Workload
embedding
Batch size Mean throughput (vectors/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report
B1 38.33 31 ms — 0.82 50.5 4 2c17d254 ↗
B4 138.64 33 ms — 0.82 54.2 4 2c17d254 ↗

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	38.33	31 ms	—	0.82	50.5	4	2c17d254 ↗
B4	138.64	33 ms	—	0.82	54.2	4	2c17d254 ↗

bf16 · Text → Vectors · embedding-sanity-v1 · Test duration 12 s

Throughput · Batch 1: 38.8vectors/sec
Best measured · Batch 64: 1,766vectors/sec
Observed GPU occupancy: 0.8GiB
P95 latency: 27 ms

Use this recipe · Batch 64 ↗Evidence report and run availability ↗Same test on other GPUs

Test details · 4 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: sentence-transformers · PyTorch 2.13.0+cu130
Protocol: native-forward-v1
Dataset: embedding-sanity-v1
Workload: embedding

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	38.8	27 ms	—	0.82	48.8	1	dc5960cd ↗
B4	141.65	29 ms	—	0.82	52.4	1	dc5960cd ↗
B16	553.54	30 ms	—	0.87	56.4	1	dc5960cd ↗
B64	1,766.47	38 ms	—	1.03	65.3	1	dc5960cd ↗

bf16 · Text → Vectors · embedding-sanity-v1 · Test duration 6 s
Throughput · Batch 1
38.3vectors/sec
Best measured · Batch 4
138vectors/sec
Observed GPU occupancy
0.8GiB
P95 latency
32 ms
Use this recipe · Batch 4 ↗Evidence report and run availability ↗Same test on other GPUs
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
Engine
sentence-transformers
Protocol
native-forward-v1
Dataset
embedding-sanity-v1
Workload
embedding
Batch size Mean throughput (vectors/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report
B1 38.27 32 ms — 0.82 48.6 1 47f71b64 ↗
B4 137.82 35 ms — 0.82 51.9 1 47f71b64 ↗
bf16 · Text → Vectors · embedding-sanity-v1
Throughput · Batch 1
39.4vectors/sec
Best measured · Batch 4
120vectors/sec
Observed GPU occupancy
Not recorded
P95 latency
26 ms
Use this recipe · Batch 4 ↗Evidence report and run availability ↗Same test on other GPUs
Test details · 2 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
Engine
sentence-transformers
Protocol
native-forward-v1
Dataset
embedding-sanity-v1
Workload
embedding
Batch size Mean throughput (vectors/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report
B1 39.4 26 ms — — — 1 2c97c869 ↗
B4 119.85 44 ms — — — 1 2c97c869 ↗

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	38.27	32 ms	—	0.82	48.6	1	47f71b64 ↗
B4	137.82	35 ms	—	0.82	51.9	1	47f71b64 ↗

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	39.4	26 ms	—	—	—	1	2c97c869 ↗
B4	119.85	44 ms	—	—	—	1	2c97c869 ↗

Sortable tables by exact test condition · 31 rows

Embedding · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 9 s · Batch 1 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformersPyTorch 2.13.0+cu130	251.11	4 ms	—	1.05	99.4	1	f489c748 ↗

Embedding · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 9 s · Batch 4 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformersPyTorch 2.13.0+cu130	924.83	4 ms	—	1.05	111.5	1	f489c748 ↗

Embedding · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 9 s · Batch 16 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformersPyTorch 2.13.0+cu130	2,710.19	6 ms	—	1.05	114.9	1	f489c748 ↗

Embedding · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s · Batch 1 · vectors/sec · 3 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	RTX PRO 6000 Blackwell Server Edition · 96 GB	nf4	sentence-transformersPyTorch 2.12.1+cu130	189.23	6 ms	—	1.33	145.5	1	c673556b ↗
embeddinggemma-2	L4 · 24 GB	nf4	sentence-transformersPyTorch 2.12.1+cu126	174.88	6 ms	—	0.85	53.1	6	7ad6a821 ↗
embeddinggemma-2	T4 · 16 GB	nf4	sentence-transformersPyTorch 2.12.1+cu126	90.02	11 ms	—	0.75	54.6	2	43c67a74 ↗

Embedding · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s · Batch 1 · vectors/sec · 3 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	RTX PRO 6000 Blackwell Server Edition · 96 GB	fp16	sentence-transformersPyTorch 2.12.1+cu130	206.79	5 ms	—	1.48	119.3	1	196678d3 ↗
embeddinggemma-2	L4 · 24 GB	fp16	sentence-transformersPyTorch 2.12.1+cu126	177.46	6 ms	—	0.99	49.8	6	e0700e04 ↗
embeddinggemma-2	T4 · 16 GB	fp16	sentence-transformersPyTorch 2.12.1+cu126	108.65	9 ms	—	0.89	49.3	2	2846de88 ↗

Embedding · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s · Batch 4 · vectors/sec · 3 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	RTX PRO 6000 Blackwell Server Edition · 96 GB	nf4	sentence-transformersPyTorch 2.12.1+cu130	713.32	6 ms	—	1.33	142.8	1	c673556b ↗
embeddinggemma-2	L4 · 24 GB	nf4	sentence-transformersPyTorch 2.12.1+cu126	571.03	7 ms	—	0.85	57	6	7ad6a821 ↗
embeddinggemma-2	T4 · 16 GB	nf4	sentence-transformersPyTorch 2.12.1+cu126	303.35	13 ms	—	0.75	60.1	2	43c67a74 ↗

Embedding · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s · Batch 4 · vectors/sec · 3 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	RTX PRO 6000 Blackwell Server Edition · 96 GB	fp16	sentence-transformersPyTorch 2.12.1+cu130	764.95	6 ms	—	1.48	141.4	1	196678d3 ↗
embeddinggemma-2	L4 · 24 GB	fp16	sentence-transformersPyTorch 2.12.1+cu126	650.16	6 ms	—	0.99	56.9	6	e0700e04 ↗
embeddinggemma-2	T4 · 16 GB	fp16	sentence-transformersPyTorch 2.12.1+cu126	365.65	11 ms	—	0.89	57.9	2	2846de88 ↗

Embedding · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s · Batch 16 · vectors/sec · 3 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	RTX PRO 6000 Blackwell Server Edition · 96 GB	nf4	sentence-transformersPyTorch 2.12.1+cu130	2,571.53	7 ms	—	1.33	162.7	1	c673556b ↗
embeddinggemma-2	L4 · 24 GB	nf4	sentence-transformersPyTorch 2.12.1+cu126	1,639.08	10 ms	—	0.85	59.8	6	7ad6a821 ↗
embeddinggemma-2	T4 · 16 GB	nf4	sentence-transformersPyTorch 2.12.1+cu126	814.64	20 ms	—	0.75	64.1	2	43c67a74 ↗

Embedding · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s · Batch 16 · vectors/sec · 3 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	RTX PRO 6000 Blackwell Server Edition · 96 GB	fp16	sentence-transformersPyTorch 2.12.1+cu130	2,938.63	6 ms	—	1.48	161.8	1	196678d3 ↗
embeddinggemma-2	L4 · 24 GB	fp16	sentence-transformersPyTorch 2.12.1+cu126	2,039.17	8 ms	—	0.99	58.4	6	e0700e04 ↗
embeddinggemma-2	T4 · 16 GB	fp16	sentence-transformersPyTorch 2.12.1+cu126	1,004.11	16 ms	—	0.89	63.9	2	2846de88 ↗

Embedding · Text → Vectors · embedding-sanity-v1 · Batch 1 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformers	39.4	26 ms	—	—	—	1	2c97c869 ↗

Embedding · Text → Vectors · embedding-sanity-v1 · Batch 4 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformers	119.85	44 ms	—	—	—	1	2c97c869 ↗

Embedding · Text → Vectors · embedding-sanity-v1 · Test duration 6 s · Batch 1 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformersPyTorch 2.13.0+cu130	38.33	31 ms	—	0.82	50.5	4	2c17d254 ↗

Embedding · Text → Vectors · embedding-sanity-v1 · Test duration 6 s · Batch 1 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformers	38.27	32 ms	—	0.82	48.6	1	47f71b64 ↗

Embedding · Text → Vectors · embedding-sanity-v1 · Test duration 6 s · Batch 4 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformersPyTorch 2.13.0+cu130	138.64	33 ms	—	0.82	54.2	4	2c17d254 ↗

Embedding · Text → Vectors · embedding-sanity-v1 · Test duration 6 s · Batch 4 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformers	137.82	35 ms	—	0.82	51.9	1	47f71b64 ↗

Embedding · Text → Vectors · embedding-sanity-v1 · Test duration 12 s · Batch 1 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformersPyTorch 2.13.0+cu130	38.8	27 ms	—	0.82	48.8	1	dc5960cd ↗

Embedding · Text → Vectors · embedding-sanity-v1 · Test duration 12 s · Batch 4 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformersPyTorch 2.13.0+cu130	141.65	29 ms	—	0.82	52.4	1	dc5960cd ↗

Embedding · Text → Vectors · embedding-sanity-v1 · Test duration 12 s · Batch 16 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformersPyTorch 2.13.0+cu130	553.54	30 ms	—	0.87	56.4	1	dc5960cd ↗

Embedding · Text → Vectors · embedding-sanity-v1 · Test duration 12 s · Batch 64 · vectors/sec · 1 rows
Model	Hardware	Format	Engine	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
embeddinggemma-2	vGPU-32GB · 32 GB	bf16	sentence-transformersPyTorch 2.13.0+cu130	1,766.47	38 ms	—	1.03	65.3	1	dc5960cd ↗