0 models with qualified results

Models

Measured configurations by model. Open a model to compare GPUs on one exact test.

Run this model

Choose your operating system and enter a model repository. Launch support is checked separately from performance results.

Embedding · L4 · 24 GB

Speeds compare only within one exact test. Recipe availability is checked on each report against the published recipe executor.

No configurations match these filters.

Clear filters

Measured alternatives on other GPUs

Measured on different GPUs with the same or smaller listed capacity. These are references for choosing hardware, not performance or compatibility evidence for your selected GPU.

Qwen3-Embedding-4B

Qwen · 2 tested configurations · 1 GPU

RTX 4090 · 24 GBfp16 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 3 s
Throughput · Batch 16
498vectors/sec
Observed GPU occupancy
8.2GiB
P95 latency
33 ms
Use this recipe · Batch 16 ↗Evidence report and run availability ↗Same test on other GPUs
Test details
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
Engine
sentence-transformers · PyTorch 2.12.1+cu126
Protocol
native-forward-v1
Dataset
embedding-mteb-tasks-v1
Workload
embedding
Batch size Mean throughput (vectors/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report
B16 497.84 33 ms — 8.22 262.8 1 0d6d756e ↗

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B16	497.84	33 ms	—	8.22	262.8	1	0d6d756e ↗

1 other test configurations on this GPU

fp16 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s

Throughput · Batch 1: 81.2vectors/sec
Best measured · Batch 16: 507vectors/sec
Observed GPU occupancy: 8.3GiB
P95 latency: 12 ms

Use this recipe · Batch 16 ↗Evidence report and run availability ↗Same test on other GPUs

Test details · 3 batch sizes

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

Engine: sentence-transformers · PyTorch 2.12.1+cu126
Protocol: native-forward-v1
Dataset: embedding-mteb-tasks-v1
Workload: embedding

Batch size	Mean throughput (vectors/sec)	P95	TTFT	Observed occupancy (GiB)	GPU power (W)	Reports combined	View report
B1	81.19	12 ms	—	8.34	258.9	1	4f6f3fbb ↗
B4	279.31	14 ms	—	8.34	270.5	1	4f6f3fbb ↗
B16	507.04	32 ms	—	8.34	264.4	1	4f6f3fbb ↗