96 GB · 196 reports
RTX PRO 6000 Blackwell Server Edition · 96 GB
Qualified results first; original reports and full tables stay below.
Embedding · Qualified results
Speeds compare only within one exact test. Recipe availability is checked on each report against the published recipe executor.
embeddinggemma-2
google · 2 tested configurations
- fp16 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s
- Throughput · Batch 1
- 207vectors/sec
- Best measured · Batch 16
- 2,939vectors/sec
- Observed GPU occupancy
- 1.5GiB
- P95 latency
- 5 ms
Test details · 3 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- sentence-transformers · PyTorch 2.12.1+cu130
- Protocol
- native-forward-v1
- Dataset
- embedding-mteb-tasks-v1
- Workload
- embedding
Batch size Mean throughput (vectors/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 206.79 5 ms — 1.48 119.3 1 196678d3 ↗ B4 764.95 6 ms — 1.48 141.4 1 196678d3 ↗ B16 2,938.63 6 ms — 1.48 161.8 1 196678d3 ↗ 1 other test configurations on this GPU
- nf4 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s
- Throughput · Batch 1
- 189vectors/sec
- Best measured · Batch 16
- 2,572vectors/sec
- Observed GPU occupancy
- 1.3GiB
- P95 latency
- 6 ms
Test details · 3 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- sentence-transformers · PyTorch 2.12.1+cu130
- Protocol
- native-forward-v1
- Dataset
- embedding-mteb-tasks-v1
- Workload
- embedding
Batch size Mean throughput (vectors/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 189.23 6 ms — 1.33 145.5 1 c673556b ↗ B4 713.32 6 ms — 1.33 142.8 1 c673556b ↗ B16 2,571.53 7 ms — 1.33 162.7 1 c673556b ↗
Qwen3-Embedding-0.6B
Qwen · 3 tested configurations
- fp16 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 90 s
- Throughput · Batch 1
- 232vectors/sec
- Best measured · Batch 32
- 3,763vectors/sec
- Observed GPU occupancy
- 2.2GiB
- P95 latency
- 5 ms
Test details · 3 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- sentence-transformers · PyTorch 2.12.1+cu130
- Protocol
- native-forward-v1
- Dataset
- embedding-mteb-tasks-v1
- Workload
- embedding
Batch size Mean throughput (vectors/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 232.18 5 ms — 2.22 155 1 65594583 ↗ B8 1,601.21 5 ms — 2.22 191.2 1 65594583 ↗ B32 3,763.07 9 ms — 2.22 208.7 1 65594583 ↗ 2 other test configurations on this GPU
- nf4 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 15 s
- Throughput · Batch 1
- 196vectors/sec
- Best measured · Batch 32
- 3,091vectors/sec
- Observed GPU occupancy
- 1.6GiB
- P95 latency
- 5 ms
Test details · 3 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- sentence-transformers · PyTorch 2.12.1+cu130
- Protocol
- native-forward-v1
- Dataset
- embedding-mteb-tasks-v1
- Workload
- embedding
Batch size Mean throughput (vectors/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 195.8 5 ms — 1.61 174.8 1 b9501833 ↗ B8 1,156.9 7 ms — 1.61 196 1 b9501833 ↗ B32 3,091.08 10 ms — 1.61 207.4 1 b9501833 ↗ - fp16 · Text → Vectors · embedding-mteb-tasks-v1 · Test duration 15 s
- Throughput · Batch 1
- 218vectors/sec
- Best measured · Batch 32
- 3,617vectors/sec
- Observed GPU occupancy
- 2.2GiB
- P95 latency
- 5 ms
Test details · 3 batch sizes
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.
- Engine
- sentence-transformers · PyTorch 2.12.1+cu130
- Protocol
- native-forward-v1
- Dataset
- embedding-mteb-tasks-v1
- Workload
- embedding
Batch size Mean throughput (vectors/sec) P95 TTFT Observed occupancy (GiB) GPU power (W) Reports combined View report B1 217.92 5 ms — 2.22 156.5 1 a7d85bcf ↗ B8 1,494.89 5 ms — 2.22 185.4 1 a7d85bcf ↗ B32 3,616.74 9 ms — 2.22 206.8 1 a7d85bcf ↗
Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.
Sortable tables by exact test condition · 15 rows
C: concurrency · B: batch · —: not measured
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-Embedding-0.6BScaling curves ↗ | nf4 | sentence-transformers | embeddingnative-forward-v1 | B1 | 195.8 | 195.8 | — | 0.005 | 1.61 | 174.8 | 195.8 | 1.12 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-Embedding-0.6BScaling curves ↗ | fp16 | sentence-transformers | embeddingnative-forward-v1 | B1 | 217.92 | 217.92 | — | 0.005 | 2.22 | 156.5 | 217.92 | 1.39 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-Embedding-0.6BScaling curves ↗ | nf4 | sentence-transformers | embeddingnative-forward-v1 | B8 | 1,156.9 | 1,156.9 | — | 0.007 | 1.61 | 196 | 1,156.9 | 5.9 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-Embedding-0.6BScaling curves ↗ | fp16 | sentence-transformers | embeddingnative-forward-v1 | B8 | 1,494.89 | 1,494.89 | — | 0.005 | 2.22 | 185.4 | 1,494.89 | 8.06 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-Embedding-0.6BScaling curves ↗ | nf4 | sentence-transformers | embeddingnative-forward-v1 | B32 | 3,091.08 | 3,091.08 | — | 0.01 | 1.61 | 207.4 | 3,091.08 | 14.9 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-Embedding-0.6BScaling curves ↗ | fp16 | sentence-transformers | embeddingnative-forward-v1 | B32 | 3,616.74 | 3,616.74 | — | 0.009 | 2.22 | 206.8 | 3,616.74 | 17.49 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| google/embeddinggemma-2Scaling curves ↗ | fp16 | sentence-transformers | embeddingnative-forward-v1 | B1 | 206.79 | 206.79 | — | 0.005 | 1.48 | 119.3 | 206.79 | 1.73 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| google/embeddinggemma-2Scaling curves ↗ | nf4 | sentence-transformers | embeddingnative-forward-v1 | B1 | 189.23 | 189.23 | — | 0.006 | 1.33 | 145.5 | 189.23 | 1.3 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-Embedding-0.6BScaling curves ↗ | fp16 | sentence-transformers | embeddingnative-forward-v1 | B1 | 232.18 | 232.18 | — | 0.005 | 2.22 | 155 | 232.18 | 1.5 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| google/embeddinggemma-2Scaling curves ↗ | fp16 | sentence-transformers | embeddingnative-forward-v1 | B4 | 764.95 | 764.95 | — | 0.006 | 1.48 | 141.4 | 764.95 | 5.41 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| google/embeddinggemma-2Scaling curves ↗ | nf4 | sentence-transformers | embeddingnative-forward-v1 | B4 | 713.32 | 713.32 | — | 0.006 | 1.33 | 142.8 | 713.32 | 4.99 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-Embedding-0.6BScaling curves ↗ | fp16 | sentence-transformers | embeddingnative-forward-v1 | B8 | 1,601.21 | 1,601.21 | — | 0.005 | 2.22 | 191.2 | 1,601.21 | 8.37 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| google/embeddinggemma-2Scaling curves ↗ | fp16 | sentence-transformers | embeddingnative-forward-v1 | B16 | 2,938.63 | 2,938.63 | — | 0.006 | 1.48 | 161.8 | 2,938.63 | 18.16 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| google/embeddinggemma-2Scaling curves ↗ | nf4 | sentence-transformers | embeddingnative-forward-v1 | B16 | 2,571.53 | 2,571.53 | — | 0.007 | 1.33 | 162.7 | 2,571.53 | 15.8 | 1 ↗ |
| Model | Format | Engine | Workload | Concurrency / batch | Mean throughput | Best measured | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | GPU power (W) | Lowest measured | Throughput / W | Reports combined |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen3-Embedding-0.6BScaling curves ↗ | fp16 | sentence-transformers | embeddingnative-forward-v1 | B32 | 3,763.07 | 3,763.07 | — | 0.009 | 2.22 | 208.7 | 3,763.07 | 18.03 | 1 ↗ |
Scaling curves and individual runs
One model and test protocol per curve; different workloads are never joined into one line.
google/embeddinggemma-2 · fp16 · sentence-transformers · embedding · native-forward-v1
Measured points only. Select a point to open its source report.
Measured points only. Select a point to open its source report.
Measured points only. Select a point to open its source report.
Each point is the mean of recorded runs at that level. A source report may differ from the mean; all runs are listed below.
| Batch size | Throughput | Decode (tok/s) | Uncached prefill (tok/s) | GPU power (W) | TTFT (ms) | P95 (s) | Observed occupancy (GiB) | Test date | View report |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 206.79 vectors/sec | — | Uncached prefill unavailableView report | 119.33 | — | 0.005 | 1.48 | 10/19/2026, 10:00:34 PM | 196678d3 ↗ |
| 4 | 764.95 vectors/sec | — | Uncached prefill unavailableView report | 141.4 | — | 0.006 | 1.48 | 10/19/2026, 10:00:34 PM | 196678d3 ↗ |
| 16 | 2,938.63 vectors/sec | — | Uncached prefill unavailableView report | 161.85 | — | 0.006 | 1.48 | 10/19/2026, 10:00:34 PM | 196678d3 ↗ |
Original reports
Every report for this task, including quality, diagnostic and legacy runs that do not enter comparisons.
| Model | Test task | Format | Engine | Workload | Protocol | Quality score | Test date |
|---|---|---|---|---|---|---|---|
| embeddinggemma-2 ↗ | Embedding | fp16 | sentence-transformers | embedding | native-forward-v1 | — | 10/19/2026, 10:00:34 PM |
| embeddinggemma-2 ↗ | Embedding | nf4 | sentence-transformers | embedding | native-forward-v1 | — | 10/19/2026, 9:52:34 PM |
| Qwen3-Embedding-0.6B ↗ | Embedding | fp16 | sentence-transformers | embedding | native-forward-v1 | — | 10/14/2026, 8:39:45 AM |
| Qwen3-Embedding-0.6B ↗ | Embedding | nf4 | sentence-transformers | embedding | native-forward-v1 | — | 10/14/2026, 6:35:06 AM |
| Qwen3-Embedding-0.6B ↗ | Embedding | fp16 | sentence-transformers | embedding | native-forward-v1 | — | 10/14/2026, 6:31:26 AM |
Running benchmarks
0Updates automaticallyNo benchmarks are currently reported as running.
RTX PRO 6000 Blackwell Server Edition · 96 GB · 403 queued · 0 running · 0 awaiting reassignment · 6 succeeded · 3 failed or exhausted
Methodology
Average of error-free runs for the selected recorded configuration. Missing methods and fallback runs are not ranked. Performance index = average / fastest matching hardware × 100. Value index = performance per purchase cost / best comparable value × 100. Quality is separate by dataset and protocol. Prices are dated seller listings, not completed transactions or market averages.
Updated 11/5/2026, 11:07:29 PM