Benchmark reports
999 reports · Newest first · Page 36 / 40
Qwen3-0.6B
/dev/shm/gpullmbench_models/modelscope/Qwen/Qwen3-0___6B
A100-SXM4-80GB · 80 GB
Text generation · BF16 · vLLM
Qwen3-0.6B
/root/.cache/huggingface/hub/models--Qwen--Qwen3-0.6B/snapshots/c1899de289a04d12100db370d81485cdf75e47ca
A100-SXM4-80GB · 80 GB
Text generation · BF16 · vLLM
Qwen3-1.7B
/root/.cache/huggingface/hub/models--Qwen--Qwen3-1.7B/snapshots/70d244cc86ccca08cf5af4e1e306ecf908b1ad5e
A100-SXM4-80GB · 80 GB
Text generation · BF16 · vLLM
Qwen3-0.6B
/root/.cache/huggingface/hub/models--Qwen--Qwen3-0.6B/snapshots/c1899de289a04d12100db370d81485cdf75e47ca
A100-SXM4-80GB · 80 GB
Text generation · BF16 · vLLM
Qwen2.5-72B-AWQ
/root/.cache/modelscope/hub/models/Qwen/Qwen2___5-72B-Instruct-AWQ
RTX 4090D · 48 GB
Text generation · AWQ · vLLM
Qwen3-VL-32B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-32B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-32B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-32B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-32B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-32B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-30B-A3B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-30B-A3B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-30B-A3B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-30B-A3B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-14B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-14B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-8B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-8B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-8B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-8B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Hunyuan-7B-FP8
/root/.cache/modelscope/hub/models/Tencent-Hunyuan/HY-MT1___5-7B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-4B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-4B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-4B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-4B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-2B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-2B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-0.6B-FP8
/home/lyx/.cache/modelscope/hub/models/Qwen/Qwen3-0___6B-FP8
RTX PRO 6000 Blackwell Workstation Edition · 96 GB
Text generation · FP8 · vLLM
Hunyuan-1.8B-FP8
/root/.cache/modelscope/hub/models/Tencent-Hunyuan/HY-MT1___5-1___8B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-1.7B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-1___7B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-0.6B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-0___6B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-32B-FP8
/home/lyx/.cache/modelscope/hub/models/Qwen/Qwen3-VL-32B-Instruct-FP8
RTX PRO 6000 Blackwell Workstation Edition · 96 GB
Text generation · FP8 · vLLM
Qwen3-VL-32B-Instruct
/home/lyx/.cache/modelscope/hub/models/Qwen/Qwen3-VL-32B-Instruct
RTX PRO 6000 Blackwell Workstation Edition · 96 GB
Text generation · Native · vLLM
Qwen3-VL-30B-A3B-FP8
/home/lyx/.cache/modelscope/hub/models/Qwen/Qwen3-VL-30B-A3B-Instruct-FP8
RTX PRO 6000 Blackwell Workstation Edition · 96 GB
Text generation · FP8 · vLLM
Qwen3-VL-30B-A3B-Instruct
/home/lyx/.cache/modelscope/hub/models/Qwen/Qwen3-VL-30B-A3B-Instruct
RTX PRO 6000 Blackwell Workstation Edition · 96 GB
Text generation · Native · vLLM
Updated