Benchmark reports
999 reports · Newest first · Page 33 / 40
HY-MT1.5-1.8B-Q4_K_M
/root/.cache/modelscope/hub/models/Tencent-Hunyuan/HY-MT1___5-1___8B-GGUF/HY-MT1.5-1.8B-Q4_K_M.gguf
RTX 4090D · 48 GB
Text generation · Q4_K_M · vLLM
Qwen3-1.7B-Q8_0
/root/.cache/modelscope/hub/models/Qwen/Qwen3-1___7B-GGUF/Qwen3-1.7B-Q8_0.gguf
RTX 4090D · 48 GB
Text generation · Q8_0 · vLLM
Qwen3-0.6B-Q8_0
/root/.cache/modelscope/hub/models/Qwen/Qwen3-0___6B-GGUF/Qwen3-0.6B-Q8_0.gguf
RTX 4090D · 48 GB
Text generation · Q8_0 · vLLM
Qwen2.5-0.5B-Q4_K_M
/root/.cache/huggingface/hub/models--Qwen--Qwen2.5-0.5B-Instruct-GGUF/snapshots/9217f5db79a29953eb74d5343926648285ec7e67/qwen2.5-0.5b-instruct-q4_k_m.gguf
RTX 4090D · 48 GB
Text generation · Q4_K_M · vLLM
Qwen3-32B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-32B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-30B-A3B-Thinking-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-30B-A3B-Thinking-2507-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-30B-A3B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-30B-A3B-Instruct-2507-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-30B-A3B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-30B-A3B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-14B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-14B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-8B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-8B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-8B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-8B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-4B-Instruct-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-4B-Instruct-2507-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-4B-Thinking-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-4B-Thinking-2507-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-4B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-4B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-4B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-4B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-2B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-2B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-1.7B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-1___7B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-0.6B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-0___6B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-32B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-32B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-30B-A3B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-30B-A3B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-8B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-8B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-VL-4B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-4B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-30B-A3B-Thinking-FP8
/home/lyx/.cache/modelscope/hub/models/Qwen/Qwen3-30B-A3B-Thinking-2507-FP8
RTX PRO 6000 Blackwell Workstation Edition · 96 GB
Text generation · FP8 · vLLM
Qwen3-4B-Instruct-FP8
/home/lyx/.cache/modelscope/hub/models/Qwen/Qwen3-4B-Instruct-2507-FP8
RTX PRO 6000 Blackwell Workstation Edition · 96 GB
Text generation · FP8 · vLLM
Qwen3-4B-Thinking-FP8
/home/lyx/.cache/modelscope/hub/models/Qwen/Qwen3-4B-Thinking-2507-FP8
RTX PRO 6000 Blackwell Workstation Edition · 96 GB
Text generation · FP8 · vLLM
Updated