Benchmark reports
999 reports · Newest first · Page 39 / 40
Qwen3-VL-2B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-VL-2B-Instruct-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Hunyuan-1.8B-FP8
/root/.cache/modelscope/hub/models/Tencent-Hunyuan/HY-MT1___5-1___8B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-1.7B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-1___7B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-0.6B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-0___6B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-30B-A3B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-30B-A3B-FP8
RTX 4090D · 48 GB
Text generation · FP8 · vLLM
Qwen3-14B-FP8
/root/autodl-tmp/modelscope/Qwen/Qwen3-14B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-14B-AWQ
/home/u20250324/.cache/modelscope/hub/models/Qwen/Qwen3-14B-AWQ
RTX 3090 · 24 GB
Text generation · AWQ · vLLM
Qwen3-8B-FP8
/root/autodl-tmp/modelscope/Qwen/Qwen3-8B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-8B-AWQ
/home/u20250324/.cache/modelscope/hub/models/Qwen/Qwen3-8B-AWQ
RTX 3090 · 24 GB
Text generation · AWQ · vLLM
Qwen3-4B-FP8
/root/autodl-tmp/modelscope/Qwen/Qwen3-4B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-4B
/home/u20250324/.cache/modelscope/hub/models/Qwen/Qwen3-4B
RTX 3090 · 24 GB
Text generation · BF16 · vLLM
Qwen3-1.7B-FP8
/root/autodl-tmp/modelscope/Qwen/Qwen3-1___7B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-1.7B
/home/u20250324/.cache/modelscope/hub/models/Qwen/Qwen3-1___7B
RTX 3090 · 24 GB
Text generation · BF16 · vLLM
Qwen3-0.6B-FP8
/root/autodl-tmp/modelscope/Qwen/Qwen3-0___6B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-0.6B
/home/u20250324/.cache/modelscope/hub/models/Qwen/Qwen3-0___6B
RTX 3090 · 24 GB
Text generation · BF16 · vLLM
Qwen2.5-32B-Q4_K_M
/Users/kanshan/.cache/modelscope/hub/models/qwen/Qwen2___5-32B-Instruct-GGUF/qwen2.5-32b-instruct-q4_k_m.gguf
Apple M2 Max GPU (38-core) · 48 GB
Text generation · Q4_K_M · vLLM
Qwen2.5-14B-Q4_K_M
/Users/kanshan/.cache/modelscope/hub/models/qwen/Qwen2___5-14B-Instruct-GGUF/qwen2.5-14b-instruct-q4_k_m.gguf
Apple M2 Max GPU (38-core) · 48 GB
Text generation · Q4_K_M · vLLM
Qwen3-VL-8B-FP8
/root/autodl-tmp/modelscope/Qwen/Qwen3-VL-8B-Instruct-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen2.5-7B-Q4_K_M
/Users/kanshan/.cache/modelscope/hub/models/qwen/Qwen2___5-7B-Instruct-GGUF/qwen2.5-7b-instruct-q4_k_m.gguf
Apple M2 Max GPU (38-core) · 48 GB
Text generation · Q4_K_M · vLLM
Qwen2.5-3B-Q4_K_M
/Users/kanshan/.cache/modelscope/hub/models/qwen/Qwen2___5-3B-Instruct-GGUF/qwen2.5-3b-instruct-q4_k_m.gguf
Apple M2 Max GPU (38-core) · 48 GB
Text generation · Q4_K_M · vLLM
Qwen2.5-1.5B-Q4_K_M
/Users/kanshan/.cache/modelscope/hub/models/qwen/Qwen2___5-1___5B-Instruct-GGUF/qwen2.5-1.5b-instruct-q4_k_m.gguf
Apple M2 Max GPU (38-core) · 48 GB
Text generation · Q4_K_M · vLLM
Qwen2.5-0.5B-Q4_K_M
/Users/kanshan/.cache/modelscope/hub/models/qwen/Qwen2___5-0___5B-Instruct-GGUF/qwen2.5-0.5b-instruct-q4_k_m.gguf
Apple M2 Max GPU (38-core) · 48 GB
Text generation · Q4_K_M · vLLM
Qwen3-VL-4B-FP8
/root/autodl-tmp/modelscope/Qwen/Qwen3-VL-4B-Instruct-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-VL-2B-FP8
/root/autodl-tmp/modelscope/Qwen/Qwen3-VL-2B-Instruct-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-VL-2B
/home/obscura/.cache/modelscope/hub/models/Qwen/Qwen3-VL-2B-Instruct
RTX 3080 · 10 GB
Text generation · BF16 · vLLM
Updated