Benchmark reports
999 reports · Newest first · Page 18 / 40
Qwen3.5-2B
/root/.cache/modelscope/models/Qwen--Qwen3.5-2B/snapshots/master
vGPU-32GB · 32 GB
Text generation · BF16 · vLLM
Qwen3.5-4B
/root/.cache/modelscope/models/Qwen--Qwen3.5-4B/snapshots/master
vGPU-32GB · 32 GB
Text generation · BF16 · vLLM
Qwen3.5-2B
/root/.cache/modelscope/models/Qwen--Qwen3.5-2B/snapshots/master
vGPU-32GB · 32 GB
Text generation · BF16 · vLLM
Qwen3.5-0.8B
/root/.cache/modelscope/models/Qwen--Qwen3.5-0.8B/snapshots/master
vGPU-32GB · 32 GB
Text generation · BF16 · vLLM
Qwen3.5-0.8B
/root/.cache/modelscope/models/Qwen--Qwen3.5-0.8B/snapshots/master
vGPU-32GB · 32 GB
Text generation · BF16 · vLLM
Qwen3.5-0.8B
/root/.cache/modelscope/models/Qwen--Qwen3.5-0.8B/snapshots/master
vGPU-32GB · 32 GB
Text generation · BF16 · vLLM
Qwen3.6-27B-AWQ
/root/.cache/modelscope/models/tclf90--Qwen3.6-27B-AWQ/snapshots/master
vGPU-32GB · 32 GB
Text generation · AWQ · vLLM
Qwen3.5-4B
/root/.cache/modelscope/models/Qwen--Qwen3.5-4B/snapshots/master
vGPU-32GB · 32 GB
Text generation · BF16 · vLLM
Qwen3.5-2B
/root/.cache/modelscope/models/Qwen--Qwen3.5-2B/snapshots/master
vGPU-32GB · 32 GB
Text generation · BF16 · vLLM
Qwen3.5-0.8B
/root/.cache/modelscope/models/Qwen--Qwen3.5-0.8B/snapshots/master
vGPU-32GB · 32 GB
Text generation · BF16 · vLLM
Qwen3-0.6B
/root/.cache/modelscope/models/Qwen--Qwen3-0.6B/snapshots/master
vGPU-32GB · 32 GB
Text generation · Native · vLLM
Qwen3-0.6B
/root/.cache/huggingface/hub/models--Qwen--Qwen3-0.6B/snapshots/c1899de289a04d12100db370d81485cdf75e47ca
A100-SXM4-40GB · 40 GB
Text generation · BF16 · vLLM
Qwen3-4B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-4B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Hunyuan-MT2-1.8B-FP8
/root/.cache/modelscope/hub/models/Tencent-Hunyuan/Hy-MT2-1___8B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-1.7B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-1___7B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-0.6B-FP8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-0___6B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-14B-NVFP4
/root/.cache/modelscope/hub/models/RedHatAI/Qwen3-14B-NVFP4
RTX 5090 · 32 GB
Text generation · NVFP4 · vLLM
Qwen3-8B-NVFP4
/root/.cache/modelscope/hub/models/RedHatAI/Qwen3-8B-NVFP4
RTX 5090 · 32 GB
Text generation · NVFP4 · vLLM
ChatTTS
2Noise/ChatTTS
RTX 5090 · 32 GB
Speech synthesis · fp16 · vLLM
whisper-large-v3-turbo
openai/whisper-large-v3-turbo
RTX 5090 · 32 GB
Speech recognition · fp16 · vLLM
qwen3:0.6b
qwen3:0.6b
RTX 5090 · 32 GB
Text generation · Ollama · vLLM
Qwen3-0.6B-Q8
/root/.cache/modelscope/hub/models/Qwen/Qwen3-0___6B-GGUF/Qwen3-0.6B-Q8_0.gguf
RTX 5090 · 32 GB
Text generation · Q8_0 · vLLM
Hunyuan-MT2-7B-FP8
/root/.cache/modelscope/hub/models/Tencent-Hunyuan/Hy-MT2-7B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Qwen3-8B-NVFP4
/root/.cache/modelscope/hub/models/RedHatAI/Qwen3-8B-NVFP4
RTX 5090 · 32 GB
Text generation · NVFP4 · vLLM
Hunyuan-MT2-1.8B-FP8
/root/.cache/modelscope/hub/models/Tencent-Hunyuan/Hy-MT2-1___8B-FP8
RTX 5090 · 32 GB
Text generation · FP8 · vLLM
Updated