GPU · Dedicated Accelerators · by comparability tier
GPU leaderboards
Ranked by capability composite inside each tier. Tiers are derived from the exact recorded GPU model, never from a label — an entry card and a datacenter part are different experiments and share no ranking.
everything above the entry cards — consumer Ampere–Ada through Blackwell / Hopper datacenter silicon, any count; ranked by capability composite
#
Model
Hardware – Engine
Capability
Tiers
Agentic
Refusals
tok/s
Date
=1T1
Qwen/Qwen3.8-27B-FP8
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.96±0.023
0.95 usability
0.97 · 0.96 · 0.83
0.96
0
64.3
Aug 30
=1T1
openai/gpt-oss-120b
4×NVIDIA GeForce RTX 3090 – vllm
ndc
0.92±0.037
0.91 usability
0.95 · 0.91 · 0.75
0.89
0
132.5
Aug 30
=1T1
google/gemma-4-31B-it-qat-w4a16-ct
Googleqat-w4a16
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.92±0.027
0.92 usability
0.93 · 0.92 · 0.86
0.91
0
46.7
Aug 30
=4T2
cyankiwi/Ornith-1.0-35B-AWQ-INT4
cyankiwiawq-int4
4×NVIDIA GeForce RTX 3090 – vllm
ndc
0.89±0.043
0.89 usability
0.94 · 0.86 · 0.72
0.89
0
94.7
Aug 30
=4T2
poolside/Laguna-S-2.1-NVFP4
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.89±0.045
0.89 usability
0.94 · 0.89 · 0.61
0.96
0
98.7
Aug 30
=4T2
deepseek-ai/DeepSeek-V4-Flash-0731
2×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.89±0.053
0.88 usability
0.94 · 0.88 · 0.58
1.00
0
58.5
Aug 30
=1T1
0.96
capability
ndc · vllm99% done · 2 timeouts64.3 tok/s
Categories:
Aug 30
=1T1
openai/gpt-oss-120bGPU
OpenAI0.92
capability
ndc · vllm100% done132.5 tok/s
Categories:
Aug 30
=1T1
0.92
capability
ndc · vllm100% done46.7 tok/s
Categories:
Aug 30
=4T2
0.89
capability
ndc · vllm100% done94.7 tok/s
Categories:
Aug 30
=4T2
poolside/Laguna-S-2.1-NVFP4GPU
poolside0.89
capability
ndc · vllm100% done98.7 tok/s
Categories:
Aug 30
=4T2
deepseek-ai/DeepSeek-V4-Flash-0731GPU
DeepSeek0.89
capability
ndc · vllm100% done58.5 tok/s
Categories:
Aug 30
Entry GPU (16 GB class)
filter & Pareto view →single entry datacenter card — Tesla T4 / L4 class: the 'runs on what you already have' tier; ranked by usability because item budgets bite here
#
Model
Hardware – Engine
Capability
Tiers
Agentic
Refusals
tok/s
Date
1T1
hf.co/unsloth/gpt-oss-20b-GGUF:UD-Q4_K_XL
OpenAIq4
1×NVIDIA Tesla T4 – ollama
cdc
0.76±0.072
0.81 capability
0.83 · 0.64 · 0.79
0.49
0
37.3
Aug 31
2T2
hf.co/google/gemma-4-12B-it-qat-q4_0-gguf:latest⚠
Googleq4
1×NVIDIA Tesla T4 – ollama
cdc
0.53±0.129
0.66 capability
0.62 · 0.43 · 0.39
0.00
0
17.3
Aug 30