ndc
NDC
18 results
VM Types
—
Engines
vllm
GPUs
NVIDIA GeForce RTX 3090, NVIDIA RTX PRO 6000 Blackwell Max-Q
Compute
GPU
everything above the entry cards — consumer Ampere–Ada through Blackwell / Hopper datacenter silicon, any count; ranked by capability composite
#
Model
Hardware – Engine
Capability
Tiers
Agentic
Refusals
tok/s
Date
1
Qwen/Qwen3.8-27B-FP8
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.96±0.020
0.96 usability
0.98 · 0.98 · 0.83
1.00
0
65.9
Aug 30
2
Qwen/Qwen3.8-27B-FP8
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.96±0.023
0.95 usability
0.97 · 0.96 · 0.83
0.96
0
64.3
Aug 30
3
openai/gpt-oss-120b
4×NVIDIA GeForce RTX 3090 – vllm
ndc
0.92±0.037
0.91 usability
0.95 · 0.91 · 0.75
0.89
0
132.5
Aug 30
4
openai/gpt-oss-120b
4×NVIDIA GeForce RTX 3090 – vllm
ndc
0.92±0.054
0.88 usability
0.96 · 0.82 · 0.72
0.67
0
134.5
Aug 30
4
google/gemma-4-31B-it-qat-w4a16-ct
Googleqat-w4a16
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.92±0.027
0.92 usability
0.93 · 0.92 · 0.86
0.91
0
46.7
Aug 30
6
cyankiwi/Ornith-1.0-35B-AWQ-INT4
cyankiwiawq-int4
4×NVIDIA GeForce RTX 3090 – vllm
ndc
0.89±0.043
0.89 usability
0.94 · 0.86 · 0.72
0.89
0
94.7
Aug 30
6
Qwen/Qwen3.8-27B-FP8
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.89±0.103
0.82 usability
—
0.60
0
69.3
Aug 26
8
poolside/Laguna-S-2.1-NVFP4
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.89±0.045
0.89 usability
0.94 · 0.89 · 0.61
0.96
0
98.7
Aug 30
9
deepseek-ai/DeepSeek-V4-Flash-0731
2×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.89±0.053
0.88 usability
0.94 · 0.88 · 0.58
1.00
0
58.5
Aug 30
10
cyankiwi/Ornith-1.0-35B-AWQ-INT4
cyankiwiawq-int4
4×NVIDIA GeForce RTX 3090 – vllm
ndc
0.88±0.049
0.87 usability
0.91 · 0.87 · 0.72
0.91
0
87.3
Aug 30
11
poolside/Laguna-S-2.1-NVFP4
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.86±0.048
0.85 usability
0.91 · 0.84 · 0.61
0.89
0
96.3
Aug 30
12
deepseek-ai/DeepSeek-V4-Flash-0731
2×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.86±0.066
0.84 usability
0.89 · 0.87 · 0.54
1.00
0
57.3
Aug 30
13
google/gemma-4-31B-it-qat-w4a16-ct
Googleqat-w4a16
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.86±0.106
0.85 usability
0.81 · 0.92 · 0.84
0.98
0
48.2
Aug 30
14
openai/gpt-oss-120b
4×NVIDIA GeForce RTX 3090 – vllm
ndc
0.84±0.111
0.76 usability
—
0.56
0
130.4
Aug 26
15
poolside/Laguna-S-2.1-NVFP4
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.81±0.100
0.76 usability
—
0.69
0
93.6
Aug 26
16
deepseek-ai/DeepSeek-V4-Flash-0731
2×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.80±0.105
0.73 usability
—
0.60
0
57.1
Aug 26
17
google/gemma-4-31B-it-qat-w4a16-ct
Googleqat-w4a16
1×NVIDIA RTX PRO 6000 Blackwell Max-Q – vllm
ndc
0.79±0.140
0.71 usability
—
0.57
0
47.4
Aug 26
18
cyankiwi/Ornith-1.0-35B-AWQ-INT4
cyankiwiawq-int4
4×NVIDIA GeForce RTX 3090 – vllm
ndc
0.79±0.107
0.72 usability
—
0.65
0
58.4
Aug 26
1
0.96
capability
ndc · vllm99% done · 2 timeouts65.9 tok/s
Categories:
Aug 30
2
0.96
capability
ndc · vllm99% done · 2 timeouts64.3 tok/s
Categories:
Aug 30
3
openai/gpt-oss-120bGPU
OpenAI0.92
capability
ndc · vllm100% done132.5 tok/s
Categories:
Aug 30
4
openai/gpt-oss-120bGPU
OpenAI0.92
capability
ndc · vllm100% done134.5 tok/s
Categories:
Aug 30
5
0.92
capability
ndc · vllm100% done46.7 tok/s
Categories:
Aug 30
6
0.89
capability
ndc · vllm100% done94.7 tok/s
Categories:
Aug 30
7
0.89
capability
ndc · vllm99% done · 1 timeout69.3 tok/s
Categories:
Aug 26
8
poolside/Laguna-S-2.1-NVFP4GPU
poolside0.89
capability
ndc · vllm100% done98.7 tok/s
Categories:
Aug 30
9
deepseek-ai/DeepSeek-V4-Flash-0731GPU
DeepSeek0.89
capability
ndc · vllm100% done58.5 tok/s
Categories:
Aug 30
10
0.88
capability
ndc · vllm100% done87.3 tok/s
Categories:
Aug 30
11
poolside/Laguna-S-2.1-NVFP4GPU
poolside0.86
capability
ndc · vllm99% done · 1 timeout96.3 tok/s
Categories:
Aug 30
12
deepseek-ai/DeepSeek-V4-Flash-0731GPU
DeepSeek0.86
capability
ndc · vllm100% done57.3 tok/s
Categories:
Aug 30
13
0.86
capability
ndc · vllm100% done48.2 tok/s
Categories:
Aug 30
14
openai/gpt-oss-120bGPU
OpenAI0.84
capability
ndc · vllm100% done130.4 tok/s
Categories:
Aug 26
15
poolside/Laguna-S-2.1-NVFP4GPU
poolside0.81
capability
ndc · vllm100% done93.6 tok/s
Categories:
Aug 26
16
deepseek-ai/DeepSeek-V4-Flash-0731GPU
DeepSeek0.80
capability
ndc · vllm100% done57.1 tok/s
Categories:
Aug 26
17
0.79
capability
ndc · vllm100% done47.4 tok/s
Categories:
Aug 26
18
0.79
capability
ndc · vllm99% done · 1 timeout58.4 tok/s
Categories:
Aug 26