Historical benchmark · different suite. View current ModelProbe scorecards →

ndc

NDC

25 results

VM Types

—

Engines

vllm

GPUs

NVIDIA GeForce RTX 3090, NVIDIA RTX PRO 6000 Blackwell Max-Q

Compute

GPU

everything above the entry cards — consumer Ampere–Ada through Blackwell / Hopper datacenter silicon, any count; ranked by capability composite

ndc · vllm99% done · 2 timeouts65.9 tok/s
Categories:
Aug 30
ndc · vllm99% done · 2 timeouts64.3 tok/s
Categories:
Aug 30
ndc · vllm99% done · 2 timeouts68.4 tok/s
Categories:
Sep 10
ndc · vllm98% done · 4 timeouts67.5 tok/s
Categories:
Sep 11
ndc · vllm100% done132.5 tok/s
Categories:
Aug 30
ndc · vllm100% done47.3 tok/s
Categories:
Sep 10
ndc · vllm99% done · 1 timeout79.2 tok/s
Categories:
Sep 10
ndc · vllm100% done134.5 tok/s
Categories:
Aug 30
ndc · vllm100% done46.7 tok/s
Categories:
Aug 30
ndc · vllm100% done46.4 tok/s
Categories:
Sep 9
ndc · vllm100% done77.5 tok/s
Categories:
Sep 9
ndc · vllm99% done · 1 timeout69.3 tok/s
Categories:
Aug 26
ndc · vllm100% done98.7 tok/s
Categories:
Aug 30
ndc · vllm100% done57.4 tok/s
Categories:
Sep 10
ndc · vllm100% done58.5 tok/s
Categories:
Aug 30
ndc · vllm99% done · 1 timeout58.2 tok/s
Categories:
Sep 9
ndc · vllm100% done98.4 tok/s
Categories:
Sep 9
ndc · vllm100% done98.6 tok/s
Categories:
Sep 10
ndc · vllm99% done · 1 timeout96.3 tok/s
Categories:
Aug 30
ndc · vllm100% done57.3 tok/s
Categories:
Aug 30
ndc · vllm100% done48.2 tok/s
Categories:
Aug 30
ndc · vllm100% done130.4 tok/s
Categories:
Aug 26
ndc · vllm100% done93.6 tok/s
Categories:
Aug 26
ndc · vllm100% done57.1 tok/s
Categories:
Aug 26
ndc · vllm100% done47.4 tok/s
Categories:
Aug 26