▲ local intelligence

can it run

Can the RTX PRO 6000 Blackwell (96GB) run LLAMA4 Maverick 400B A17B?

NO

No. 96GB of memory can't hold the 307GB working set this model needs. A smaller quant or a bigger machine is required.

~3.4–5.6 tok/s

weights 245GB + KV cache 0.75GB at 4k context vs ~96GB usable → no. 245.8 GB vs 96 GB usable — does not fit

computed roofline: 1792 GB/s × 0.46–0.76 efficiency window / 245.0GB (Q4_K_M) — bands, never points.

→explore the full catalog100 machines indexed · live prices · what each one can run

Specs

model file245GB (GGUF Q4_K_M)
minimum memory307GB working set
this machine96GB GDDR7
paramsMaverick 400B A17B
licensellama4 (gated on HF)
price$16499

Run it

model files: hugging face ↗

easy run: ollama pull llama4:maverick

runs with: ollama · llama.cpp · koboldcpp · lm studio

Alternatives

→ ASUS ExpertCenter Pro ET900N G3 (GB300) — cheapest machine that runs it ($60000)

→ every model the RTX PRO 6000 Blackwell (96GB) can run — full list

→ tinybox green v2 blackwell (4× RTX PRO 6000) — upgrade path machine

Buy

NVIDIA ↗ · B&H Photo ↗

2026-10-08 · ← all models on the RTX PRO 6000 Blackwell (96GB) · ← full hardware catalog · prices verified at source, may drift