local intelligence

can it run

Can the NVIDIA Titan V 12GB run gpt-oss 120B MoE?

NO

65.3 GB vs 12 GB usable — does not fit

12GB · Volta · model file 65GB · 120B MoE

~31–51 tok/s (active-expert estimate)

computed roofline: 652.8 GB/s × 0.46–0.76 efficiency window / 9.8GB (Q4_K_M) — bands, never points.

MoE: file is 65GB (that decides fit) but only ~18B of experts activate per token (~9.8GB streamed) — band below is the active-expert estimate, optimistic; community MoE rows run several× the naive bandwidth math

Run gpt-oss 120B MoE on instead

NIMO AI Mini PC (128GB) — cheapest catalog machine that runs gpt-oss 120B MoE fully ($1999)

tesla-v100-32gb — the next step up from NVIDIA Titan V 12GB

every model the NVIDIA Titan V 12GB can run — full list

explore the full catalog90 machines indexed · live prices · what each one can run
2026-09-24 · ← all models on the NVIDIA Titan V 12GB · fit = weights + 4k KV vs usable memory