local intelligence

can it run

Can the NVIDIA GeForce RTX 2060 Super run gpt-oss 120B MoE?

NO

65.3 GB vs 8 GB usable — does not fit

8GB · Turing TU106 · model file 65GB · 120B MoE

~22–33 tok/s (active-expert estimate)

computed roofline: 448 GB/s × 0.48–0.72 efficiency window / 9.8GB (Q4_K_M) — bands, never points.

MoE: file is 65GB (that decides fit) but only ~18B of experts activate per token (~9.8GB streamed) — band below is the active-expert estimate, optimistic; community MoE rows run several× the naive bandwidth math

Run gpt-oss 120B MoE on instead

NIMO AI Mini PC (128GB) — cheapest catalog machine that runs gpt-oss 120B MoE fully ($1999)

rtx-3060-12 — the next step up from NVIDIA GeForce RTX 2060 Super

every model the NVIDIA GeForce RTX 2060 Super can run — full list

explore the full catalog84 machines indexed · live prices · what each one can run
2026-09-17 · ← all models on the NVIDIA GeForce RTX 2060 Super · fit = weights + 4k KV vs usable memory