▲ local intelligence

can it run

Can the Jetson Orin Nano Super dev kit run DEEPSEEK-R1 distill 7B?

TIGHT

Yes, but close to the edge. 8GB against a 6GB working set: it runs, with little room for long context windows or other processes.

~3.6–9.4 tok/s

weights 4.7GB + KV cache 0.22GB at 4k context vs ~6GB usable → tight. 4.9 of 6 GB usable — keep context modest

computed roofline: 68 GB/s × 0.25–0.65 efficiency window / 4.7GB (Q4_K_M) — bands, never points.

→explore the full catalog91 machines indexed · live prices · what each one can run

Specs

model file4.7GB (GGUF Q4_K_M)
minimum memory6GB working set
this machine8GB unified
paramsdistill 7B
licensemit
price$499

Run it

model files: hugging face ↗

easy run: ollama pull deepseek-r1:7b

runs with: ollama · llama.cpp · koboldcpp · lm studio

Alternatives

→ Tesla M60 (16GB, used) — cheapest machine that runs it ($35)

→ every model the Jetson Orin Nano Super dev kit can run — full list

Buy

NVIDIA (direct) ↗ · Amazon ↗

2026-10-01 · ← all models on the Jetson Orin Nano Super dev kit · ← full hardware catalog · prices verified at source, may drift