local intelligence

can it run

Can the Mac mini M4 (32GB) run qwen3 8B?

YES

Comfortably. 32GB of memory against a 7GB working set leaves headroom for context, the OS, and anything else you're running.

~18–23 tok/s

weights 5.2GB + KV cache 0.56GB at 4k context vs ~30GB usable → full. 5.8 GB needed of 30 GB usable — headroom for context

computed roofline: 120 GB/s × 0.80–1.00 efficiency window / 5.2GB (Q4_K_M) — bands, never points.

What users report — 3 cited rows:

→ 23 tok/s · Llama 3.1 8B Q4_K_M Ollama/Metal · source

→ 18.15 tok/s · Llama 3.1 8B Q5_K_M Ollama/Metal (primary run) · source

→ ~20 tok/s · 8B Q4_K_M aggregated estimate · source

note: optimized engines (MLX / MTP / speculative decode) measured ×1.3–1.9 over the base stack on 8B-class — a note, not a second band. ollama.com · reddit.com · genie.devoxx.com

explore the full catalog84 machines indexed · live prices · what each one can run

Specs

model file5.2GB (GGUF Q4_K_M)
minimum memory7GB working set
this machine32GB unified
params8B
licenseapache-2.0
price$999

Run it

model files: hugging face ↗

easy run: ollama pull qwen3:8b

runs with: ollama · llama.cpp · koboldcpp · lm studio

Alternatives

no alternatives — every machine in the catalog can run this one.

Buy

Apple ↗ · Amazon ↗

2026-09-18 · ← full hardware catalog · prices verified at source, may drift