can it run
4.6 GB needed of 14 GB usable — headroom for context
~14GB usable · Apple M4 · model file 4.1GB · 7B
computed roofline: 120 GB/s × 0.80–1.00 efficiency window / 4.1GB (Q4_K_M) — bands, never points.
What users report — 3 cited rows:
→ 23 tok/s · Llama 3.1 8B Q4_K_M Ollama/Metal · source
→ 18.15 tok/s · Llama 3.1 8B Q5_K_M Ollama/Metal (primary run) · source
→ ~20 tok/s · 8B Q4_K_M aggregated estimate · source
→ Raspberry Pi 5 + AI Kit (Hailo-8L) — cheapest catalog machine that runs mistral 7B fully ($110)
→ every model the Apple M4 can run — full list
→explore the full catalog84 machines indexed · live prices · what each one can run