Question 1

Can the Intel Lunar Lake (Core Ultra 200V) run llava 13B?

Accepted Answer

llava 13B needs about 11.12GB working set (weights 8GB + KV cache 3.12GB at 4k context). The Intel Lunar Lake (Core Ultra 200V) offers ~14GB usable — verdict: full. 11.1 GB needed of 14 GB usable — headroom for context

Question 2

How fast is llava 13B on the Intel Lunar Lake (Core Ultra 200V)?

Accepted Answer

~7.7–12 tok/s on the Intel Lunar Lake (Core Ultra 200V). computed roofline: 136.5 GB/s × 0.45–0.70 efficiency window / 8.0GB (Q4_K_M) — bands, never points.

Question 3

What should I run llava 13B on instead?

Accepted Answer

Tesla M60 (16GB, used) runs it fully ($35).

Can the Intel Lunar Lake (Core Ultra 200V) run llava 13B?

Run llava 13B on instead