Best Mini PC for Local LLMs

Picks refresh twice a day.

The model that fits is a RAM question first. At 4-bit, an 8B model such as Llama 8B wants about 8GB plus room for the system, so 16GB is the comfortable floor. A 32B model wants roughly 24GB and is happier at 32GB. A 70B model wants 48GB or more, which is why 64GB machines are the ones people shop for. On a mini PC the graphics and the CPU share that memory. There is no separate VRAM pool.

A higher graphics score means faster generation once the model fits. A large RAM kit on a weak chip still fits a larger model, and still runs it slowly. The picks say which of 8B, 32B, and 70B each machine can hold. They do not invent a tokens-per-second figure. Nothing under 16GB is in the pool.