local-llmllama-cppmoe
Betelgeuse runs a 68GB Qwen build on a 12GB card, and the SSD sets the pace
Betelgeuse, a llama.cpp fork, decodes a 68GB Qwen 3.8 Flash Next build at 22 tok/s on a 12GB RTX 3060 by streaming experts off an NVMe drive, bit-exact.
5 min