A new milestone for local AI as llama.cpp officially supports Multi-Token Prediction (MTP) for the Qwen3.6 series, dramatically boosting processing speeds on consumer hardware.
Llama.cpp has officially launched the llama.app website alongside a cross-platform installer that runs via a single command, making local AI more accessible than ever.
The latest llama.cpp update supporting Multi-Token Prediction (MTP) enables the Qwen3.6-27B model to reach 45 tokens/second on mid-range hardware, accelerating the trend of self-hosting AI.
The latest update to llama.cpp features a built-in Model Router, allowing instant switching between on-disk models without restarting the server.
