llama.cpp introduces Model Router: A complete replacement for Ollama in model switching
The latest update to llama.cpp features a built-in Model Router, allowing instant switching between on-disk models without restarting the server.
Sources x.com
The latest update to llama.cpp features a built-in Model Router, allowing instant switching between on-disk models without restarting the server.