GGUF

Single-binary llama.cpp fork with a lightweight built-in UI; fast local inference for RP with long context options.

All-in-one local web UI for LLMs with chat, memory, extensions and RP-friendly presets; runs GGUF/llama.cpp and more.

Pull open-weight LLMs locally with one command; browse popular chat and embedding models.

Compact 1.1B Llama-compatible model; popular GGUF quantizations make it fast on CPUs/GPUs locally.