Features
Overview
Tour of the Models section: what each sub-page is for, and where the model file vs alias vs API model distinction lives in the UI
Model Aliases
Create, edit, and manage model aliases — the named recipes Bodhi uses to launch llama.cpp with the right file and parameters
Model Files
List, inspect, and remove the GGUF files Bodhi has cached locally for inference
Model Downloads
Pull GGUF model files from HuggingFace into Bodhi’s local cache, with background progress and idempotent retries
API Models
Connect Bodhi to a remote provider — OpenAI, OpenAI Responses, Anthropic, Anthropic OAuth, or Gemini — and proxy requests through your local server
Anthropic OAuth
Use a Claude.ai / Anthropic Console subscription with Bodhi via an OAuth Bearer token instead of an API key