Rumrunner docs
Rumrunner is a background daemon for macOS that serves an OpenAI-compatible
endpoint at http://127.0.0.1:11711/v1 and routes each request to the cheapest
lane that can actually do the job. These pages cover the current closed-alpha build,
0.1.0-dev.5, and say so where something is not in it yet.
InstallOllama, the disk image, first run, and what the wizard does.
Point your editorConfig for Continue, aider, Zed and Cline, as shipped in the app.
The three lanesLocal, nearshore, frontier — what each costs and when the router picks it.
Keys and the KeychainWhere a key lives, where it never does, and what happens with none stored.
The receiptWhat the ledger counts, and what “quality-adjusted” means.
Removing itThe service, the files and the Keychain items, in the order that leaves nothing behind.
The four things it will not do
- Your prompts stay on the machine unless a request explicitly routes to a hosted lane. Telemetry is aggregate counts. No prompt content is ever shipped anywhere.
- Frontier tokens are billed at the provider's price, with zero markup. You bring your own key and pay Anthropic, OpenAI or DeepSeek directly.
- API keys live in the macOS Keychain. Never in a config file, never in a log, never in an error message.
- Privacy fences are absolute. A request whose context touches a fenced path runs locally, whatever the router would otherwise have scored it.