Local Models And Routing
Not every task should leave your machine. Ambient can route work across local runtimes, cloud models, and specialized providers — keeping private, cheap, or latency-sensitive work local while reserving heavy reasoning for the cloud.
Settings
Settings search keeps provider, permission, and runtime configuration discoverable.
One task, the right model
A single model is rarely the right answer for every step of a task. Summarizing a private file, analyzing a screenshot, and reasoning through an architecture trade-off have different needs for privacy, latency, cost, and capability. Ambient treats the model layer like the provider layer: an ordered set of runtimes that can be selected and retried by what the task actually needs.
What can route where
Local runtimes
llama.cpp-hosted models with non-destructive start/stop lifecycle, for private, low-cost, or offline-friendly work.
MiniCPM-V
Local visual analysis so screenshots and images can be understood even when the selected text model has no native vision.
Ambient & cloud
High-capability and network-native models for the hard synthesis steps a small local model should not own.
Ambient Mini
A future local-model network layer where eligible machines can serve and earn — built on this same runtime foundation.
Controls you have
- Prioritize local-first, fastest, most private, cheapest, or most capable providers.
- Disable a provider entirely so it never receives a class of content.
- Inspect fallback and skip evidence to see why a given runtime was or was not used.
- Repair or revalidate local runtimes from Settings when assets or binaries drift.
FAQ
How is this different from provider routing?
Provider routing covers search, fetch, browser, and vision capabilities; local model routing is the model layer specifically. They share the same idea: an ordered, retryable set chosen by preference and task fit. See Provider Priority and Dynamic Fallback.
Do I need a powerful machine?
Local runtimes scale with your hardware. You can keep heavy reasoning in the cloud and use local models for private, cheap, or vision tasks — or run more locally on capable machines.
Is this finished?
The runtime lifecycle, local-first selection, and vision routing are real today; broader routing across Ambient and Ambient Mini is still being built, which is why this page is labeled In Development.