Ambient Desktop Docs
Quickstart Download ambient.xyz
Ambient Network

Local Models And Routing

Not every task should leave your machine. Ambient can route work across local runtimes, cloud models, and specialized providers — keeping private, cheap, or latency-sensitive work local while reserving heavy reasoning for the cloud.

In Development
Product screenshots

Settings

Settings search keeps provider, permission, and runtime configuration discoverable.

Ambient Desktop settings search.

One task, the right model

A single model is rarely the right answer for every step of a task. Summarizing a private file, analyzing a screenshot, and reasoning through an architecture trade-off have different needs for privacy, latency, cost, and capability. Ambient treats the model layer like the provider layer: an ordered set of runtimes that can be selected and retried by what the task actually needs.

What can route where

On your machine

Local runtimes

llama.cpp-hosted models with non-destructive start/stop lifecycle, for private, low-cost, or offline-friendly work.

Vision, locally

MiniCPM-V

Local visual analysis so screenshots and images can be understood even when the selected text model has no native vision.

Heavy reasoning

Ambient & cloud

High-capability and network-native models for the hard synthesis steps a small local model should not own.

Coming

Ambient Mini

A future local-model network layer where eligible machines can serve and earn — built on this same runtime foundation.

Controls you have

  • Prioritize local-first, fastest, most private, cheapest, or most capable providers.
  • Disable a provider entirely so it never receives a class of content.
  • Inspect fallback and skip evidence to see why a given runtime was or was not used.
  • Repair or revalidate local runtimes from Settings when assets or binaries drift.

FAQ

How is this different from provider routing?

Provider routing covers search, fetch, browser, and vision capabilities; local model routing is the model layer specifically. They share the same idea: an ordered, retryable set chosen by preference and task fit. See Provider Priority and Dynamic Fallback.

Do I need a powerful machine?

Local runtimes scale with your hardware. You can keep heavy reasoning in the cloud and use local models for private, cheap, or vision tasks — or run more locally on capable machines.

Is this finished?

The runtime lifecycle, local-first selection, and vision routing are real today; broader routing across Ambient and Ambient Mini is still being built, which is why this page is labeled In Development.