Client.local() gives you the same sessions API as the cloud. Only model calls go to H, plus any cloud browser you use. With your own model server and your own browser or desktop, nothing does. Sessions start instantly, and each action runs next to the agent, with no network round trip. From the terminal, use holo --local.
Where the agent loop runs is independent of what it drives: a cloud browser, your browser, or your desktop.
Cloud vs local
Use your own model server
Run Holo4 on hardware you control. Your H API key is never sent to it, so you can skip Sign in and thecli extra, but cloud environments cannot run. The model server can run on any machine you can reach.
Serve Holo4
Start a Holo4 server with Local inference: vLLM on an NVIDIA GPU (base URL
http://localhost:8000/v1) or llama.cpp on a Mac (http://localhost:8080/v1).Point the runtime at it
Use the With llama.cpp, use
agent from Run a session, with its model set:Python
http://localhost:8080/v1. Without inference, Client.local() reads HAI_AGENT_RUNTIME_BASE_URL and HAI_AGENT_RUNTIME_MODEL instead.Two model names
GPUs on another machine
No API key is sent to your server, so keep it private. Use an SSH tunnel and keephttp://localhost:8000/v1:
SSH tunnel