Skip to content

web: request upstream agent-browser serve/batch mode to cut per-action process overhead #1958

Description

@thymikee

Verified during the 2026-08 architecture audit (empirical: ~205ms per CLI invocation; a click = 3 spawns, fill = 5, paced scroll up to 20; includeRects snapshots do an N+1 get box @ref per node at concurrency 8).

The web provider (src/platforms/web/agent-browser-provider.ts) is process-per-command against the pinned agent-browser CLI. The browser itself stays warm (socket dir), but the control plane pays Node boot + reconnect per call.

Ask: upstream agent-browser capability, one of:

  1. A serve/stdio mode: one long-lived child per web session speaking line-delimited JSON (the CLI already tracks sessions via --session).
  2. Composite gesture commands (click = move+down+up in one call) and a batched box fetch (get box --all or rects embedded in snapshot JSON refs).

Either removes 5–20x per-action overhead for web automation. Until then agent-device keeps the CLI-per-call shape; no local workaround exists because refs aren't resolvable from page eval.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions