Skip to content

[wip] feat(assistant): hidden lk assistant voice assistant - #1025

Draft
royalfig wants to merge 5 commits into
mainfrom
ryan/lk-assistant
Draft

royalfig wants to merge 5 commits into
mainfrom
ryan/lk-assistant

Conversation

@royalfig

@royalfig royalfig commented Oct 9, 2026

Copy link
Copy Markdown

Adds a hidden lk assistant command: LK, a voice assistant for LiveKit in a macOS overlay.

  • Blurs the desktop and shows the LiveKit logo as an audio meter.
  • Talks with a LiveKit voice agent (console mode, local audio) that answers from the Docs MCP server.
  • Shows code and prompt cards with Copy buttons.
  • Runs lk commands (create a project from a template, install skills, list agents) after the user confirms by voice or on screen.
  • "Meet your agent": runs the user's new agent in the same audio pipeline and switches the conversation to it. Press B to come back.
  • X-ray mode shows the pipeline's models and metrics.
  • Saves each conversation as Markdown in ~/Library/Caches/livekit/assistant-sessions/.

Supporting changes, in separate commits:

  • lk agent init . and lk app create . create the project in the empty current directory.
  • pkg/console: playback audio metrics, and multiple agent connections with an active one.
  • pkg/overlay: native macOS overlay (NSWindow, blur, WKWebView). Other platforms get a stub.
  • simulate: entrypoint lookup stays inside the project directory.

Try it: lk assistant (needs uv and LiveKit Cloud credentials). --windowed runs it in a normal window, --demo plays a scripted session without audio.

Known gaps (WIP):

  • Starting a second guest agent leaks the first.
  • Tool results that finish while the guest agent is active are lost.
  • Overlay settings in localStorage don't persist.

🤖 Generated with Claude Code

royalfig and others added 5 commits October 9, 2026 17:42
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…init .`

`lk agent init .` and `lk app create .` fill the empty current directory and name the project after it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The pipeline measures the agent's playback audio as well as the microphone, and can hold several agent connections and switch the active one.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
LK is a voice assistant in a macOS overlay. It answers from the LiveKit docs, shows code and prompts to copy, runs lk commands after the user confirms, and lets the user talk to the agent they created.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant