Skip to content

fix(ipc): prune completed inference tasks - #2211

Open
swayamg20 wants to merge 1 commit into
livekit:mainfrom
swayamg20:fix/1996-prune-inference-tasks
Open

fix(ipc): prune completed inference tasks#2211
swayamg20 wants to merge 1 commit into
livekit:mainfrom
swayamg20:fix/1996-prune-inference-tasks

Conversation

@swayamg20

Copy link
Copy Markdown

Summary

  • replace the unbounded inference task array with an active-task set
  • remove each inference task after it settles so completed promises are not retained for the job process lifetime
  • add a patch changeset for @livekit/agents

Fixes #1996

Testing

  • pnpm test agents/src/ipc/proc_pool.test.ts agents/src/ipc/supervised_proc.test.ts
  • pnpm test agents --silent
  • pnpm lint
  • pnpm format:check
  • pnpm throws:check
  • pnpm typecheck
  • pnpm build:agents
  • uvx --from 'reuse[charset-normalizer]' reuse lint

@swayamg20
swayamg20 requested a review from a team as a code owner August 3, 2026 12:24
@changeset-bot

changeset-bot Bot commented Aug 3, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: ccad459

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 39 packages
Name Type
@livekit/agents Patch
@livekit/agents-plugin-anam Patch
@livekit/agents-plugin-anthropic Patch
@livekit/agents-plugin-assemblyai Patch
@livekit/agents-plugin-azure Patch
@livekit/agents-plugin-baseten Patch
@livekit/agents-plugin-bey Patch
@livekit/agents-plugin-cartesia Patch
@livekit/agents-plugin-cerebras Patch
@livekit/agents-plugin-deepgram Patch
@livekit/agents-plugin-did Patch
@livekit/agents-plugin-elevenlabs Patch
@livekit/agents-plugin-fishaudio Patch
@livekit/agents-plugin-google Patch
@livekit/agents-plugin-hedra Patch
@livekit/agents-plugin-hume Patch
@livekit/agents-plugin-inworld Patch
@livekit/agents-plugin-krisp Patch
@livekit/agents-plugin-lemonslice Patch
@livekit/agents-plugin-liveavatar Patch
@livekit/agents-plugin-livekit Patch
@livekit/agents-plugin-minimax Patch
@livekit/agents-plugin-mistral Patch
@livekit/agents-plugin-mistralai Patch
@livekit/agents-plugin-neuphonic Patch
@livekit/agents-plugin-openai Patch
@livekit/agents-plugin-perplexity Patch
@livekit/agents-plugin-phonic Patch
@livekit/agents-plugin-protoface Patch
@livekit/agents-plugin-resemble Patch
@livekit/agents-plugin-rime Patch
@livekit/agents-plugin-runway Patch
@livekit/agents-plugin-sarvam Patch
@livekit/agents-plugin-silero Patch
@livekit/agents-plugin-soniox Patch
@livekit/agents-plugin-tavus Patch
@livekit/agents-plugins-test Patch
@livekit/agents-plugin-trugen Patch
@livekit/agents-plugin-xai Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 1 additional finding.

Open in Devin Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

JobProcExecutor.#inferenceTasks array grows unbounded — one retained Promise per IPC inference request for the life of the job process

1 participant