Skip to content

ekaone/n-agent

Repository files navigation

@ekaone/n-agent

Multi-agent conversation loop with human-in-the-loop support.

@ekaone/n-agent is a lightweight, provider-agnostic TypeScript library for orchestrating structured conversations between multiple AI agents. It gives you a simple, turn-based loop where any number of LLM-powered agents take part in a discussion, with built-in support for real-time token streaming, human participation, mid-stream interruption, and automatic error recovery.

Whether you're building an autonomous debate, a moderated Q&A, a co-writing workflow, or a live CLI chatbot, n-agent handles the conversation plumbing so you can focus on your agents' logic.

Features

  • 🤖 Multi-agent rotation — register any number of LLM or human agents; the loop handles turn ordering automatically
  • 🌊 Real-time token streaming — receive each token as it arrives via callbacks or typed events
  • 🙋 Human-in-the-loop — pause the loop for human input at any turn or on a custom condition
  • Mid-stream interruption — users can inject a message or abort the current LLM turn at any time
  • 🔁 Retry & error recovery — automatically retry failed turns with configurable back-off (none / linear / exponential) and a custom retry filter
  • 🛑 Stop sequences — halt the conversation the moment an agent generates a specific string
  • 📡 Typed event emitter — attach multiple independent listeners (CLI, logging, UI, persistence) without composing callbacks
  • 🔌 Pluggable adapters — ships with Anthropic and Vercel AI SDK adapters; bring your own for any other provider
  • 🪶 Zero runtime dependencies — the core package has no required dependencies; adapters are optional peer deps
  • 🔒 Strict TypeScript — full type safety end-to-end, including events and adapter contracts

npm version License: MIT TypeScript

Installation

npm install @ekaone/n-agent
yarn add @ekaone/n-agent
pnpm add @ekaone/n-agent

Quick Start

import {
  attachInteractiveConsole,
  createChatBus,
  createConversation,
} from "@ekaone/n-agent";
import { anthropicAdapter } from "@ekaone/n-agent/adapters/anthropic";

// 1. Create a chat bus to register agents
const bus = createChatBus();

// 2. Register LLM agents
bus.register({
  name: "scientist",
  type: "llm",
  system: "You are a scientist. Keep responses brief.",
  adapter: anthropicAdapter({ model: "claude-haiku-4-5-20251001", maxTokens: 150 }),
});

bus.register({
  name: "philosopher",
  type: "llm",
  system: "You are a philosopher. Keep responses brief.",
  adapter: anthropicAdapter({ model: "claude-haiku-4-5-20251001", maxTokens: 150 }),
});

// 3. Create a conversation
const convo = createConversation(bus, {
  participants: ["scientist", "philosopher"],
  topic: "What is consciousness?",
  maxTurns: 6,
});

// 4. Attach interactive console (optional, for CLI usage)
const rl = attachInteractiveConsole(convo);

// 5. Start the conversation
await convo.start();
rl.close();

API Reference

createChatBus()

Creates a registry for agents.

const bus = createChatBus();

Methods:

  • bus.register(agent: ChatAgent): void — Register an agent
  • bus.get(name: string): ChatAgent — Get an agent by name
  • bus.has(name: string): boolean — Check if agent exists

createConversation(bus, options)

Creates a conversation loop between registered agents.

const convo = createConversation(bus, {
  participants: ["agent1", "agent2"],
  topic: "Discussion topic",
  maxTurns: 10,
  delayMs: 2000,
  pauseCondition: (ctx) => ctx.turnIndex % 3 === 2,
  onToken: (chunk, speaker) => process.stdout.write(chunk),
  onTurnComplete: (turn) => console.log(turn.content),
  onStateChange: (state) => console.log("State:", state),
});

Events (recommended)

createConversation() returns a handle that can emit typed events. This is the easiest way to attach multiple independent listeners (CLI output, logging, persistence, UI) without composing callbacks.

const convo = createConversation(bus, {
  participants: ["agent1", "agent2"],
  topic: "Discussion topic",
  maxTurns: 10,
});

// Stream tokens
convo.on("token", ({ chunk }) => process.stdout.write(chunk));

// Turn boundaries
convo.on("turnComplete", ({ turn }) => console.log(`\n---\n${turn.speaker}: ${turn.content}`));

// State changes
convo.on("state", ({ state }) => console.log("State:", state));

// Retry attempts (fires before each back-off sleep)
convo.on("retry", ({ speaker, attempt, maxAttempts, error, delayMs }) => {
  console.warn(`[${speaker}] attempt ${attempt}/${maxAttempts} failed — retrying in ${delayMs}ms`, error);
});

ConversationOptions

Option Type Default Description
participants string[] required Ordered list of agent names defining turn rotation
topic string required Opening message to seed the conversation
maxTurns number 10 Maximum number of turns before auto-stopping
delayMs number 0 Delay between turns in milliseconds
stopSequence string String that triggers immediate stop when generated
pauseCondition (ctx: TurnContext) => boolean Function to pause for human input
retry RetryOptions Per-turn retry policy for transient LLM errors (see below)
onToken (chunk: string, speaker: string) => void Called for each token streamed from LLM
onTurnComplete (turn: ChatMessage) => void Called when a turn finishes
onStateChange (state: LoopState) => void Called when conversation state changes
onRetry (ctx: RetryContext) => void Called before each retry attempt

Note: the callback options above are still supported for backward compatibility, but events are preferred if you need more than one listener.

RetryOptions

Configure per-turn retry behaviour for transient errors (network blips, rate-limit 429s, etc.). Retry is opt-in — omitting retry preserves the original behaviour where any error immediately stops the conversation.

Option Type Default Description
maxAttempts number 1 Total attempts including the first try. 1 means no retries.
backoff "none" | "linear" | "exponential" "exponential" Back-off strategy between attempts
initialDelayMs number 1000 Base delay in ms for the first retry
maxDelayMs number 30000 Upper bound on delay in ms
shouldRetry (err: unknown, attempt: number) => boolean Return false to abort retrying early

Back-off delay calculation:

  • "none" — no delay between attempts
  • "linear"initialDelayMs × attempt (e.g. 1 s, 2 s, 3 s, …)
  • "exponential"initialDelayMs × 2^(attempt−1) (e.g. 1 s, 2 s, 4 s, …), capped at maxDelayMs

attachInteractiveConsole(convo, config?)

Attaches readline interface for CLI interaction. Provides real-time message injection and interrupt capabilities.

const rl = attachInteractiveConsole(convo, {
  feedback: true,              // Show interrupt/inject messages
  interruptMessage: "⚡ Interrupted!",
  injectMessage: "💬 Message sent.",
});

// User can:
// - Type + Enter to inject a message or interrupt current LLM
// - Ctrl+C to stop gracefully

await convo.start();
rl.close();

Conversation Modes

1. Continuous Mode (default)

Agents take turns automatically until maxTurns is reached.

const convo = createConversation(bus, {
  participants: ["agent1", "agent2", "agent3"],
  topic: "Let's discuss AI.",
  maxTurns: 12,
  delayMs: 1000,  // 1 second pause between turns
});

2. Turn-by-Turn Mode (pauseCondition)

Pause after each turn for human approval or input.

const convo = createConversation(bus, {
  participants: ["agent1", "agent2"],
  topic: "Step-by-step discussion.",
  pauseCondition: () => true,  // Pause after every turn
  // Or: pause every 3rd turn
  // pauseCondition: (ctx) => ctx.turnIndex % 3 === 2,
});

const rl = attachInteractiveConsole(convo);
await convo.start();
rl.close();

TurnContext:

interface TurnContext {
  turnIndex: number;      // Current turn number
  speaker: string;          // Current agent name
  lastMessage: string;     // Full content of last message
  history: ChatMessage[];  // Complete conversation history
}

3. Human-in-the-Loop Mode

Register a human agent that waits for user input as a participant.

// Register human agent in the rotation
bus.register({ name: "human", type: "human" });

const convo = createConversation(bus, {
  participants: ["agent1", "human", "agent2"],  // Human takes a turn
  topic: "Hello everyone!",
  maxTurns: 10,
});

const rl = attachInteractiveConsole(convo);
await convo.start();  // Pauses when it's human's turn
rl.close();

4. Retry & Error Recovery Mode

Automatically retry failed LLM turns with configurable back-off so transient errors don't kill a session.

const convo = createConversation(bus, {
  participants: ["agent1", "agent2"],
  topic: "Let's discuss AI.",
  maxTurns: 10,
  retry: {
    maxAttempts: 3,          // try up to 3 times per turn
    backoff: "exponential",  // 1 s → 2 s between retries
    initialDelayMs: 1000,
    maxDelayMs: 10000,
    // optional: only retry on specific errors
    shouldRetry: (err) => err instanceof Error && err.message.includes("429"),
  },
  onRetry: ({ speaker, attempt, maxAttempts, error, delayMs }) => {
    console.warn(`[${speaker}] attempt ${attempt}/${maxAttempts} failed — retrying in ${delayMs}ms`);
  },
});

// Or listen via events
convo.on("retry", ({ speaker, attempt, error }) => {
  console.warn(`[${speaker}] retry #${attempt}:`, error);
});

// If all attempts are exhausted, 'error' fires and conversation stops
convo.on("error", ({ error, speaker }) => {
  console.error(`[${speaker}] fatal:`, error);
});

// stopped.reason will be "error" when retries are exhausted
convo.on("stopped", ({ reason }) => {
  if (reason === "error") console.log("Conversation ended due to a fatal LLM error.");
});

UI note: On a retry the previously streamed tokens for that turn are discarded. If you render tokens live, clear the active message bubble when you receive the "retry" event.

5. Interrupt Mode

Users can interrupt ongoing LLM generation mid-stream.

const convo = createConversation(bus, {
  participants: ["agent1", "agent2"],
  topic: "Rapid fire discussion.",
  onTurnComplete: (turn) => {
    if (turn.partial) console.log("(interrupted)");
  },
});

const rl = attachInteractiveConsole(convo);
await convo.start();
// While agent is speaking, type and press Enter to interrupt
rl.close();

Complete Example: Colored Multi-Agent Debate

import {
  attachInteractiveConsole,
  createChatBus,
  createConversation,
} from "@ekaone/n-agent";
import { anthropicAdapter } from "@ekaone/n-agent/adapters/anthropic";

const bus = createChatBus();

// Color coding for each participant
const colors: Record<string, string> = {
  physicist: "\x1b[36m",   // Cyan
  philosopher: "\x1b[35m", // Magenta
  economist: "\x1b[33m",   // Yellow
  reset: "\x1b[0m",
};

function colorize(name: string): string {
  const c = colors[name] || "";
  return `${c}[${name}]${colors.reset}`;
}

// Register 3 experts
bus.register({
  name: "physicist",
  type: "llm",
  system: "You are a theoretical physicist...",
  adapter: anthropicAdapter({ model: "claude-haiku-4-5-20251001", maxTokens: 150 }),
});

bus.register({
  name: "philosopher",
  type: "llm",
  system: "You are a philosopher...",
  adapter: anthropicAdapter({ model: "claude-haiku-4-5-20251001", maxTokens: 150 }),
});

bus.register({
  name: "economist",
  type: "llm",
  system: "You are an economist...",
  adapter: anthropicAdapter({ model: "claude-haiku-4-5-20251001", maxTokens: 150 }),
});

// Track speaker for colored output
let currentSpeaker = "";
let firstToken = true;

const convo = createConversation(bus, {
  participants: ["physicist", "philosopher", "economist"],
  topic: "Should humanity colonize Mars?",
  maxTurns: 9,
  delayMs: 2000,  // 2 second pause between turns

  onToken: (chunk, speaker) => {
    // Print speaker name once per turn with color
    if (speaker !== currentSpeaker) {
      currentSpeaker = speaker;
      firstToken = true;
    }
    if (firstToken) {
      process.stdout.write(`\n${colorize(speaker)} `);
      firstToken = false;
    }
    process.stdout.write(chunk);
  },

  onTurnComplete: (turn) => {
    console.log(`\n${"─".repeat(50)}`);
    if (turn.partial) console.log("⚠️ (interrupted)");
  },

  onStateChange: (state) => {
    if (state === "stopped") console.log("\n✅ Conversation ended.");
  },
});

// Enable interactive CLI
const rl = attachInteractiveConsole(convo);

console.log("🚀 Topic: Mars colonization debate");
console.log("💡 Type + Enter to interrupt. Ctrl+C to stop.\n");

const history = await convo.start();
console.log(`\n📜 Total messages: ${history.length}`);
rl.close();

Adapters

Adapters bridge the framework to LLM providers. Currently available:

Anthropic

import { anthropicAdapter } from "@ekaone/n-agent/adapters/anthropic";

bus.register({
  name: "claude",
  type: "llm",
  system: "You are helpful.",
  adapter: anthropicAdapter({
    model: "claude-3-sonnet-20250219",
    maxTokens: 500,
    apiKey: process.env.ANTHROPIC_API_KEY,  // or auto from env
  }),
});

AI SDK (Vercel)

import { openaiAdapter } from "@ekaone/n-agent/adapters/ai-sdk";

bus.register({
  name: "gpt",
  type: "llm",
  adapter: openaiAdapter({ model: "gpt-4o-mini" }),
});

Type Definitions

type AgentType = "llm" | "human";

interface ChatAgent {
  name: string;
  type: AgentType;
  system?: string;
  adapter?: AgentAdapter;
}

interface ConversationHandle {
  start(): Promise<ChatMessage[]>;
  send(message: string): SendResult;
  stop(): void;
  readonly state: LoopState;
  readonly history: ChatMessage[];
}

type LoopState = "idle" | "streaming" | "awaiting-human" | "stopped";

type ConversationStoppedReason =
  | "maxTurns"      // reached maxTurns cap
  | "stop"          // stop() called explicitly
  | "stopSequence"  // stopSequence string was generated
  | "error";        // all retry attempts exhausted

type SendResult = {
  intent: "inject" | "interrupt";
  turnIndex: number;
};

// ─── Retry types

type RetryBackoff = "none" | "linear" | "exponential";

interface RetryOptions {
  maxAttempts?: number;       // default 1 (no retries)
  backoff?: RetryBackoff;     // default "exponential"
  initialDelayMs?: number;    // default 1000
  maxDelayMs?: number;        // default 30000
  shouldRetry?: (err: unknown, attempt: number) => boolean;
}

interface RetryContext {
  speaker: string;
  turnIndex: number;
  attempt: number;      // 1-based retry count
  maxAttempts: number;
  error: unknown;
  delayMs: number;      // back-off sleep before next attempt
}

License

MIT © Eka Prasetia

Links


⭐ If this library helps you, please consider giving it a star on GitHub!

About

Multi-agent conversation loop with human-in-the-loop support.

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors