Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
LiveKit Voice Agent Orchestration
Demo a voice-controlled AI coding agent orchestrating parallel sub-agents, syncing state across clients via WebSockets, and integrating LiveKit audio.
I’ll demo a voice-controlled AI coding agent that delegates work to parallel sub-agents while maintaining bidirectional sync across terminal, web, and mobile. The core challenge: how do you coordinate multiple autonomous agents in real-time while enabling voice interaction?
I’ll walk through the technical architecture:
- Agent orchestration: How the main agent spawns workers for parallel execution and aggregates results
- Real-time sync: WebSocket relay architecture that broadcasts messages via Redis PubSub to all connected clients
- Voice integration: Connecting LiveKit’s WebRTC audio to the agent via separate channels (audio through LiveKit, commands through WebSocket relay)
- Async voice notifications: Using debounced triggers to make the voice agent proactively speak when background tasks complete
The interesting bits: handling the dual-connection model (audio vs. text), preventing message echo loops in pubsub, and designing the database schema to support hierarchical agent sessions with parent/child relationships.
Code walkthrough will cover TypeScript agent orchestration, Python voice agent with STT/TTS, and the WebSocket relay protocol.