Gemini Live API

A high-speed WebSocket interface for building real-time, bidirectional voice and video interactions using Gemini 2.0 Flash.

The Multimodal Live API enables sub-second latency for voice-to-voice applications by streaming audio and video directly to Gemini 2.0 Flash. It supports over 40 languages and provides 10 distinct built-in voices (such as Lyra and Orion) for natural, interruptible conversations. Developers use a single WebSocket connection to handle complex tasks like real-time vision processing and tool use (function calling) without the lag of traditional text-to-speech pipelines. This is the production-ready engine for building AI agents that see, hear, and respond instantly.

https://ai.google.dev/gemini-api/docs/multimodal-live