Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
AG-UI Ragas Integration for Evals
Learn how to integrate AG‑UI with Ragas via HTTP, enabling generic, framework‑agnostic evaluation of agents and running identical datasets across multiple platforms.
There are numerous examples in the Ragas documentation and Github showing how to integrate directly with various agentic frameworks, but they all involve directly invoking the agents through their respective APIs. This demo will show how AG-UI can be used as a more generic integration mechanism, communicating with any AG-UI-compatible agent over HTTP instead, opening up additional frameworks (e.g., ADK) as well as test scenarios (e.g., easily running the same datasets across a wider variety of agents).
Ragas provides objective LLM-based metrics and test generation for AI evaluation.