LLM Cost Reduction: SEC Analysis

See a live coding demo building an LLM analysis system, focusing on cost reduction via regex, data extraction, semantic caching, and observability.

Overview

A live coding demo walking through an LLM-powered document analysis system. I’ll run the pipeline live and show the code that makes it work.

Using regex and rule-based filters to reduce LLM API costs by 80%+
Extracting structured data from unstructured documents with Claude
Implementing semantic caching with Qdrant to avoid redundant API calls
Tracking LLM costs and latency with Langfuse

Tech stack