Agent Engineering with Pydantic + Graphs — with Samuel Colvin, CEO of Pydantic Logfire
Feb 6, 2025 · 1:02:15
Samuel Colvin, CEO of Pydantic Logfire, argues that Pydantic AI offers a production-ready agent framework with type-safe graphs, unlike most agent frameworks that sacrifice engineering quality. He explains Pydantic's shift from a validation library to an AI tool, noting 300M monthly downloads and a 20% reduction in time-to-first-token for a major model company after upgrading to Pydantic V2. Colvin details Logfire's use of DataFusion over ClickHouse for better JSON support and control, and why Pydantic AI resists an LLM gateway, favoring OpenAI-aligned APIs. He defends graphs for complex workflows, reveals agents now use graphs internally, and shares that Pydantic.run enables browser-based demos. The episode covers OpenTelemetry's emerging GenAI semantic conventions, the need for self-hosted observability due to PII in LLM data, and Colvin's investment in Marimo as a text-based Jupyter replacement.
