Datadog

Notion’s Sarah Sachs & Simon Last on Custom Agents, Evals, and the Future of Work

Apr 15, 2026 · 1:25:37

Sarah Sachs and Simon Last of Notion explain how Custom Agents were rebuilt four to five times since 2022, with early attempts failing due to lack of tool-calling standards and short context windows. They shifted from few-shot prompting to tool definitions and progressive disclosure, now supporting over 100 tools. Their eval system includes frontier evals that pass only 30% to gauge model progress, and they employ Model Behavior Engineers to write evals and triage failures. The episode covers their views on MCP versus CLI, meeting notes as data capture, and the software factory concept of agents collaborating to develop codebases. They also discuss Notion's culture of low-ego, high-velocity rebuilding and the philosophy that every surface must work for both humans and agents.

Cursor's Third Era: Cloud Agents — ft. Sam Whitmore, Jonas Nelle, Cursor

Mar 6, 2026 · 1:11:18

Cursor's Sam Whitmore and Jonas Nelle detail their Cloud Agents launch, where agents get full cloud VMs to onboard repos, run code, and test changes end-to-end before returning PRs with demo videos and remote desktop access. The model decides whether to test (with /no-test to skip and /repro for bug reproduction videos). Videos cut review time by letting humans watch 20-second clips instead of giant diffs. Cursor supports parallel model swarms via best-of-N—running multiple models head-to-head on the same prompt—and subagents for context management, plus a long-running 'grind mode' for multi-day tasks. They predict cloud agents will surpass local agents in volume by year-end, driving per-developer spend to thousands per month and creating new bottlenecks in CI/CD and production pipelines.

⚡️ Ship AI recap: Agents, Workflows, and Python — w/ Vercel CTO Malte Ubl

Nov 1, 2025 · 42:02

Vercel CTO Malte Ubl discusses the company's AI strategy, centered on the new Workflow Development Kit that enables durable, resumable serverless functions with infinite idle time at no cost. He explains how the AI SDK was extracted from v0 and remains deliberately low-level to accommodate emerging patterns, with a direct agent abstraction now stable in version six. Ubl details Vercel's internal agents—including a DevOps agent that investigates production anomalies by querying observability data and logs, solving the recall-precision problem in alerting—and the 'Agent on Every Desk' program that helps large companies build their first three agents. He also covers zero-config Python support for Flask and FastAPI, and a security model that assumes developers cannot be trusted, extracting auth and data access from application code.

Agent Engineering with Pydantic + Graphs — with Samuel Colvin, CEO of Pydantic Logfire

Feb 6, 2025 · 1:02:15

Samuel Colvin, CEO of Pydantic Logfire, argues that Pydantic AI offers a production-ready agent framework with type-safe graphs, unlike most agent frameworks that sacrifice engineering quality. He explains Pydantic's shift from a validation library to an AI tool, noting 300M monthly downloads and a 20% reduction in time-to-first-token for a major model company after upgrading to Pydantic V2. Colvin details Logfire's use of DataFusion over ClickHouse for better JSON support and control, and why Pydantic AI resists an LLM gateway, favoring OpenAI-aligned APIs. He defends graphs for complex workflows, reveals agents now use graphs internally, and shares that Pydantic.run enables browser-based demos. The episode covers OpenTelemetry's emerging GenAI semantic conventions, the need for self-hosted observability due to PII in LLM data, and Colvin's investment in Marimo as a text-based Jupyter replacement.

Why every AI Engineer needs an AI Gateway (ft Portkey.ai CEO)

Feb 5, 2025 · 31:18

Rohit Agarwal, CEO of Portkey, explains why every AI engineer needs an AI gateway: an operational platform that connects to LLMs more efficiently, handling routing, observability, guardrails, and cost management. He notes that 90% of production use cases don't use automatic routing, but reasoning models and agents are driving new routing demands. Portkey's open-source gateway minimizes latency with a 21 MB memory footprint using JSON transformers. Key jobs include routing, observability (monitoring price, performance, accuracy), guardrails (e.g., regex-based, empty output detection, PII redaction), and human feedback tied to business metrics like video download rates. Rohit also highlights MCP adoption for simplifying agent-to-service connections, with bidirectional communication via RPC.