Cloudflare

⚡️ Why you should build Science Fiction — Sunil Pai, Cloudflare

May 24, 2026 · 14:47

Sunil Pai (Cloudflare) argues that Cloudflare's Durable Objects and Dynamic Workers offer a more efficient architecture for AI agents than Anthropic's cloud-managed agents by providing stateful serverless computing and safe execution of LLM-generated code. He explains that Durable Objects enable millions of stateful serverless actors, while Dynamic Workers allow running user- or LLM-generated code in a zero-startup-time sandbox with controlled API exposure. Pai notes that no one has yet built the 'React' for agent harnesses, and the industry needs a standardized cross-platform abstraction. He recounts a personal 'slop fork' incident where his fork of Vercel’s Just Bash was misinterpreted as a Cloudflare move, highlighting the importance of candor in a tight-knit industry. He observes that open source repos have become adversarial grounds, with fake security reports being a top attack vector. Pai concludes by encouraging developers to build original 'sci-fi' projects instead of incremental improvements or chasing enterprise deals.

AI Agents Need Computers: 74% MoM Growth, 850K/Day Runs, & New Agent Cloud — Ivan Burazin, Daytona

May 21, 2026 · 1:11:40

In this episode, Ivan Burazin, CEO of Daytona, explains why AI agents need composable computers rather than disposable code execution boxes, and how Daytona pivoted from human dev environments to building a bare-metal sandbox platform that spins up one sandbox in 60ms and 50,000 in 75 seconds. Daytona's biggest customer runs 850,000 sandboxes daily, and RL/eval workloads have surged from 0% to 50% of usage. The platform competes against managed Kubernetes (EKS/GKS) by offering stateful snapshots, dynamic resizing, and a scheduler purpose-built for agent workloads. Burazin also discusses the company's 74% month-over-month growth, the addition of Windows sandboxes, and the licensing challenges of macOS. He argues the future AI cloud will look more like Stripe than AWS, and that agents will need every kind of computer—including legacy Windows environments—to automate knowledge work.

Senior Dev: This "Grill Me" Prompt Is Going Viral Among Top Engineers

May 7, 2026 · 22:03

Matt Pocock — the TypeScript educator turned AI engineering teacher who created the viral "Grill Me" prompt and runs AI Hero — argues that classic software engineering fundamentals are more critical than ever in the AI coding era. He explains how Domain-Driven Design's ubiquitous language and deep module patterns let developers contain complexity and delegate implementation to AI. His free "Grill Me" skill (part of his 13,000-star skills repo) forces AI to relentlessly interview humans until reaching shared understanding. He contrasts Claude Code's ease-of-use against Pie's transparent primitives, predicting a shift toward developer observability. The episode also covers his two-month course creation process, why TypeScript is overtaking Python in AI engineering, and why traditional lectures still dominate learning.

⚡️Monty: the ultrafast Python interpreter by Agents for Agents — Samuel Colvin, Pydantic

Mar 14, 2026 · 34:02

Samuel Colvin joins Shawn Wang to introduce Monty, Pydantic's ultrafast Python interpreter built with AI for agents, positioning it as a lightweight, secure alternative to sandboxes for code execution. Monty runs inside the same process, achieving sub-microsecond latency (800 nanoseconds in a hot loop), versus over a second for cloud sandboxes. Colvin explains the inspiration came from conversations at Anthropic about type safety's critical role in AI tool calling, and how Monty fills the gap between simple tool calling and full sandboxes. Monty is not full CPython—it lacks third-party library support and some standard library modules—but covers essential built-ins, implemented largely by LLMs that Colvin calls 100x faster for tasks where internal and external APIs are well-known, unit tests are trivial, and there's no API bikeshedding. He demonstrates a Pydantic AI agent using Monty to scrape LLM pricing from websites, with type checking built into the runtime so only permitted host functions (e.g., Playwright, Beautiful Soup wrappers) can be called. Colvin also shares his workflow using Claude Code, Codex, and Gemini CLI in combination for code review and implementation, and…

⚡️ OpenClaw's Memory Sucks and the fix is simple — Dhravya Shah, Supermemory

Mar 9, 2026 · 27:10

Supermemory founder Dhravya Shah argues that current memory approaches like OpenClaw's static markdown files fail because they lack freshness and agent-driven retrieval, proposing a hooks-based system that dynamically injects less than 2,000 tokens per turn. His company Supermemory uses a hybrid mode combining structured memory with RAG fallbacks, achieving costs as low as 2 cents per million tokens. Shah critiques benchmarks like LongMemEval and LoCoMo for not testing personalization or forgetfulness, and his team built the open platform MemoryBench for evaluation. Future plans include plugins for Cursor and partnerships with voice agent companies, aiming for prosumer interoperability across AI providers.

[State of Context Engineering] Agentic RAG, Context Rot, MCP, Subagents — Nina Lopatina, Contextual

Dec 31, 2025 · 26:48

Nina Lopatina of Contextual AI discusses the state of context engineering, arguing that while the field is still in prototyping, 2025 will see true scale with full-system design patterns. She notes that agentic RAG—especially query reformulation into subqueries—has become the baseline, dramatically improving retrieval. Context rot is widely cited but industry benchmarks at real scale (100k+ documents, billions of tokens) remain rare. MCP is both a driver and a flaw: giant JSON tool definitions stuff the context window, yet MCP servers enable rapid prototyping before optimizing down to direct API calls. Sub-agents with turn limits are critical—unlimited agency degrades performance and causes hallucinations. Instruction-following re-rankers are essential for scaling retrieval across massive databases, providing more recall upfront and precision in the final context. Benchmarks are being saturated faster than ever: a Princeton benchmark from October was saturated by Claude Code in weeks, with solutions so good the gold dataset had errors. Lopatina also shares a lesson from using ChatGPT as a snowboarding coach—after several months of training for a 25-lap mogul race, she had to close…

One Year of MCP — with David Soria Parria and AAIF leads from OpenAI, Goose, Linux Foundation

Dec 28, 2025 · 1:39:19

David Soria Parra, MCP lead at Anthropic, along with Jim Zemlin (Linux Foundation CEO), Nick Cooper (OpenAI), and Brad Howes (Block/Goose), recount the one-year evolution of the Model Context Protocol from a local experiment to the de facto standard for agentic systems, now donated to the new Agentic AI Foundation. They detail four spec releases—from local stdio to remote HTTP streaming, OAuth 2.1 authentication (and enterprise lessons learned), long-running tasks, and MCP Apps (iframes for richer UI)—and explain why internal enterprise adoption is exploding faster than expected, mostly invisible and at massive scale. The group reveals how three competitive AI labs came together to donate protocols and agents to a neutral foundation, how the foundation will balance taste-making (curating meaningful projects) with openness, and their 2025 vision: MCP as the communication layer for asynchronous, long-running agents that discover and install their own tools, unlocking another order of magnitude in AI productivity.

Anthropic, Glean & OpenRouter: How AI Moats Are Built with Deedy Das of Menlo Ventures

Nov 14, 2025 · 1:26:59

Deedy Das of Menlo Ventures returns to explain how Anthropic became the fastest-growing software company ever (zero to billions in revenue) and why Glean’s boring enterprise search moat of hard integrations and ranking problems is harder than competitors think. He reveals the $100M Anthology Fund’s strategy: backing OpenRouter, Goodfire, Prime Intellect, and Whisper—companies that solve thorny infrastructure or research problems rather than chasing apps. Das argues that model-layer companies will capture most value because building great models is harder than building apps, and that Anthropic’s product innovations like Claude Code emerge from a culture that lets researchers experiment freely. He also warns that vibe coding is becoming a cognitive crutch for engineers, eroding deep problem-solving skills, and discusses how enterprise AI market share has shifted dramatically: OpenAI went from 50% to 20%, while Anthropic rose from 12% to 32% of enterprise LLM API spend.

⚡️Accelerators @ 3x NVIDIA H200 perf, Made in the USA - Thomas Sohmers + Mitesh Agrawal, Positron AI

Aug 18, 2025 · 47:56

Thomas Sohmers and Mitesh Agrawal of Positron AI argue memory bandwidth, not compute, is the true bottleneck in AI inference, and their accelerator achieves 93% memory bandwidth utilization—triple NVIDIA's efficiency—enabling 70% faster token generation at 150W. The founders, both Lambda Labs veterans, shipped an FPGA product 15 months after founding, then raised a $51M Series A for an ASIC in late 2026. Their hardware requires no recompilation: it ingests raw binary weights from NVIDIA training and outputs an OpenAI-compatible API. Positron focuses on the decode phase of transformers, where memory-bound matrix-vector multiplication dominates, and already counts Cloudflare and Parasail as customers. The company sells systems directly, prioritizing capital efficiency and ROIC over operating its own cloud.

AI is Eating Search

Jul 23, 2025 · 56:22

Robert McCloy of Scrunch AI argues that AI is replacing web browsing, not just search, as consumers prefer ChatGPT and similar tools over traditional browsing. He explains that AI search platforms still rely on traditional search under the hood, but re-rank results based on metadata clarity—so clickbait titles fail while descriptive content wins. Prompt injection works currently but is a temporary tactic; the durable strategy is clear, structured content with server-side rendered HTML because AI tools don't execute JavaScript. Scrunch helps brands optimize for platforms like ChatGPT, Perplexity, and Meta AI; customer Clerk saw a 6x traffic increase and 9x conversion lift from AI-referred visitors. Robert predicts the future is about 'agent experience'—optimizing how AI systems interact with your content to serve end users directly.

⚡️The Future of Notebooks - with Akshay Agrawal of Marimo

Jul 18, 2025 · 28:14

Akshay Agrawal introduces Marimo, an open-source reactive Python notebook built from scratch for AI and data work, emphasizing its lack of Jupyter dependencies and features like reactive execution, built-in UI elements, and pure Python storage for Git versioning. Marimo has surpassed 300k monthly PyPI downloads and more GitHub stars than Jupyter Notebook, used at OpenAI, Hugging Face, and Cloudflare. Agrawal demos interactive data exploration, including a PS5 controller for data annotation, and AI-native code generation with context-aware cell completion. He explains Marimo's UV package integration for inline dependency management and the upcoming MoLab cloud-hosted service on Modal, free for community use, addressing demand for a Colab-like experience. Marimo notebooks can be run as scripts or deployed as data apps, with a fork exploring agent cells for generative analysis.

Cline: The Collaborative AI Coder

Jul 16, 2025 · 1:15:44

Saoud Rizwan and Pash from Cline join to explain why their open-source coding agent uses a Plan + Act paradigm — having models explore and plan before executing — pioneered before competitors like Claude Code. They argue that "RAG is a mind virus" and "Fast Apply got bitter lesson'd" as frontier models now achieve sub-5% diff edit failure rates, making layered workarounds obsolete. Cline's bring-your-own-API-key model avoids inference markups, with enterprise features driven by Fortune 5 companies asking for security and ROI insights. The MCP ecosystem grew via Cline's marketplace (150+ servers, top ones with hundreds of thousands of downloads), though monetization and security remain open questions. They detail how Plan mode extracts user intent and Act mode auto-approves, how context engineering prioritizes agentic file exploration over retrieval, and why they stayed a VS Code extension rather than fork — to focus solely on the agentic loop.

Building Manus AI (first ever Manus Meetup)

Mar 27, 2025 · 48:59

Tao Zhang, co-founder of Manus, explains how Manus gives LLMs 'hands' to take real-world actions, inspired by MIT's 'mens et manus' (mind and hand). Manus assigns each task its own cloud virtual machine via E2B, provides pre-paid data APIs (stock, social media), and a knowledge system to remember user preferences. Their previous product, Monica.im, grew to 20M monthly active users and $50M ARR before they pivoted from a failed AI browser project to Manus. On the GAIA benchmark, Manus achieves a per-task cost of ~$2, far cheaper than OpenAI's Deep Research (~$20) and prior SOTA. Zhang emphasizes a 'less structure, more intelligence' philosophy, opting not to predefine workflows but to give the model rich context and tools. He also discusses plans to partner with Cloudflare, pay paywalls on behalf of users, and integrate more APIs based on usage patterns, while ruling out building their own foundation model.

npm install Agents — with Sunil Pai and Rita Kozlov (VP AI) of Cloudflare

Mar 19, 2025 · 35:36

Shawn Wang hosts Sunil Pai and Rita Kozlov to discuss Cloudflare's new Agents product, which uses Durable Objects to provide a scalable, stateful runtime for building AI agents. Sunil built an initial prototype in two weeks, which Rita helped polish into a full SDK and starter kit. They demo a chat agent with persistent state, human-in-the-loop confirmation, and built-in scheduling via cron, all running on Durable Objects without Kubernetes. The conversation covers local-first syncing (Durable Objects as always-on sync clients), the need for observability across millions of agents, and excitement about MCP for easy integrations. Rita teases upcoming "durable object enabled containers" to bridge long-running and CPU-heavy workloads, and a new browser rendering REST API launching the same day.

Agent Engineering with Pydantic + Graphs — with Samuel Colvin, CEO of Pydantic Logfire

Feb 6, 2025 · 1:02:15

Samuel Colvin, CEO of Pydantic Logfire, argues that Pydantic AI offers a production-ready agent framework with type-safe graphs, unlike most agent frameworks that sacrifice engineering quality. He explains Pydantic's shift from a validation library to an AI tool, noting 300M monthly downloads and a 20% reduction in time-to-first-token for a major model company after upgrading to Pydantic V2. Colvin details Logfire's use of DataFusion over ClickHouse for better JSON support and control, and why Pydantic AI resists an LLM gateway, favoring OpenAI-aligned APIs. He defends graphs for complex workflows, reveals agents now use graphs internally, and shares that Pydantic.run enables browser-based demos. The episode covers OpenTelemetry's emerging GenAI semantic conventions, the need for self-hosted observability due to PII in LLM data, and Colvin's investment in Marimo as a text-based Jupyter replacement.