Agent Platforms

Podcast Crossover: AIE, AGI, frontier lab strategy with ​ ⁨@matthew_berman⁩ and @swyxtv

Jul 10, 2026 · 28:03

Shawn 'Swyx' Wang, founder of the AI Engineer conference, tells Matthew Berman how he seized the industry shift by buying ai.engineer and partnering with a veteran conference organizer, crediting Andrej Karpathy's early endorsement. He argues Etched's ASICs are a natural next-gen bet for transformer inference, not an NVIDIA disruptor, and that Fable 5's slowness and cost signal the end of the LLM scaling era—making model efficiency the next problem. Swyx interprets OpenAI's reported 5% equity offer to the US government as a pragmatic multi-turn negotiation, likening it to Singapore's Temasek model, but warns against premature utility regulation. He pegs his own P(doom) at ~5% over 50 years, rejecting near-term doomerism as egotistical. For founders, he advocates building 'agent labs' that solve specific customer problems (e.g., for lawyers, dentists) rather than betting on model routing, which he dismisses as a marketing line that fails to exploit a single model's full stack as deeply as frontier labs do.

The Blueprint for Autonomous Work Agents | Gavriel Cohen, NanoClaw

Jun 29, 2026 · 23:15

Gavriel Cohen, founder of NanoClaw, explains why he built a minimal, secure alternative to OpenClaw after feeling apprehensive about its codebase and dependencies for production use. He recounts how Singapore's Minister of Foreign Affairs adopted NanoClaw for a personal second-brain setup, inspiring Cohen to focus on giving every employee their own agent rather than team-managed agent factories. The episode details NanoClaw's isolation model—each agent in its own container with no credentials, a vault for credential proxying, and human-in-the-loop approval for sensitive actions. Cohen also shares the pivot from an AI-native marketing agency to nanoCo, which now deploys and manages agents for over 100 enterprise clients, and discusses the challenge of triaging AI-generated pull requests in open source.

The Agent Cloud: Databricks’ Bet on the Future of AI — Matei Zaharia and Reynold Xin

Jun 24, 2026 · 1:10:06

Databricks cofounders Matei Zaharia and Reynold Xin argue the company is moving beyond the lakehouse into a full data-and-AI operating system, anchored by two new initiatives: Omnigent, an open-source meta-harness for combining coding and enterprise agents, and LTAP, a unified storage layer that gets most HTAP benefits without collapsing query engines. Omnigent provides a common API for agent sessions, files, streams, tool calls, and cancellation, solving portability, collaboration, and security issues across Claude Code, Codex, Cursor, and custom agents. LTAP writes transactional data directly in columnar Parquet format, eliminating brittle CDC pipelines—Reynold jokes CDC means 'continuous data corruption'—and enables instant analytics without overloading the source database. The episode details Databricks’ culture of rapid prototyping, where an engineer built the LTAP prototype without a formal design doc, and the thesis that traditional software will be rewritten once data is in the right place with agents on top. They also cover Mosaic’s shift from general frontier models to specialized fine-tuned models like document parsing, internal agent usage, and security features such…

Satya Nadella on AI: @NoPriorsPodcast x Latent Space Crossover Special at Microsoft Build 2026

Jun 3, 2026 · 41:27

Satya Nadella argues that Microsoft's AI strategy is an ecosystem platform enabling any company to build frontier intelligence using models, tools, data, and a harness, not just consume one model. He outlines MAI training with clean data lineage, hill-climbing scaffolds, and private evals as core IP. The harness concept features multi-model harnesses with strong context layers, exemplified by GitHub Copilot and Work IQ turning M365 data into a database for agents. He notes coding agents required new IDE/UI, and long-running autopilots create value. Pricing evolves from per-user to consumption, and SaaS will unbundle and rebundle. Engineering generalists gain leverage; infrastructure roles like RLEs remain critical. Datacenter expansion requires community permission, with benefits in healthcare and rethinking education. Microsoft built more Azure capacity in 15 months than its first 15 years.

GitHub’s Agent Era: 14x Commits, 200M Developers, Copilot’s Next Act — Kyle Daigle

Jun 2, 2026 · 1:24:44

GitHub COO Kyle Daigle joins Swyx to unpack how the agent era is transforming GitHub's infrastructure and developer workflows, from 14x commit growth to internal AI micro-skills. Daigle describes using WorkIQ, MCP, and Slack/Teams context to retroactively analyze weeks' work and build executive presentations entirely with AI, undetected. He advocates atomic micro-skills over mega-skills and reveals GitHub now hosts 200M developers generating 275M weekly commits, on pace for 14B this year. Scaling issues stem from MySQL1 permissions and monorepo shifts, forcing rewrites of 10-year-old services. Copilot has evolved from code completion to a unified agent SDK powering CLI, desktop, and cloud agents. Microsoft's deep investment in OpenClaw reflects a need for OS-level sandboxing for enterprise agent deployment.

⚡️ Why you should build Science Fiction — Sunil Pai, Cloudflare

May 24, 2026 · 14:47

Sunil Pai (Cloudflare) argues that Cloudflare's Durable Objects and Dynamic Workers offer a more efficient architecture for AI agents than Anthropic's cloud-managed agents by providing stateful serverless computing and safe execution of LLM-generated code. He explains that Durable Objects enable millions of stateful serverless actors, while Dynamic Workers allow running user- or LLM-generated code in a zero-startup-time sandbox with controlled API exposure. Pai notes that no one has yet built the 'React' for agent harnesses, and the industry needs a standardized cross-platform abstraction. He recounts a personal 'slop fork' incident where his fork of Vercel’s Just Bash was misinterpreted as a Cloudflare move, highlighting the importance of candor in a tight-knit industry. He observes that open source repos have become adversarial grounds, with fake security reports being a top attack vector. Pai concludes by encouraging developers to build original 'sci-fi' projects instead of incremental improvements or chasing enterprise deals.

AI Agents Need Computers: 74% MoM Growth, 850K/Day Runs, & New Agent Cloud — Ivan Burazin, Daytona

May 21, 2026 · 1:11:40

In this episode, Ivan Burazin, CEO of Daytona, explains why AI agents need composable computers rather than disposable code execution boxes, and how Daytona pivoted from human dev environments to building a bare-metal sandbox platform that spins up one sandbox in 60ms and 50,000 in 75 seconds. Daytona's biggest customer runs 850,000 sandboxes daily, and RL/eval workloads have surged from 0% to 50% of usage. The platform competes against managed Kubernetes (EKS/GKS) by offering stateful snapshots, dynamic resizing, and a scheduler purpose-built for agent workloads. Burazin also discusses the company's 74% month-over-month growth, the addition of Windows sandboxes, and the licensing challenges of macOS. He argues the future AI cloud will look more like Stripe than AWS, and that agents will need every kind of computer—including legacy Windows environments—to automate knowledge work.

The Agent-Native Cloud: 3M Users, 100K Signups/Wk, Data Centers, & Death PRs — Jake Cooper, Railway

May 20, 2026 · 1:29:54

Jake Cooper, founder of Railway, argues that the next era of software infrastructure requires an agent-native cloud built on own-metal data centers, with primitives for version control, observability, and orchestration at 1000x scale. Railway grew from a slow six-year grind to 3 million users and 100,000 weekly signups with only 35 people, after surviving a $500,000/month loss on its free tier and rebuilding the business. Cooper explains that building its own data centers yields a three-month payback period and 70% margins, while using cloud bursting (AWS, GCP, Oracle) for overflow, and that data center debt is a better tool than venture debt for infra startups. He details how agents need CLIs with many flags, safe production forks, feature flags, and incremental rollouts, and why the pull request is dying in favor of prompt requests. Railway relies on Temporal for orchestration but may build its own workflow engine, and uses an internal tool called Central Station to aggregate customer feedback and incidents. Cooper advocates using agents to generate and review code instead of writing it by hand, and says focus on primitives—not GPUs—is key for now.

⚡️ Competing with ChatGPT and Sierra, building a $10M ARR company — Yasser Elsaid, Founder, Chatbase

May 2, 2026 · 1:00:26

Yasser Elsaid, founder of bootstrapped AI chatbot company Chatbase, discusses how he grew from a side project to $10M ARR in three years, reaching $1M in just 117 days. He explains why he never raised VC, relying instead on product-led growth, self-serve signups, and a content-driven go-to-market strategy. Elsaid shares specific tactics like warm outbound to signed-up users, leveraging LinkedIn virality in early AI days, and now moving toward outcome-based pricing for enterprise customers. He details Chatbase's evolution from a simple RAG chatbot into a 'chief customer officer' that handles support, sales, and onboarding while surfacing business insights from conversations. The episode also covers his transition from Toronto to San Francisco, his hiring philosophy favoring results-oriented engineers, and his daily use of both Claude Code and Codex for development.

Notion’s Sarah Sachs & Simon Last on Custom Agents, Evals, and the Future of Work

Apr 15, 2026 · 1:25:37

Sarah Sachs and Simon Last of Notion explain how Custom Agents were rebuilt four to five times since 2022, with early attempts failing due to lack of tool-calling standards and short context windows. They shifted from few-shot prompting to tool definitions and progressive disclosure, now supporting over 100 tools. Their eval system includes frontier evals that pass only 30% to gauge model progress, and they employ Model Behavior Engineers to write evals and triage failures. The episode covers their views on MCP versus CLI, meeting notes as data capture, and the software factory concept of agents collaborating to develop codebases. They also discuss Notion's culture of low-ego, high-velocity rebuilding and the philosophy that every surface must work for both humans and agents.

Extreme Harness Engineering: 1M LOC, 1B toks/day, 0% human code or review — Ryan Lopopolo, OpenAI

Apr 7, 2026 · 1:17:54

Ryan Lopopolo of OpenAI's Frontier team details his team's extreme experiment in harness engineering: building a 1M LOC internal Electron app with zero human-written or reviewed code, relying instead on Codex agents that process 1B tokens daily ($2-3k/day). He argues that humans are the bottleneck and that teams should encode non-functional requirements into specs, skills, and observability tooling rather than prompting agents to 'try harder.' The result is Symphony, a ghost library spec and Elixir reference implementation that automates the entire pull-request lifecycle, including self-review and merge. Lopopolo explains how the team scales by treating software as agent-legible text, using worktrees for multi-agent collaboration, and feeding agent mistakes back into the repository via docs like core-beliefs.md. He also discusses Frontier's enterprise platform for safe agent deployment, noting that success depends on giving agents full context—even company culture and inside jokes—so they can act as full teammates.

Dreamer: the Agent OS for Everyone — David Singleton

Mar 20, 2026 · 1:04:23

David Singleton, former Stripe CTO, introduces Dreamer, a consumer platform for discovering, building, and using AI agents and agentic apps centered on a personal Sidekick that acts as both companion and kernel-like traffic cop. He demonstrates building a conference schedule app in 25 minutes via natural language, a ski trip app that splits expenses, and tools like Gmail, Google Search, and live sports data feeds. Dreamer features an open tool ecosystem where builders get paid, a private waitlist skip at dreamer.com/latentspace, and a Builder-in-Residence program with a $10,000 prize for the best tool by mid-April. Singleton explains the OS model with Sidekick as kernel and agents as users enforcing data isolation and cross-agent coordination only through Sidekick. He shares insights on tiny-team building (six-person core, 17 total), hiring engineers who collaborate with coding agents, and LLMs' current lack of taste and creativity.

Why Your AI Agents Don’t Work with Dex Horthy of HumanLayer | In-Context Cooking

Mar 6, 2026 · 24:59

Dex Horthy, founder of HumanLayer and creator of "context engineering," joins Alan to recreate Dan Dan noodles while explaining why most AI agent demos fail in production and how the top 1% of AI engineers build differently from the rest. Horthy describes how his NASA JPL internship at 17 taught him pathfinding with Dijkstra's algorithm, and later coining "context engineering" after observing that public hype around open-source frameworks doesn't match enterprise reliability needs. He defines AI "slop" as low-effort derivative content often produced without reading, and introduces the "dumb zone"—a rule of thumb to start thinking about context compaction at 40% usage unless you have strong intuition. Horthy argues that while smarter models narrow the gap, the frontier of reliably achievable tasks keeps shifting, so context engineering remains valuable. He predicts software engineering will evolve from writing code to producing working code, emphasizing shipping over coding, and notes HumanLayer helps enterprises standardize AI adoption with guardrails rather than vibe coding.

Cursor's Third Era: Cloud Agents — ft. Sam Whitmore, Jonas Nelle, Cursor

Mar 6, 2026 · 1:11:18

Cursor's Sam Whitmore and Jonas Nelle detail their Cloud Agents launch, where agents get full cloud VMs to onboard repos, run code, and test changes end-to-end before returning PRs with demo videos and remote desktop access. The model decides whether to test (with /no-test to skip and /repro for bug reproduction videos). Videos cut review time by letting humans watch 20-second clips instead of giant diffs. Cursor supports parallel model swarms via best-of-N—running multiple models head-to-head on the same prompt—and subagents for context management, plus a long-running 'grind mode' for multi-day tasks. They predict cloud agents will surpass local agents in volume by year-end, driving per-developer spend to thousands per month and creating new bottlenecks in CI/CD and production pipelines.

⚡️ Polsia: Solo Founder Tiny Team from 0 to 1m ARR in 1 month & the future of Self-Running Companies

Mar 1, 2026 · 41:56

Polsia, an AI that autonomously builds and runs companies, crossed $1M ARR in its first month, solo founder Ben Cera explains on Latent Space. The platform lets users give an idea and it handles product coding, marketing, cold outreach, Meta ads, and competitive research, sending daily emails summarizing progress. Cera built Polsia for himself starting in November, stripping features to keep onboarding simple—provisioning everything so users only need to reply to an email. He uses AI agents to run Polsia itself, from fixing bugs to responding to investor inbound, embodying the vision of a self-running company. The business model charges $50/month (near break-even on model costs) and takes 20% of any revenue the user's company generates. Cera emphasizes that the hardest part was deciding what not to build, and he sees Polsia as an Apple-like ecosystem for autonomous business operations.

Brex’s AI Hail Mary — With CTO James Reggio (acquired for $5B by Capital One!)

Jan 17, 2026 · 1:13:27

Brex CTO James Reggio details the company's three-pillar AI strategy—corporate, operational, and product AI—arguing that SOP-driven agents outperform overengineered RL in finance ops like underwriting, KYC, and fraud. He explains why Brex built an internal AI platform (LLM gateway, prompt/version management, evals) before adopting Mastra for TypeScript-based multi-agent networks, where an EA-style orchestrator coordinates specialist agents via multi-turn conversations rather than single tool calls. The audit agent pattern separates detection, judgment, and follow-up to reduce false negatives. Brex also lets employees build their own AI stack (ChatGPT, Claude, Gemini) and runs agentic coding interviews internally, with the company growing 5X and cutting burn 99% in 18 months without adding engineers.

One Year of MCP — with David Soria Parria and AAIF leads from OpenAI, Goose, Linux Foundation

Dec 28, 2025 · 1:39:19

David Soria Parra, MCP lead at Anthropic, along with Jim Zemlin (Linux Foundation CEO), Nick Cooper (OpenAI), and Brad Howes (Block/Goose), recount the one-year evolution of the Model Context Protocol from a local experiment to the de facto standard for agentic systems, now donated to the new Agentic AI Foundation. They detail four spec releases—from local stdio to remote HTTP streaming, OAuth 2.1 authentication (and enterprise lessons learned), long-running tasks, and MCP Apps (iframes for richer UI)—and explain why internal enterprise adoption is exploding faster than expected, mostly invisible and at massive scale. The group reveals how three competitive AI labs came together to donate protocols and agents to a neutral foundation, how the foundation will balance taste-making (curating meaningful projects) with openness, and their 2025 vision: MCP as the communication layer for asynchronous, long-running agents that discover and install their own tools, unlocking another order of magnitude in AI productivity.

Steve Yegge's Vibe Coding Manifesto: Why Claude Code Isn't It & What Comes After the IDE

Dec 26, 2025 · 37:25

Steve Yegge argues that vibe coding—using multi-agent AI workflows—will replace traditional IDEs by January 1, calling anyone still using an IDE a 'bad engineer.' He claims Claude Code, Cursor, and the 2024 stack are already obsolete, predicting agent orchestration dashboards (like his VC project) will manage fleets of agents. Yegge highlights that senior engineers with 12–15 years of experience are the most resistant, but their productivity will be eclipsed by vibe coders. He warns that merging code becomes a new wall as agents produce 10x more code, citing one company's solution of one engineer per repo. Yegge also notes the chaos inside AI labs (OpenAI, Anthropic, Google) as they scale, and believes open‑source models will approach frontier capability within a year.

⚡️GPT5-Codex-Max: Training Agents with Personality, Tools & Trust — Brian Fioca + Bill Chen, OpenAI

Dec 26, 2025 · 27:46

OpenAI’s Brian Fioca and Bill Chen discuss the launch of Codex Max, a long-running coding agent designed to work 24+ hours, manage its own context, and spawn sub-agents. They reveal how GPT-5 training prioritized personality traits—communication, planning, and self-checking—to build developer trust, and how Codex develops tool habits like preferring 'rg' over 'grep'. The abstraction layer is shifting from models to full-stack agents, enabling partners to plug Codex into tools like VS Code or Zed. They highlight applied evals that measure real-world impact over academic benchmarks, and the need for multi-turn eval APIs. Their 2026 vision: coding agents trusted enough to handle the hardest refactors at any company, not just top-tier firms, and general enough to automate personal workflows like organizing desktops or email.

World Models & General Intuition: Khosla's largest bet since LLMs & OpenAI

Dec 6, 2025 · 1:04:51

Pim de Wit, founder of Medal and General Intuition (GI), turned down a reported $500M offer from OpenAI to spin out GI with a $134M seed from Khosla Ventures — Vinod Khosla's largest bet since OpenAI — arguing that world models trained on peak human gameplay are the next frontier after LLMs. Medal's 12M users generate 3.8B action-labeled clips via retroactive recording, creating a privacy-preserving dataset of 'episodic memory for simulation.' GI builds fully vision-based agents that see only frames and output actions in real-time, using pure imitation learning without RL, and can transfer from arcade games to realistic games to real-world video. Pim explains why world models need actions, memory, and partial observability (e.g., smoke, camera shake) compared to video generation, and how they distill giant policies into tiny real-time models that navigate and hide like humans. He recounts his path from running the largest RuneScape private server to reverse engineering, cold-emailing the Diamond (world model) paper authors to assemble a top research team, and advises data founders to train models themselves before selling. GI's near-term customers are game developers replacing…

⚡️ Building the AI Hardware Engineer with Matthias Wagner, Co-founder of Flux

Nov 22, 2025 · 49:03

Matthias Wagner, CEO of Flux.ai, describes building the "AI hardware engineer" that turns product briefs into manufacturable PCB designs in under 30 minutes. After leaving Meta in 2019, Wagner built a browser-based collaborative CAD tool from scratch, designed as a reinforcement learning environment. The emergence of LLMs and reliable tool calling let Flux's agents search component libraries, check pricing and availability, and execute complex designs autonomously. In a live demo, Wagner designs a battery-powered Alexa-like device with ESP32, microphones, OLED display, and speaker in about 25 minutes. Flux now has 7,000 paying customers, growing 26x year over year, and Wagner envisions eventually letting users prompt full hardware products like smartphones into existence, claiming the cost of custom manufacturing is plummeting.

⚡ Inside GitHub’s AI Revolution: Jared Palmer Reveals Agent HQ & The Future of Coding Agents

Nov 10, 2025 · 35:52

Jared Palmer, SVP at GitHub and VP at CoreAI at Microsoft, traces his journey from building v0 at Vercel—a focused Next.js coding agent that grew from $1M ARR to millions more after adding chat—to launching Agent HQ at GitHub Universe, a collaboration hub for developers and coding agents. He explains how v0's success came from laser-focus on one stack and framework, and how GitHub's 180M developers enable scaling agent-based workflows. Palmer discusses model strategy tradeoffs (composite vs. branded models), the challenge of repo setup and infrastructure reliability, and using coding agents for non-coding tasks like automating Excel workflows. He reveals Stacked Diffs as GitHub's top feature request, with active exploration after previous attempts, and outlines his vision for seamless AI integration across GitHub, VS Code, and Actions, including features like resolving merge conflicts with AI.

⚡️ Ship AI recap: Agents, Workflows, and Python — w/ Vercel CTO Malte Ubl

Nov 1, 2025 · 42:02

Vercel CTO Malte Ubl discusses the company's AI strategy, centered on the new Workflow Development Kit that enables durable, resumable serverless functions with infinite idle time at no cost. He explains how the AI SDK was extracted from v0 and remains deliberately low-level to accommodate emerging patterns, with a direct agent abstraction now stable in version six. Ubl details Vercel's internal agents—including a DevOps agent that investigates production anomalies by querying observability data and logs, solving the recall-precision problem in alerting—and the 'Agent on Every Desk' program that helps large companies build their first three agents. He also covers zero-config Python support for Flask and FastAPI, and a security model that assumes developers cannot be trusted, extracting auth and data access from application code.

Why RL Won — Kyle Corbitt, OpenPipe (acq. CoreWeave)

Oct 16, 2025 · 1:08:23

Kyle Corbitt, co-founder and CEO of OpenPipe (acquired by CoreWeave), explains why reinforcement learning has replaced supervised fine-tuning for training reliable AI agents. He argues GRPO is a dead end due to its requirement for perfectly reproducible parallel rollouts, which is extremely hard in practice. Instead, OpenPipe’s RULER uses relative LLM-as-judge rewards, achieving state-of-the-art performance even with a weak judge. Corbitt reports that 90% of AI projects remain stuck in proof-of-concept due to reliability issues, and that LoRAs are underrated for production while GEPA failed in his tests. He predicts continuous RL from real-world experience can unlock 10x more inference demand.

DevDay 2025: Apps SDK, Agent Kit, MCP, Codex and why Prompting is More Important than Ever

Oct 7, 2025 · 44:52

Sherwin Wu and Christina Huang from OpenAI's platform team discuss the new AgentKit suite and Apps SDK, arguing that visual agent builders and prompt optimization remain critical for production AI. They detail AgentKit's components—Agent SDK, visual Builder, Evals, and Tool Registry—and how Apps SDK inverts the website-chatbot paradigm by embedding apps inside ChatGPT. OpenAI adopted Anthropic's MCP protocol for tool connectivity, and the team dogfoods these tools for their own customer support at openai.com. They explain that automated prompt optimization and evaluation pipelines are essential for scaling agents, and share how Codex is used internally for code generation and PR reviews. The episode also covers the Service Health Dashboard for real-time API SLO tracking, reflecting OpenAI's reliability investments.

⚡️Claude Sonnet 4.5 and Anthropic's roadmap for Agents and Developers — Mike Krieger, Anthropic

Sep 30, 2025 · 26:25

Mike Krieger, Anthropic's CPO, discusses the launch of Claude Sonnet 4.5 and its implications for AI development, emphasizing the growing symbiosis between product and research teams. He describes his personal 'vibe evals' for new models, including generating a Virtual Boy-style game and a Nintendo board presentation, and notes that Sonnet 4.5 traffic eclipsed Sonnet 4 on day one. Krieger explains how Anthropic is improving model output quality across UIs, Excel, and PowerPoint, and highlights the shift toward interactive planning rather than pure autonomy. He reveals the rename of the Claude Code SDK to the Claude Agent SDK, reflecting its general-purpose use for complex agentic workflows beyond coding. Krieger stresses the need for better visual understanding in models and invites developers to share feedback on hard challenges to help improve the platform.

Context Engineering for Agents - Lance Martin, LangChain

Sep 11, 2025 · 1:03:18

Lance Martin from LangChain discusses context engineering for AI agents, arguing that managing context from tool calls is the key challenge and introducing five techniques: offloading, reducing, retrieval, caching, and context isolation. Offloading saves raw tool call outputs to disk and passes only summaries, drastically cutting token usage—Martin's deep research agent went from 500,000 tokens per run to much less. Manus uses file system offloading and warns that irreversible pruning risks information loss, while Cognition advocates fine-tuned summarization for agent-agent boundaries. For retrieval, Martin contrasts Windsurf's multi-step indexing with Claude Code's agentic search using grep and llms.txt, finding the latter more effective. He applies the Bitter Lesson to agent engineering: his own Open Deep Research evolved from a highly structured workflow to a simple agent loop as models improved, and he warns against rigid abstractions that hinder adaptation.

⚡️Launching Ona: Coding Agent with Fully Sandboxed Cloud Environment

Sep 1, 2025 · 33:44

Gitpod co-founders Johannes Landgraf and Chris Weichel launch Ona, a coding agent platform with fully sandboxed cloud environments, arguing that the future of development is parallel agent-driven work rather than mono-focused IDEs. They explain their rebrand from Gitpod to Ona, driven by their product outgrowing the technical name. Ona provides reproducible dev environments via dev containers and automations YAML, runs any Linux workload, and by default gives agents full autonomy (Yolo mode) since environments are ephemeral and risk-free. They dogfood heavily—75% of their PRs are co-authored by Ona. Key challenges include file edits (they settled on Anthropic's string replace tool) and underspecification by users. Pricing follows a credit model blending compute and token usage, with enterprise VPC deployment and $100 in credits for new self-serve users. They envision IDEs shifting to interfaces supporting parallel tracks, but currently offer one-click transitions to desktop editors like Cursor.

⚡️OpenCode: Claude Code but Open Source, with Any Model, and frontier TUI - with Dax Reed (@thdxr)

Aug 5, 2025 · 37:04

Dax Reed of OpenCode and SST explains why his open-source terminal-based agent is a serious alternative to Claude Code, emphasizing that the real battle is product experience, not squeezing 3% more from LLMs. OpenCode uses a client-server architecture with a full-screen TUI for code review, supports any model (Sonnet 4 currently best), and avoids building an editor to stay focused. Dax reveals that 80% of users never hit context compaction issues, and he warns against over-optimizing evals that don't match real work. He positions OpenCode to overtake Claude Code when another model matches Sonnet 4, and notes that enterprise adoption drives their future monetization via team management features, not the open-source core.

⚡️Composio: 10,000+ tools that evolve for Agents — Karan Vaidya and Soham Ganatra

Aug 4, 2025 · 22:09

Composio co-founders Karan Vaidya and Soham Ganatra join Swyx and Alessio to discuss their platform for self-evolving agent skills, now with 25,000+ actions and 100,000+ developers. They explain how MCP's client-side limitations led them to build a learning infrastructure that analyzes agent usage patterns to improve tool reliability over time. The team uses agents to build and maintain 95% of their 500+ integrations, adding 35 per week, with plans for 5,000 by year-end. They reveal that more than 20-25 actions confuse LLMs, so they offer a natural-language execution tool and dynamic tool exposure via MCP. Key challenges include enterprise APIs with poor documentation and the need for dev environments. Composio's internal agent benchmarks and A/B testing infrastructure optimize tool schemas for LLM calling.

[AIEWF Preview] Containing Agent Chaos — Solomon Hykes

Jun 3, 2025 · 27:14

Solomon Hykes, creator of Docker and founder of Dagger, argues that the industry needs an open standard for AI coding agent environments to avoid repeating the fragmentation seen before Docker. Dagger, a workflow engine originally built for post-development automation (CI/CD), is now being pulled by its community into the agentic space to solve environment isolation, portability, and observability for concurrent agent teams. Hykes insists containers are the right base layer but require a new, agent-native UX—unlike legacy Dockerfile or Compose—that is decoupled from any IDE, model, or cloud provider. He critiques current vertical monoliths (e.g., proprietary IDE-hosted agent environments) and advocates for a Lego-like modular approach where the environment is the standard linchpin. Dagger integrates with existing stacks rather than replacing them, and Hykes previews fresh, unreleased content for his upcoming keynote at AI Engineer World's Fair.

The AI Coding Factory

May 29, 2025 · 59:23

Factory.ai co-founders Eno Reyes and Matan Grinberg join Latent Space to explain their vision for autonomous software engineering droids that handle everything from code generation to incident response for enterprises. They met at a Langchain Hackathon in 2023, and within eight days both quit their jobs to start Factory. The platform is browser-based, not IDE-based, because they argue the optimal UI for a world where humans write less code will not evolve from the IDE. They focus on enterprise codebases, citing a large migration that took from four months to three and a half days. Key design decisions include a delegation model where agents ask clarifying questions, proactive context gathering via synthetic insights, and usage-based pricing tied to token efficiency. They also discuss why SWE-Bench is dead for their use case, the challenge of model post-training biases toward CLI tools, and their need for 'junior Enos' in go-to-market roles.

Zed Agents — with Zed Cofounders Nathan Sobo & Antonio Scandurra

May 7, 2025 · 35:50

Zed co-founders Nathan Sobo and Antonio Scandurra explain how their high-performance code editor is launching Zed Agents, aiming to make AI an integrated collaborator rather than just a tool. Built from scratch in Rust for 120fps performance and real-time collaboration via CRDTs, Zed previously open-sourced Xeta, an edit prediction model fine-tuned on Qwen 2.5. Now they introduce an agentic mode that lets LLMs call tools in a loop, surfacing changes in a multi-buffer for easy review. The agent can run shell commands, install MCP servers via an extension store, and be used with bring-your-own-key or a $20/month plan for 500 requests. Sobo and Scandurra stress that vertical integration gives them control to wire AI into debugging, git, and multi-agent workflows where multiple agents collaborate via CRDTs, treating agents as always-available teammates.

Why Every Agent needs Open Source Cloud Sandboxes

Apr 24, 2025 · 1:06:39

Vasek Mlejnsky, CEO of E2B, explains how his company grew from 40,000 sandboxes in March 2024 to 15 million in March 2025 by providing cloud sandboxes for AI agents. Originally built from DevBook's interactive docs playground, E2B now serves use cases from code interpreting and data analysis to Computer Use and reinforcement learning with Hugging Face's Open R1. The sandboxes are general Linux VMs with fast startup, security isolation, and persistence, handling untrusted code and allowing forking/checkpoints for parallel agent execution. Mlejnsky discusses the LLMOS landscape, pricing challenges (moving from token-based to value-based), MCPs as higher-order tools, and why he relocated from Prague to San Francisco to be closer to users. E2B is hiring across engineering and customer success as it aims to become full-lifecycle infrastructure for LLMs.

Sleep-Time Compute — Letta AI (Charles Packer, Charlie Snell, Kevin Lin)

Apr 21, 2025 · 34:02

This episode covers Letta AI's new paper on Sleep-Time Compute, a scaling direction that applies compute during model idle periods (sleep time) rather than only at test time. Charles Packer, Kevin Lin, and Charlie Snell explain that sleep-time compute precomputes inferences from static context before queries arrive, yielding Pareto improvements on math benchmarks like GSM8K by shifting the accuracy-to-token curve leftwards. They distinguish it from test-time compute by emphasizing that sleep-time tokens incur no user-latency cost, and show that the benefit is largest when questions are predictable from context. The team also ties the concept to stateful agents and memory systems (building on MemGPT), releasing two implementations: one for low-latency chatbots and another for document-driven agents.

Claude Plays Pokémon Hackathon: Escape from Mt. Moon!

Apr 5, 2025 · 1:15:00

David Hershey (creator of Claude Plays Pokémon), Andrew (a developer building a Pokémon-playing virtual streamer), and Jesse Han (Morph Labs CEO) detail how to build agents that escape Mt. Moon in Pokémon FireRed using Anthropic's Claude and Morph Cloud's Infinibranch technology. Hershey explains that Claude's vision is often unreliable—it spent 8 hours pressing A on a doormat thinking it was a dialogue box—and that spatial reasoning remains a core bottleneck, best mitigated by touchscreen controls rather than prompt engineering. Andrew reveals he relied on reading raw RAM and A* pathfinding rather than computer vision, calling it “cheating” but pragmatically useful: his biggest breakthrough was a single prompt line telling the agent to try something else if it fails to grab a starter Pokémon. Jesse introduces Morph's EVA agent framework, which uses low-overhead snapshotting for test-time search, and the hackathon's judging criteria—escape Mt. Moon in the fewest agent turns, with a $1,000 prize for the coolest use of Infinibranch branching. The episode serves as both a technical walkthrough and a challenge to build general-purpose agents that can handle complex, open-ended tasks…

The Agent Network — Dharmesh Shah, Agent.ai + CTO of HubSpot

Mar 28, 2025 · 1:42:28

Dharmesh Shah, founder of Agent.ai and co-founder of HubSpot, defines an AI agent broadly as AI-powered software that accomplishes a goal, and argues that the next frontier is multi-agent systems and shared memory across agents. He reveals Agent.ai has 1.3M users and 3,000 published agents, positioning it as a professional network where agents have profiles, post release notes, and can be composed via MCP servers. Shah contrasts work as a service (paying for the work done) versus results as a service (paying for outcomes), warning that results-based pricing only works for objectively measurable, low-variance tasks like customer support tickets. He advocates for MCP as the standard for agent-tool discovery, and shares his personal engineering philosophy of preferring under-engineering over over-engineering because the cost to fix later trends toward zero with AI code generation. Shah also discusses his domain investing strategy (owning chat.com, prompt.com, crew.ai), his rule against competing with Sam Altman, and the 'Sorry Must Pass' framework for managing overwhelm by defaulting to no.

Building Manus AI (first ever Manus Meetup)

Mar 27, 2025 · 48:59

Tao Zhang, co-founder of Manus, explains how Manus gives LLMs 'hands' to take real-world actions, inspired by MIT's 'mens et manus' (mind and hand). Manus assigns each task its own cloud virtual machine via E2B, provides pre-paid data APIs (stock, social media), and a knowledge system to remember user preferences. Their previous product, Monica.im, grew to 20M monthly active users and $50M ARR before they pivoted from a failed AI browser project to Manus. On the GAIA benchmark, Manus achieves a per-task cost of ~$2, far cheaper than OpenAI's Deep Research (~$20) and prior SOTA. Zhang emphasizes a 'less structure, more intelligence' philosophy, opting not to predefine workflows but to give the model rich context and tools. He also discusses plans to partner with Cloudflare, pay paywalls on behalf of users, and integrate more APIs based on usage patterns, while ruling out building their own foundation model.

Fullstack-Bench: The Eval for Coding Agents — with Sujay Jayakar, Chief Scientist, Convex

Mar 19, 2025 · 31:13

Sujay Jayakar, Convex chief scientist, presents Fullstack-Bench, a benchmark evaluating how well AI coding agents build full-stack apps on Convex, Supabase, and FastAPI+Redis, finding Convex’s tight feedback loops and strong abstractions let agents autonomously complete tasks within time limits. The benchmark tests three tasks (chat, to-do, files) across three backends with 30-60 minute limits and human hints. Convex succeeded autonomously on chat and to-do tasks, while Supabase agents struggled with RLS policy debugging and FastAPI agents with manual SSE wiring. Sujay discusses how platform design impacts AI code generation: simple procedural code, strong abstractions, and guardrails like end-to-end type safety improve LLM performance. He notes that API choices matter—things too similar to Firebase but not exact cause hallucinations—and that models like Claude 3.7 sometimes regress on platform-specific evals. The episode concludes with Convex’s focus on enabling AI-generated backends and anticipation of new agent workflow patterns.

npm install Agents — with Sunil Pai and Rita Kozlov (VP AI) of Cloudflare

Mar 19, 2025 · 35:36

Shawn Wang hosts Sunil Pai and Rita Kozlov to discuss Cloudflare's new Agents product, which uses Durable Objects to provide a scalable, stateful runtime for building AI agents. Sunil built an initial prototype in two weeks, which Rita helped polish into a full SDK and starter kit. They demo a chat agent with persistent state, human-in-the-loop confirmation, and built-in scheduling via cron, all running on Durable Objects without Kubernetes. The conversation covers local-first syncing (Durable Objects as always-on sync clients), the need for observability across millions of agents, and excitement about MCP for easy integrations. Rita teases upcoming "durable object enabled containers" to bridge long-running and CPU-heavy workloads, and a new browser rendering REST API launching the same day.

The new OpenAI Agents Platform: CUA, Web Search, Responses API, Agents SDK!!

Mar 11, 2025 · 25:39

OpenAI's Nikunj Handa and Romain Huet join host Swyx to announce their new Agents Platform, including the Responses API, Web Search, File Search, Computer Use tools, and an upgraded Agents SDK. The Responses API unifies Chat Completions and the Assistants API, offering free state storage for 30 days and acting as a strict superset for future agentic workflows; Chat Completions remains supported, but the Assistants API will sunset in first half 2026. Web Search is available both as a built-in tool in Responses and as a fine-tuned GPT-4o Search Preview model in Chat Completions, achieving 90% accuracy on simple QA compared to 30% for GPT-4o. The File Search tool gains metadata filtering, while Computer Use—powering OpenAI's Operator—enables browser automation via screenshots and action signals, described as the "GPT-2 of computer use." The Agents SDK builds on the Swarm experiment, adding type support, guardrails, handoffs, and tracing in the OpenAI dashboard, with plans to tie traces to evals and reinforcement fine-tuning.

Raycast: Your AI Automation Assistant

Feb 26, 2025 · 20:19

Raycast CEO Thomas introduces AI Extensions, letting users @-mention apps like Slack or Google Calendar and perform actions (e.g., set status, book meetings) via natural language, powered by a fine-tuned model called Ray 1 based on GPT-4o for faster, more accurate function calling. He shares how Raycast evolved from a Spotlight replacement to an extension platform, now adding AI chat with tool-aware reasoning. Challenges include building evals for tool calls (harder than standard LLM evals) and supporting third-party extension authors with a JSDoc-based TypeScript interface. Thomas envisions Raycast becoming an AI-native layer for macOS, eventually enabling background automations triggered by time or file events.

Why is everyone cloning Deep Research?

Feb 18, 2025 · 1:00:10

In this episode, hosts Alessio and Swyx interview Aarush Selvan and Mukund Sridhar, the lead PM and tech lead for Gemini Deep Research, about how Google created the deep research agent category and the technical decisions behind it. They finetuned a special version of Gemini 1.5 Pro for the feature, which autonomously browses the web for about five minutes to produce a research report. The team built an asynchronous platform to handle long-running tasks and developed an ontology of research behaviors—from broad shallow exploration to deep focus—to evaluate performance. They found that users value the visible browsing process even when it takes minutes, contrary to typical latency norms. The discussion covers iterative planning, trade-offs between model memory and web grounding, and future directions including thinking models, multimodality, and personalization.

smol agents are all you need

Feb 13, 2025 · 22:31

This episode features Aymeric Roucher of Hugging Face discussing smol agents, a lightweight agent framework, and argues that code-based agents outperform JSON-based agents. Roucher explains that agents are defined by LLM control over execution flow, and smol agents simplifies this with a core file under 1000 lines. He describes the origin from transformers.agents and the security-focused custom Python interpreter. The library achieved third place on the GAIA benchmark, using o1 and Sonnet models, and Roucher projects 90% accuracy by 2026 based on a sigmoid trend line. Hugging Face is launching an agent course and plans to build GUI agents for computer use, while also fine-tuning R1 for agentic tasks.

The AI Architect: Bret Taylor

Feb 11, 2025 · 1:35:59

Bret Taylor, CEO of Sierra and chairman of OpenAI, recounts engineering AI's future across three eras — rewriting Google Maps' frontend in a weekend (cutting un-gzipped code to 20K), building Sierra's in-house agent platform for consumer brands like Sonos and SiriusXM, and navigating OpenAI's leadership crisis. He argues that AI agents' core abstractions are still pre-React, compares today's agents to jQuery, and predicts that outcome-based pricing will dominate as agents complete jobs rather than assist humans. He urges software engineers to move up the stack toward domain-specific agents and to embrace Rust-like languages for AI-generated code, emphasizing formal verification and safety. Taylor also shares how OpenAI prioritizes mission over product features, and why the relationship with Microsoft remains OpenAI's most important partnership.

Agent Engineering with Pydantic + Graphs — with Samuel Colvin, CEO of Pydantic Logfire

Feb 6, 2025 · 1:02:15

Samuel Colvin, CEO of Pydantic Logfire, argues that Pydantic AI offers a production-ready agent framework with type-safe graphs, unlike most agent frameworks that sacrifice engineering quality. He explains Pydantic's shift from a validation library to an AI tool, noting 300M monthly downloads and a 20% reduction in time-to-first-token for a major model company after upgrading to Pydantic V2. Colvin details Logfire's use of DataFusion over ClickHouse for better JSON support and control, and why Pydantic AI resists an LLM gateway, favoring OpenAI-aligned APIs. He defends graphs for complex workflows, reveals agents now use graphs internally, and shares that Pydantic.run enables browser-based demos. The episode covers OpenTelemetry's emerging GenAI semantic conventions, the need for self-hosted observability due to PII in LLM data, and Colvin's investment in Marimo as a text-based Jupyter replacement.

Beating OpenAI and Anthropic by Looking At Data: the new #1 on SWE-Bench w/ W&B CTO Shawn Lewis

Jan 28, 2025 · 34:31

Shawn Lewis, CTO of Weights & Biases, built a coding agent using OpenAI's o1 model that achieved 64.6% on SWE-bench verified, the top score at the time. He developed a TypeScript agent framework called PhaseShift and an Eval Studio tool backed by Weave, emphasizing that rigorous data inspection and tooling are critical for agent development. Lewis explains his process of running parallel rollouts and a crosscheck method to select the best trajectory, which contributed a 6% improvement. He also discusses the challenges of adapting reasoning models like o1 for agentic tasks and shares plans to open-source PhaseShift. The episode highlights Lewis's dogfooding approach, using Weights & Biases' own tools to build and evaluate the agent.

Outlasting Noam Shazeer, Crowdsourcing Chai AI w/ 1.4m DAU — with William Beauchamp, Chai Research

Jan 26, 2025 · 1:13:33

William Beauchamp, founder-CEO of Chai AI, explains how he pivoted from algorithmic trading to build a character chatbot platform before Character.ai, growing to 1.4M DAU and $22M+ revenue by crowdsourcing model improvements through Chaiverse. Starting with GPT-J in 2021, he found product-market fit with a therapist bot and shifted to user-generated content, letting users define prompts, images, and names. Competing against well-funded rivals like Character AI and Talkie, Chai ships over 100 LLMs weekly via its developer platform, spending $10M on compute in 2024 and tripling it. Beauchamp argues AI follows an S-curve, not scaling laws, and focuses on inference optimization using rejection sampling and reward models to serve better responses. He prioritizes 'insanely great' products over technology-driven features, noting that audio and image features failed to move metrics, while a data flywheel and aggressive user acquisition drove rapid growth.

Best of 2024 in Agents (from #1 on SWE-Bench Full, Prof. Graham Neubig of OpenHands/AllHands)

Dec 25, 2024 · 51:25

Professor Graham Neubig of CMU and AllHands AI, maintainer of the open-source coding agent framework OpenHands, delivers a talk on the state of agents in 2024, arguing that agents are now capable of automating significant portions of software development but still struggle with information gathering and error recovery. He demonstrates OpenHands solving real coding tasks live, explains key design choices like using Python code execution over granular tool calls to reduce LLM invocations, and shares that Claude currently outperforms other models for agentic tasks due to superior instruction following and error correction. Neubig discusses eight perennial agent problems including agent-computer interface, human-agent interface, model selection, planning, workflows, exploration, search, and evaluation. He predicts every major LLM trainer will focus on agent-oriented models by mid-2025, that agent benchmarks like SWE-Bench and WebArena will saturate and require harder successors, and that the biggest challenge will be designing human-agent interfaces for systems that succeed only 30-40% of the time autonomously but 80-90% with human feedback. The talk also covers workflow memory as a…

Windsurf: The Enterprise AI IDE

Dec 13, 2024 · 1:06:36

Varun Mohan and Anshul of Codeium explain why they built Windsurf, a new AI IDE, arguing that VS Code's API limitations prevented them from delivering the best agentic experience. They detail how Cascade, their agentic system, uses proprietary retrieval and planning models alongside third-party LLMs, and describe their evaluation method that masks commits and tests incomplete code states. The duo also reveals that over 800,000 developers use Codeium extensions, that they still support JetBrains and Eclipse for enterprise customers, and that they intentionally avoided a waitlist launch. They discuss the trade-offs of building first-party vs. third-party models, the importance of 'go slow to go fast' in enterprise infrastructure, and their belief that individual developer profits should come after building switching costs through superior product.

Agents @ Work: Lindy.ai (with live demo!)

Nov 15, 2024 · 1:08:01

Florent Crivello, founder of Lindy.ai, explains how his no-code agent platform evolved from an overly LLM-dependent design to a deterministic 'on rails' system that puts AI in a box, making agents more reliable and easier to use. The product was rebuilt from scratch as Lindy 2.0, featuring step-by-step workflows with structured outputs and memory management that still requires pruning. Crivello reveals that Claude 3.5 Sonnet ended model bottlenecks but warns against over-engineering cognitive architectures, advocating instead for letting models scale. He discusses building their own eval tools (now considering Braintrust), hiring vertical GMs for go-to-market, and the decision to return to in-person work, arguing remote work hampers creativity. He also shares his contrarian views on Europe vs. US tech, testing the Overton window with spicy tweets, and balancing AI safety concerns (10% p(doom)) with building toward a potential utopia.

Agents @ Work: Dust.tt — with Stanislas Polu

Nov 11, 2024 · 58:53

Stanislas Polu, co-founder of Dust.tt, argues that horizontal agent platforms—not vertical, single-use-case agents—will win the enterprise by letting non-technical employees build their own automation. A former OpenAI researcher who worked directly with Ilya Sutskever on formal mathematics and saw GPT-4 internally before ChatGPT, Polu left in 2022 to start Dust, now an open-source infrastructure layer that connects company data (Slack, Notion, GitHub) to LLMs and lets anyone create simple, instruction-driven agents. He contrasts Dust’s API-first, integration-heavy approach with LangChain’s open-source orchestration and Adept’s browser automation bet, insisting that most useful agent workflows require only a few tool calls and that function-calling quality (where GPT-4 Turbo still leads) matters more than model size. Dust achieves 88% daily active user penetration at some enterprise customers, and Polu predicts the first billion-dollar company run by a single person will emerge once platforms like Dust mature enough to let tiny teams scale to massive output.

Language Agents: From Reasoning to Acting — with Shunyu Yao of OpenAI, Harrison Chase of LangGraph

Sep 27, 2024 · 1:26:33

Shunyu Yao of OpenAI and Harrison Chase of LangChain discuss the evolution of language agents, arguing that combining reasoning and acting through techniques like ReAct remains foundational, while tool design and cognitive architectures like CoALA will shape the next wave. Shunyu traces his work from text games to ReAct, showing how thinking as an action improves reliability; Harrison explains LangChain's adoption and the shift to LangGraph for stateful orchestration. They emphasize agent-computer interfaces (ACI) as a neglected area, noting that SWE-Agent's success came from optimizing tools for models, not humans. The conversation covers memory types (semantic, episodic, procedural) and applies CoALA's three dimensions to current systems. They highlight promising applications: customer support, coding agents, and spreadsheet-style UX for batch operations. Shunyu stresses that better benchmarks like SWE-Bench (which solved 30% of GitHub issues) and TauBench (best model 48%) are critical, and that data—not architecture—will drive future model improvements.

The Winds of AI Winter (Q2 Four Wars of the AI Stack Recap)

Aug 2, 2024 · 1:23:36

Swyx and Alessio recap Q2 2024 through their 'Four Wars' framework, arguing that the AI landscape is shifting from frontier model dominance to commoditization and vertical applications. They highlight Claude 3.5 Sonnet overtaking OpenAI on coding benchmarks, Llama 3.1's synthetic data approach enabling 7B models to rival GPT-4, Mistral Large 2's non-commercial license and lost open-source crown, and on-device models like Gemini Nano and Apple Intelligence. The Quality Data Wars see NYT suing OpenAI, Reddit licensing data for $200M+, and synthetic data proving real for math (AlphaProof near IMO gold) and code. The Multimodality War includes ChatGPT Voice Mode delayed, Meta's Chameleon for native fusion, and Google's PaliGemma for PDF extraction. The renamed LLM OS War covers agent protocols, memory databases, and the collapse of model cost by an order of magnitude every four months, pushing startups toward vertical services like Brightwave and Dropzone that sell labor, not tools. The episode ends with a CrowdStrike joke about agent safety.

Why Google failed to make GPT-3 -- with David Luan of Adept

Mar 27, 2024 · 49:27

David Luan, co-founder of Adept and former early OpenAI leader, explains why Google failed to build GPT-3—its 'brain credit marketplace' prevented critical mass—and why Adept builds enterprise AI agents prioritizing reliability over generality. He recounts the GPT-2 demo that helped secure Microsoft's $1B investment and details Adept's goal: an AI teammate that can do anything a human does on a computer, targeting 'nines of reliability' for workflows like dispatching a physical truck. Luan contrasts Adept's vertical integration—training fast multimodal models (Fuyu) for charts and UIs—with pure-play foundation model companies that sell tokens, predicting commoditization. He notes Adept is sold out for Q1 and raised $420M, and explains how an augmentation focus creates a data flywheel from human oversight.

Why AI Agents Don't Work (yet) - with Kanjun Qiu of Imbue

Oct 21, 2023 · 1:12:37

Kanjun Qiu, CEO of Imbue (formerly Generally Intelligent), argues that AI agents remain unreliable because they lack robust reasoning and proper abstractions, which Imbue tackles by training foundation models optimized for reasoning over data like code. With a $200M Series B and $1B+ valuation, Imbue builds internal tools for debugging and inspecting agent decision-making, rejecting pure reinforcement learning after their Avalon environment revealed RL cannot handle planning. Instead, they emphasize natural language reasoning for inspectability, use code as a curriculum for reasoning, and design interfaces that let users fork and modify agents mid-execution. Qiu also discusses lessons from earlier startups (Sorceress in recruiting, Embark in VR), the importance of treating team members as creative agents, and her role in co-founding communal living space The Archive to foster scenius.

RAG is a hack - with Jerry Liu of LlamaIndex

Oct 12, 2023 · 1:13:25

In this episode of Latent Space, Jerry Liu of LlamaIndex argues that while RAG is fundamentally a hack, it remains the most practical approach for grounding LLMs with external data, and his open-source framework now serves 600,000 monthly downloads. Liu recounts how LlamaIndex originated from a hackathon at Robust Intelligence, evolving from an experimental tree-index to a modular toolkit spanning data loading, retrieval, synthesis, and agent loops. He explains the trade-offs between RAG and fine-tuning, noting that context window limits force algorithmic rather than learned optimizations, but RAG offers transparency and access control that fine-tuning cannot. Liu details the company’s $8.5M Greylock raise, the launch of LlamaHub for community-contributed data loaders, and the open-source SEC Insights app as a production-grade template. Looking ahead, he emphasizes the need for better retrieval benchmarks and predicts that future personalization will move beyond vector stores into model-internal memory architectures.