LMArena

[State of Research Funding] Beyond NSF, Slingshots, Open Frontiers — Andy Konwinski, Laude Institute

Dec 31, 2025 · 22:34

Andy Konwinski, co-founder of Databricks and Perplexity, launches Laude Institute—a dual venture fund and nonprofit to accelerate the path from open research to breakout companies. At NeurIPS, he explains how Laude's Slingshot program funds projects like DSPy, Terminal Bench, and LMArena, and why the NSF's $1B/year for CS is insufficient, needing $10-100B for frontier AI. He argues Chinese labs (Moonshot, DeepSeek) now outpublish US because OpenAI and others stopped sharing; Open Frontiers, a live-streamed conference in SF, aims to unite top open researchers (Yann LeCun, François Chollet, Jan Leike) to reclaim global leadership. The episode also spotlights the emerging 'post-post-training' layer—prompt optimization, context management, RAG—and why research teams with multiple co-founders (like Databricks' eight) are the new gold standard for AI startups.

⚡️Multi-Turn RL for Multi-Hour Agents — with Will Brown, Prime Intellect

May 23, 2025 · 38:59

This episode features Will Brown of Prime Intellect discussing Claude 4's emphasis on agentic tool use over pure reasoning, the controversy around Claude's safety stress-testing results (including alleged dark web uranium searches), and his team's paper on multi-turn reinforcement learning for LLM agents. Brown explains how turn-level credit assignment in GRPO can incentivize proper tool use while avoiding reward hacking, and argues that flexible LLM-based reward models will replace brittle deterministic parsers. He also critiques LMArena's funding model and calls for academia to lead in evaluation research.

Why Every Agent needs Open Source Cloud Sandboxes

Apr 24, 2025 · 1:06:39

Vasek Mlejnsky, CEO of E2B, explains how his company grew from 40,000 sandboxes in March 2024 to 15 million in March 2025 by providing cloud sandboxes for AI agents. Originally built from DevBook's interactive docs playground, E2B now serves use cases from code interpreting and data analysis to Computer Use and reinforcement learning with Hugging Face's Open R1. The sandboxes are general Linux VMs with fast startup, security isolation, and persistence, handling untrusted code and allowing forking/checkpoints for parallel agent execution. Mlejnsky discusses the LLMOS landscape, pricing challenges (moving from token-based to value-based), MCPs as higher-order tools, and why he relocated from Prague to San Francisco to be closer to users. E2B is hiring across engineering and customer success as it aims to become full-lifecycle infrastructure for LLMs.