Harvey

The AI Memory Problem: Why Long Context Isn’t Enough — Dan Biderman, Engram Co-founder & CEO

Jul 13, 2026 · 49:44

Engram co-founder and CEO Dan Biderman tells hosts Allen Park and Sean that long context and RAG aren't enough for AI memory—continual learning and gradient-based weight updates are needed. He argues Engram's approach compresses company knowledge into 'cartridges' that let models reason with far fewer tokens, overcoming 'context rot' and the inefficiency of re-reading massive corpora. Biderman draws on his background in Israeli special forces and computational neuroscience to explain how training creates intuition beyond text retrieval, citing examples like Harvey's legal queries where holistic understanding beats search. He envisions personal AI weights that improve like Tamagotchis, driven by user-specific feedback loops, and stresses that token efficiency and intelligence are inseparable—doing more with less enables harder problems. Engram is hiring infrastructure engineers to deploy millions of continuously updated memories.

⚡️Every product of the future will be a living system — Ronak Malde, Trajectory.ai

Jun 21, 2026 · 33:58

Ronak Malde, CEO of Trajectory.ai, recounts his journey from building AI coding agents at Windsurf (acquired by Google DeepMind in a deal involving Demis Hassabis and Sergey Brin) to launching a platform for continual learning in enterprise AI. He argues that every future product must be a 'living system' that learns from real-world user interactions, not static models. The episode details Trajectory's technical innovations, including Self-Distillation Policy Optimization (SDPO) for learning from corrections, continuous LoRA for parallel training, and open-sourcing a training stack with SkyRL. It covers partnerships with Harvey and NVIDIA to train NeMoTron 3 Super for legal workflows, improving metrics like issue spotting and citation accuracy while cutting costs. Malde explains data curation strategies that capture nuanced user edits beyond binary signals, and outlines Trajectory's roadmap from AI-native companies like Clay and Decagon to Fortune 500 enterprises. He also reveals that the idea for Trajectory emerged after giving up his acquisition equity to pursue this vision.

[State of AI Startups] Memory/Learning, RL Envs & DBT-Fivetran — Sarah Catanzaro, Amplify

Dec 30, 2025 · 28:43

Sarah Catanzaro of Amplify Partners argues that the DBT-Fivetran merger was not the death of the modern data stack but a path to IPO targeting $600M+ combined revenue, that data catalogs failed because they were built for humans rather than machines, and that RL environments are a fad. She notes that frontier labs use dbt and Fivetran for training data curation and agent analytics, and criticizes $100M+ seed rounds raised without near-term roadmaps. For 2026, she identifies personalization via memory and continual learning as the key retention unlock, observing that AI founders are unfamiliar with growth concepts like k-factor. She prefers real-world logs over synthetic RL environments, citing Cursor's use of user activity, and says the most exciting startups combine hard research problems (RAG, rule-following, continual learning) with applications that were previously impossible.

The State of AI Startups in 2024 [LS Live @ NeurIPS]

Dec 21, 2024 · 26:35

Sarah Guo and Pranav Reddy argue that 2024 has become a far friendlier ecosystem for AI startups, with the model landscape shifting from OpenAI's near-monopoly to a competitive field where Google's Gemini now leads LMSys Arena and open-source models like Llama 8B score ten points higher on MMLU than Mistral 7B a year ago. They note that OpenAI's API cost has dropped 80-85% in 18 months, and total OpenAI API share fell from ~90% to ~60% as customers switch. The funding environment is rational, not a bubble, with foundation-model labs raising $30-40B but most startups seeing sane valuations; one portfolio company grew from zero to twenty million in PLG-style spending. Key startup themes include first-wave service automation (Sierra, Decagon, Harvey, EvenUp), better search and new friends (Perplexity, Glean, Character, Replica), and democratized creativity (Midjourney, HeyGen). They argue the 'GPT wrapper' narrative is false—applications capture value—and that incumbents face innovator's dilemma because AI changes business models (outcomes-based pricing) and data needs (reasoning traces rarely saved). The speed of change and new markets (legal, healthcare, defense) structurally favor…