Flamingo

Why AI Agents Don't Actually Understand You — Danielle Perszyk, Amazon AGI Lab

Jul 11, 2026 · 48:54

Danielle Perszyk of Amazon's AGI Lab argues that AI agents fail because they don't truly understand users — they model tasks but not the human mind, so reliability must shift from clicking correctly to aligning representations. She explains how Amazon's AGI Lab, seeded by the former Adept team, builds perception agents that perceive digital environments like humans and interact in real time, moving beyond chatbots and coding agents. The lab is exploring new architectures for episodic memory, social world models, and multi-agent systems where agents fluidly negotiate meaning, inspired by human collective intelligence. Perszyk warns that current AI homogenizes thinking, reducing human agency, and advocates for a diverse society of AIs with different biases to augment rather than replace human cognition. She discusses how aligning AI's goals with inferring and matching human representations could unlock generalization and make agents genuinely collaborative, from automating digital drudgery to transforming education with Socratic tutors.

The AI Frontier: from Gemini 3 Deep Think distilling to Flash — Jeff Dean

Feb 12, 2026 · 1:23:31

Jeff Dean, Google's Chief AI Scientist, explains how the company's dual strategy of frontier "Pro" models and distilled "Flash" models, alongside co-designed TPUs and latency-optimization, keeps Gemini at the Pareto frontier. Distillation compresses high-capability large models into smaller, efficient ones, enabling Flash models to exceed earlier Pro generations. He emphasizes energy-based thinking: data movement costs thousands more picojoules than arithmetic, making batching and speculative decoding essential. TPU development requires predicting ML workloads 2–6 years out, often speculatively adding hardware features. Gemini was born after Dean wrote a one-page memo arguing that fragmented model efforts across Google Brain and DeepMind should merge into a single unified multimodal effort. Looking ahead, he predicts personalized models attending to all user data and reasoning speeds of 10,000 tokens/second will transform software engineering.

[Paper Club] Molmo + Pixmo + Whisper 3 Turbo - with Vibhu Sapra, Nathan Lambert, Amgadoz

Oct 13, 2024 · 1:12:59

This episode covers two papers: AI2's Molmo open-source vision-language models and OpenAI's Whisper Large V3 Turbo. For Molmo, the key claim is that high-quality, audio-annotated data (Pixmo) enables models as small as 1B to match GPT-4V on academic benchmarks, with the 72B variant outperforming GPT-4o, Gemini 1.5, and Claude 3.5 Sonnet. The team avoided distilling proprietary models by having annotators describe images in speech for 60-90 seconds, then transcribing and augmenting the captions. For Whisper Turbo, OpenAI pruned the decoder from 32 to 4 layers and continued pre-training on 10 million hours of multilingual transcription data, making it 1.78x smaller than Large V3 with minimal word-error-rate increase. The model is faster and supports real-time chunk-based decoding, unlike English-only DistilWhisper. Nathan Lambert and Amgadoz provide commentary on data strategies and benchmarking nuances.