AI mode

The AI Frontier: from Gemini 3 Deep Think distilling to Flash — Jeff Dean

Feb 12, 2026 · 1:23:31

Jeff Dean, Google's Chief AI Scientist, explains how the company's dual strategy of frontier "Pro" models and distilled "Flash" models, alongside co-designed TPUs and latency-optimization, keeps Gemini at the Pareto frontier. Distillation compresses high-capability large models into smaller, efficient ones, enabling Flash models to exceed earlier Pro generations. He emphasizes energy-based thinking: data movement costs thousands more picojoules than arithmetic, making batching and speculative decoding essential. TPU development requires predicting ML workloads 2–6 years out, often speculatively adding hardware features. Gemini was born after Dean wrote a one-page memo arguing that fragmented model efforts across Google Brain and DeepMind should merge into a single unified multimodal effort. Looking ahead, he predicts personalized models attending to all user data and reasoning speeds of 10,000 tokens/second will transform software engineering.

AI is Eating Search

Jul 23, 2025 · 56:22

Robert McCloy of Scrunch AI argues that AI is replacing web browsing, not just search, as consumers prefer ChatGPT and similar tools over traditional browsing. He explains that AI search platforms still rely on traditional search under the hood, but re-rank results based on metadata clarity—so clickbait titles fail while descriptive content wins. Prompt injection works currently but is a temporary tactic; the durable strategy is clear, structured content with server-side rendered HTML because AI tools don't execute JavaScript. Scrunch helps brands optimize for platforms like ChatGPT, Perplexity, and Meta AI; customer Clerk saw a 6x traffic increase and 9x conversion lift from AI-referred visitors. Robert predicts the future is about 'agent experience'—optimizing how AI systems interact with your content to serve end users directly.