Kimi

⚡️Making DeepSeek v4 outperform Opus 4.7 with Taste — @AhmadAwais , CommandCode.ai

Jun 6, 2026 · 40:41

Ahmad Awais, CEO of CommandCodeAI, explains how his team's 'tool-input repair layer' lets open models like DeepSeek V4 Pro outperform premium models like Opus 4.7 in tool-calling reliability. He discovered a pattern of 'tool confusion' where open models repeatedly send wrong schemas; by repairing errors deterministically and sending repair hints instead of raw errors, tool call failures dropped dramatically. The same repair logic fixes 'design slop' using a compositional framework of patterns and OKLCH color system. Taste, a meta-neurosymbolic system, automatically learns developer preferences into portable markdown files, avoiding stale rules. Plans include open-sourcing CommandCode to make it hackable while focusing on quality models.

AI-Native Engineering: 100% adoption, 5x search throughput, unlimited tokens — Mikhail Parakhin

Apr 22, 2026 · 1:14:30

Shopify CTO Mikhail Parakhin details how the company achieved near 100% AI tool adoption, driven by a December 2025 inflection point where model quality triggered exponential token consumption. He argues token budgets matter only with strong critique loops: running multiple parallel agents without communication wastes tokens, while agentic PR review using large models—like GPT-5.4 Pro or Gemini Deep Think—reduces bugs even though latency increases. Parakhin unveils Tangle, Shopify's third-generation ML workflow system with content-based caching that eliminates duplicate computation across teams, and Tangent, an auto-research loop that optimizes pipelines—boosting search throughput from 800 to 4,200 QPS on the same hardware. SimGym simulates shoppers using decades of merchant data and browser-based agents to predict conversion changes, achieving 0.7 correlation with add-to-cart events. Shopify uses Liquid AI (non-transformer architecture) for sub-30ms query understanding and long-context tasks like catalog categorization, distilling larger models into Liquid for high-throughput batch jobs.

Agent Inference at the "Speed of Light" — How NVIDIA moves like a $4.3 Trillion Startup

Mar 8, 2026 · 1:26:00

NVIDIA's Nader Khalil and Kyle Kranen join Swyx and Vibhu to explain how the company moves like a $4.3 trillion startup through speed-of-light (SOL) first-principles thinking, agent security boundaries, and the Dynamo inference engine. They argue agents should only do two of three things (files, internet, code) to prevent vulnerabilities, and detail Brev's acquisition to improve developer UX with one-click GPU access and DGX Spark integration. Kyle describes Dynamo as a data center scale inference engine that optimizes serving by scaling out, using prefill/decode disaggregation, Kubernetes-based scheduling, and model-hardware co-design to improve cost, latency, and quality. The episode covers SOL's role in creating urgency, long-context limits and potential 'unhobblers' like multi-head latent attention, and the shift toward CLI-first agent workflows for enterprise tools.

Claude Code for Finance + The Global Memory Shortage: Doug O'Laughlin, SemiAnalysis

Feb 24, 2026 · 2:07:40

Doug O'Laughlin, SemiAnalysis founder, explains his Claude Code awakening in December 2024: Anthropic's Opus 4.5 one-shotted tasks that used to take 24 hours, leading him to predict Claude Code will write 25–50% of all GitHub code by year-end (already 4% of commits in two weeks). He argues this marks the death of Excel and Bloomberg for analysts—'you can just do things'—but warns of a 'hygiene' crisis as junior analysts lose meta-learning. On the semiconductor side, O'Laughlin details a severe memory squeeze: HBM demand consumes 4× the DRAM capacity, DRAM prices could double again, and CXL is reviving as a workaround. He compares AI infrastructure buildout to the railroad boom (25% of U.S. gross fixed capital investment) and says Microsoft faces an innovator's dilemma—renting GPUs to 'barbarians at the gate' while its own office franchise is disrupted by Claude Code. Google's TPU v7 enjoys a temporary TCO advantage, but Nvidia's supply chain dominance (Jensen doing shots with SK and Samsung) will reassert with Rubin. O'Laughlin also reflects on his 2,800-mile Continental Divide Trail hike as essential self-mastery.

Goodfire AI’s Bet: Interpretability as the Next Frontier of Model Design — Myra Deng & Mark Bissell

Feb 5, 2026 · 1:08:41

Goodfire AI's Mark Bissell and Myra Deng argue that interpretability is the next frontier for model design, using their recent $150M Series B at $1.25B valuation to scale surgical edits of model internals beyond post-hoc poking. They explain how their platform detects behaviors like sycophancy and reward hacking, enabling targeted unlearning without wrecking capabilities. The episode covers real-world deployments from Rakuten's PII guardrails to life science partnerships with Mayo Clinic finding Alzheimer's biomarkers. Mark demonstrates real-time steering of a trillion-parameter Kimi K2 model, while Myra details how SAEs sometimes underperform probes for detection tasks. They envision a future where interpretability guides training so customization isn't brute-force guesswork.

⚡ Open Model Pretraining Masterclass — Elie Bakouch, HuggingFace SmolLM 3, FineWeb, FinePDF

Oct 20, 2025 · 1:03:40

Elie Bakouch, Hugging Face's pre-training lead and architect behind SmolLM, presents a five-pillar framework for model training spanning data quality, architecture, information extraction, gradient quality, and stability, while breaking down recent innovations in optimizers, Mixture of Experts, and data rephrasing. He explains that the field of optimizers is moving beyond AdamW with Muon and Shampoo, noting that speed-ups are often exaggerated due to undertuned baselines. He deep-dives into MoE architecture, showing that expert specialization requires load balancing at the global batch level, as demonstrated by Qwen's findings. He discusses the rephrasing revolution, where converting low-quality web data into QA format yields non-random MMLU performance even for small models. Elie also highlights Hugging Face's open science contributions: FinePDF (new PDF dataset), FineWeb-Edu2, and tools like Nanotron, Datahub, and Liteval.

Better Data is All You Need — Ari Morcos, Datology

Aug 29, 2025 · 1:18:43

Ari Morcos, CEO of Datology, argues that data curation is the most impactful and underinvested area in AI, claiming models are defined by what they eat. He details his shift from focusing on inductive biases to realizing data quality is paramount, citing the DCLM study where human experts could not predict automated filtering decisions. Datology's methods combine filtering, rebalancing, curriculum, and rephrasing synthetic data to achieve baseline performance 12x faster, improve accuracy by 4–5 absolute points, and train models with fewer than half the parameters. Morcos explains how curating data bends naive scaling laws by maintaining marginal information gain, and shares results from the Arc 4.5B model, which was trained on 7 trillion tokens (down from 25 trillion) using Datology's curation. He highlights that data is a compute multiplier, making it possible for enterprises to train smaller, cheaper models for specific domains.