DBRX

The Agent Cloud: Databricks’ Bet on the Future of AI — Matei Zaharia and Reynold Xin

Jun 24, 2026 · 1:10:06

Databricks cofounders Matei Zaharia and Reynold Xin argue the company is moving beyond the lakehouse into a full data-and-AI operating system, anchored by two new initiatives: Omnigent, an open-source meta-harness for combining coding and enterprise agents, and LTAP, a unified storage layer that gets most HTAP benefits without collapsing query engines. Omnigent provides a common API for agent sessions, files, streams, tool calls, and cancellation, solving portability, collaboration, and security issues across Claude Code, Codex, Cursor, and custom agents. LTAP writes transactional data directly in columnar Parquet format, eliminating brittle CDC pipelines—Reynold jokes CDC means 'continuous data corruption'—and enables instant analytics without overloading the source database. The episode details Databricks’ culture of rapid prototyping, where an engineer built the LTAP prototype without a formal design doc, and the thesis that traditional software will be rewritten once data is in the right place with agents on top. They also cover Mosaic’s shift from general frontier models to specialized fine-tuned models like document parsing, internal agent usage, and security features such…

State of the Art: Training 70B LLMs on 10,000 H100 clusters

Jun 25, 2024 · 1:32:05

Josh Albrecht, CTO of Imbue, and Jon Frankle, Chief AI Scientist of Databricks, detail the challenges of training 70B models on 10,000 H100 clusters, from stolen Infiniband cables to GPUs silently returning wrong math. Imbue open-sources infrastructure scripts, health checks, the CARBS hyperparameter optimizer, and cleaned versions of 11 benchmarks plus 450,000 human judgments on ambiguity. Databricks released DBRX, a 132B-parameter mixture-of-experts model with 36B active per token, and a text-to-image model trained exclusively on Shutterstock's curated dataset. They discuss typical 3% weekly hardware failure rates, the difficulty of MoE training pushing network bandwidth, and why eval datasets need human scrutiny—most benchmarks are saturated once ambiguous examples are removed. Both emphasize that success requires deep understanding from firmware to final loss, not just fancy libraries.