The Agent Cloud: Databricks’ Bet on the Future of AI — Matei Zaharia and Reynold Xin
Jun 24, 2026 · 1:10:06
Databricks cofounders Matei Zaharia and Reynold Xin argue the company is moving beyond the lakehouse into a full data-and-AI operating system, anchored by two new initiatives: Omnigent, an open-source meta-harness for combining coding and enterprise agents, and LTAP, a unified storage layer that gets most HTAP benefits without collapsing query engines. Omnigent provides a common API for agent sessions, files, streams, tool calls, and cancellation, solving portability, collaboration, and security issues across Claude Code, Codex, Cursor, and custom agents. LTAP writes transactional data directly in columnar Parquet format, eliminating brittle CDC pipelines—Reynold jokes CDC means 'continuous data corruption'—and enables instant analytics without overloading the source database. The episode details Databricks’ culture of rapid prototyping, where an engineer built the LTAP prototype without a formal design doc, and the thesis that traditional software will be rewritten once data is in the right place with agents on top. They also cover Mosaic’s shift from general frontier models to specialized fine-tuned models like document parsing, internal agent usage, and security features such…
