Data Engineering Central Podcast
The Future of the Lakehouse: Delta Lake, Rust, and Data Platforms at Scale
· 56 min
Jakson kuvaus
In this episode of the Data Engineering Central Podcast, I sit down with Ethan, a maintainer of delta-rs and an expert in modern lakehouse architecture working in the pharmaceutical industry.
We discuss Ethan’s journey into tech and data engineering, the evolution of open table formats like Delta Lake and Apache Iceberg, and what it actually takes to build scalable enterprise data platforms in highly regulated environments like big pharma.
We also dive into:
* delta-rs and the future of Delta Lake outside Spark
* Lakehouse architecture and open catalogs
* Rust in the modern data ecosystem
*…
Sivusto: dataengineeringcentral.substack.com
