Skip to content
Global sound
The Databricks Data Engineer

The Databricks Data Engineer

Medallion architecture vs. reality - when your Databricks bronze, silver and gold are just folders

· 12 min

Show notes

Three schemas. Bronze, silver, gold. The diagram got nods in the architecture review. Then two dashboards land in the same leadership meeting with two different active customer counts, and the head of finance asks which one is right.

The trail ends at bronze, where rows that failed parsing were quietly dropped. The vendor keeps thirty days. Every label was there. What the medallion was invented to fix was not, and the pipeline had rebuilt the old mess across three schemas.

In this episode:
- What pipelines looked like before bronze, silver and gold, and the three pains the diagram was…

Website: podcasters.spotify.com

Live, last hour: 14,880 songs on 6,837 stations in 140 countries

Discover the world through radio

More ways to discover (9)

Heard something good? Save it, or open it straight away in Spotify.

ZedRadio.caContinue listening