Saltar al contenido
Global sound
The Databricks Data Engineer

The Databricks Data Engineer

Your Databricks director: what they fear, why they fund the duller proposal, what gets yours through

· 12 min

Notas del episodio

Two proposals sit on a head of data's desk, both about the nightly pipeline that feeds the finance dashboard. One swaps the full reload for incremental loads with Auto Loader: it finishes in a fraction of the time and it's cheaper every month after the first. The other keeps the full reload, puts it on a bigger job cluster and starts it an hour earlier. It costs more. Forever. She asks one question, "What happens if this breaks on quarter close?", and approves the second one.

It's tempting to call that ignorance or politics. It's neither. The better proposal was arguing merit to someone who…

Web: podcasters.spotify.com

En directo, última hora: 7.863 canciones en 3.482 emisoras de 132 países

Descubre el mundo a través de la radio

Más formas de descubrir (9)

¿Has oído algo bueno? Guárdalo o ábrelo directamente en Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Damar FMSeguir escuchando