The Microsoft Fabric Pod (by Queryzens)
06 - Data Engineering with Managed Apache Spark - The Microsoft Fabric POD
· 2 min · Saison 1 Épisode 6
Notes d’épisode
Welcome back to Episode 6! Today, let’s talk about writing code and processing heavy datasets using Apache Spark inside Fabric.
If you have ever set up Spark on your own or worked with cloud clusters, you know what a headache it can be:
• You have to decide how many worker nodes you need.
• You tweak driver memory and runtime versions.
• And every time you want to run a simple script, you sit and stare at the screen for five to ten minutes just waiting for the cluster to turn on.
Fabric makes Spark completely managed, which removes almost all of that background setup.
Here is what changes in…
Site web: podcasters.spotify.com
