Salt la conținut
Global sound
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Orchestrating local LLMs for sensitive data with Airflow

· 27 min · Sezonul 1 Episodul 97

Note de episod

Running LLMs over sensitive data means external APIs are off the table, but open-weight models still need reproducibility, validation, and a paper trail before downstream systems can depend on their output. In this episode, Kenten is joined by Chhayank Jain, Senior ML Engineer at Visa, to talk through how Airflow orchestrates local LLM pipelines end to end: nightly inference over millions of records, silent failure handling with Pydantic and distribution checks, and using a separate DAG to ma...

Live, ultima oră: 15.573 melodii pe 7.821 posturi din 148 țări

Descoperă lumea prin radio

Mai multe moduri de a descoperi (9)

Ai auzit ceva frumos? Salvează-l sau deschide-l direct în Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
4CC - Gladstone - 927 AMContinuă să asculți