Skip to content
Global sound
AI Bites: The Academic Series

AI Bites: The Academic Series

EP 60 | MIT 6.036: Logistic Regression & ML as Optimization

· 60 min

Show notes

• Welcome to Week 4 of MIT 6.036! This week we transition from heuristic rules to the formal framework of Machine Learning as Optimization. We explore why traditional step-function loss fails calculus, introduce smooth Sigmoid probabilities, and derive the Negative Log-Likelihood loss function.

• Key Topics:

• Framing ML as Loss Minimization plus $L_2$ Regularization.

• Why $0\text{--}1$ Loss fails (zero gradients & NP-hardness).

• The Linear Logistic Classifier and the Sigmoid function ($\sigma(z)$).

• Deriving Negative Log-Likelihood (NLL) and cross-entropy loss.

• Disclaimer: Note…

Website: podcasters.spotify.com

Live, last hour: 7,517 songs on 3,000 stations in 125 countries

Discover the world through radio

More ways to discover (7)

Heard something good? Save it, or open it straight away in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio Cas OstravskoContinue listening