Gå til indhold
Global sound
AI Bites: The Academic Series

AI Bites: The Academic Series

Title: EP 61 | MIT 6.036: Gradient Descent & Optimization in Practice

· 33 min.

Episodebeskrivelse

• Welcome to Week 5 of MIT 6.036! Now that we've framed machine learning as loss minimization, how do we actually find the parameters that sit at the bottom of the bowl? We explore the geometry of loss landscapes, analyze step-size dynamics, derive analytical gradients for Logistic Regression, and examine why Stochastic Gradient Descent (SGD) uses random noise to outpace traditional Batch GD.

• Key Topics:

• Intuition and update rules for 1D and High-Dimensional Gradient Descent.

• Convexity, Local Optima, and the critical role of learning rates ($\eta$).

• Computing analytical gradients…

Website: podcasters.spotify.com

Live, seneste time: 13.509 sange på 5.380 stationer i 117 lande

Opdag verden gennem radioen

Flere måder at opdage på (7)

Hørt noget godt? Gem det, eller åbn det direkte i Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Rhema RadioFortsæt med at lytte