Episodebeskrivelse
• Welcome to Week 5 of MIT 6.036! Now that we've framed machine learning as loss minimization, how do we actually find the parameters that sit at the bottom of the bowl? We explore the geometry of loss landscapes, analyze step-size dynamics, derive analytical gradients for Logistic Regression, and examine why Stochastic Gradient Descent (SGD) uses random noise to outpace traditional Batch GD.
• Key Topics:
• Intuition and update rules for 1D and High-Dimensional Gradient Descent.
• Convexity, Local Optima, and the critical role of learning rates ($\eta$).
• Computing analytical gradients…
Website: podcasters.spotify.com

