Demystifying Machine Learning

Summary:

• The equation for logistic regression is non-convex (squiggly)
• Convex functions are ‘bowl’ shaped
  • Single global minimum
• Non-convex functions may have many local minima
  • Might get stuck at a local minimum with gradient descent instead of the global minimum
• Binary cross entropy: A convex loss function for logistic regression