Demystifying Machine Learning

Summary:

• The curse of dimensionality: More features may cause overfitting:
  • from data sparsity
  • as a result of a more complex model
• Avoiding the curse by reducing features
  • feature extraction or feature selection
  • apply statistical methods like Principal Component Analysis (PCA)
  • let machine learning algorithm automatically extract/select features optimised for the task