Demystifying Machine Learning

Summary:

• Feature encoding: Map from measurement space to a feature vector in feature space
• Feature selection: Select a subset of features as input to the algorithm
• Feature extraction: Extract a new set of features from the original features as input to the algorithm
• Feature selection/extraction can be done manually (by domain experts) or automatically (algorithm decides the best features for the task)
• Always examine and understand your features!