Overfitting , Underfitting,
and Regularization
Aly O. Abdelkareem
How to find
overfitting or
underfitting
?
Solutions for
overfitting?
1. Increase training
examples
2. Regularization
1. L2
2. L1
3. Dropout
Regularization
Dropout
Resources
• http://www.chioka.in/differences-between-l1-and-l2-as-loss-
function-and-regularization/
• https://medium.com/@amarbudhiraja/https-medium-com-
amarbudhiraja-learning-less-to-learn-better-dropout-in-deep-
machine-learning-74334da4bfc5