Overfitting

4 problems

• Overfitting — read the learning curvesEasy
• Ensembling — average models, then predictMedium
• Weight decay — the L2 penalty termEasy
• Little's LawEasy