Hello everybody,
today I want to write short summary of how to reduce overfitting. Here it goes:
Weight decay.
Weight sharing
Early stopping of training
Model averaging
Bayesian fitting of NN
Dropout
Generative pre-training
Some explanations about some points.
Weight decay stands for keeping w...