What is regularisation? Why is it useful?

Category: QuestionsWhat is regularisation? Why is it useful?
1 Answers
Editor">Editor Staff answered 2 years ago

Regularisation is the process of adding tuning parameter to a model to induce smoothness in order to prevent overfitting. This is most often done by adding a constant multiple to an existing weight vector. This constant is often the L1(Lasso) or L2(ridge). The model predictions should then minimize the loss function calculated on the regularized training set.