To start of with let’s find out why regularization, by doing so we would get a better intuition of what and how. Before starting with why, we would have to know “what is overfitting?”
Overfitting
On a whole overfitting is a modelling error. When a model start to learn too much of training data or if a model is trying to “adapt” to the training data this leads to high training accuracy.
Wait ,“isn’t high accuracy a good thing?”
Ans: not necessarily, when training accuracy becomes very high the model adapts to the train data only, for example: if you are…
