What is regularization and what kind of problems does regularization solve?

What is regularization and what kind of problems does regularization solve?

Answer: Regularization is used to help prevent you from overfitting your model. It does this by introducing a penalty term for the size of the coefficients in your model.