Cross-validation

Is it k-fold (normally 5 or 10) or Leave-one-out cross-validation (LOOCV). K-fold is the commonly chosen option.

Ridge Regression

Method for linear and other regression forms to limit the number of parameters we use to model the system. The more parameters, the worse the weighting of the parameters. Drives models to be more simple

Lasso Model

An improvement on Ridge Regression to minimise the number of predictors used to build a model - making it a sparse rather than dense model