Ordinary Least Squares estimates rely on independent features. When features are correlated and the columns of the design matrix have near linear dependence, the design matrix becomes nearly singular, which can result in unreliable least-squares estimates.