For regression problems with #Predictors > #observations, I recently read about Moore Penrose (pseudo inverse method) which solves the problem of non invertible matrix in OLS for regression problems.

enter image description here

How well does this 'generally' perform as compared to some of the other alternatives such as Ridge/Lasso, Partial least squares, Principle component regression?

Also, while datasets with predictors > observations, is there a method among the above listed that always performs better than the rest (purely in terms of prediction accuracy)?


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.