R packages which implements most known linear model families in a single unifier method called "lm2":
Partial least squares
Ridge regression
Lasso, LAR (least angular regression), IFSR
Principal components regression
Best subset selection
...
Loss function used is RSS
For any additional linear regression methods, please let me know as [email protected]