Splines, knots, and penalties
Wiley Interdisciplinary Reviews. Computational Statistics (Print) , Volume 2 - Issue 6 p. 637- 653
Penalized splines have gained much popularity as a flexible tool for smoothing and semi-parametric models. Two approaches have been advocated: (1) use a B-spline basis, equally spaced knots, and difference penalties [Eilers PHC, Marx BD. Flexible smoothing using B-splines and penalized likelihood (with Comments and Rejoinder). Stat Sci 1996, 11:89-121.] and (2) use truncated power functions, knots based on quantiles of the independent variable and a ridge penalty [Ruppert D, Wand MP, Carroll RJ. Semiparametric Regression. New York: Cambridge University Press; 2003]. We compare the two approaches on many aspects: numerical stability, quality of the fit, interpolation/extrapolation, derivative estimation, visual presentation and extension to multidimensional smoothing. We discuss mixed model and Bayesian parallels to penalized regression. We conclude that B-splines with difference penalties are clearly to be preferred.
|Wiley Interdisciplinary Reviews. Computational Statistics (Print)|
|Organisation||Erasmus MC: University Medical Center Rotterdam|
Eilers, P.H.C, & Marx, B.D. (2010). Splines, knots, and penalties. Wiley Interdisciplinary Reviews. Computational Statistics (Print), 2(6), 637–653. doi:10.1002/wics.125