Abstract
In predicting a response variable using multiple linear regression model, several candidate models may be available which are subsets of the full model. Shrinkage estimators borrow information from the full model and provides a hybrid estimate of the regression parameters by shrinking the full model estimates toward the candidate submodel. The process introduces bias in the estimation but reduces the overall prediction error that offsets the bias. In this article, we give an overview of shrinkage estimators and their asymptotic properties. A real data example is given and a Monte Carlo simulation study is carried out to evaluate the performance of shrinkage estimators compared to the absolute penalty estimators such as least absolute shrinkage and selection operator (LASSO), adaptive LASSO and smoothly clipped absolute deviation (SCAD) based on prediction errors criterion in a multiple linear regression setup. WIREs Comput Stat 2012, 4:541–553. DOI: 10.1002/wics.1232
Keywords
shrinkage estimation; absolute penalty estimation; LASSO; adaptive LASSO; SCAD
How to cite
S. Ejaz Ahmed, and S. E. Raheem, (2012). Shrinkage and absolute penalty estimation in linear modelsWIREs Computational StatisticsVolume 4, Issue 6, pages 541–553, November/December 2012.

Assistant Professor of Statistics at University of Northern Colorado

Related Posts:

  • Permutations Permutations A permutation is an arrangement of objects without repetition where order is important. Permutations using all the objects A permutation of n objects, arranged into one group of size n, without repetition, an… Read More
  • F-Test F-Test The F-distribution is formed by the ratio of two independent chi-square variables divided by their respective degrees of freedom. Since F is formed by chi-square, many of the chi-square properties carry over to… Read More
  • Combinations Combinations A combination is an arrangement of objects without repetition where order is not important. Note: The difference between a permutation and a combination is not whether there is repetition or not -- there must… Read More
  • How to make box and whisker plot Box Plots Enter the data.  Turn off any regular plots: Hit Y= and position the cursor over any equal sign which is in inversed video (white on black) by arrowing left and then down if necessary. Hit enter w… Read More
  • Terminology of Statistics F-distribution The ratio of two independent chi-square variables divided by their respective degrees of freedom. If the population variances are equal, this simplifies to be the ratio of the sample variances. Analysis o… Read More

0 Comments:

Powered by Blogger.

Visitors

198562
Print Friendly Version of this pagePrint Get a PDF version of this webpagePDF


 download University Notes apps for android

Popular Posts

Flag Counter