Geodesic
Rank theory approach to ridge, LASSO, preliminary test and Stein-type estimators: Comparative study
Kybernetika, Tome 54 (2018) no. 5, pp. 958-977

Voir la notice de l'article provenant de la source Czech Digital Mathematics Library

In the development of efficient predictive models, the key is to identify suitable predictors for a given linear model. For the first time, this paper provides a comparative study of ridge regression, LASSO, preliminary test and Stein-type estimators based on the theory of rank statistics. Under the orthonormal design matrix of a given linear model, we find that the rank based ridge estimator outperforms the usual rank estimator, restricted R-estimator, rank-based LASSO, preliminary test and Stein-type R-estimators uniformly. On the other hand, neither LASSO nor the usual R-estimator, preliminary test and Stein-type R-estimators outperform the other. The region of domination of LASSO over all the R-estimators (except the ridge R-estimator) is the interval around the origin of the parameter space. Finally, we observe that the L$_2$-risk of the restricted R-estimator equals the lower bound on the L$_2$-risk of LASSO. Our conclusions are based on L$_2$-risk analysis and relative L$_2$-risk efficiencies with related tables and graphs.
DOI : 10.14736/kyb-2018-5-0958
Classification : 62G05, 62J05, 62J07
Keywords: efficiency of LASSO; penalty estimators; preliminary test; Stein-type estimator; ridge estimator; L$_2$-risk function 
@article{10_14736_kyb_2018_5_0958,
     author = {Saleh, A. K. Md. Ehsanes and Navr\'atil, Radim},
     title = {Rank theory approach to ridge, {LASSO,} preliminary test and {Stein-type} estimators: {Comparative} study},
     journal = {Kybernetika},
     pages = {958--977},
     publisher = {mathdoc},
     volume = {54},
     number = {5},
     year = {2018},
     doi = {10.14736/kyb-2018-5-0958},
     mrnumber = {3893130},
     zbl = {07031754},
     language = {en},
     url = {http://geodesic.mathdoc.fr/articles/10.14736/kyb-2018-5-0958/}
}
TY  - JOUR
AU  - Saleh, A. K. Md. Ehsanes
AU  - Navrátil, Radim
TI  - Rank theory approach to ridge, LASSO, preliminary test and Stein-type estimators: Comparative study
JO  - Kybernetika
PY  - 2018
SP  - 958
EP  - 977
VL  - 54
IS  - 5
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/articles/10.14736/kyb-2018-5-0958/
DO  - 10.14736/kyb-2018-5-0958
LA  - en
ID  - 10_14736_kyb_2018_5_0958
ER  - 
%0 Journal Article
%A Saleh, A. K. Md. Ehsanes
%A Navrátil, Radim
%T Rank theory approach to ridge, LASSO, preliminary test and Stein-type estimators: Comparative study
%J Kybernetika
%D 2018
%P 958-977
%V 54
%N 5
%I mathdoc
%U http://geodesic.mathdoc.fr/articles/10.14736/kyb-2018-5-0958/
%R 10.14736/kyb-2018-5-0958
%G en
%F 10_14736_kyb_2018_5_0958
Saleh, A. K. Md. Ehsanes; Navrátil, Radim. Rank theory approach to ridge, LASSO, preliminary test and Stein-type estimators: Comparative study. Kybernetika, Tome 54 (2018) no. 5, pp. 958-977. doi: 10.14736/kyb-2018-5-0958

Cité par Sources :