全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

基于弹性网惩罚的高维部分线性模型的稳健变量选择
Robust Variable Selection Based on High-Dimensional Partial Linear Model of Elastic Net Penalty

DOI: 10.12677/PM.2024.141006, PP. 41-52

Keywords: 高维数据,弹性网,部分线性模型,变量选择,分位数回归
High-Dimensional Data
, Elastic Net, Partial Linear Model, Variable Selection, Quantile Regression

Full-Text   Cite this paper   Add to My Lib

Abstract:

高维数据下部分线性模型的变量选择方法大多基于最小二乘回归估计展开,但随着数据复杂性的提升,极端、异常等因素使得以往模型的估计效率直线下滑。为此,本文基于弹性网络法与分位数回归相结合的正则化理论,提出了一种应对高维数据下部分线性模型的稳健变量选择模型。该模型不仅可以有效处理强相关变量组的数据,还可以在面对离群点或存在异方差时仍达到较好的稳健性。此外,理论上证明了在一定条件下模型估计量的相合性和稀疏性,最后通过数值模拟,与其他变量选择方法作比较,进一步表明了该方法的优越性。
Most of the variable selection methods of some linear models under high-dimensional data are based on least squares regression estimation, but with the increase of data complexity, extreme and abnormal factors make the estimation efficiency of previous model plummet. Therefore, based on the regularization theory combining elastic network method and quantile regression, this paper proposes a robust variable selection model to cope with some linear models under high-dimensional data. The model can not only effectively handle data for groups of strongly cor-related variables, but also achieve better robustness in the face of outliers or heteroscedasticity. In addition, the coherence and sparsity of model estimators under certain conditions are theoretically proved, and finally the superiority of this method is further demonstrated by numerical simulation and comparison with other variable selection methods.

References

[1]  Engle, R.F., Granger, C.W.J., et al. (1986) Semiparametric Estimates of the Relation between Weather and Electricity Sales. Journal of the American Statistical Association, 81, 310-320.
https://doi.org/10.1080/01621459.1986.10478274
[2]  Hoerl, A.E., Kennard, R.W., et al. (1985) Practical Use of Ridge Regression: A Challenge Met. Journal of the Royal Statistical Society: Series C, 34, 114-120.
https://doi.org/10.2307/2347363
[3]  Tibshirani, R. (1996) Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society: Series B, 58, 267-288.
https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
[4]  Fan, J.Q. and Li, R.Z. (2001) Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties. Journal of the American Statistical Association, 96, 1348-1360.
https://doi.org/10.1198/016214501753382273
[5]  Zou, H. and Hastie, T. (2005) Regularization and Variable Selection via the Elastic Net. Journal of the Royal Statistical Society: Series B, 67, 301-320.
https://doi.org/10.1111/j.1467-9868.2005.00503.x
[6]  Xie, H.L. and Huang, J. (2009) SCAD-Penalized Regres-sion in High-Dimensional Partially Linear Models. The Annals of Statistics, 37, 673-696.
https://doi.org/10.1214/07-AOS580
[7]  杨宜平, 薛留根, 王学娟. 高维部分线性模型中的变量选择[J]. 北京工业大学报, 2011, 37(2): 291-295.
[8]  Chen, B., Yu, Y., et al. (2012) Profifiled Adaptive Elastic-Net Procedure for Partially Linear Models with High-Dimensional Covariates. Journal of Statistical Planning and Inference, 142, 1733-1745.
https://doi.org/10.1016/j.jspi.2012.02.035
[9]  Wang, X.L. and Wang, M.Q. (2017) Adaptive Group Bridge Es-timation for High-Dimensional Partially Linear Models. Journal of Inequalities and Applications, 2017, 158.
https://doi.org/10.1186/s13660-017-1432-x
[10]  赖秋楠, 李玉杰, 李高容. 超高维部分线性模型的PGFR变量筛选[J]. 应用概率统计, 2017, 33(6): 608-624.
[11]  Koenker, R. (2005) Quantiles Regression. Cambridge Univer-sity Press, Cambridge.
[12]  Su, M.H. and Wang, W.J. (2021) Elastic Net Penalized Quantile Regression Model. Journal of Computational and Applied Mathematics, 392, Article ID: 113462.
https://doi.org/10.1016/j.cam.2021.113462
[13]  Fan, J.Q., Fan, Y.Y., et al. (2014) Adaptive Robust Variable Se-lection. The Annals of Statistics, 42, 324-351.
https://doi.org/10.1214/13-AOS1191
[14]  Chen, B.C., Yu, Y., Zou, H., et al. (2012) Profiled Adaptive Elastic-Net Procedure for Partially Linear Models with High-Dimensional Covariates. Journal of Statistical Planning and Inference, 142, 1733-1745.
https://doi.org/10.1016/j.jspi.2012.02.035
[15]  Bühlmann, P. and Geer, S. (2011) Statistics for High-Dimensional Data: Methods, Theory and Applications. Springer, Heidelberg.
https://doi.org/10.1007/978-3-642-20192-9

Full-Text

comments powered by Disqus

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133