Screen Then Select: A Strategy for Correlated Predictors in High-Dimensional Quantile Regression

Xuejun Jiang1; Yakun Liang1; Haofeng Wang2

2024

10.1007/s11222-024-10424-6

Statistics and Computing   影响因子和分区

0960-3174

1573-1375

Strong correlation among predictors and heavy-tailed noises pose a great challenge in the analysis of ultra-high dimensional data. Such challenge leads to an increase in the computation time for discovering active variables and a decrease in selection accuracy. To address this issue, we propose an innovative two-stage screen-then-select approach and its derivative procedure based on a robust quantile regression with sparsity assumption. This approach initially screens important features by ranking quantile ridge estimation and subsequently employs a likelihood-based post-screening selection strategy to refine variable selection. Additionally, we conduct an internal competition mechanism along the greedy search path to enhance the robustness of algorithm against the design dependence. Our methods are simple to implement and possess numerous desirable properties from theoretical and computational standpoints. Theoretically, we establish the strong consistency of feature selection for the proposed methods under some regularity conditions. In empirical studies, we assess the finite sample performance of our methods by comparing them with utility screening approaches and existing penalized quantile regression methods. Furthermore, we apply our methods to identify genes associated with anticancer drug sensitivities for practical guidance.

Correlation Feature screening Likelihood-based criterion Quantile ridge regression Variable selection

SCI

英语

第一

COMPUTER SCIENCE

2-s2.0-85189774347

人工提交

1.Department of Statistics and Data Science, Southern University of Science and Technology, Shenzhen, Guangdong, China
2.Department of Mathematics, Hong Kong Baptist University, Kowloon Tong, Hong Kong, China

Xuejun Jiang,Yakun Liang,Haofeng Wang. Screen Then Select: A Strategy for Correlated Predictors in High-Dimensional Quantile Regression[J]. Statistics and Computing,2024,34(3).

Xuejun Jiang,Yakun Liang,&Haofeng Wang.(2024).Screen Then Select: A Strategy for Correlated Predictors in High-Dimensional Quantile Regression.Statistics and Computing,34(3).

Xuejun Jiang,et al."Screen Then Select: A Strategy for Correlated Predictors in High-Dimensional Quantile Regression".Statistics and Computing 34.3(2024).