Abstract
For ultra-high-dimensional censored data, feature screening can be performed to remove noise in big data, and classical statistic analysis can be applied after that. This paper proposes a robust partial correlation coefficient for feature screening, and introduces an inverse probability weighting method to deal with censoring. Based on that, a new joint feature screening method is developed. By incorporating the information of the entire conditional distribution of the failure time, our method can depict the relationship between the response and covariates comprehensively. Compared with the traditional Pearson partial correlation coefficient, this measurement is robust to outliers, heavy-tailed distribution and heteroscedasticity. Moreover, the joint feature screening method proposed based on this metric eliminates the interference caused by the correlation between the covariates through the projection effect, so as to reduce the false negative errors, false positive errors and tackle the problem of collinearity of covariates. We establish the sure screening property of our method and give the details of the iterative algorithm. The competence of our method is further confirmed through comprehensive simulation studies and a real data example.
| Translated title of the contribution | Joint feature screening method for ultrahigh dimensional censored data |
|---|---|
| Original language | Chinese (Traditional) |
| Pages (from-to) | 169-190 |
| Number of pages | 22 |
| Journal | Xitong Gongcheng Lilun yu Shijian/System Engineering Theory and Practice |
| Volume | 43 |
| Issue number | 1 |
| DOIs | |
| State | Published - Jan 2023 |
Fingerprint
Dive into the research topics of 'Joint feature screening method for ultrahigh dimensional censored data'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver