Skip to main navigation Skip to search Skip to main content

超高维删失数据的联合特征筛选方法研究

Translated title of the contribution: Joint feature screening method for ultrahigh dimensional censored data
  • Fintech Research Institute
  • Fudan University

Research output: Contribution to journalArticlepeer-review

Abstract

For ultra-high-dimensional censored data, feature screening can be performed to remove noise in big data, and classical statistic analysis can be applied after that. This paper proposes a robust partial correlation coefficient for feature screening, and introduces an inverse probability weighting method to deal with censoring. Based on that, a new joint feature screening method is developed. By incorporating the information of the entire conditional distribution of the failure time, our method can depict the relationship between the response and covariates comprehensively. Compared with the traditional Pearson partial correlation coefficient, this measurement is robust to outliers, heavy-tailed distribution and heteroscedasticity. Moreover, the joint feature screening method proposed based on this metric eliminates the interference caused by the correlation between the covariates through the projection effect, so as to reduce the false negative errors, false positive errors and tackle the problem of collinearity of covariates. We establish the sure screening property of our method and give the details of the iterative algorithm. The competence of our method is further confirmed through comprehensive simulation studies and a real data example.

Translated title of the contributionJoint feature screening method for ultrahigh dimensional censored data
Original languageChinese (Traditional)
Pages (from-to)169-190
Number of pages22
JournalXitong Gongcheng Lilun yu Shijian/System Engineering Theory and Practice
Volume43
Issue number1
DOIs
StatePublished - Jan 2023

Fingerprint

Dive into the research topics of 'Joint feature screening method for ultrahigh dimensional censored data'. Together they form a unique fingerprint.

Cite this