Stable Causal Feature Selection based on Direct Causal Effect Estimation

Xiaojing Du, Qingfeng Chen, Debo Cheng, Qian Huang, Junyue Cao, Zhenyun Deng, Shichao Zhang

Abstract

Feature selection is an important technique and tool for selecting relevant and critical features from the high-dimensional data in many tasks of data mining and machine learning. However, existing algorithms mainly rely on the associations between features and response variables such that they lack stability and may result in wrong conclusions. To improve the interpretability and stability of feature selection algorithms, we propose a stable causal feature selection algorithm based on the direct causal effect estimation, which achieves interpretable feature selection by considering the causal relationship between features and response variables. Specifically, we develop a theorem based on the graphical causal model to estimate the direct causal effects for supporting the proposed stable causal feature selection algorithm. Moreover, the causal feature selection algorithm is applied for a real-world application, i.e. earthquake prediction by utilising a neural network model, BiLSTM. Abundant experiments carried out on synthetic and real-world data sets demonstrate that the proposed stable causal feature selection algorithm has better performance than the baselines.
BibTeX
@inproceedings{du2022stable,
  author = {Xiaojing Du and Qingfeng Chen and Debo Cheng and Qian Huang and Junyue Cao and Zhenyun Deng and Shichao Zhang},
  title = {{Stable Causal Feature Selection based on Direct Causal Effect Estimation}},
  booktitle = {HPCC/DSS/SmartCity/DependSys},
  year = {2022},
  doi = {10.1109/hpcc-dss-smartcity-dependsys57074.2022.00243},
}

Loading related content...

Figure