A novel ensemble causal feature selection approach with mutual information and group fusion strategy for multi-label data

Abstract

Purpose

As intelligent technology advances, practical applications often involve data with multiple labels. Therefore, multi-label feature selection methods have attracted much attention to extract valuable information. However, current methods tend to lack interpretability when evaluating the relationship between different types of variables without considering the potential causal relationship.

Design/methodology/approach

To address the above problems, we propose an ensemble causal feature selection method based on mutual information and group fusion strategy (CMIFS) for multi-label data. First, the causal relationship between labels and features is analyzed by local causal structure learning, respectively, to obtain a causal feature set. Second, we eliminate false positive features from the obtained feature set using mutual information to improve the feature subset reliability. Eventually, we employ a group fusion strategy to fuse the obtained feature subsets from multiple data sub-space to enhance the stability of the results.

Findings

Experimental comparisons are performed on six datasets to validate that our proposal can enhance the interpretation and robustness of the model compared with other methods in different metrics. Furthermore, the statistical analyses further validate the effectiveness of our approach.

Originality/value

The present study makes a noteworthy contribution to proposing a causal feature selection approach based on mutual information to obtain an approximate optimal feature subset for multi-label data. Additionally, our proposal adopts the group fusion strategy to guarantee the robustness of the obtained feature subset.

Citation

Zheng, Y., Zeng, X., Zhang, W., Wei, B., Ren, W. and Qing, D. (2024), "A novel ensemble causal feature selection approach with mutual information and group fusion strategy for multi-label data", International Journal of Intelligent Computing and Cybernetics, Vol. 17 No. 4, pp. 671-704. https://doi.org/10.1108/IJICC-04-2024-0144