Feature Selection Using Zentropy-Based Uncertainty Measure

Kehua Yuan,Duoqian Miao,Yiyu Yao,Hongyun Zhang, Xuerong Zhao

IEEE TRANSACTIONS ON FUZZY SYSTEMS(2024)

引用 0|浏览3
暂无评分
摘要
Feature selection and entropy theory are two efficacious data analysis tools for investigating uncertainty information processing in artificial intelligence. The fruitful marriage of the two has been an active research topic in knowledge discovery. Currently, most feature selection methods via entropy theory mainly focus on the information measures at a single granular level. However, it ignores the interaction between granular levels, which leads to the poor stability and accuracy of related methods. Hence, this article proposes a novel zentropy-based uncertainty measure to design a feature selection method by exploiting the granular level structure in knowledge space. Subsequently, by analyzing the granular level structure in decision data, the zentropy-based uncertainty measure and its properties are designed and analyzed to depict the uncertainty knowledge from whole and internal. Moreover, two importance measures are defined to evaluate features based on the designed uncertainty measure, and then a corresponding feature selection algorithm is developed. Finally, some experiments are carried out on public datasets to demonstrate that the proposed method can achieve state-of-the-art performance among methods, especially regarding stability and classification accuracy.
更多
查看译文
关键词
Uncertainty,Measurement uncertainty,Rough sets,Entropy,Information systems,Feature extraction,Current measurement,Decision information system,feature selection,granular computing,rough set (RS),uncertainty measure
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要