Adaptive sparse confidence-weighted learning for online feature selection

Liu，Yanbin1,2; Yan，Yan2; Chen，Ling2; Han，Yahong3; Yang，Yi2

2019

33rd AAAI Conference on Artificial Intelligence, AAAI 2019, 31st Innovative Applications of Artificial Intelligence Conference, IAAI 2019 and the 9th AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019

4408-4415

In this paper, we propose a new online feature selection algorithm for streaming data. We aim to focus on the following two problems which remain unaddressed in literature. First, most existing online feature selection algorithms merely utilize the first-order information of the data streams, regardless of the fact that second-order information explores the correlations between features and significantly improves the performance. Second, most online feature selection algorithms are based on the balanced data presumption, which is not true in many real-world applications. For example, in fraud detection, the number of positive examples are much less than negative examples because most cases are not fraud. The balanced assumption will make the selected features biased towards the majority class and fail to detect the fraud cases. We propose an Adaptive Sparse Confidence-Weighted (ASCW) algorithm to solve the aforementioned two problems. We first introduce an `0-norm constraint into the second-order confidence-weighted (CW) learning for feature selection. Then the original loss is substituted with a cost-sensitive loss function to address the imbalanced data issue. Furthermore, our algorithm maintains multiple sparse CW learner with the corresponding cost vector to dynamically select an optimal cost. We theoretically enhance the theory of sparse CW learning and analyze the performance behavior in F-measure. Empirical studies show the superior performance over the state-of-the-art online learning methods in the online-batch setting.

第一

英语

EI

20203509101560

E-learning ; Crime ; Learning systems

Social Sciences:971

2-s2.0-85084682929

Scopus

1.SUSTech-UTS Joint Centre of CIS,Southern University of Science and Technology,
2.Centre for Artificial Intelligence,University of Technology Sydney,Australia
3.College of Intelligence and Computing,Tianjin University,China

Liu，Yanbin,Yan，Yan,Chen，Ling,et al. Adaptive sparse confidence-weighted learning for online feature selection[C],2019:4408-4415.