Data streams classification with ensemble model based on decision-feedback

doi:10.1016/S1005-8885(14)60272-7

中国邮电高校学报(英文) ›› 2014, Vol. 21 ›› Issue (1): 79-85.doi: 10.1016/S1005-8885(14)60272-7

• Artificial Intelligence • 上一篇下一篇

Data streams classification with ensemble model based on decision-feedback

刘敬,徐国胜,郑世慧,肖达,谷利泽

1. Information Security Center, Beijing University of Posts and Telecommunications, Beijing 100876, China 2. National Engineering Laboratory for Disaster Backup and Recovery, Beijing University of Posts and Telecommunications, Beijing 100876, China

收稿日期:2013-04-22 修回日期:2014-01-03 出版日期:2014-02-28 发布日期:2014-02-28
通讯作者: 刘敬 E-mail:liujing81@sohu.com
基金资助:
This work was supported by the National Natural Science Foundation of China (61202082), the Fundamental Research Funds for the Central Universities (BUPT2012RC0218, BUPT2012RC0219).

Data streams classification with ensemble model based on decision-feedback

1. Information Security Center, Beijing University of Posts and Telecommunications, Beijing 100876, China 2. National Engineering Laboratory for Disaster Backup and Recovery, Beijing University of Posts and Telecommunications, Beijing 100876, China

Received:2013-04-22 Revised:2014-01-03 Online:2014-02-28 Published:2014-02-28
Supported by:
This work was supported by the National Natural Science Foundation of China (61202082), the Fundamental Research Funds for the Central Universities (BUPT2012RC0218, BUPT2012RC0219).

摘要/Abstract

摘要：

The main challenges of data streams classification include infinite length, concept-drifting, arrival of novel classes and lack of labeled instances. Most existing techniques address only some of them and ignore others. So an ensemble classification model based on decision-feedback (ECM-BDF) is presented in this paper to address all these challenges. Firstly, a data stream is divided into sequential chunks and a classification model is trained from each labeled data chunk. To address the infinite length and concept-drifting problem, a fixed number of such models constitute an ensemble model E and subsequent labeled chunks are used to update E. To deal with the appearance of novel classes and limited labeled instances problem, the model incorporates a novel class detection mechanism to detect the arrival of a novel class without training E with labeled instances of that class. Meanwhile, unsupervised models are trained from unlabeled instances to provide useful constraints for E. An extended ensemble model Ex can be acquired with the constraints as feedback information, and then unlabeled instances can be classified more accurately by satisfying the maximum consensus of Ex. Experimental results demonstrate that the proposed ECM-BDF outperforms traditional techniques in classifying data streams with limited labeled data.

关键词:

ensemble classification, novel class, concept drifting, decision-feedback

Abstract:

Key words:

ensemble classification, novel class, concept drifting, decision-feedback

中图分类号:

TP391.4

LIU Jing , XU Guo-sheng, ZHENG Shi-hui, XIAO Da, GU Li-ze. Data streams classification with ensemble model based on decision-feedback[J]. Acta Metallurgica Sinica(English letters), 2014, 21(1): 79-85.

参考文献

1. Hulten G, Spencer L, Domingos P. Mining time-changing data streams. Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’01), Aug 26?29, 2001, San Francisco, CA, USA. New York, NY, USA: ACM, 2001: 97?106 2. Yang Y, Wu X, Zhu X. Combining proactive and reactive predictions for data streams. Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’05), Aug 21?24, 2005, Chicago, IL, USA. New York, NY, USA: ACM, 2005: 710?715 3. Aggarwal C C, Han J, Wang J, et al. A framework for on-demand classification of evolving data streams. IEEE Transactions on Knowledge and Data Engineering, 2005, 18(5): 577?589 4. Chen S, Wang H, Zhou S, et al. Stop chasing trends: Discovering high order models in evolving data. Proceedings of the 24th IEEE International Conference on Data Engineering (ICDE’08), Apr 7?12, 2008, Cancun, Mexico. Piscataway, NJ, USA: IEEE, 2008: 923?932 5. Wang H, Fan W, Yu P S, et al. Mining concept-drifting data streams using ensemble classifiers. Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’03), Aug 24?27, 2003, Washington, DC, USA. New York, NY, USA: ACM, 2003: 226?235 6. Kolter J Z, Maloof M A. Using additive expert ensembles to cope with concept drift. Proceedings of the 22nd International Conference on Machine Learning (ICML’05), Aug 7?10, 2005, Bonn, Germany. New York, NY, USA: ACM, 2005: 449?456 7. Spinosa E J, de Leon F A P, de Carvalho, et al. Cluster-based novel concept detection in data streams applied to intrusion detection in computer networks. Proceedings of the 23rd Annual ACM Symposium on Applied Computing (SAC’08), Mar 16?20, 2008, Fortaleza, Brazil. New York, NY, USA: ACM, 2008: 976?980 8. Masud M M, Gao J, Khan L, et al. Classification and novel class detection in concept-drifting data streams under time constraints. IEEE Transactions on Knowledge and Data Engineering, 2011, 23(1): 859?874 9. Al-Khateeb T, Masud M M, Khan L, et al. Stream classification with recurring and novel class detection using class-based ensemble. Proceedings of the 9th IEEE International Conference on Data Mining (ICDM’09), Dec 10?13, 2012, Brussels, Belgium. Los Alamitos, CA, USA: IEEE Computer Society, 2012: 31?40 10. Farid D M, Rahman C M. Novel class detection in concept-drifting data stream mining employing decision tree. Proceedings of the 7th International Conference on Electrical and Computer Engineering (ICECE’12), Dec 20?22, 2012, Dhaka, Bangladesh. Piscataway, NJ, USA: IEEE, 2012: 630?633 11. Zhang P, Zhu X, Lin X, et al. Classifier and cluster ensembles for mining concept drifting data streams. Proceedings of the 10th IEEE International Conference on Data Mining (ICDM’10), Dec 13?17, 2010, Sydney, Australia. Los Alamitos, CA, USA: IEEE Computer Society, 2010: 1175?1180 12. Gao F, Liang F, Fan W, et al. A graph-based consensus maximization approach for combining multiple supervised and unsupervised models. IEEE Transactions on Knowledge and Data Engineering, 2013, 25(1): 15?28

[1]	王亮刘贵喜段红岩. Dynamic and combined gestures recognition based on multi-feature fusion in a complex environment [J]. Acta Metallurgica Sinica(English letters), 2015, 22(2): 81-88.
[2]	李岩周亚建袁开国郭玉翠钮心忻. Exposing photo manipulation with inconsistent perspective geometry[J]. Acta Metallurgica Sinica(English letters), 2014, 21(4): 83-91.
[3]	卢官明左加阔. Orthogonal isometric projection for face recognition[J]. Acta Metallurgica Sinica(English letters), 2011, 18(1): 91-97.

Data streams classification with ensemble model based on decision-feedback

Data streams classification with ensemble model based on decision-feedback

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 3

编辑推荐

Metrics

本文评价