中国邮电高校学报(英文) ›› 2019, Vol. 26 ›› Issue (2): 17-29.doi: 10.19682/j.cnki.1005-8885.2019.1003

• Artificial Intelligence • 上一篇    下一篇

Multiple feature fusion for unimodal emotion recognition

Yang Lingzhi, Ban Xiaojuan, Michele Mukeshimana, Chen Zhe   

  1. 1. School of Computer and Communication Engineering, Beijing Key Laboratory of Knowledge Engineering for Materials Science, University of Science and Technology Beijing, Beijing 10083, China
    2. Citic Pacific Special Steel Holdings Qingdao Special Iron and Steel Company Limited
    3. Faculity of Engineering Sciences, University of Burundi, Bujumbura P. O. Box 1550 Bujumbura, Burundi
    4. Qingdao Hisense Group Company Limited, Qingdao 266000, China
  • 收稿日期:2018-08-07 修回日期:2019-04-04 出版日期:2019-04-30 发布日期:2019-06-14
  • 通讯作者: Corresponding author: Yang Lingzhi, E-mail: yanglingzhi@citicsteel.com E-mail:yanglingzhi@citicsteel.com
  • 作者简介:Corresponding author: Yang Lingzhi, E-mail: yanglingzhi@citicsteel.com
  • 基金资助:
    This work was supported by the National Key Research and Development Program of China (2016YFB1001404), and the National Natural Science Foundation of China (61873299, 61702036, 61572075).

Multiple feature fusion for unimodal emotion recognition

Yang Lingzhi, Ban Xiaojuan, Michele Mukeshimana, Chen Zhe   

  1. 1. School of Computer and Communication Engineering, Beijing Key Laboratory of Knowledge Engineering for Materials Science, University of Science and Technology Beijing, Beijing 10083, China
    2. Citic Pacific Special Steel Holdings Qingdao Special Iron and Steel Company Limited
    3. Faculity of Engineering Sciences, University of Burundi, Bujumbura P. O. Box 1550 Bujumbura, Burundi
    4. Qingdao Hisense Group Company Limited, Qingdao 266000, China
  • Received:2018-08-07 Revised:2019-04-04 Online:2019-04-30 Published:2019-06-14
  • Contact: Corresponding author: Yang Lingzhi, E-mail: yanglingzhi@citicsteel.com E-mail:yanglingzhi@citicsteel.com
  • About author:Corresponding author: Yang Lingzhi, E-mail: yanglingzhi@citicsteel.com
  • Supported by:
    This work was supported by the National Key Research and Development Program of China (2016YFB1001404), and the National Natural Science Foundation of China (61873299, 61702036, 61572075).

摘要: A new semi-serial fusion method of multiple feature based on learning using privileged information (LUPI) model was put forward. The exploitation of LUPI paradigm permits the improvement of the learning accuracy and its stability, by additional information and computations using optimization methods. The execution time is also reduced, by sparsity and dimension of testing feature. The essence of improvements obtained using multiple features types for the emotion recognition (speech expression recognition), is particularly applicable when there is only one modality but still need to improve the recognition. The results show that the LUPI in unimodal case is effective when the size of the feature is considerable. In comparison to other methods using one type of features or combining them in a concatenated way, this new method outperforms others in recognition accuracy, execution reduction, and stability.

关键词: multiple feature, LUPI, emotion recognition, semi-serial fusion method

Abstract: A new semi-serial fusion method of multiple feature based on learning using privileged information (LUPI) model was put forward. The exploitation of LUPI paradigm permits the improvement of the learning accuracy and its stability, by additional information and computations using optimization methods. The execution time is also reduced, by sparsity and dimension of testing feature. The essence of improvements obtained using multiple features types for the emotion recognition (speech expression recognition), is particularly applicable when there is only one modality but still need to improve the recognition. The results show that the LUPI in unimodal case is effective when the size of the feature is considerable. In comparison to other methods using one type of features or combining them in a concatenated way, this new method outperforms others in recognition accuracy, execution reduction, and stability.

Key words: multiple feature, LUPI, emotion recognition, semi-serial fusion method

中图分类号: