中国邮电高校学报(英文) ›› 2015, Vol. 22 ›› Issue (2): 81-88.doi: 10.1016/S1005-8885(15)60643-4

• Artificial Intelligence • 上一篇    下一篇

Dynamic and combined gestures recognition based on multi-feature fusion in a complex environment

王亮,刘贵喜,段红岩   

  1. 西安电子科技大学
  • 收稿日期:2014-07-14 修回日期:2015-01-17 出版日期:2015-04-30 发布日期:2015-04-22
  • 通讯作者: 刘贵喜 E-mail:gxliu@xidian.edu.cn
  • 基金资助:

    国家部委基金项目;国家部委十二五科技项目;中央高校基本科研业务费专项资金资助

Dynamic and combined gestures recognition based on multi-feature fusion in a complex environment

  • Received:2014-07-14 Revised:2015-01-17 Online:2015-04-30 Published:2015-04-22
  • Supported by:

    National Ministries Foundation of China;National Ministries Research of Twelfth Five projects

摘要: Gestures recognition is of great importance to intelligent human-computer interaction technology, but it is also very difficult to deal with, especially when the environment is quite complex. In this paper, the recognition algorithm of dynamic and combined gestures, which based on multi-feature fusion, is proposed. Firstly, in image segmentation stage, the algorithm extracts interested region of gestures in color and depth map by combining with the depth information. Then, to establish support vector machine (SVM) model for static hand gestures recognition, the algorithm fuses weighted Hu invariant moments of depth map into the Histogram of oriented gradients (HOG) of the color image. Finally, an hidden Markov model (HMM) toolbox supporting multi-dimensional continuous data input is adopted to do the training and recognition. Experimental results show that the proposed algorithm can not only overcome the influence of skin object, multi-object moving and hand gestures interference in the background, but also real-time and practical in Human-Computer interaction.

关键词: gesture recognition, a weighted Hu, HOG , SVM, HMM

Abstract: Gestures recognition is of great importance to intelligent human-computer interaction technology, but it is also very difficult to deal with, especially when the environment is quite complex. In this paper, the recognition algorithm of dynamic and combined gestures, which based on multi-feature fusion, is proposed. Firstly, in image segmentation stage, the algorithm extracts interested region of gestures in color and depth map by combining with the depth information. Then, to establish support vector machine (SVM) model for static hand gestures recognition, the algorithm fuses weighted Hu invariant moments of depth map into the Histogram of oriented gradients (HOG) of the color image. Finally, an hidden Markov model (HMM) toolbox supporting multi-dimensional continuous data input is adopted to do the training and recognition. Experimental results show that the proposed algorithm can not only overcome the influence of skin object, multi-object moving and hand gestures interference in the background, but also real-time and practical in Human-Computer interaction.

Key words: gesture recognition, a weighted Hu, HOG , SVM, HMM

中图分类号: