中国邮电高校学报(英文) ›› 2021, Vol. 28 ›› Issue (4): 1-12.doi: 10.19682/j.cnki.1005-8885.2021.2001

• Artificial Intelligence •    下一篇

Liveness detection of occluded face based on dual-modality convolutional neural network

Ming Yue, Li Wenmin, Xu Siya, Gao Lifang, Zhang Hua, Shao Sujie, Yang Huifeng
  

  1. 1. State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China
    2. State Grid Hebei Information and Telecommunication Branch, Shijiazhuang 050013, China
  • 收稿日期:2020-12-22 修回日期:2021-07-29 接受日期:2021-07-29 出版日期:2021-08-31 发布日期:2021-10-11
  • 通讯作者: Corresponding author: Li Wenmin, E-mail: liwenmin@bupt.edu.cn E-mail:liwenmin@bupt.edu.cn
  • 基金资助:
    This work was supported by the Science and Technology Project of State Grid Corporation of China
    (SGHEXT00YJJS1900050).

Liveness detection of occluded face based on dual-modality convolutional neural network

Ming Yue, Li Wenmin, Xu Siya, Gao Lifang, Zhang Hua, Shao Sujie, Yang Huifeng   

  1. 1. State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China
    2. State Grid Hebei Information and Telecommunication Branch, Shijiazhuang 050013, China
  • Received:2020-12-22 Revised:2021-07-29 Accepted:2021-07-29 Online:2021-08-31 Published:2021-10-11
  • Contact: Corresponding author: Li Wenmin, E-mail: liwenmin@bupt.edu.cn E-mail:liwenmin@bupt.edu.cn
  • Supported by:
    This work was supported by the Science and Technology Project of State Grid Corporation of China
    (SGHEXT00YJJS1900050).

摘要: Facial recognition has become the most common identity authentication technologies. However, problems such as uneven light and occluded faces have increased the hardness of liveness detection. Nevertheless, there are a few pieces of research on face liveness detection under occlusion conditions. This paper designs a face recognition technique suitable for different degrees of facial occlusion, which employs the facial datasets of near-infrared (NIR) images and visible (VIS) light images to examine the single-modality detection accuracy rate (experimental control group) and the corresponding high-dimensional features through the residual network (ResNet). Based on the idea of data fusion, we propose two feature fusion methods. The two methods extract and fuse the data of one and two convolutional layers from two single-modality detectors respectively. The fusion of high-dimensional features apply a new ResNet to get the dual-modality detection accuracy. And then, a new ResNet is applied to test the accuracy of dual-modality detection. The experimental results show that the dual-modality face liveness detection model improves face live detection accuracy and robustness compared with the single-modality. The fusion of two-layer features from the single-modality detector can also improve face detection accuracy by utilizing the above-mentioned dual-modality detector, and it doesn't increase the algorithm's complexity.

关键词: face deception, face occlusion, near-infrared image, residual network, feature fusion

Abstract: Facial recognition has become the most common identity authentication technologies. However, problems such as uneven light and occluded faces have increased the hardness of liveness detection. Nevertheless, there are a few pieces of research on face liveness detection under occlusion conditions. This paper designs a face recognition technique suitable for different degrees of facial occlusion, which employs the facial datasets of near-infrared (NIR) images and visible (VIS) light images to examine the single-modality detection accuracy rate (experimental control group) and the corresponding high-dimensional features through the residual network (ResNet). Based on the idea of data fusion, we propose two feature fusion methods. The two methods extract and fuse the data of one and two convolutional layers from two single-modality detectors respectively. The fusion of high-dimensional features apply a new ResNet to get the dual-modality detection accuracy. And then, a new ResNet is applied to test the accuracy of dual-modality detection. The experimental results show that the dual-modality face liveness detection model improves face live detection accuracy and robustness compared with the single-modality. The fusion of two-layer features from the single-modality detector can also improve face detection accuracy by utilizing the above-mentioned dual-modality detector, and it doesn't increase the algorithm's complexity.

Key words: face deception, face occlusion, near-infrared image, residual network, feature fusion

中图分类号: