JOURNAL OF CHINA UNIVERSITIES OF POSTS AND TELECOM ›› 2017, Vol. 24 ›› Issue (2): 48-56.doi: 10.1016/S1005-8885(17)60197-3

Previous Articles     Next Articles

GrabCut image segmentation algorithm based on structure tensor

  

  • Received:2016-09-13 Revised:2017-04-17 Online:2017-04-30 Published:2017-04-30
  • Supported by:
    the National Natural Science Foundation of China (61372148, 61502036, 61571045, 71373023), the Beijing Advanced Innovation Center for Imaging Technology (BAICIT-2016002), the National Science and Technology Support Program (2014BAK08B02, 2015BAH55F03).

Abstract: This paper attempts to present an interactive color natural images segmentation method. This method extracts the feature of images by using the nonlinear compact structure tensor (NCST) and then uses GrabCut method to obtain the segmentation. This method not only realizes the non-parametric fusion of texture information and color information, but also improves the efficiency of the calculation. Then, the improved GrabCut algorithm is used to evaluate the foreground target segmentation. In order to calculate the simplicity and efficiency, this paper also extends the Gaussian mixture model (GMM) constructed base on the GrabCut to the tensor space, and uses the Kullback-Leibler (KL) divergence instead of the usual Riemannian geometry. Lastly, an iteration convergence criterion is proposed to reduce the time of the iteration of GrabCut algorithm dramatically with satisfied segmentation accuracy. After conducting a large number of experiments on synthetic texture images and natural images, the results demonstrate that this method has a more accurate segmentation effect.

Key words: image segmentation, structure tensor, GrabCut, Kullback-Leibler, GMM