GrabCut image segmentation algorithm based on structure tensor

doi:10.1016/S1005-8885(17)60197-3

中国邮电高校学报(英文版) ›› 2017, Vol. 24 ›› Issue (2): 48-56.doi: 10.1016/S1005-8885(17)60197-3

• Artificial Intelligence • 上一篇下一篇

GrabCut image segmentation algorithm based on structure tensor

张勇,袁家政,刘宏哲,李青

北京联合大学

收稿日期:2016-09-13 修回日期:2017-04-17 出版日期:2017-04-30 发布日期:2017-04-30
通讯作者: 袁家政 E-mail:jiazheng@buu.edu.cn
基金资助:
国家自然基金：基于超图形XGML的图像半结构化研究;国家自然基金：图像内容的对象级语义标记及场景布局迁移;国家自然基金：面向视频社交网站的视频内容理解与挖掘研究;国家科技支撑：文化旅游资源挖掘与体验式平台研发与示范;国家科技支撑：数字文化旅游共性支撑技术研发与区域资源;北京市自然基金项目：海量社群图像语义分析与检索方法研究;北京市自然基金项目：基于视觉注意机制的3D视觉搜索研究

GrabCut image segmentation algorithm based on structure tensor

Received:2016-09-13 Revised:2017-04-17 Online:2017-04-30 Published:2017-04-30
Supported by:
the National Natural Science Foundation of China (61372148, 61502036, 61571045, 71373023), the Beijing Advanced Innovation Center for Imaging Technology (BAICIT-2016002), the National Science and Technology Support Program (2014BAK08B02, 2015BAH55F03).

摘要/Abstract

摘要： This paper attempts to present an interactive color natural images segmentation method. This method extracts the feature of images by using the nonlinear compact structure tensor (NCST) and then uses GrabCut method to obtain the segmentation. This method not only realizes the non-parametric fusion of texture information and color information, but also improves the efficiency of the calculation. Then, the improved GrabCut algorithm is used to evaluate the foreground target segmentation. In order to calculate the simplicity and efficiency, this paper also extends the Gaussian mixture model (GMM) constructed base on the GrabCut to the tensor space, and uses the Kullback-Leibler (KL) divergence instead of the usual Riemannian geometry. Lastly, an iteration convergence criterion is proposed to reduce the time of the iteration of GrabCut algorithm dramatically with satisfied segmentation accuracy. After conducting a large number of experiments on synthetic texture images and natural images, the results demonstrate that this method has a more accurate segmentation effect.

关键词: image segmentation, structure tensor, GrabCut, Kullback-Leibler, GMM

Abstract: This paper attempts to present an interactive color natural images segmentation method. This method extracts the feature of images by using the nonlinear compact structure tensor (NCST) and then uses GrabCut method to obtain the segmentation. This method not only realizes the non-parametric fusion of texture information and color information, but also improves the efficiency of the calculation. Then, the improved GrabCut algorithm is used to evaluate the foreground target segmentation. In order to calculate the simplicity and efficiency, this paper also extends the Gaussian mixture model (GMM) constructed base on the GrabCut to the tensor space, and uses the Kullback-Leibler (KL) divergence instead of the usual Riemannian geometry. Lastly, an iteration convergence criterion is proposed to reduce the time of the iteration of GrabCut algorithm dramatically with satisfied segmentation accuracy. After conducting a large number of experiments on synthetic texture images and natural images, the results demonstrate that this method has a more accurate segmentation effect.

Key words: image segmentation, structure tensor, GrabCut, Kullback-Leibler, GMM

参考文献

1. Cheng H D, Jiang X H, Sun Y, et al. Color image segmentation: advances and prospects. Pattern Recognition, 2001, 34(12): 2259-2281

2. De S, Bhattacharyya S, Chakraborty S, et al. Hybrid soft computing for multilevel image and data segmentation. Berlin, Germany: Springer, 2016: 29-40

3. Lombaert H, Sun Y, Grady L, et al. A multilevel banded graph cuts method for fast image segmentation. Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV’05), Vol 1, Oct 17-21, 2005, Beijing, China. Piscataway, NJ, USA: IEEE, 2005: 259-265

4. Boykov Y Y, Jolly M P. Interactive graph cuts for optimal boundary and region segmentation of objects in ND images. International Conference on Computer Vision: Vol 1, July 7-14, 2001, Vancouver, British Columbia, Canada. 2001: 105-112

5. Rother C, Kolmogorov V, Blake A. "GrabCut": interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics. 2004, 23(3): 309-314

6. Boykov Y, Funka L G. Graph cuts and efficient N-D image segmentation. International Journal of Computer Vision, 2006, 70(2): 109-131

7. Cross G R, Jain A K. Markov random field texture models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1983, 5(1): 25-39

8. Manjunath B S, Chellappa R. Unsupervised texture segmentation using Markov random field models. IEEE Transactions on Pattern Analysis & Machine Intelligence, 1991, 13(5): 478-482

9. Bouman C, Liu B. Multiple resolution segmentation of textured images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1991, 13(2): 99-113

10. Kim B G, Shim J I, Park D J. Fast image segmentation based on multi-resolution analysis and wavelets. Pattern Recognition Letters, 2003, 24(16): 2995-3006

11. Bigun J, Granlund G H, Wiklund J. Multidimensional orientation estimation with applications to texture analysis and optical flow. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1991, 13(8): 775-790

12. Meng L. Geometric active contours based on structure tensor for image segmentation. Application Research of Computers, 2014, 31(12): 3890-3893 (in Chinese)

13. Mao L C, Ming C Y. An image segmentation method based on level set and structure tensor. 2010 ETP/IITA Conference on Telecommunication and Information (TEIN 2010), June 22-23, 2010, Kuala Lumpur, Malaysia. 2010: 145-148

14. Rousson M, Brox T, Deriche R. Active unsupervised texture segmentation on a diffusion based feature space. Proceedings of the 2003 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’03): Vol 2, Jun 18-20, 2003, Madison, WI, USA. Piscataway, NJ, USA: IEEE, 2003: 699-704

15. Weldeselassie Y T, Hamarneh G. DT-MRI segmentation using graph cuts. Proceedings of the SPIE Medical Imaging 2007: Image Processing, Mar 26, 2007, San Diego, CA, USA. SPIE 6512. Bellingham, WA, USA: Society of Photo-Optical Instrumentation Engineers (SPIE), 2007: 1K1-1K9

16. Malcolm J, Rathi Y, Tannenbaum A. A graph cut approach to image segmentation in tensor space. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’07), Jun 17-22, 2007, Minneapolis, MN, USA. Piscataway, NJ, USA: IEEE, 2007: 8p

17. Wang Z, Vemuri B C. An affine invariant tensor dissimilarity measure and its applications to tensor-valued image segmentation. IEEE conference on computer vision and pattern recognition, June 27-July 2, 2004, Washington, DC USA: IEEE, 2004, 1: I-228-I-233

18. Cyganek B. Object detection and recognition in digital images: theory and practice. New York, USA: Wiley, 2013

19. Luis-García R D, Deriche R, Rousson M, et al. Tensor processing for texture and colour segmentation. Scandinavian Conference on Image Analysis, June 19-22, 2005, Joensuu Finland. Springer-Verlag, 2005: 1117-1127

20. Perona P, Malik J. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990, 12(7): 629-639

21. Andrew A M. Geometric Partial Differential Equations and Image Analysis. Kybernetes, 2002, 31(2):1426-1427

22. Zhukov L, Museth K, Breen D, et al. Level set modeling and segmentation of DT-MRI brain data. Journal of Electronic Imaging, 2003, 12: 125-133

23. Wiegell M R, Tuch D S, Larsson H B, et al. Automatic segmentation of thalamic nuclei from diffusion tensor magnetic resonance imaging. Neuroimage, 2003, 19(2 Pt 1): 391-401

24. Lenglet C, Rousson M, Deriche R, et al. Statistics on the manifold of multivariate normal distributions: theory and application to diffusion tensor MRI processing. Journal of Mathematical Imaging and Vision, 2006, 25(3): 423-444

25. Pennec X, Fillard P, Ayache N. A riemannian framework for tensor computing. International Journal of Computer Vision, 2006, 66(1): 41-66

26. Li Y, Sun J, Tang C K, et al. Lazy snapping. ACM Transactions on Graphics, 2004, 23(3): 303-308

27. Flether P T, Joshi S. Principal geodesic analysis on symmetric spaces: statistics of diffusion tensors. Proceedings of the 2004 Computer Vision and Mathematical Methods in Medical and Biomedical Image Analysis (CVAMIA’04), May 15, 2004, Prague, Czech. LNCS 3117. Berlin, Germany: Springer, 2004: 87-98

28. Do M N, Vetterli M. Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance. IEEE Transactions on Image Processing, 2002, 11(2): 146-158

29. Tao W B. Iterative narrowband-based graph cuts optimization for geodesic active contours with region forces (GACWRF). IEEE Transactions on Image Processing, 2012, 21(1): 284-296

30. Yang Z J, Qian J J, Huang P, et al. GrabCut texture image segmentation based on Gabor wavelet transform. Control and Decision, 2016, 31(1): 149-154 (in Chinese)

GrabCut image segmentation algorithm based on structure tensor

GrabCut image segmentation algorithm based on structure tensor

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

编辑推荐

Metrics

本文评价