Extraction technique of region of interest from stereoscopic video

doi:10.1016/S1005-8885(17)60235-8

中国邮电高校学报(英文版) ›› 2017, Vol. 24 ›› Issue (5): 68-76.doi: 10.1016/S1005-8885(17)60235-8

• Signal processing • 上一篇下一篇

Extraction technique of region of interest from stereoscopic video

Lü Chaohui, Pan Jiaying

School of Information Engineering, Communication University of China, Beijing 100024, China

收稿日期:2017-06-07 修回日期:2017-09-28 出版日期:2017-10-30 发布日期:2017-12-18
通讯作者: Lü Chaohui, E-mail: llvch@hotmail.com E-mail:llvch@hotmail.com
作者简介:Lü Chaohui, E-mail: llvch@hotmail.com
基金资助:
This work was supported by the National Natural Science Foundation of China (61201236), National Key Technology Support Program (2012BAH01F04), and Beijing Key Laboratory of Science and Technology (Z141101004414045).

Extraction technique of region of interest from stereoscopic video

Lü Chaohui, Pan Jiaying

School of Information Engineering, Communication University of China, Beijing 100024, China

Received:2017-06-07 Revised:2017-09-28 Online:2017-10-30 Published:2017-12-18
Contact: Lü Chaohui, E-mail: llvch@hotmail.com E-mail:llvch@hotmail.com
About author:Lü Chaohui, E-mail: llvch@hotmail.com
Supported by:
This work was supported by the National Natural Science Foundation of China (61201236), National Key Technology Support Program (2012BAH01F04), and Beijing Key Laboratory of Science and Technology (Z141101004414045).

摘要/Abstract

摘要： A feature fusion approach is presented to extract the region of interest (ROI) from the stereoscopic video. Based on human vision system (HVS), the depth feature, the color feature and the motion feature are chosen as vision features. The algorithm is shown as follows. Firstly, color saliency is calculated on superpixel scale. Color space distribution of the superpixel and the color difference between the superpixel and background pixel are used to describe color saliency and color salient region is detected. Then, the classic visual background extractor (Vibe) algorithm is improved from the update interval and update region of background model. The update interval is adjusted according to the image content. The update region is determined through non-obvious movement region and background point detection. So the motion region of stereoscopic video is extracted using improved Vibe algorithm. The depth salient region is detected by selecting the region with the highest gray value. Finally, three regions are fused into final ROI. Experiment results show that the proposed method can extract ROI from stereoscopic video effectively. In order to further verify the proposed method, stereoscopic video coding application is also carried out on the joint model (JM) encoder with different bit allocation in ROI and the background region.

关键词: stereoscopic video, depth, saliency, ROI, Vibe

Abstract: A feature fusion approach is presented to extract the region of interest (ROI) from the stereoscopic video. Based on human vision system (HVS), the depth feature, the color feature and the motion feature are chosen as vision features. The algorithm is shown as follows. Firstly, color saliency is calculated on superpixel scale. Color space distribution of the superpixel and the color difference between the superpixel and background pixel are used to describe color saliency and color salient region is detected. Then, the classic visual background extractor (Vibe) algorithm is improved from the update interval and update region of background model. The update interval is adjusted according to the image content. The update region is determined through non-obvious movement region and background point detection. So the motion region of stereoscopic video is extracted using improved Vibe algorithm. The depth salient region is detected by selecting the region with the highest gray value. Finally, three regions are fused into final ROI. Experiment results show that the proposed method can extract ROI from stereoscopic video effectively. In order to further verify the proposed method, stereoscopic video coding application is also carried out on the joint model (JM) encoder with different bit allocation in ROI and the background region.

Key words: stereoscopic video, depth, saliency, ROI, Vibe

中图分类号:

TP301.6

Lü Chaohui, Pan Jiaying. Extraction technique of region of interest from stereoscopic video[J]. JOURNAL OF CHINA UNIVERSITIES OF POSTS AND TELECOM, 2017, 24(5): 68-76.

参考文献

References

1. Itti L, Koch C. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 2000, 40(12): 1489-1506

2. Achanta R, Hemami S, Estrada F, et al. Frequency-tuned salient region detection. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09), Jun 20-25, 2009, Miami, FL, USA. Piscataway, NJ, USA: IEEE, 2009: 1597-1604

3. Xie Y L, Lu H C. Visual saliency detection based on Bayesian model. Proceedings of the 18th IEEE International Conference on Image Processing (ICIP’11), Sept 11-14, 2011, Brussels, Belgium. Piscataway, NJ, USA: IEEE, 2011: 645-648

4. Cheng M M, Mitra N, Huang X L, et al. Global contrast based salient region detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(3): 409-416

5. Perazzi F, Krähenbühl P, Pritch Y, et al. Saliency filters: Contrast based filtering for salient region detection. Proceedings of the 2012 IEEE International Conference on Computer Vision and Pattern Recognition (CVPR’12), Jun 16-21, 2012, Providence, RI, USA. Piscataway, NJ, USA: IEEE, 2012: 733-740

6. Klein D A, Frintrop S. Center-surround divergence of feature statistics for salient object detection. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV’11), Nov 6-13, 2011, Barcelona, Spain. Piscataway, NJ, USA: IEEE, 2011: 2214-2219

7. Imamoglu N, Lin W S, Fang Y M. A saliency detection model using low-level features based on wavelet transform. IEEE Transactions on Multimedia, 2013, 15(1): 96-105

8. Zhai Y, Shah M. Visual attention detection in video sequences using spatiotemporal cues. Proceedings of the 14th ACM International Conference on Multimedia, Oct 23-27, 2006, Santa Barbara, CA, USA. New York, NY, USA: ACM, 2006: 815-824

9. Barnich O, Van D M. ViBe: A universal background subtraction algorithm for video sequences. IEEE Transactions on Image Processing, 2011, 20(6): 1709-1724

10. Chen L, Chen X Z, Fan Z T. Ghost suppression algorithm based on Vibe. Journal of China University of Metrology, 2013, 24(4): 425-429 (in Chinese)

11. Yin K, Wei J, Li Z, et al. Moving objects detection algorithm with improved Vibe. Electronic Design Engineering, 2014, 22(16): 178-180 (in Chinese)

12. Wang H, Song J X. Threshold based adaptive vibe target detection algorithm. Computer Science, 2015, 42(6A): 154-157 (in Chinese)

13. Achanta R, Shaji A, Smith K, et al. SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(11): 2274-2282

14. Cheng M M, Warrell J, Lin W Y, et al. Efficient salient region detection with soft image abstraction. Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV’13), Dec 1-8, 2013, Sydney, Australia. Piscataway, NJ, USA: IEEE, 2013: 1529-1536

15. Cao J G. Study on method of video key frame extraction. Master Thesis. Chongqing, China: Chongqing University, 2008 (in Chinese)

16. Farnebäck G. Polynomial expansion for orientation and motion estimation. Ph D Thesis. Linköping, Sweden: Linköping University, 2002

17. Feng K, Lei J J, Wu W M, et al. A bit allocation method for multi-view video coding based on stereoscopic visual saliency. Journal of Optoelectronics Laser, 2013, 24(10): 1995-2001 (in Chinese)

[1]	李丽, 郑嘉利, 全艺璇, 林子涵, 李映超, 黄天星. RFID Indoor positioning based on Semi-supervised Actor-Critic Co-training[J]. 中国邮电高校学报(英文版), 2020, 27(5): 69-81.
[2]	Ren Xingyi, Song Meina, E Haihong, Song Junde. Social media mining and visualization for point-of-interest recommendation[J]. 中国邮电高校学报(英文版), 2017, 24(1): 67-76.
[3]	张小红胡应梦. RFID mutual-authentication protocol with synchronous updated-keys based on Hash function[J]. Acta Metallurgica Sinica(English letters), 2015, 22(6): 27-35.

Extraction technique of region of interest from stereoscopic video

Extraction technique of region of interest from stereoscopic video

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 3

编辑推荐

Metrics

本文评价