Research on emotion space of film and television scene images based on subjective perception

doi:10.19682/j.cnki.1005-8885.2019.0008

中国邮电高校学报(英文) ›› 2019, Vol. 26 ›› Issue (1): 75-81.doi: 10.19682/j.cnki.1005-8885.2019.0008

Research on emotion space of film and television scene images based on subjective perception

苏志斌¹,钱亚红²,谷雨²,任慧¹

1. 中国传媒大学
2.

收稿日期:2018-07-13 修回日期:2018-12-17 出版日期:2019-02-26 发布日期:2019-02-27
通讯作者: 任慧 E-mail:renhui@cuc.edu.cn
基金资助:
面向流行音乐情感的灯光效果自动推荐方法研究;个性化图像情感感知的计算与关键技术研究

Research on emotion space of film and television scene images based on subjective perception

Received:2018-07-13 Revised:2018-12-17 Online:2019-02-26 Published:2019-02-27

摘要/Abstract

摘要： The premise of image emotion recognition is to determine its representative emotional adjectives and establish the quantifiable emotion space. In this paper, focusing on aroused emotion from film and television （TV） scene images, a method of selecting emotional adjectives and establishing the emotion space based on subjective perception experiment is proposed. Firstly, a special data set about film and TV scene images was established and a set of initial emotional adjectives was collected. Then the subjective perception experiment was designed to let subjects to evaluate the affection of all the initial adjectives during watching these scene images. Then the method of principal basis analysis was used for variable selection. Finally, the factor analysis was applied to accomplish the second dimension reduction to form a 5-dimensional（5D）orthogonal emotion space. The optimized emotion space can explain more than 94% of original emotional adjectives, which greatly reduces the dimension of emotional adjectives and lays a foundation for the further research on image content and emotion recognition.

关键词: film and television scene images, subjective perception, emotion space, principal basis analysis, factor analysis

Abstract: The premise of image emotion recognition is to determine its representative emotional adjectives and establish the quantifiable emotion space. In this paper, focusing on aroused emotion from film and television （TV） scene images, a method of selecting emotional adjectives and establishing the emotion space based on subjective perception experiment is proposed. Firstly, a special data set about film and TV scene images was established and a set of initial emotional adjectives was collected. Then the subjective perception experiment was designed to let subjects to evaluate the affection of all the initial adjectives during watching these scene images. Then the method of principal basis analysis was used for variable selection. Finally, the factor analysis was applied to accomplish the second dimension reduction to form a 5-dimensional（5D）orthogonal emotion space. The optimized emotion space can explain more than 94% of original emotional adjectives, which greatly reduces the dimension of emotional adjectives and lays a foundation for the further research on image content and emotion recognition.

Key words: film and television scene images, subjective perception, emotion space, principal basis analysis, factor analysis

中图分类号:

TP391

参考文献

1. Tang L P, Chen F. Research progress of emotion-based image classification. Information Studies: Theory and Application, 2018, 41(6): 149-160 (in Chinese)

2. Zhao S C, Yao H Y. A survey of image emotion computing. Intelligent Computer and Applications, 2017, 7(1): 1-5 (in Chinese)

3. Ekman P. An argument for basic emotions. Cognition and Emotion, 1992, 6(3/4): 169-200

4. Russell J A, Mehrabian A. Evidence for a three-factor theory of emotions. Journal of Research in Personality, 1977, 11 (3): 273-294

5. Li P T, Shi Y X, Dai H G. Classification of house-designing image based on color feature. Computer Engineering, 2011, 37(16): 224-229 (in Chinese)

6. Wang S F, Chen A H, Wang S, et al. A kansei image retrieval based on emotion model. Journal of Circuits and Systems, 2003, 8(6): 48-52 (in Chinese)

7. Li H F, He H P, Chen J J. A multi-layer affective model based on personality, mood and emotion. Journal of Computer-Aided Design and Computer Graphics, 2011, 23(4): 725-730 (in Chinese)

8. WU X H. Research on emotional semantic image annotation and retrieval. Master Thesis. Hangzhou, China: Zhejiang University, 2013 (in Chinese)

9. Cao J F, Chen J J, Li H F. On natural scene image classification based on improved OCC affective model. Computer Applications and Software, 2014, 31(6): 181-184 (in Chinese)

10. Zhang H B, Zhang C Y. Study on the emotion factor space of men’s T-shirt. Proceedings of the 3rd International Conference on Information Science and Control Engineering (ICISCE’16), Jul 8-10, 2016, Beijing, China. Piscataway, NJ, USA: IEEE, 2016: 654-658

11. Zhang X L, Lou S D. Image emotional semantic annotation based on fusion features. Proceedings of the 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI’17), Oct 14-16, 2017, Shanghai, China. Piscataway, NJ, USA: IEEE, 2017: 5p

12. Deng P, Sun S. Image semantic research based on factor analysis. Packaging Engineering, 2017, 39(20): 112-115 (in Chinese)

13. Wu P, Tao C, Zhu Y H, et al. Image annotation retrieval based on emotion semantic. Computer Technology and Development, 2015, 25(10): 13-18 (in Chinese)

14. Zhao S C. Research on affective computing and application of image emotion perceptions. Ph D Thesis. Harbin, China: Harbin Institute of Technology, 2016 (in Chinese)

15. Wang H W. Elementary introduction to multiple correlation causing harm to principle component analysis. Journal of Beijing University of Aeronautics and Astronautics, 1996, 22(1): 65-70 (in Chinese)

16. Guo L J, Yi B, Guan R, et al. Evaluation of regional innovation capability with a condensed index system based on principal basis variable selection and principal component analysis. Systems Engineering, 2011, 29(7): 34-40 (in Chinese)

17. Wang H W, Yi B, Ye M. Variable selection based on principal basis analysis. Journal of Beijing University of Aeronautics and Astronautics, 2008, 34(11): 1288-1291 (in Chinese)

18. Li X, Zhang M M. SPSS 22.0 Statistical analysis from getting started to proficient. Beijing, China: Publishing House of Electronics Industry, 2015 (in Chinese)

Guo J H, Xu N N. Evaluation and cluster analysis of universities’ transformation ability of scientific and technological achievements in China. Journal of Intelligence, 2016, 35(12): 155-168 (in Chinese)

[1]	Guo Xiangbo, Wang Jian, Huang Mengjie, Wang Minghui, Yang Jian, Yu Yongtao. Deep knowledge tracking algorithm based on forgetting law[J]. 中国邮电高校学报(英文版), 2023, 30(1): 17-27.
[2]	Wang Xianlun, Wang Guangyu, Cui Yuxia. Facial expression recognition based on improved ResNet[J]. 中国邮电高校学报(英文版), 2023, 30(1): 28-38.
[3]	Wu Hongxin, Lin Zhijian, Chen Pingping, Chen Feng. Joint partial computation offloading and resource allocation in MEC-enable networks[J]. 中国邮电高校学报(英文版), 2023, 30(1): 80-86.
[4]	Kong Chao, Ou Weihua, Gong Xiaofeng, Li Weian, Han Jie, Yao Yi, Xiong Jiahao. Face anti-spoofing based on multi-modal and multi-scale features fusion [J]. 中国邮电高校学报(英文版), 2022, 29(6): 73-82.
[5]	张函井音吉赵永利. FS-LSTM: sales forecasting in e-commerce on feature selection [J]. 中国邮电高校学报(英文版), 2022, 29(5): 92-98.
[6]	Shi Jinjing, Wang Wenxuan, Xiao Zimeng, Mu Shuai, Li Qin. Quantum classifier with parameterized quantum circuit based on the isolated quantum system[J]. 中国邮电高校学报(英文版), 2022, 29(4): 21-31.
[7]	Liu Hailing, Zhang Jie, Qin Sujuan, Gao Fei. Quantum algorithm for soft margin support vector machine with hinge loss function[J]. 中国邮电高校学报(英文版), 2022, 29(4): 32-41.
[8]	Wang Jian, Qiao Kuoyuan, Yuan Yanlei, Liu Xiaole, Yang Jian. Adaptive learning path recommendation model for examination-oriented education[J]. 中国邮电高校学报(英文版), 2022, 29(4): 77-88.
[9]	Meng Wei, Wang Liting, Lu Meng. Summary of research on recommendation system based on serendipity[J]. 中国邮电高校学报(英文版), 2022, 29(4): 89-105.
[10]	Jia Wei, Gong Chao. Precise and efficient Chinese license plate recognition in the real monitoring scene of intelligent transportation system[J]. 中国邮电高校学报(英文版), 2022, 29(3): 1-14.
[11]	Song Yue, Wu Chengmao, Tian Xiaoping, Song Qiuyu. Enhanced kernel-based fuzzy local information clustering integrating neighborhood membership [J]. 中国邮电高校学报(英文版), 2021, 28(6): 65-81.
[12]	Xue Chenzi, Wei Yifei, Zhang Yong. Performance optimization for smart grid blockchain integrated with fog computing using DDQN[J]. 中国邮电高校学报(英文版), 2021, 28(2): 68-78.
[13]	Guo Hairu, Meng Xueyao, Liu Yongli, Liu Shen. Improved HHO algorithm based on good point set and nonlinear convergence formula[J]. 中国邮电高校学报(英文版), 2021, 28(2): 48-67.
[14]	吴成茂曹卓. Entropy-like distance driven fuzzy clustering with local information constraints for image segmentation [J]. 中国邮电高校学报(英文版), 2021, 28(1): 24-40.
[15]	山蕊蒋林邓军勇崔朋飞张玉婷吴皓月谢晓燕. Parallel design of convolutional neural networks for remote sensing images object recognition based on data-driven array processor [J]. 中国邮电高校学报(英文版), 2020, 27(6): 87-100.

Research on emotion space of film and television scene images based on subjective perception

Research on emotion space of film and television scene images based on subjective perception

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价