Artificial emotion model based on reinforcement learning mechanism of neural network

doi:10.1016/S1005-8885(10)60071-4

Acta Metallurgica Sinica(English letters)

Artificial emotion model based on reinforcement learning mechanism of neural network

史雪飞¹,Zhi-liang Wang¹,An PING²

1. 北京科技大学
2.The Translation Group of the Certain Department of the Second Artillery of PLA, Beijing 100015, China

收稿日期:2010-11-03 修回日期:2011-02-18 出版日期:2011-06-30 发布日期:2011-06-13
通讯作者: Zhi-liang Wang E-mail:wangzhiliang@ies.ustb.edu.cn
基金资助:
论文得到863国家高技术发展计划（2007AA04Z218）的支持;北京市自然科学基金重点项目(KZ200810028016)的支持

Artificial emotion model based on reinforcement learning mechanism of neural network

Received:2010-11-03 Revised:2011-02-18 Online:2011-06-30 Published:2011-06-13

摘要/Abstract

摘要：

A hierarchical-processed frame construction of artificial emotion model for intelligent system is proposed in the paper according to the basic conclusion of emotional psychology. The general method of emotion processing, which considers only one single layer, has been changed in the presented construction. An artificial emotional development model is put forward based on reinforcement learning mechanism of neural network. The new model takes the emotion itself as reinforcement signal and describes its different influences on action learning efficiency corresponding to different individualities. In the end, simulation result based on child playmate robot is discussed and the effectiveness of the model is verified.

关键词:

artificial emotion model, reinforcement learning, hierarchical structure, neural network

Abstract:

Key words:

artificial emotion model, reinforcement learning, hierarchical structure, neural network

参考文献

1. Mitchell W M. Complexity: the emerging science at the edge of order and chaos. New York, NY, USA: Simon & Schuster, 1992

2. Marpaung A H, Lisetti C L. Multilevel emotion modeling for autonomous agents. Proceedings of the Fall Symposium on the Intersection of Cognitive Science and Robotics: From Interfaces to Intelligence (AAAI FSS’04), Oct 22-24, 2004, Washington, DC, USA. Menlo Park, CA, USA: American Association for Artificial Intelligence, 2004

3. Zhou W D, Coggins R. Computational models of the amygdala and the orbitofrontal cortex: a hierarchical reinforcement learning system for robotic control. Advances in Artificial Intelligence. Proceedings of the 15th Australian Joint Conference on Artificial Intelligence (AI’02), Dec 2-6, 2002, Canberra, Australia. LNCS 2557. Berlin, Germany: Springer-Verlag, 2002: 419-430

4. Ortony A, Clore G L, Collins A. The cognitive structure of emotions. New York, NY, USA: Cambridge University Press, 1988: 68

5. Sloman A. Varieties of affect and the CogAff architecture schema. Proceedings of the AISB’01 Symposium on Emotion, Cognition, and Affective Computing, Mar 21-24, 2001, York, UK. Lonton, UK: AISB Press, 2001: 39-48

6. Picard R W. Affective computing. Cambridge, MA, USA: MIT Press, 1997

7. Arkin R C, Fujita M, Takagi T, et al. Ethological modeling and architecture for an entertainment robot. Proceedings of the 2001 IEEE International Conference on Robotics and Automation (ICRA’01): Vol 1, May 21-26, 2001, Seoul, Korea. Piscataway, NJ, USA: IEEE, 2001: 454-458

8. Park G Y, Lee S I, Kwon W Y, et al. Neurocognitive affective system for an emotive robot. Proceedings of the 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’06), Oct 9-15, 2006, Beijing, China. Piscataway, NJ, USA: IEEE, 2006: 2595-2600

9. Zhong D L, Yong X, Cao C G. Research on emotion and action about generation of intelligent story. Information Technology Letter, 2006, 4(5): 16-25 (in Chinese)

10. Yang H W, Pan Z G, Liu G D. A comprehensive computational model of emotions. Journal of Computer Research and Development, 2008, 45 (4): 579-587 (in Chinese)

11. Liu Z. A personality based emotion model for intelligent virtual agents. Proceedings of the 4th International Conference on Natural Computation (ICNC’08), Oct 18-20, 2008, Jinan, China. Los Alamitos, CA, USA: IEEE Computer Society, 2008: 13-16

12. Malfaz M, Salichs M A. Learning behaviour-selection algorithms for autonomous social agents living in a role-playing game. Proceedings of the International Conference on Adaptation in Artificial and Biological Systems (AISB’06), Apr 3-6, 2006, Bristol, UK. 2006

13. Meng Z L. The psychology of emotion. Beijing, China: Peking University Press, 2005 (in Chinese)

Artificial emotion model based on reinforcement learning mechanism of neural network

Artificial emotion model based on reinforcement learning mechanism of neural network

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

编辑推荐

Metrics

本文评价