Acta Metallurgica Sinica(English letters) ›› 2012, Vol. 19 ›› Issue (1): 87-93.doi: 10.1016/S1005-8885(11)60232-X

• Networks • 上一篇    下一篇

Performance evaluation of new echo state networks based on complex network

刘翔,崔鸿雁,周天君,陈建亚   

  1. 北京邮电大学
  • 收稿日期:2011-05-12 修回日期:2011-09-30 出版日期:2012-02-28 发布日期:2012-02-21
  • 通讯作者: 刘翔 E-mail: sjzrilx@126.com
  • 基金资助:

    This work was supported by the Fundamental Research Funds for the Central Universities (2009RC0124), the National Basic Research Program of China (2012CB315805), and the National Key Science and Technology Projects (2010ZX03004-002).

Performance evaluation of new echo state networks based on complex network

  1. Key Laboratory of Network System Architecture and Convergence, Beijing University of Posts and Telecommunications, Beijing 100876, China
  • Received:2011-05-12 Revised:2011-09-30 Online:2012-02-28 Published:2012-02-21
  • Contact: LIU Xiang E-mail: sjzrilx@126.com
  • Supported by:

    This work was supported by the Fundamental Research Funds for the Central Universities (2009RC0124), the National Basic Research Program of China (2012CB315805), and the National Key Science and Technology Projects (2010ZX03004-002).

摘要:

Recently, echo state networks (ESN) have aroused a lot of interest in their nonlinear dynamic system modeling capabilities. In a classical ESN, its dynamic reservoir (DR) has a sparse and random topology, but the performance of ESN with its DR taking another kind of topology is still unknown. So based on complex network theory, three new ESNs are proposed and investigated in this paper. The small-world topology, scale-free topology and the mixed topology of small-world effect and scale-free feature are considered in these new ESNs. We studied the relationship between DR architecture and prediction capability. In our simulation experiments, we used two widely used time series to test the prediction performance among the new ESNs and classical ESN, and used the independent identically distributed (i.i.d) time series to analyze the short-term memory (STM) capability. We answer the following questions: What are the differences of these ESNs in the prediction performance? Can the spectral radius of the internal weights matrix be wider? What is the short-term memory capability? The experimental results show that the proposed new ESNs have better prediction performance, wider spectral radius and almost the same STM capacity as classical ESN’s.

关键词:

ESN, complex network, time series prediction, short-term memory capacity

Abstract:

Recently, echo state networks (ESN) have aroused a lot of interest in their nonlinear dynamic system modeling capabilities. In a classical ESN, its dynamic reservoir (DR) has a sparse and random topology, but the performance of ESN with its DR taking another kind of topology is still unknown. So based on complex network theory, three new ESNs are proposed and investigated in this paper. The small-world topology, scale-free topology and the mixed topology of small-world effect and scale-free feature are considered in these new ESNs. We studied the relationship between DR architecture and prediction capability. In our simulation experiments, we used two widely used time series to test the prediction performance among the new ESNs and classical ESN, and used the independent identically distributed (i.i.d) time series to analyze the short-term memory (STM) capability. We answer the following questions: What are the differences of these ESNs in the prediction performance? Can the spectral radius of the internal weights matrix be wider? What is the short-term memory capability? The experimental results show that the proposed new ESNs have better prediction performance, wider spectral radius and almost the same STM capacity as classical ESN’s.

Key words:

ESN, complex network, time series prediction, short-term memory capacity

中图分类号: