Acta Metallurgica Sinica(English letters) ›› 2013, Vol. 20 ›› Issue (4): 59-66.doi: 10.1016/S1005-8885(13)60070-9

• Networks • 上一篇    下一篇

Analysis of prediction performance in wavelet minimum complexity echo state network

冯辰,崔鸿雁,刘韵洁   

  1. 1. Key Laboratory of Network System Architecture and Convergence, Beijing University of Posts and Telecommunications, Beijing 100876, China 2. School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
  • 收稿日期:2012-05-07 修回日期:2012-09-14 出版日期:2013-08-31 发布日期:2013-08-30
  • 通讯作者: 崔鸿雁 E-mail:cuihy@bupt.edu.cn
  • 基金资助:
    This work was supported by the National Natural Science Foundation of China (61201153), the National Basic Research Program of China (2012CB315805), and the National Key Science and Technology Projects (2010ZX03004-002-02).

Analysis of prediction performance in wavelet minimum complexity echo state network

  1. 1. Key Laboratory of Network System Architecture and Convergence, Beijing University of Posts and Telecommunications, Beijing 100876, China 2. School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
  • Received:2012-05-07 Revised:2012-09-14 Online:2013-08-31 Published:2013-08-30
  • Contact: Cui Hongyan E-mail:cuihy@bupt.edu.cn
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61201153), the National Basic Research Program of China (2012CB315805), and the National Key Science and Technology Projects (2010ZX03004-002-02).

摘要: Echo state network (ESN) has become one of the most popular recurrent neural networks (RNN) for its good prediction performance of non-linear time series and simple training process. But several problems still prevent ESN from becoming a widely used tool. The most prominent problem is its high complexity with lots of random parameters. Aiming at this problem, a minimum complexity ESN model (MCESN) was proposed. In this paper, we proposed a new wavelet minimum complexity ESN model (WMCESN) to improve the prediction accuracy and increase the practical applicability. Our new model inherits the characters of minimum complexity ESN model using the fixed parameters and simple circle topology. We injected wavelet neurons to replace the original neurons in internal reservoir and designed a wavelet parameter matrix to reduce the computing time. By using different datasets, our new model performed better than the minimum complexity ESN model with normal neurons, but only utilized tiny time cost. We also used our own packets of transmission control protocol (TCP) and user datagram protocol (UDP) dataset to prove that our model can deal with the data packet bit prediction problem well.

关键词: wavelet minimum complexity echo state network, echo state network, wavelet parameter matrix, practical applicability

Abstract: Echo state network (ESN) has become one of the most popular recurrent neural networks (RNN) for its good prediction performance of non-linear time series and simple training process. But several problems still prevent ESN from becoming a widely used tool. The most prominent problem is its high complexity with lots of random parameters. Aiming at this problem, a minimum complexity ESN model (MCESN) was proposed. In this paper, we proposed a new wavelet minimum complexity ESN model (WMCESN) to improve the prediction accuracy and increase the practical applicability. Our new model inherits the characters of minimum complexity ESN model using the fixed parameters and simple circle topology. We injected wavelet neurons to replace the original neurons in internal reservoir and designed a wavelet parameter matrix to reduce the computing time. By using different datasets, our new model performed better than the minimum complexity ESN model with normal neurons, but only utilized tiny time cost. We also used our own packets of transmission control protocol (TCP) and user datagram protocol (UDP) dataset to prove that our model can deal with the data packet bit prediction problem well.

Key words: wavelet minimum complexity echo state network, echo state network, wavelet parameter matrix, practical applicability