論文

2024年4月15日

Impact of time-history terms on reservoir dynamics and prediction accuracy in echo state networks

Scientific Reports
  • Yudai Ebato
  • ,
  • Sou Nobukawa
  • ,
  • Yusuke Sakemi
  • ,
  • Haruhiko Nishimura
  • ,
  • Takashi Kanamaru
  • ,
  • Nina Sviridova
  • ,
  • Kazuyuki Aihara

14
1
記述言語
掲載種別
研究論文(学術雑誌)
DOI
10.1038/s41598-024-59143-y
出版者・発行元
Springer Science and Business Media LLC

Abstract

The echo state network (ESN) is an excellent machine learning model for processing time-series data. This model, utilising the response of a recurrent neural network, called a reservoir, to input signals, achieves high training efficiency. Introducing time-history terms into the neuron model of the reservoir is known to improve the time-series prediction performance of ESN, yet the reasons for this improvement have not been quantitatively explained in terms of reservoir dynamics characteristics. Therefore, we hypothesised that the performance enhancement brought about by time-history terms could be explained by delay capacity, a recently proposed metric for assessing the memory performance of reservoirs. To test this hypothesis, we conducted comparative experiments using ESN models with time-history terms, namely leaky integrator ESNs (LI-ESN) and chaotic echo state networks (ChESN). The results suggest that compared with ESNs without time-history terms, the reservoir dynamics of LI-ESN and ChESN can maintain diversity and stability while possessing higher delay capacity, leading to their superior performance. Explaining ESN performance through dynamical metrics are crucial for evaluating the numerous ESN architectures recently proposed from a general perspective and for the development of more sophisticated architectures, and this study contributes to such efforts.

リンク情報
DOI
https://doi.org/10.1038/s41598-024-59143-y
URL
https://www.nature.com/articles/s41598-024-59143-y.pdf
URL
https://www.nature.com/articles/s41598-024-59143-y
ID情報
  • DOI : 10.1038/s41598-024-59143-y
  • eISSN : 2045-2322

エクスポート
BibTeX RIS