Re-visiting the echo state property

Publikation: Beitrag in FachzeitschriftForschungsartikelBeigetragenBegutachtung


  • Izzet B. Yildiz - , Max-Planck-Institut für Kognitions- und Neurowissenschaften (Autor:in)
  • Herbert Jaeger - , Jacobs University Bremen (Autor:in)
  • Stefan J. Kiebel - , Max-Planck-Institut für Kognitions- und Neurowissenschaften (Autor:in)


An echo state network (ESN) consists of a large, randomly connected neural network, the reservoir, which is driven by an input signal and projects to output units. During training, only the connections from the reservoir to these output units are learned. A key requisite for output-only training is the echo state property (ESP), which means that the effect of initial conditions should vanish as time passes. In this paper, we use analytical examples to show that a widely used criterion for the ESP, the spectral radius of the weight matrix being smaller than unity, is not sufficient to satisfy the echo state property. We obtain these examples by investigating local bifurcation properties of the standard ESNs. Moreover, we provide new sufficient conditions for the echo state property of standard sigmoid and leaky integrator ESNs. We furthermore suggest an improved technical definition of the echo state property, and discuss what practicians should (and should not) observe when they optimize their reservoirs for specific tasks.


Seiten (von - bis)1-9
FachzeitschriftNeural Networks
PublikationsstatusVeröffentlicht - Nov. 2012
Extern publiziertJa

Externe IDs

PubMed 22885243



  • Bifurcation, Diagonally Schur stable, Echo state network, Lyapunov, Spectral radius