Home | About | Journals | Submit | Contact Us | Français |

**|**Scientific Reports**|**PMC3286854

Formats

Article sections

Authors

Related links

Sci Rep. 2012; 2: 287.

Published online 2012 February 27. doi: 10.1038/srep00287

PMCID: PMC3286854

Y. Paquot,^{1} F. Duport,^{1} A. Smerieri,^{1} J. Dambre,^{2} B. Schrauwen,^{2} M. Haelterman,^{1} and S. Massar^{a,}^{3}

Received 2011 October 19; Accepted 2012 February 13.

Copyright © 2012, Macmillan Publishers Limited. All rights reserved

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareALike 3.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-sa/3.0/

This article has been cited by other articles in PMC.

Reservoir computing is a recently introduced, highly efficient bio-inspired approach for processing time dependent data. The basic scheme of reservoir computing consists of a non linear recurrent dynamical system coupled to a single input layer and a single output layer. Within these constraints many implementations are possible. Here we report an optoelectronic implementation of reservoir computing based on a recently proposed architecture consisting of a single non linear node and a delay line. Our implementation is sufficiently fast for real time information processing. We illustrate its performance on tasks of practical importance such as nonlinear channel equalization and speech recognition, and obtain results comparable to state of the art digital implementations.

The remarkable speed and multiplexing capability of optics makes it very attractive for information processing. These features have enabled the telecommunications revolution of the past decades. However, so far they have not been exploited insomuch as computation is concerned. The reason is that optical nonlinearities are very difficult to harness: it remains challenging to just demonstrate optical logic gates, let alone compete with digital electronics^{1}. This suggests that a much more flexible approach is called for, which would exploit as much as possible the strengths of optics without trying to mimic digital electronics. Reservoir computing^{2}^{,3}^{,4}^{,5}^{,6}^{,7}^{,8}^{,9}^{,10}, a recently introduced, bio-inspired approach to artificial intelligence, may provide such an opportunity.

Here we report the first experimental reservoir computer based on an opto-electronic architecture. As nonlinear element we exploit the sine nonlinearity of an integrated Mach-Zehnder intensity modulator (a well known, off-the-shelf component in the telecommunications industry), and to store the internal states of the reservoir computer we use a fiber optics spool. We report results comparable to state of the art digital implementations for two tasks of practical importance: nonlinear channel equalization and speech recognition.

Reservoir computing, which is at the heart of the present work, is a highly successful method for processing time dependent information. It provides state of the art performance for tasks such as time series prediction^{4} (and notably won a financial time series prediction competition^{11}), nonlinear channel equalization^{4}, or speech recognition^{12}^{,13}^{,14}. For some of these tasks reservoir computing is in fact the most powerful approach known at present.

The central part of a reservoir computer is a nonlinear recurrent dynamical system that is driven by one or multiple input signals. The key insight behind reservoir computing is that the reservoir's response to the input signal, i.e., the way the internal variables depend on present and past inputs, is a form of computation. Experience shows that in many cases the computation carried out by reservoirs, even randomly chosen ones, can be extremely powerful. The reservoir should have a large number of internal (state) variables. The exact structure of the reservoir is not essential: for instance, in some works the reservoir closely mimics the interconnections and dynamics of biological neurons in a brain^{6}, but many other architectures are possible.

To achieve useful computation on time dependent input signals, a good reservoir should be able to compute a large number of different functions of its inputs. That is, the reservoir should be sufficiently high-dimensional, and its responses should not only depend on present inputs but also on inputs up to some finite time in the past. To achieve this, the reservoir should have some degree of nonlinearity in its dynamics, and a “fading memory”, meaning that it will gradually forget previous inputs as new inputs come in.

Reservoir computing is a versatile and flexible concept. This follows from two key points: 1) many of the details of the nonlinear reservoir itself are unimportant except for the dynamic regime which can be tuned by some global parameters; and 2) the only part of the system that is trained is a linear output layer. Because of this flexibility, reservoir computing is amenable to a large number of experimental implementations. Thus proof of principle demonstrations have been realized in a bucket of water^{15} and using an analog VLSI chip^{16}, and arrays of semiconductor amplifiers have been considered in simulation^{17}. However, it is only very recently that an analog implementation with performance comparable to digital implementations has been reported: namely, the electronic implementation presented in^{18}.

Our experiment is based on a similar architecture as that of^{18}, namely a single non linear node and a delay line. The main differences are the type of non linearity and the desynchronisation of the input with respect to the period of the delay line. These differences highlight the flexibility of the concept. The performance of our experiment on two benchmark tasks, isolated digit recognition and non linear channel equalization, is comparable to state of the art digital implementations of reservoir computing. Compared to^{18}, our experiment is almost 6 orders of magnitude faster, and a further 2–3 orders of magnitude speed increase should be possible with only small changes to the system.

The flexibility of reservoir computing and its success on hard classification tasks makes it a promising route for realizing computation in physical systems other than digital electronics. In particular it may provide innovative solutions for ultra fast or ultra low power computation. In the Supplementary Material we describe reservoir computing in more detail and provide a road map for building high performance analog reservoir computers.

Before introducing our implementation, we recall a few key features of reservoir computing; for a more detailed treatment of the underlying theory, we refer the reader to Supplementary Material.

As is traditional in the literature, we will consider tasks that are defined in discrete time, e.g., using sampled signals. We denote by *u*(*n*) the input signal, where is the discretized time; by the internal states of the system used as reservoir; and by the output of the reservoir. A typical evolution law for is , where *f* is a nonlinear function, **A** is the time independent connection matrix and is the time independent input mask. Note that in our work we will use a slightly different form for the evolution law, as explained below.

In order to perform the computation one needs a readout mechanism. To this end we define a subset *x _{i}*(

over a set of examples (the training set). Because the MSE is a quadratic function of the *W _{i}* the optimal weights can be easily computed from the knowledge of

In the present work we use an architecture related to that used in^{18} and to the minimum complexity networks studied in^{19}. As in^{18}, the reservoir is based on a non-linear system with delayed feedback (a class of systems widely studied in the nonlinear dynamics community, see e.g.^{20}) and consists of a single nonlinear node and a delay loop. The information about the previous internal state of the reservoir up to some time *T* in the past is stored in the delay loop. After a period *T* of the loop, the entire internal state has been updated (processed) by the nonlinear node. In contrast to the work described in^{18}, the nonlinear node in our implementation is essentially instantaneous. Hence, in the absence of input, the dynamics of our system can be approximated by the simple recursion

where *α* (the *feedback gain*) and *ϕ* (the *bias*) are adjustable parameters and we have explicitly written the sine nonlinearity used in our implementation.

We will use this system to perform useful computation on input signals *u*(*n*) evolving in discrete time . As the system itself operates in continuous time, we need to define ways to convert input signal(s) to continuous time and to convert the system's state back to discrete time. The first is achieved by using a sample and hold procedure. We obtain a piecewise constant function *u*(*t*) of the continuous variable *t* : *u*(*t*) = *u*(*n*), *nT′* ≤ *t* < (*n* + 1)*T′*. The time *T′* ≤ *T* is taken to be less than or equal to the period *T* of the delay loop; when *T′* ≠ *T* we are in the unsynchronised regime (see below). To discretize the system's state, we note that the delay line acts as a memory, storing the delayed states of the nonlinearity. From this large-dimensional state space, we take *N* samples by dividing the input period *T′* into *N* segments, each of duration *θ* and sampling the state of the delay line at a single point with periodicity *θ*. This provides us with *N snapshots* of the nonlinearity's response to each input sample *u*(*n*). From these snapshots, we construct *N* discrete-time sequences *x _{i}*(

Without further measures, all such recorded reservoir states would be identical, so for computational purposes our system is one-dimensional. In order to use this system as a reservoir computer, we need to drive it in such a way that the *x _{i}*(

The input mask *m*(*t*) = *m*(*t* + *T′*) is a periodic function of period *T′*. It is piecewise constant over intervals of length *θ*, i.e., *m*(*t*) = *m _{j}* when

It follows that the reservoir states can be approximated by

when *T′* = *T* (the synchronized regime); or more generally as

when , (*k* {1, …, *N* − 1}) (the unsynchronized regime). In the synchronized regime, the reservoir states correspond to the responses of *N* uncoupled discrete-time dynamical systems which are similar, but slightly different through the randomly chosen *m _{j}*. In the unsynchronized regime, with a desynchronization

In summary, by using an input mask, combined with desynchronization of the input and the feedback delay, we have turned a system with a one-dimensional information representation into an N-dimensional system.

The above architecture is implemented in the experiment depicted in Fig. 1. The sine nonlinearity is implemented by a voltage driven intensity modulator (Lithium Niobate Mach Zehnder interferometer), placed at the output of a continuous light source, and the delay loop is a fiber spool. A photodiode converts the light intensity *I*(*t*) at the output of the fiber spool into a voltage; this is mixed with an input voltage generated by a function generator and proportional to *m*(*t*)*u*(*t*), amplified, and then used to drive the intensity modulator. The feedback gain *α* is set by adjusting the average intensity *I*_{0} of the light inside the fiber loop with an optical attenuator. By changing *α* we can bring the system to the dynamical regime required. The nonlinear dynamics of this system have already been extensively studied, see^{21}^{,22}^{,23}. The dynamical variable *x*(*t*) is obtained by rescaling the light intensity to lie in the interval [−1, +1] through *x*(*t*) = 2*I*(*t*)/*I*_{0} − 1. Then, neglecting the effect of the bandpass filter induced by the electronic amplifiers, the dynamics of the system is given by eq. (3) where *α* is proportional to *I*_{0}. Equation (3), as well as the discretized versions thereof, eqs. (4) and (5), are derived in the supplementary material; the various stages of processing of the reservoir nodes and inputs are shown in Fig. 2.

In our experiment the round trip time is *T* = 8.504 µs and we typically use *N* = 50 internal nodes. The parameters *α* and *β* in eq. (3) are adjusted for optimal performance (their optimal value may depend on the task, see methods and supplementary material for details), while *ϕ* is set to 0, which seems to be the optimal value in all our experiments. The intensity *I*(*t*) is recorded by a digitizer, and the estimator is reconstructed offline on a computer.

We illustrate the operations of our reservoir computer in Fig. 3 where we consider a very simple signal recognition task. Here, the input to the system is taken to be a random concatenation of sine and square waves; the target function *y*(*n*) is 0 for a sine wave and 1 for a square wave. The top panel of Fig. 3 shows the input to the reservoir: the blue line is the representation of the input in continuous time *u*(*t*). In the bottom panel, the output of the network after training is shown with red crosses, against the desired output represented by a blue line. The performance on this task is essentially perfect: the Normalized Mean Square Error reaches , which is significantly better than the results reported using simulations in^{17}. (Note that, although reservoirs are usually trained using linear regression, i.e., minimizing the MSE, they are often evaluated using other error metrics. In order to be able to compare with previously reported results, we have adopted the most commonly used error metric for each task).

We have checked the performance of this system extensively in simulations. First of all, if we neglect the effects of the bandpass filters, and neglect all noise introduced in our experiment, we obtain a discretized system described by eq. (5) which is similar to (but nevertheless distinct from) the minimum complexity reservoirs introduced in^{19}. We have checked that this discretized version of our system has performance similar to usual reservoirs on several tasks. This shows that the chosen architecture is capable of state of the art reservoir computing, and sets for our experimental system a performance goal. Secondly we have also developed a simulation code that takes into account all the noises of the experimental components, as well as the effects of the bandpass filters. These simulations are in very good agreement with the experimentally measured dynamics of the system. They allow us to efficiently explore the experimental parameter space, and to validate the experimental results. Further details on these two simulation models are given in the supplementary information.

We apply our optoelectronic reservoir to three tasks. These tasks are benchmarks which have been widely used in the reservoir computing community to evaluate the performance of reservoirs. They therefore allow comparison between our experiment and state of the art digital implementations of reservoir computing.

For the first task, we train our reservoir computer to behave like a Nonlinear Auto Regressive Moving Average equation of order 10, driven by white noise (NARMA10). More precisely, given the white noise *u*(*n*), the reservoir should produce an output which should be as close as possible to the response *y*(*n*) of the NARMA10 model to the same white noise. The task is described in detail in the methods section. The performance is measured by the Normalized Mean Square Error (NMSE) between output and target *y*(*n*). For a network of 50 nodes, both in simulations and experiment, we obtain a *NMSE* = 0.168 ± 0.015. This is similar to the value obtained using digital reservoirs of the same size. For instance a NMSE value of 0.15 ± 0.01 is reported in^{24} also for a reservoir of size 50.

For our second task we consider a problem of practical relevance: the equalization of a nonlinear channel. We consider a model of a wireless communication channel in which the input signal *d*(*n*) travels through multiple paths to a nonlinear and noisy receiver. The task is to reconstruct the input *d*(*n*) from the output *u*(*n*) of the receiver. The model we use was introduced in^{25} and studied in the context of reservoir computing in^{4}. Our results, given in Fig. 4, are one order of magnitude better than those obtained in^{25} with a nonlinear adaptive filter, and comparable to those obtained in^{4} with a digital reservoir. At 28 dB of signal to noise ratio, for example, we obtain an error rate of 1.3 · 10^{−4}, while the best error rate obtained in^{25} is 4 · 10^{−3} and in^{4} error rates between 10^{−4} and 10^{−5} are reported.

Finally we apply our reservoir to isolated spoken digits recognition using a benchmark task introduced in the reservoir computing community in^{26}. The performance on this task is measured using the Word Error Rate (WER) which gives the percentage of words that are wrongly classified. Performances reported in the literature are a WER of 0.55% using a hidden Markov model^{27}; WERs of 4.3%^{26}, of 0.2%^{12}, of 1.3%^{19} for reservoir computers of different sizes and with different post processing of the output. The experimental reservoir presented in^{18} reported a WER of 0.2%. Our experiment yields a WER of 0.4%, using a reservoir of 200 nodes.

Further details on these tasks are given in the methods section and in the Supplementary Material.

We have reported the first demonstration of an opto-electronic reservoir computer. Our experiment has performance comparable to state of the art digital implementations on benchmark tasks of practical relevance such as speech recognition and channel equalization. Our work demonstrates the flexibility of reservoir computers that can be readily reprogrammed for different tasks. Indeed by re-optimizing the output layer (that is, choosing new readout weights *W _{k}*), and by readjusting the operating point of the reservoir (changing the feedback gain

We have introduced a new feature in the architecture, as compared to the related experiment reported in^{18}. Namely by desynchronizing the input with respect to the period of the reservoir we conserve the necessary coupling between the internal states, but make a more efficient use of the internal states as the correlations introduced by the low pass filter in^{18} are not necessary.

Our experiment is also the first implementation of reservoir computing fast enough for real time information processing. (We should point out that, after the submission of this manuscript, related results where reported in^{28}). It can be converted into a high speed reservoir computer simply by increasing the bandwidth of all the components (an increase of at least 2 orders of magnitude is possible with off-the-shelf optoelectronic components). We note that in future realizations it will be necessary to have an analog implementation of the pre-processing of the input (digitisation and multiplication by the input mask) and of the post-processing of the output (multiplication by output weights), rather than the digital pre- and post-processing used in the present work.

From the point of view of applications, the present work thus constitutes an important step towards building ultra high speed optical reservoir computers. To help achieve this goal, in the supplementary material we present guidelines for building experimental reservoir computers. Whether optical implementations can eventually compete with electronic implementations is an open question. From the fundamental point of view, the present work helps understanding what are the minimal requirements for high level analog information processing.

The optimal operating point of the experimental reservoir computer is task dependent. Specifically, if the threshold of instability (see Figure 1 in the supplementary material) is taken to correspond to 0 dB attenuation, then at the optimal operating point the attenuation varies between −0.5 and −4.2 dB. For the input gain, we set to 1 the minimum value of *β* that makes the Mach-Zehnder transmit the maximum light intensity when driven with an input equal to +1. Note that a small *β* value corresponds to a very linear regime, whereas a large *β* corresponds to a very non linear regime. At the optimal operating point, the multiplicative factor *β* for different tasks ranges from *β* = 0.55 to *β* = 10.5. For all tasks except the signal classification task the bias phase *ϕ* was set to zero. We did not try to optimize the bias phase *ϕ*. Details of the optimal operating points for each task are given in the supplementary material.

Auto Regressive models and Moving Average models, and their generalization Nonlinear Auto Regressive Moving Average Models (NARMA), are widely used to simulate time series. The NARMA10 model is given by the recurrence

where *u*(*n*) is a sequence of random inputs drawn from an uniform distribution over the interval [0, 0.5]. The aim is to predict the *y*(*n*) knowing the *u*(*n*). This task was introduced in^{29}. It has been widely used as a benchmark in the reservoir computing community, see for instance^{19}^{,24}^{,30}

This task was introduced in^{25}, and used in the reservoir computing community in^{4} and^{24}. The input to the channel is an i.i.d. random sequence *d*(*n*) with values from {−3, −1, +1, +3}. The signal first goes through a linear channel, yielding

It then goes through a noisy nonlinear channel, yielding

where *ν*(*n*) is an i.i.d. Gaussian noise with zero mean adjusted in power to yield signal-to-noise ratios ranging from 12 to 32 db. The task is, given the output *u*(*n*) of the channel, to reconstruct the input *d*(*n*). The performance on this task is measured using the Symbol Error Rate, that is the fraction of inputs *d*(*n*) that are misclassified (Ref.^{24} used another error metric on this task).

The data for this task is taken from the NIST TI-46 corpus^{31}. It consists of ten spoken digits (0…9), each one recorded ten times by five different female speakers. These 500 spoken words are sampled at 12.5 kHz. This spoken digit recording is preprocessed using the Lyon cochlear ear model^{32}. The input to the reservoir *u _{j}*(

Using a standard cross-validation procedure, the 500 spoken words are divided in five subsets. We trained the reservoir on four of the subsets, and then tested it on the fifth one. This is repeated five times, each time using a different subset as test, and the average performance is computed. The performance is given in terms of the Word Error Rate, that is the fraction of digits that are misclassified. We obtain a WER of 0.4% (which correspond to 2 errors in 500 recognized digits).

Y.P., J.D., B.S., M.H. and S.M. conceived the experiment. Y.P., F.D and A.S. performed the experiment and the numerical simulations, supervised by S.M. and M.H.. All authors contributed to the discussion of the results and to the writing of the manuscript.

Optoelectronic Reservoir Computing: Supplementary Material

Click here to view.^{(611K, pdf)}

We would like to thank J. Van Campenhout and I. Fischer for helpful discussions which initiated this research project. All authors would like to thank the researchers of the researchers of the Photonics@be network working on reservoir computing for numerous discussions over the duration of this project. The authors acknowledge financial support by Interuniversity Attraction Poles Program (Belgian Science Policy) project Photonics@be IAP6/10 and by the Fonds de la Recherche Scientifique FRS-FNRS.

- Caulfield H. J. & Dolev S. Why future supercomputing requires optics. Nature Photon. 4 261–263 (2010).
- Jaeger H. The “echo state” approach to analysing and training recurrent neural networks. Technical Report GMD Report 148, German National Research Center for Information Technology (2001).
- Jaeger H. Short term memory in echo state networks. Technical Report GMD Report 152, German National Research Center for Information Technology (2001).
- Jaeger H. & Haas H. Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304, 78–80 (2004). [PubMed]
- Legenstein R. & Maass W. New Directions in Statistical Signal Processing: From Systems to Brain, chapter What makes a dynamical system computationally powerful? pages 127–154. MIT Press (2005).
- Maass W., Natschlager T. & Markram H. Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Comput. 14, 2531–2560 (2002). [PubMed]
- Steil J. J. Backpropagation-decorrelation: online recurrent learning with O(N) complexity. 2004 IEEE International Joint Conference on Neural Networks 843–848 (2004)
- Verstraeten D., Schrauwen B., D'Haene M. & Stroobandt D. An experimental unification of reservoir computing methods. Neural Netw. 20, 391–403 (2007). [PubMed]
- Lukoševičius M. & Jaeger H. Reservoir computing approaches to recurrent neural network training. Computer Science Review 3, 127–149 (2009).
- Hammer B., Schrauwen B. & Steil J. J. Recent advances in efficient learning of recurrent networks. In: Proceedings of the European Symposium on Artificial Neural Networks pages 213–216 (2009).
- http://www.neural-forecasting-competition.com/NN3/index.htm.
- Verstraeten D., Schrauwen B. & Stroobandt D. Reservoir-based techniques for speech recognition. In: The 2006 IEEE International Joint Conference on Neural Network Proceedings 1050–1053 (2006).
- Triefenbach F., Jalalvand A., Schrauwen B. & Martens J. Phoneme recognition with large hierarchical reservoirs. Advances in Neural Information Processing Systems 23, 1–9 (2010).
- Jaeger H., Lukosevicius M., Popovici D. & Siewert U. Optimization and applications of echo state networks with leaky-integrator neurons. Neural Netw. 20, 335–52 (2007). [PubMed]
- Fernando C. & Sojakka S.
Pattern recognition in a bucket. In Banzhaf, W., Ziegler, J., Christaller, T., Dittrich, P. and Kim, J., editors, Advances in Artificial Life, volume 2801 of
*Lecture Notes in Computer Science*588–597. Springer Berlin / Heidelberg (2003). - Schürmann F., Meier K. & Schemmel J. Edge of chaos computation in mixed-mode vlsi - a hard liquid. In: Advances in Neural Information Processing Systems. MIT Press (2005).
- Vandoorne K.
*et al.*Toward optical signal processing using photonic reservoir computing. Opt. Express 16, 11182–92 (2008). [PubMed] - Appeltant L.
*et al.*Information processing using a single dynamical node as complex system. Nat. Commun. 2, 468 (2011). [PMC free article] [PubMed] - Rodan A. & Tino P. Minimum complexity echo state network. IEEE T. Neural Netw. 22, 131–44 (2011). [PubMed]
- Erneux T. Applied Delay Differential Equations. (Springer Science + Business Media, 2009).
- Larger T., Lacourt P. A., Poinsot S. & Hanna M. From flow to map in an experimental high-dimensional electro-optic nonlinear delay oscillator. Phys. Rev. Lett. 95, 1–4 (2005). [PubMed]
- Chembo Y. K., Colet P., Larger L. & Gastaud N. Chaotic Breathers in Delayed Electro-Optical Systems. Phys. Rev. Lett. 95, 2–5 (2005). [PubMed]
- Peil M., Jacquot M., Chembo Y. K., Larger L. & Erneux T. Routes to chaos and multiple time scale dynamics in broadband bandpass nonlinear delay electro-optic oscillators. Phys. Rev. E 79, 1–15 (2009). [PubMed]
- Rodan A. & Tino P. Simple deterministically constructed recurrent neural networks. Intelligent Data Engineering and Automated Learning - IDEAL 2010, 267–274 (2010).
- Mathews V. J. & Lee J. Adaptive algorithms for bilinear filtering. Proceedings of SPIE 2296, 317–327 (1994).
- Verstraeten D., Schrauwen B. & Stroobandt D. Isolated word recognition using a liquid state machine. In: Proceedings of the 13th European Symposium on Artificial Neural Networks (ESANN) 435–440 (2005).
- Walker W.
*et al.*Sphinx-4: a flexible open source framework for speech recognition. Technical report, Mountain View, CA, USA. (2004). - Larger T.
*et al.*Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing. Opt. Express 20, 3241–49 (2012). [PubMed] - Atiya A. F. & Parlos A. G. New results on recurrent network training: unifying the algorithms and accelerating convergence. IEEE T. Neural Netw. 11, 697–709 (2000). [PubMed]
- Jaeger H. Adaptive nonlinear system identification with echo state networks. In: Advances in Neural Information Processing Systems 8, 593–600. MIT Press (2002).
- Texas Instruments-Developed 46-Word Speaker-Dependent Isolated Word Corpus (TI46), September 1991, NIST Speech Disc 7-1.1 (1 disc) (1991).
- Lyon R. A computational model of filtering, detection, and compression in the cochlea. In: ICASSP '82. IEEE International Conference on Acoustics, Speech, and Signal Processing pages 1282–1285. IEEE (1982).

Articles from Scientific Reports are provided here courtesy of **Nature Publishing Group**

PubMed Central Canada is a service of the Canadian Institutes of Health Research (CIHR) working in partnership with the National Research Council's national science library in cooperation with the National Center for Biotechnology Information at the U.S. National Library of Medicine(NCBI/NLM). It includes content provided to the PubMed Central International archive by participating publishers. |