Brain-inspired interpretable reservoir computing with resonant recurrent neural networks

원문 초록

Traditional artificial neural networks consist of nodes with non-oscillatory dynamics. Biological neural networks, on the other hand, consist of oscillatory components embedded in an oscillatory environment. Motivated by this feature of biological neurons, we describe a reservoir computing framework with explicit damped, oscillatory node dynamics. We express the oscillatory dynamics using two history dependent terms to connect these dynamics with existing artificial neural network approaches and apply physical and stationary constraints to reduce the number of free parameters. We then optimize and illustrate reservoir performance by classifying different brain rhythms associated with epilepsy and show that reservoir elements support classification by resonating with features of the input signals. Applying the same reservoir network to visual and auditory signal types, we show the reservoir generalizes for accurate classification with few trainable parameters. Compared to existing artificial neural network approaches, the proposed resonant reservoir network (RRN) utilizes oscillatory dynamics expressed as a straightforward extension of traditional artificial neural networks, produces interpretable features for classification, avoids computationally expensive training (e.g., backpropagation), and performs well with few parameters in different classification scenarios. We propose that RRNs may serve as efficient, biologically implemented building blocks to achieve complex goals in biological and artificial neural networks.