Sequence learning, prediction, and replay in networks of spiking neurons
AI-generated Key Points
⚠The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.
- Neocortex performs universal computations through sequence learning, prediction, and replay
- Hierarchical Temporal Memory (HTM) algorithm embodies these processes
- HTM algorithm relies on abstract discrete-time neuron and synapse dynamics
- Authors propose a continuous-time implementation of the temporal-memory (TM) component of HTM using spiking neurons with biophysically interpretable variables and parameters
- Proposed model learns high-order sequences using structural Hebbian synaptic plasticity mechanism and rate-based homeostatic control
- Model enables dynamic self-organization of narrow sequence-specific subnetworks
- Subnetworks facilitate propagation of sparse, synchronous activity for robust predictions and autonomous replay of learned sequences
- Continuous-time implementation strengthens link to biology and allows for better evaluation through electrophysiological and behavioral data analysis
- Advancement in bridging computational models with biological mechanisms for sequence learning and prediction in networks of spiking neurons.
Authors: Younes Bouhadjar, Dirk J. Wouters, Markus Diesmann, Tom Tetzlaff
Abstract: Sequence learning, prediction and replay have been proposed to constitute the universal computations performed by the neocortex. The Hierarchical Temporal Memory (HTM) algorithm realizes these forms of computation. It learns sequences in an unsupervised and continuous manner using local learning rules, permits a context specific prediction of future sequence elements, and generates mismatch signals in case the predictions are not met. While the HTM algorithm accounts for a number of biological features such as topographic receptive fields, nonlinear dendritic processing, and sparse connectivity, it is based on abstract discrete-time neuron and synapse dynamics, as well as on plasticity mechanisms that can only partly be related to known biological mechanisms. Here, we devise a continuous-time implementation of the temporal-memory (TM) component of the HTM algorithm, which is based on a recurrent network of spiking neurons with biophysically interpretable variables and parameters. The model learns high-order sequences by means of a structural Hebbian synaptic plasticity mechanism supplemented with a rate-based homeostatic control. In combination with nonlinear dendritic input integration and local inhibitory feedback, this type of plasticity leads to the dynamic self-organization of narrow sequence-specific subnetworks. These subnetworks provide the substrate for a faithful propagation of sparse, synchronous activity, and, thereby, for a robust, context specific prediction of future sequence elements as well as for the autonomous replay of previously learned sequences. By strengthening the link to biology, our implementation facilitates the evaluation of the TM hypothesis based on electrophysiological and behavioral data.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
⚠The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.