Library · 01-neuromodulated-architectures
Neuromodulated arch
| Title | Peer | Link |
|---|---|---|
| Neuromodulation Gated Transformer (NGT) | ◦ preprint | arxiv.org/abs/2305.03232 |
| Backpropamine: training self-modifying NNs with differentiable neuromodulated plasticity | ✓ peer | arxiv.org/abs/2002.10585 |
| Context Meta-Reinforcement Learning via Neuromodulation | ◦ preprint | arxiv.org/abs/2111.00134 |
| Metalearning and neuromodulation | ✓ peer | doi.org/10.1016/S0893-6080(02)00044-8 |
| Introducing Neuromodulation in Deep Neural Networks to Learn Adaptive Behaviours | ◦ preprint | arxiv.org/abs/1812.09113 |
| Synchrony-Gated Plasticity with Dopamine Modulation for SNNs | ◦ preprint | arxiv.org/abs/2512.07194 |
| Neuromodulatory Control Networks (NCNs): A Biologically Inspired Architecture for Dynamic LLM Processing | github.com/Mmorgan-ML/Neuromodulatory-Contr… | |
| Informing deep neural networks by multiscale principles of neuromodulatory systems | ✓ peer | doi.org/10.1016/j.tins.2021.12.008 |
| Gated Attention for LLMs (systematic study of attention gating) | ◦ preprint | arxiv.org/abs/2505.06708 |
| Mixture-of-Depths: dynamically allocating compute | ◦ preprint | arxiv.org/abs/2404.02258 |
| Gated attention neural networks (granted patents) | image-ppubs.uspto.gov/dirsearch-public/prin… | |
| Neuromodulation-Inspired Gated Associative Memory | ◦ preprint | arxiv.org/html/2512.13859v1 |
| Lifelong Reinforcement Learning via Neuromodulation | ◦ preprint | arxiv.org/pdf/2408.08446 |
| A Miniature Brain Transformer: Thalamic Gating, Hippocampal/Amygdaloid/Prefrontal Modules | ◦ preprint | arxiv.org/html/2603.07217v1 |
| Memory-Augmented Transformers: A Systematic Review from Neuroscience Principles to Technical Solutions | ◦ preprint | arxiv.org/html/2508.10824v1 |
| Stabilizing Transformer Training by Preventing Attention Entropy Collapse (σReparam) | ◦ preprint | arxiv.org/abs/2303.06296 |
| The Arousal-Regulated Filter (ARF): modulating feedforward vs recurrent dynamics | ◦ preprint | biorxiv.org/content/10.1101/2025.03.31.646280 |
| Noradrenergic-inspired gain modulation attenuates the stability gap | ◦ preprint | arxiv.org/abs/2507.14056 |
| Homeostatic Coupling for Prosocial Behavior | ◦ preprint | arxiv.org/abs/2506.12894 |
| Structured flexibility in recurrent neural networks via neuromodulation | pmc.ncbi.nlm.nih.gov/articles/PMC12588093/ | |
| Biologically grounded neocortex primitives (sWTA) improve Vision Transformer | ✓ peer | pnas.org/doi/10.1073/pnas.2504164122 |
| Neural mechanisms of relational learning & fast knowledge reassembly in plastic NNs | — | |
| Cell-type-specific neuromodulation guides synaptic credit assignment in an SNN | — | |
| Forgetting Transformer: Softmax Attention with a Forget Gate | ◦ preprint | arxiv.org/abs/2503.02130 |
| Neuromodulation-inspired gated associative memory networks | ◦ preprint | arxiv.org/abs/2512.13859 |
| Enabling Robust In-Context Memory & Rapid Task Adaptation with Hebbian + Gradient-Based Plasticity | ◦ preprint | arxiv.org/abs/2510.21908 |
| Multi-neuromodulatory dynamics for adaptive & continual learning (DA/ACh/5-HT/NA) | ◦ preprint | arxiv.org/abs/2501.06762 |
| A Miniature Brain Transformer (thalamic gating, PFC working memory, amygdaloid salience) | ◦ preprint | arxiv.org/abs/2603.07217 |
| Contextual Gating within the Transformer Stack | ◦ preprint | arxiv.org/abs/2512.02053 |
| Neuromodulation of neuronal circuits: back to the future | ✓ peer | doi.org/10.1016/j.neuron.2012.09.010 |
| Twenty-five lessons from computational neuromodulation | ✓ peer | doi.org/10.1016/j.neuron.2012.09.027 |
| Structured flexibility in recurrent neural networks via neuromodulation | ◦ preprint | doi.org/10.1101/2024.07.26.605315 |