Probabilistic Neural Circuits leveraging AI-Enhanced Codesign for Random Number Generation.
Abstract not provided.
Cardwell, Suma↗
SEARCH · Engineering Papers
Results for “neural circuits”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Expansion microscopy reveals neural circuit organization in genetic animal models
Not provided.
Neurosciences & Neurology↗
Probabilistic Neural Circuits leveraging AI-Enhanced Codesign for Random Number Generation.
Abstract not provided.
Cardwell, Suma↗
Whole nervous system expression of glutamate receptors reveals distinct receptor roles in sensorimotor circuits
A goal of connectomics is to reveal the links between neural circuits and behavior. Larvae of the primitive chordateCionaare well-suited to make contributions in this area. In addition to having a described connectome,Cionalarvae have a range of readily-quantified behaviors. Moreover, the small number of neurons in the larval CNS (∼180) holds the promise of a comprehensive characterization of individual neurons. We present single-neuron predictions for glutamate receptor (GlutR) expression based onin situhybridization. Included are both ionotropic receptors (AMPA, NMDA, and Kainate), and metabotropic receptors. The predicted glutamate receptor expression dataset is discussed in the context of known circuits driving behaviors such as phototaxis, mechanosensation, and looming shadow response. The predicted expression of AMPA and NMDA receptors may help to resolve issues regarding the co-production of GABA and glutamate by a subset of photoreceptors. The targets of these photoreceptors in the midbrain appear to express NMDA receptors, but not AMPA receptors. This is in agreement with previous results indicating that GABA is the primary neurotransmitter from the photoreceptors evoking a swimming response through a disinhibition mechanism, and that glutamate may, therefore, have only a modulatory action in this circuit. Other findings reported here are more unexpected. For example, many of the targets of glutamatergic epidermal sensory neurons (ESNs) do not express any of the ionotropic receptors, yet the ESNs themselves express metabotropic receptors. Thus, we speculate that their production of glutamate may be for communication with neighboring ESNs, rather than to their interneuron targets. Significance StatementSimple invertebrates offer a tractable alternative to complex vertebrate brains, facilitating holistic understanding of brain function. One such invertebrate is the marine chordateCiona, which has the benefit of a complete synaptic wiring diagram for its swimming larva. This “connectome” allowed identification of putative neural circuits driving defined behaviors. Fuller understanding of neural circuits, however, requires a description of the attributes of individual neurons. This study focuses on the excitatory neurotransmitter glutamate, which signals via a complex set of both ionotropic and metabotropic receptors. Here, we present a nervous system-wide prediction of GlutR expression inCionaat the individual neuron level, considered in the context of neural circuits, with emphasis on how GlutR expression accounts for function of neural circuits.
Neurosciences & Neurology↗
Graph-Based Modeling for the Detection and Tracking of Sarin-Surrogate-Induced Neurotoxicity Using a Human-Relevant, In-Vitro Brain Model
Organophosphorus (OP) nerve agents are a chemical threat to the United States, to the civilian population (e.g., pesticides) and historically weaponized (e.g., sarin) as chemical warfare agents. The unprecedented, accelerated process from “bench-to-bedside” during the SARSCov2 pandemic has made it clear that technology and tools need to be readily available for immediate response. Advances in human organ tissue mimetic systems are a promising technology to evaluate the human-relevant response in vitro for basic and applied research and drug screening. In particular, current brain microphysiological systems (MPS) have the capability to monitor and detect changes in engineered human neural circuit activity. However, current data analytics approaches for these systems lack the granularity to functionally detect and distinguish the different mechanisms that occur in the brain following neurotoxicity, injury, and disease. The goal of this project was to advance the computational analytical capabilities of the brain MPS to detect functional changes in neural circuit structure at different stages of Sarin surrogate-induced neurotoxicity. We developed graph-based models to (1) identify the composition of the neural circuit structure; (2) detect and monitor how this structure changes following sarin-induced neurotoxicity; and (3) evaluate the analytical pipeline using known/promising oxime reactivators. Through experiments on the bMPS where in vitro neuronal cultures were exposed to a sarin surrogate, we demonstrated the capabilities of our computational pipeline to identify different responses in the functional networks of brain cells exposed to low and high concentrations of the nerve agent. We identified a biphasic response of human neural network activity following exposure to a sarin-surrogate that had not been reported in the literature before. The graph-based models and software developed in this project can be used for future studies that leverage the brain MPS technology, such as treatment efficacy assessment.
59 BASIC BIOLOGICAL SCIENCES↗
Organismic materials for beyond von Neumann machines
The elementary basis of intelligence in organisms with a central nervous system includes neurons and synapses and their complex interconnections forming neural circuits. In non-neural organisms such as slime mold with gel-like media, viscosity modulation enables adaptation to changing environments. At a larger scale, collective intelligence emerges via social interactions and feedback in animal colonies. Learning and memory are therefore multi-scale features that evolve as a result of constant interactions with the environment. There is growing interest in emulating such features of intelligence in computing machines and autonomous systems. Materials that can respond to their environment in a manner similar to organisms (referred to as "organismic materials") therefore may be of interest as hardware components in artificial intelligence machines. In this brief review, we present a class of semiconductors called correlated oxides as candidates for learning machines. The term "correlated" refers to the fact that electrons in such lattices strongly interact and the ground state is not what is predicted by classical band theory. Such materials can undergo insulator-metal transitions at near ambient conditions under external stimuli such as thermal or electrical fields, strain, and chemical doping. Depending on the mechanism driving the transition, intermediate states can be metastable with different volatilities, and the time scales of phase change can be controlled over many orders of magnitude. The change in electronic properties can be sharp or gradual, leading to digital or analog behavior. These properties enable the realization of artificial neurons and synapses and emulate the associative and non-associative learning characteristics found in various organisms. We examine microscopic properties concerning electronic and structural transitions leading to collective behavior and theoretical treatments of the ground state and dynamical response, showcasing VO 2 as a model system. Next, we briefly review algorithms designed from the plasticity demonstrated by phase changing systems. Finally, we conclude the brief review with suggestions for future research toward realizing non-von Neumann machines.
42 ENGINEERING↗
Behavioral resilience via dynamic circuit firing homeostasis
Homeostatic regulation ensures stable neural circuit output under changing conditions. We find that in Drosophila larvae, either presynaptic weakening due to perturbation of transmitter release or postsynaptic weakening due to perturbation of glutamate receptors at synapses between motor neuron (MN) and muscle has little impact on locomotion, suggesting a nonsynaptic compensatory mechanism. In vivo imaging shows that five different forms of synaptic weakening increase the duration of activity bouts in type I MNs. Strikingly, this compensation is input selective: occurring only in the tonic type Ib MN, not the phasic type Is MN that innervates the same muscle. Moreover, an inhibitory class of central pre-MNs that innervates the tonic—but not phasic—input decreases in activity. The adjustment in activity occurs remarkably quickly: within minutes of synapse perturbation. We propose that MN firing is dynamically regulated by two coordinated mechanisms: a cell-autonomous adjustment of MN excitability and a circuit adjustment of inhibitory central drive. The input selectivity of this process suggests homeostatic adjustment to maintain tonic drive but hold constant the phasic drive that organizes locomotory wave patterns.
59 BASIC BIOLOGICAL SCIENCES↗
Neuromorphic Backpropagation Algorithm Software
This software is an implementation of the backpropagation algorithm for Intel's neuromorphic research processor, Loihi. The software implements the neural circuit itself and a demonstration application where the MNIST dataset (a standard test problem) is used to train a neural network.
Sornborger, Andrew↗
NeuroCoreX: An Open-Source FPGA-Based Spiking Neural Network Emulator with On-Chip Learning
Spiking Neural Networks (SNNs) are computational models inspired by the event-driven communication and connectivity patterns of biological neural circuits. They enable high energy efficiency and natural support for diverse architectures ranging from layered networks to small-world and graphstructured topologies. In this work, we introduce NeuroCoreX, an open-source, FPGA-based spiking neural network emulator that provides real-time, on-chip learning and flexible network organization. NeuroCoreX supports both feedforward sensory inputs streamed directly from sensors or PCs via UART and recurrent on-chip connectivity, enabling simultaneous processing and learning from external stimuli and internal network dynamics-capabilities rarely available in existing FPGA SNN platforms. The system implements a Leaky Integrate-and-Fire (LIF) neuron model with current-based synapses and supports pair-based STDP learning on both feedforward and recurrent synapses. A lightweight Python interface enables interactive configuration, live monitoring, weight read-back, and experiment control. Importantly, NeuroCoreX is tightly integrated with the SuperNeuroMAT simulator, allowing SNN models to be transferred seamlessly from software to hardware for hardware-in-the-loop development. By combining real-time plasticity, flexible connectivity, and an open-source VHDL implementation, NeuroCoreX provides an extensible and accessible platform for neuromorphic research, algorithm-hardware co-design, and energy-efficient edge intelligence.
Gautam, Ashish [ORNL]↗
Protein–protein interactions between tenascin-R and RPTPζ/phosphacan are critical to maintain the architecture of perineuronal nets
Neural plasticity, the ability to alter the structure and function of neural circuits, varies throughout the age of an individual. The end of the hyperplastic period in the central nervous system coincides with the appearance of honeycomb-like structures called perineuronal nets (PNNs) that surround a subset of neurons. PNNs are a condensed form of neural extracellular matrix that include the glycosaminoglycan hyaluronan and extracellular matrix proteins such as aggrecan and tenascin-R (TNR). PNNs are key regulators of developmental neural plasticity and cognitive functions, yet our current understanding of the molecular interactions that help assemble them remains limited. Disruption of Ptprz1, the gene encoding the receptor protein tyrosine phosphatase RPTPζ, altered the appearance of nets from a reticulated structure to puncta on the surface of cortical neuron bodies in adult mice. The structural alterations mirror those found in Tnr -/- mice, and TNR is absent from the net structures that form in dissociated cultures of Ptprz1 -/- cortical neurons. These findings raised the possibility that TNR and RPTPζ cooperate to promote the assembly of PNNs. Here, we show that TNR associates with the RPTPζ ectodomain and provide a structural basis for these interactions. Furthermore, we show that RPTPζ forms an identical complex with tenascin-C, a homolog of TNR that also regulates neural plasticity. Finally, we demonstrate that mutating residues at the RPTPζ–TNR interface impairs the formation of PNNs in dissociated neuronal cultures. Overall, this work sets the stage for analyzing the roles of protein–protein interactions that underpin the formation of nets.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Solving sparse finite element problems on neuromorphic hardware
The finite element method (FEM) is one of the most important and ubiquitous numerical methods for solving partial differential equations (PDEs) on computers for scientific and engineering discovery. Applying the FEM to larger and more detailed scientific models has driven advances in high-performance computing for decades. Here we demonstrate that scalable spiking neuromorphic hardware can directly implement the FEM by constructing a spiking neural network that solves the large, sparse, linear systems of equations at the core of the FEM. We show that for the Poisson equation, a fundamental PDE in science and engineering, our neural circuit achieves meaningful levels of numerical accuracy and close to ideal scaling on modern, inherently parallel and energy-efficient neuromorphic hardware, specifically Intel’s Loihi 2 neuromorphic platform. We illustrate extensions to irregular mesh geometries in both two and three dimensions as well as other PDEs such as linear elasticity. Our spiking neural network is constructed from a recurrent network model of the brain’s motor cortex and, in contrast to black-box deep artificial neural network-based methods for PDEs, directly translates the well-understood and trusted mathematics of the FEM to a natively spiking neuromorphic algorithm.
Applied mathematics↗
Editorial: Functional microcircuits in the brain and in artificial intelligent systems
Fundamental principles underlying higher-order cognitive functions remain elusive, but recent breakthroughs in neurophysiology and deep learning offer new perspectives. First, experimental studies have uncovered neural circuit motifs consisting of various neuron types; see Brain Initiative Cell Census Network (https://www.nature.com/collections/cicghheddj). For example, inhibitory neuron types expressing exclusive genes have specific targets and distinct functions (Pfeffer et al., 2013). Furthermore, diverse neuron types in cortex and their connectomes were identified in cortical columns (Jiang et al., 2015); see also Barth et al. (2016) for a debate on neuron types. Second, artificial neural networks were originally inspired by structures of the brain (McCulloch and Pitts, 1943) and could be trained to perform complex functions similar to human perception/cognition by deep learning (DL) (Lecun et al., 2015).
59 BASIC BIOLOGICAL SCIENCES↗
Wireless Optogenetic Modulation of Cortical Neurons Enabled by Radioluminescent Nanoparticles
While offering high precision control of neural circuits, optogenetics is hampered by the necessity to implant fiber-optic waveguides in order to deliver photons to genetically engineered light-gated neurons in the brain. Unlike laser light, X-rays freely pass biological barriers. In this work, we show that radioluminescent Gd 2 (WO 4 ) 3 :Eu nanoparticles, which absorb an external X-rays energy and then down-converter it into optical photons with wavelengths of ~610 nm, can be used for the transcranial stimulation of cortical neurons expressing red-shifted, ~590-630 nm, channelrhodopsin ReaChR, thereby promoting optogenetic neural control to the practical implementation of minimally-invasive wireless deep brain stimulation.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Towards a more general understanding of the algorithmic utility of recurrent connections
Lateral and recurrent connections are ubiquitous in biological neural circuits. Yet while the strong computational abilities of feedforward networks have been extensively studied, our understanding of the role and advantages of recurrent computations that might explain their prevalence remains an important open challenge. Foundational studies by Minsky and Roelfsema argued that computations that require propagation of global information for local computation to take place would particularly benefit from the sequential, parallel nature of processing in recurrent networks. Such “tag propagation” algorithms perform repeated, local propagation of information and were originally introduced in the context of detecting connectedness, a task that is challenging for feedforward networks. Here, we advance the understanding of the utility of lateral and recurrent computation by first performing a large-scale empirical study of neural architectures for the computation of connectedness to explore feedforward solutions more fully and establish robustly the importance of recurrent architectures. In addition, we highlight a tradeoff between computation time and performance and construct hybrid feedforward/recurrent models that perform well even in the presence of varying computational time limitations. We then generalize tag propagation architectures to propagating multiple interacting tags and demonstrate that these are efficient computational substrates for more general computations of connectedness by introducing and solving an abstracted biologically inspired decision-making task. Our work thus clarifies and expands the set of computational tasks that can be solved efficiently by recurrent computation, yielding hypotheses for structure in population activity that may be present in such tasks.
59 BASIC BIOLOGICAL SCIENCES↗
Selective consolidation of learning and memory via recall-gated plasticity
In a variety of species and behavioral contexts, learning and memory formation recruits two neural systems, with initial plasticity in one system being consolidated into the other over time. Moreover, consolidation is known to be selective; that is, some experiences are more likely to be consolidated into long-term memory than others. Here, we propose and analyze a model that captures common computational principles underlying such phenomena. The key component of this model is a mechanism by which a long-term learning and memory system prioritizes the storage of synaptic changes that are consistent with prior updates to the short-term system. This mechanism, which we refer to as recall-gated consolidation, has the effect of shielding long-term memory from spurious synaptic changes, enabling it to focus on reliable signals in the environment. We describe neural circuit implementations of this model for different types of learning problems, including supervised learning, reinforcement learning, and autoassociative memory storage. These implementations involve synaptic plasticity rules modulated by factors such as prediction accuracy, decision confidence, or familiarity. We then develop an analytical theory of the learning and memory performance of the model, in comparison to alternatives relying only on synapse-local consolidation mechanisms. We find that recall-gated consolidation provides significant advantages, substantially amplifying the signal-to-noise ratio with which memories can be stored in noisy environments. We show that recall-gated consolidation gives rise to a number of phenomena that are present in behavioral learning paradigms, including spaced learning effects, task-dependent rates of consolidation, and differing neural representations in short- and long-term pathways.
59 BASIC BIOLOGICAL SCIENCES↗
Selective consolidation of learning and memory via recall-gated plasticity
In a variety of species and behavioral contexts, learning and memory formation recruits two neural systems, with initial plasticity in one system being consolidated into the other over time. Moreover, consolidation is known to be selective; that is, some experiences are more likely to be consolidated into long-term memory than others. Here, we propose and analyze a model that captures common computational principles underlying such phenomena. The key component of this model is a mechanism by which a long-term learning and memory system prioritizes the storage of synaptic changes that are consistent with prior updates to the short-term system. This mechanism, which we refer to as recall-gated consolidation, has the effect of shielding long-term memory from spurious synaptic changes, enabling it to focus on reliable signals in the environment. We describe neural circuit implementations of this model for different types of learning problems, including supervised learning, reinforcement learning, and autoassociative memory storage. These implementations involve synaptic plasticity rules modulated by factors such as prediction accuracy, decision confidence, or familiarity. We then develop an analytical theory of the learning and memory performance of the model, in comparison to alternatives relying only on synapse-local consolidation mechanisms. We find that recall-gated consolidation provides significant advantages, substantially amplifying the signal-to-noise ratio with which memories can be stored in noisy environments. We show that recall-gated consolidation gives rise to a number of phenomena that are present in behavioral learning paradigms, including spaced learning effects, task-dependent rates of consolidation, and differing neural representations in short- and long-term pathways.
Lindsey, Jack W. (ORCID:0000000309307327)↗
Proton Conducting Neuromorphic Materials and Devices
Neuromorphic computing and artificial intelligence hardware generally aims to emulate features found in biological neural circuit components and to enable the development of energy-efficient machines. In the biological brain, ionic currents and temporal concentration gradients control information flow and storage. It is therefore of interest to examine materials and devices for neuromorphic computing wherein ionic and electronic currents can propagate. Protons being mobile under an external electric field offers a compelling avenue for facilitating biological functionalities in artificial synapses and neurons. In this review, we first highlight the interesting biological analog of protons as neurotransmitters in various animals. We then discuss the experimental approaches and mechanisms of proton doping in various classes of inorganic and organic proton-conducting materials for the advancement of neuromorphic architectures. Since hydrogen is among the lightest of elements, characterization in a solid matrix requires advanced techniques. We review powerful synchrotron-based spectroscopic techniques for characterizing hydrogen doping in various materials as well as complementary scattering techniques to detect hydrogen. First-principles calculations are then discussed as they help provide an understanding of proton migration and electronic structure modification. Outstanding scientific challenges to further our understanding of proton doping and its use in emerging neuromorphic electronics are pointed out.
36 MATERIALS SCIENCE↗
Determinants of synapse diversity revealed by super-resolution quantal transmission and active zone imaging
Neural circuit function depends on the pattern of synaptic connections between neurons and the strength of those connections. Synaptic strength is determined by both postsynaptic sensitivity to neurotransmitter and the presynaptic probability of action potential evoked transmitter release (P r ). Whereas morphology and neurotransmitter receptor number indicate postsynaptic sensitivity, presynaptic indicators and the mechanism that sets P r remain to be defined. To address this, we developed QuaSOR, a super-resolution method for determining P r from quantal synaptic transmission imaging at hundreds of glutamatergic synapses at a time. We mapped the P r onto super-resolution 3D molecular reconstructions of the presynaptic active zones (AZs) of the same synapses at the Drosophila larval neuromuscular junction (NMJ). We find that P r varies greatly between synapses made by a single axon, quantify the contribution of key AZ proteins to P r diversity and find that one of these, Complexin, suppresses spontaneous and evoked transmission differentially, thereby generating a spatial and quantitative mismatch between release modes. Transmission is thus regulated by the balance and nanoscale distribution of release-enhancing and suppressing presynaptic proteins to generate high signal-to-noise evoked transmission.
59 BASIC BIOLOGICAL SCIENCES↗