Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “neuronal dynamics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Reconfigurable perovskite nickelate electronics for artificial intelligence

Reconfigurable devices offer the ability to program electronic circuits on demand. Here, in this work, we demonstrated on-demand creation of artificial neurons, synapses, and memory capacitors in post-fabricated perovskite NdNiO 3 devices that can be simply reconfigured for a specific purpose by single-shot electric pulses. The sensitivity of electronic properties of perovskite nickelates to the local distribution of hydrogen ions enabled these results. With experimental data from our memory capacitors, simulation results of a reservoir computing framework showed excellent performance for tasks such as digit recognition and classification of electrocardiogram heartbeat activity. Using our reconfigurable artificial neurons and synapses, simulated dynamic networks outperformed static networks for incremental learning scenarios. The ability to fashion the building blocks of brain-inspired computers on demand opens up new directions in adaptive networks.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Lyapunov exponents from CHUA's circuit time series using artificial neural networks

In this paper we present the general problem of identifying if a nonlinear dynamic system has a chaotic behavior. If the answer is positive the system will be sensitive to small perturbations in the initial conditions which will imply that there is a chaotic attractor in its state space. A particular problem would be that of identifying a chaotic oscillator. We present an example of three well known different chaotic oscillators where we have knowledge of the equations that govern the dynamical systems and from there we can obtain the corresponding time series. In a similar example we assume that we only know the time series and, finally, in another example we have to take measurements in the Chua's circuit to obtain sample points of the time series. With the knowledge about the time series the phase plane portraits are plotted and from them, by visual inspection, it is concluded whether or not the system is chaotic. This method has the problem of uncertainty and subjectivity and for that reason a different approach is needed. A quantitative approach is the computation of the Lyapunov exponents. We describe several methods for obtaining them and apply a little known method of artificial neural networks to the different examples mentioned above. We end the paper discussing the importance of the Lyapunov exponents in the interpretation of the dynamic behavior of biological neurons and biological neural networks.

Gonzalez, J. Jesus↗

State-space receptive fields of semicircular canal afferent neurons in the bullfrog

Receptive fields are commonly used to describe spatial characteristics of sensory neuron responses. They can be extended to characterize temporal or dynamical aspects by mapping neural responses in dynamical state spaces. The state-space receptive field of a neuron is the probability distribution of the dynamical state of the stimulus-generating system conditioned upon the occurrence of a spike. We have computed state-space receptive fields for semicircular canal afferent neurons in the bullfrog (Rana catesbeiana). We recorded spike times during broad-band Gaussian noise rotational velocity stimuli, computed the frequency distribution of head states at spike times, and normalized these to obtain conditional pdfs for the state. These state-space receptive fields quantify what the brain can deduce about the dynamical state of the head when a single spike arrives from the periphery. c2001 Elsevier Science B.V. All rights reserved.

Non-NASA Center↗

Response of pontomedullary reticulospinal neurons to vestibular stimuli in vertical planes. Role in vertical vestibulospinal reflexes of the decerebrate cat

1. To investigate the neural substrate of vestibulospinal reflexes in decerebrate cats, we studied the responses of pontomedullary reticulospinal neurons to natural stimulation of the labyrinth in vertical planes. Our principal aim was to determine whether reticulospinal neurons that terminate in, or are likely to give off collaterals to, the upper cervical segments had properties similar to those of the vestibulocollic reflex (VCR). 2. Antidromic stimulation was used to determine whether the neurons projected to the neck, lower cervical, thoracic, or lumbar levels. Dynamics of the responses of spontaneously firing neurons were studied with sinusoidal stimuli delivered at 0.05-1 Hz and aligned to the plane of body rotation, that produced maximal modulation of the neuron (response vector orientation). Each neuron was assigned a vestibular input classification of otolith, vertical canal, otolith + canal, or spatial-temporal convergence (STC). 3. We found, in agreement with previous studies, that the largest fraction of pontomedullary reticulospinal neurons projected to the lumbar cord, and that only a small number ended in the neck segments. Neurons projecting to all levels of the spinal cord had similar responses to labyrinth stimulation. 4. Reticulospinal neurons that received only vertical canal inputs were rare (1 of 67 units). Most reticulospinal neurons (48%) received predominant otolith inputs, 18% received otolith + canal input, and only 9% had STC behavior. These data are in sharp contrast to the results of our previous studies of vestibulospinal neurons. A considerable portion of vestibulospinal neurons receives vertical canal input (38%), fewer receive predominantly otolith input (22%), whereas the proportion that have otolith + canal input or STC behavior is similar to our present reticulospinal data. 5. The response vector orientations of our reticulospinal neurons, particularly those with canal inputs (canal, otolith + canal, STC) were predominantly in the roll quadrants. There was no evidence of convergence of inputs from like canals across the midline (e.g., right anterior + left anterior). 6. Two characteristics of the VCR, STC behavior and bilateral input from symmetric vertical canals (in some muscles), cannot be accounted for by the reticulospinal neurons that we studied. Because these characteristics are also not seen in vestibulocollic neurons, they are likely to be the result of the appropriate convergence of vestibular signals in the spinal cord. 7. Pontomedullary reticulospinal neurons seem particularly well suited to play a role in gravity-dependent postural reflexes of neck and limbs.

NASA Discipline Neuroscience↗

Learned adaptive properties for mitigation of weight perturbations in embedded spiking networks

Recent years have seen an increased importance of neural network inference in edge-based scenarios, which impose size and power constraints requiring novel computing devices. These same edge scenarios may require operating over long periods of time, or exposure to extreme environments, resulting in a drift of neural network weights that cause degraded performance. In searching for ways to develop neural network approaches that perform robustly under these conditions, we propose a biologically-inspired mechanism for the dynamic adaptation of within-neuron parameters that is guided by a global context signal carrying information about perturbations and variability in incoming stimuli. Specifically, we demonstrate that adaptive voltage thresholds or neuronal time constants, when informed by a global context signal, can enable network-level mechanisms to recover from perturbed synaptic weights. Consistent with prior literature, the context-modulated approach is effective for recurrent, but not feedforward networks, by modulating network level dynamics. We demonstrate this approach successfully recovers performance in image classification tasks and spatiotemporal tracking tasks under idealized and Gaussian noise as well as for realistic perturbations from a memristive device when exposed to ionizing radiation. Finally, we discuss how this approach enables the design of robust and energy-efficient neuromorphic systems that perform well, even in resource-constrained scenarios with extreme environments such as edge processing.

context modulation↗

Melatonin-Induced Modulation of Cholesterol-Enriched Model Neuronal Membranes

Melatonin, a hormone primarily produced by the brain’s pineal gland, not only regulates circadian rhythms, but also influences the structural and biophysical properties of neuronal membranes. Its amphiphilic nature enables direct incorporation into lipid bilayers and preferential interactions with cholesterol-rich lipid rafts, critical hubs for cellular signaling and membrane organization. Despite increasing recognition of its membrane activity, the molecular basis of melatonin’s interactions with coexisting liquid-ordered (L o ) and liquid-disordered (L d ) phases remains unclear. Here, in this study, we combine small-angle neutron scattering (SANS) and all-atom molecular dynamics simulations to examine model neuronal membranes composed of DSPC, DOPC, POPC, and cholesterol. Our results show that melatonin preserves domain morphology while adopting distinct orientations within the bilayer and at the membrane interface, allowing both lateral and transmembrane bridging across lipid phases. These findings establish the molecular underpinnings of melatonin’s modulation of membrane heterogeneity and provide strong support for its receptor-independent actions.

atomistic simulations↗

An artificial spiking quantum neuron

Abstract Artificial spiking neural networks have found applications in areas where the temporal nature of activation offers an advantage, such as time series prediction and signal processing. To improve their efficiency, spiking architectures often run on custom-designed neuromorphic hardware, but, despite their attractive properties, these implementations have been limited to digital systems. We describe an artificial quantum spiking neuron that relies on the dynamical evolution of two easy to implement Hamiltonians and subsequent local measurements. The architecture allows exploiting complex amplitudes and back-action from measurements to influence the input. This approach to learning protocols is advantageous in the case where the input and output of the system are both quantum states. We demonstrate this through the classification of Bell pairs which can be seen as a certification protocol. Stacking the introduced elementary building blocks into larger networks combines the spatiotemporal features of a spiking neural network with the non-local quantum correlations across the graph.

Kristensen, Lasse Bjørn (ORCID:0000000239398170)↗

Hub stability in the calcium calmodulin-dependent protein kinase II

The calcium calmodulin protein kinase II (CaMKII) is a multi-subunit ring assembly with a central hub formed by the association domains. There is evidence for hub polymorphism between and within CaMKII isoforms, but the link between polymorphism and subunit exchange has not been resolved. Here, we present near-atomic resolution cryogenic electron microscopy (cryo-EM) structures revealing that hubs from the α and β isoforms, either standalone or within an β holoenzyme, coexist as 12 and 14 subunit assemblies. Single-molecule fluorescence microscopy of Venus-tagged holoenzymes detects intermediate assemblies and progressive dimer loss due to intrinsic holoenzyme lability, and holoenzyme disassembly into dimers upon mutagenesis of a conserved inter-domain contact. Molecular dynamics (MD) simulations show the flexibility of 4-subunit precursors, extracted in-silico from the β hub polymorphs, encompassing the curvature of both polymorphs. The MD explains how an open hub structure also obtained from the β holoenzyme sample could be created by dimer loss and analysis of its cryo-EM dataset reveals how the gap could open further. An assembly model, considering dimer concentration dependence and strain differences between polymorphs, proposes a mechanism for intrinsic hub lability to fine-tune the stoichiometry of αβ heterooligomers for their dynamic localization within synapses in neurons.

59 BASIC BIOLOGICAL SCIENCES↗

Complexity for Survival of Living Systems

A logical connection between the survivability of living systems and the complexity of their behavior (equivalently, mental complexity) has been established. This connection is an important intermediate result of continuing research on mathematical models that could constitute a unified representation of the evolution of both living and non-living systems. Earlier results of this research were reported in several prior NASA Tech Briefs articles, the two most relevant being Characteristics of Dynamics of Intelligent Systems (NPO- 21037), NASA Tech Briefs, Vol. 26, No. 12 (December 2002), page 48; and Self-Supervised Dynamical Systems (NPO- 30634) NASA Tech Briefs, Vol. 27, No. 3 (March 2003), page 72. As used here, living systems is synonymous with active systems and intelligent systems. The quoted terms can signify artificial agents (e.g., suitably programmed computers) or natural biological systems ranging from single-cell organisms at one extreme to the whole of human society at the other extreme. One of the requirements that must be satisfied in mathematical modeling of living systems is reconciliation of evolution of life with the second law of thermodynamics. In the approach followed in this research, this reconciliation is effected by means of a model, inspired partly by quantum mechanics, in which the quantum potential is replaced with an information potential. The model captures the most fundamental property of life - the ability to evolve from disorder to order without any external interference. The model incorporates the equations of classical dynamics, including Newton s equations of motion and equations for random components caused by uncertainties in initial conditions and by Langevin forces. The equations of classical dynamics are coupled with corresponding Liouville or Fokker-Planck equations that describe the evolutions of probability densities that represent the uncertainties. The coupling is effected by fictitious information-based forces that are gradients of the information potential, which, in turn, is a function of the probability densities. The probability densities are associated with mental images both self-image and nonself images (images of external objects that can include other agents). The evolution of the probability densities represents mental dynamics. Then the interaction between the physical and metal aspects of behavior is implemented by feedback from mental to motor dynamics, as represented by the aforementioned fictitious forces. The interaction of a system with its self and nonself images affords unlimited capacity for increase of complexity. There is a biological basis for this model of mental dynamics in the discovery of mirror neurons that learn by imitation. The levels of complexity attained by use of this model match those observed in living systems. To establish a mechanism for increasing the complexity of dynamics of an active system, the model enables exploitation of a chain of reflections exemplified by questions of the form, "What do you think that I think that you think...?" Mathematically, each level of reflection is represented in the form of an attractor performing the corresponding level of abstraction with more details removed from higher levels. The model can be used to describe the behaviors, not only of biological systems, but also of ecological, social, and economics ones.

Zak, Michail↗

Collective dynamics and long-range order in thermal neuristor networks

Abstract In the pursuit of scalable and energy-efficient neuromorphic devices, recent research has unveiled a novel category of spiking oscillators, termed “thermal neuristors.” These devices function via thermal interactions among neighboring vanadium dioxide resistive memories, emulating biological neuronal behavior. Here, we show that the collective dynamical behavior of networks of these neurons showcases a rich phase structure, tunable by adjusting the thermal coupling and input voltage. Notably, we identify phases exhibiting long-range order that, however, does not arise from criticality, but rather from the time non-local response of the system. In addition, we show that these thermal neuristor arrays achieve high accuracy in image recognition and time series prediction through reservoir computing, without leveraging long-range order. Our findings highlight a crucial aspect of neuromorphic computing with possible implications on the functioning of the brain: criticality may not be necessary for the efficient performance of neuromorphic systems in certain computational tasks.

Science & Technology - Other Topics↗

Spiking Neurons for Analysis of Patterns

Artificial neural networks comprising spiking neurons of a novel type have been conceived as improved pattern-analysis and pattern-recognition computational systems. These neurons are represented by a mathematical model denoted the state-variable model (SVM), which among other things, exploits a computational parallelism inherent in spiking-neuron geometry. Networks of SVM neurons offer advantages of speed and computational efficiency, relative to traditional artificial neural networks. The SVM also overcomes some of the limitations of prior spiking-neuron models. There are numerous potential pattern-recognition, tracking, and data-reduction (data preprocessing) applications for these SVM neural networks on Earth and in exploration of remote planets. Spiking neurons imitate biological neurons more closely than do the neurons of traditional artificial neural networks. A spiking neuron includes a central cell body (soma) surrounded by a tree-like interconnection network (dendrites). Spiking neurons are so named because they generate trains of output pulses (spikes) in response to inputs received from sensors or from other neurons. They gain their speed advantage over traditional neural networks by using the timing of individual spikes for computation, whereas traditional artificial neurons use averages of activity levels over time. Moreover, spiking neurons use the delays inherent in dendritic processing in order to efficiently encode the information content of incoming signals. Because traditional artificial neurons fail to capture this encoding, they have less processing capability, and so it is necessary to use more gates when implementing traditional artificial neurons in electronic circuitry. Such higher-order functions as dynamic tasking are effected by use of pools (collections) of spiking neurons interconnected by spike-transmitting fibers. The SVM includes adaptive thresholds and submodels of transport of ions (in imitation of such transport in biological neurons). These features enable the neurons to adapt their responses to high-rate inputs from sensors, and to adapt their firing thresholds to mitigate noise or effects of potential sensor failure. The mathematical derivation of the SVM starts from a prior model, known in the art as the point soma model, which captures all of the salient properties of neuronal response while keeping the computational cost low. The point-soma latency time is modified to be an exponentially decaying function of the strength of the applied potential. Choosing computational efficiency over biological fidelity, the dendrites surrounding a neuron are represented by simplified compartmental submodels and there are no dendritic spines. Updates to the dendritic potential, calcium-ion concentrations and conductances, and potassium-ion conductances are done by use of equations similar to those of the point soma. Diffusion processes in dendrites are modeled by averaging among nearest-neighbor compartments. Inputs to each of the dendritic compartments come from sensors. Alternatively or in addition, when an affected neuron is part of a pool, inputs can come from other spiking neurons. At present, SVM neural networks are implemented by computational simulation, using algorithms that encode the SVM and its submodels. However, it should be possible to implement these neural networks in hardware: The differential equations for the dendritic and cellular processes in the SVM model of spiking neurons map to equivalent circuits that can be implemented directly in analog very-large-scale integrated (VLSI) circuits.

Huntsberger, Terrance↗

Vestibular convergence patterns in vestibular nuclei neurons of alert primates

Sensory signal convergence is a fundamental and important aspect of brain function. Such convergence may often involve complex multidimensional interactions as those proposed for the processing of otolith and semicircular canal (SCC) information for the detection of translational head movements and the effective discrimination from physically congruent gravity signals. In the present study, we have examined the responses of primate rostral vestibular nuclei (VN) neurons that do not exhibit any eye movement-related activity using 0.5-Hz translational and three-dimensional (3D) rotational motion. Three distinct neural populations were identified. Approximately one-fourth of the cells exclusively encoded rotational movements (canal-only neurons) and were unresponsive to translation. The canal-only central neurons encoded head rotation in SCC coordinates, exhibited little orthogonal canal convergence, and were characterized with significantly higher sensitivities to rotation as compared to primary SCC afferents. Another fourth of the neurons modulated their firing rates during translation (otolith-only cells). During rotations, these neurons only responded when the axis of rotation was earth-horizontal and the head was changing orientation relative to gravity. The remaining one-half of VN neurons were sensitive to both rotations and translations (otolith + canal neurons). Unlike primary otolith afferents, however, central neurons often exhibited significant spatiotemporal (noncosine) tuning properties and a wide variety of response dynamics to translation. To characterize the pattern of SCC inputs to otolith + canal neurons, their rotational maximum sensitivity vectors were computed using exclusively responses during earth-vertical axis rotations (EVA). Maximum sensitivity vectors were distributed throughout the 3D space, suggesting strong convergence from multiple SCCs. These neurons were also tested with earth-horizontal axis rotations (EHA), which would activate both vertical canals and otolith organs. However, the recorded responses could not be predicted from a linear combination of EVA rotational and translational responses. In contrast, one-third of the neurons responded similarly during EVA and EHA rotations, although a significant response modulation was present during translation. Thus this subpopulation of otolith + canal cells, which included neurons with either high- or low-pass dynamics to translation, appear to selectively ignore the component of otolith-selective activation that is due to changes in the orientation of the head relative to gravity. Thus contrary to primary otolith afferents and otolith-only central neurons that respond equivalently to tilts relative to gravity and translational movements, approximately one-third of the otolith + canal cells seem to encode a true estimate of the translational component of the imposed passive head and body movement.

Non-NASA Center↗

Sharing leaky-integrate-and-fire neurons for memory-efficient spiking neural networks

Spiking Neural Networks (SNNs) have gained increasing attention as energy-efficient neural networks owing to their binary and asynchronous computation. However, their non-linear activation, that is Leaky-Integrate-and-Fire (LIF) neuron, requires additional memory to store a membrane voltage to capture the temporal dynamics of spikes. Although the required memory cost for LIF neurons significantly increases as the input dimension goes larger, a technique to reduce memory for LIF neurons has not been explored so far. To address this, we propose a simple and effective solution, EfficientLIF-Net, which shares the LIF neurons across different layers and channels. Our EfficientLIF-Net achieves comparable accuracy with the standard SNNs while bringing up to ~4.3× forward memory efficiency and ~21.9× backward memory efficiency for LIF neurons. We conduct experiments on various datasets including CIFAR10, CIFAR100, TinyImageNet, ImageNet-100, and N-Caltech101. Furthermore, we show that our approach also offers advantages on Human Activity Recognition (HAR) datasets, which heavily rely on temporal information. The code has been released at https://github.com/Intelligent-Computing-Lab-Yale/EfficientLIF-Net.

60 APPLIED LIFE SCIENCES↗

RNA content in motor and sensory neurons and surrounding neuroglia of mouse spinal cord under conditions of hypodynamia and following normalization

The differences in the dynamics of reparative processes in RNA metabolism within the neuron-neuroglia unit after the cessation of hyper- and hypodynamia is dicussed. The role of neuroglia is stressed in compensatory, reparative and trophic processes in the nervous system as well as the possibility in an adaptation at the cellular level.

Brumberg, V. A.↗

A caloritronics-based Mott neuristor

Abstract Machine learning imitates the basic features of biological neural networks at a software level. A strong effort is currently being made to mimic neurons and synapses with hardware components, an approach known as neuromorphic computing. While recent advances in resistive switching have provided a path to emulate synapses at the 10 nm scale, a scalable neuron analogue is yet to be found. Here, we show how heat transfer can be utilized to mimic neuron functionalities in Mott nanodevices. We use the Joule heating created by current spikes to trigger the insulator-to-metal transition in a biased VO 2 nanogap. We show that thermal dynamics allow the implementation of the basic neuron functionalities: activity, leaky integrate-and-fire, volatility and rate coding. This approach could enable neuromorphic hardware to take full advantage of the rapid advances in memristive synapses, allowing for much denser and complex neural networks.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Properties of cerebellar fastigial neurons during translation, rotation, and eye movements

The most medial of the deep cerebellar nuclei, the fastigial nucleus (FN), receives sensory vestibular information and direct inhibition from the cerebellar vermis. We investigated the signal processing in the primate FN by recording single-unit activities during translational motion, rotational motion, and eye movements. Firing rate modulation during horizontal plane translation in the absence of eye movements was observed in all non-eye-movement-sensitive cells and 26% of the pursuit eye-movement-sensitive neurons in the caudal FN. Many non-eye-movement-sensitive cells recorded in the rostral FN of three fascicularis monkeys exhibited convergence of signals from both the otolith organs and the semicircular canals. At low frequencies of translation, the majority of these rostral FN cells changed their firing rates in phase with head velocity rather than linear acceleration. As frequency increased, FN vestibular neurons exhibited a wide range of response dynamics with most cells being characterized by increasing phase leads as a function of frequency. Unlike cells in the vestibular nuclei, none of the rostral FN cells responded to rotational motion alone, without simultaneously exhibiting sensitivity to translational motion. Modulation during earth-horizontal axis rotation was observed in more than half (77%) of the neurons, although with smaller gains than during translation. In contrast, only 47% of the cells changed their firing rates during earth-vertical axis rotations in the absence of a dynamic linear acceleration stimulus. These response properties suggest that the rostral FN represents a main processing center of otolith-driven information for inertial motion detection and spatial orientation.

Non-NASA Center↗

Easy-plane spin Hall nano-oscillators as spiking neurons for neuromorphic computing

Here we show analytically using a macrospin approximation that easy-plane spin Hall nano-oscillators excited by a spin current polarized perpendicularly to the easy plane have phase dynamics analogous to that of Josephson junctions. Similarly to Josephson junctions, they can reproduce the spiking behavior of biological neurons that is appropriate for neuromorphic computing. To take advantage of typical spin-orbit torques, we use a nanoconstriction geometry, in which the magnetostatic interaction and magnetocrystalline anisotropy are tuned to create an easy plane that includes the interface normal direction. We perform micromagnetic simulations of such oscillators realized in this geometry and show that the easy-plane spiking dynamics is preserved in this experimentally feasible architecture. Finally we simulate two elementary neural network blocks that implement operations essential for neuromorphic computing. First, we show that output spikes energies from two neurons can be summed and injected into a following layer neuron and second, we demonstrate that outputs can be multiplied by synaptic weights implemented by locally modifying the anisotropy.

36 MATERIALS SCIENCE↗

Integrated multi-omic characterizations of the synapse reveal RNA processing factors and ubiquitin ligases associated with neurodevelopmental disorders

The molecular composition of the excitatory synapse is incompletely defined due to its dynamic nature across developmental stages and neuronal populations. To address this gap, we apply proteomic mass spectrometry to characterize the synapse in multiple biological models including the fetal human brain and hiPSC-derived neurons. To prioritize the identified proteins, we develop an orthogonal multi-omic screen of genomic, transcriptomic, interactomic, and structural data. This data-driven framework identifies proteins with key molecular features intrinsic to the synapse, including characteristic patterns of biophysical interactions and cross-tissue expression. The multi-omic analysis captures synaptic proteins across developmental stages and experimental systems, including 493 synaptic candidates supported by proteomics. We further investigate three such proteins that are associated with neurodevelopmental disorders – the CUL3 E3 ubiquitin ligase, the DDX3X and YBX1 nucleic-acid binding proteins – by mapping their networks of physically interacting synapse proteins or transcripts. Our study demonstrates the potential of an integrated multi-omic approach to systematically and more comprehensively resolve the synaptic architecture.

59 BASIC BIOLOGICAL SCIENCES↗