Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “neuron”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Dual color optogenetic control of neural populations using low-noise, multishank optoelectrodes

Optogenetics allows for optical manipulation of neuronal activity and has been increasingly combined with intracellular and extracellular electrophysiological recordings. Genetically-identified classes of neurons are optically manipulated, though the versatility of optogenetics would be increased if independent control of distinct neural populations could be achieved on a sufficient spatial and temporal resolution. We report a scalable multisite optoelectrode design that allows simultaneous optogenetic control of two spatially intermingled neuronal populations in vivo. We describe the design, fabrication, and assembly of low-noise, multisite/multicolor optoelectrodes. Each shank of the four-shank assembly is monolithically integrated with 8 recording sites and a dual-color waveguide mixer with a 7 × 30 μm cross-section, coupled to 405 nm and 635 nm injection laser diodes (ILDs) via gradient-index (GRIN) lenses to meet optical and thermal design requirements. To better understand noise on the recording channels generated during diode-based activation, we developed a lumped-circuit modeling approach for EMI coupling mechanisms and used it to limit artifacts to amplitudes under 100 μV upto an optical output power of 450 μW. We implanted the packaged devices into the CA1 pyramidal layer of awake mice, expressing Channelrhodopsin-2 in pyramidal cells and ChrimsonR in paravalbumin-expressing interneurons, and achieved optical excitation of each cell type using sub-mW illumination. We highlight the potential use of this technology for functional dissection of neural circuits.

42 ENGINEERING↗

Engineering microscale systems for fully autonomous intracellular neural interfaces

Conventional electrodes and associated positioning systems for intracellular recording from single neurons in vitro and in vivo are large and bulky, which has largely limited their scalability. Further, acquiring successful intracellular recordings is very tedious, requiring a high degree of skill not readily achieved in a typical laboratory. We report here a robotic, MEMS-based intracellular recording system to overcome the above limitations associated with form-factor, scalability and highly skilled and tedious manual operations required for intracellular recordings. This system combines three distinct technologies: 1) novel microscale, glass-polysilicon penetrating electrode for intracellular recording, 2) electrothermal microactuators for precise microscale movement of each electrode and 3) closed-loop control algorithm for autonomous positioning of electrode inside single neurons. Here, we demonstrate the novel, fully integrated system of glass-polysilicon microelectrode, microscale actuators and controller for autonomous intracellular recordings from single neurons in the abdominal ganglion of Aplysia Californica (n = 5 cells). Consistent resting potentials (< –35 mV) and action potentials (> 60 mV) were recorded after each successful penetration attempt with the controller and microactuated glass-polysilicon microelectrodes. The success rate of penetration and quality of intracellular recordings achieved using electrothermal microactuators were comparable to that of conventional positioning systems. The MEMS-based system offers significant advantages: 1) reduction in overall size for potential use in behaving animals, 2) scalable approach to potentially realize multi-channel recordings and 3) a viable method to fully automate measurement of intracellular recordings. Furthermore, this system will be evaluated in vivo in future rodent studies.

42 ENGINEERING↗

Cell specific photoswitchable agonist for reversible control of endogenous dopamine receptors

Dopamine controls diverse behaviors and their dysregulation contributes to many disorders. Our ability to understand and manipulate the function of dopamine is limited by the heterogenous nature of dopaminergic projections, the diversity of neurons that are regulated by dopamine, the varying distribution of the five dopamine receptors (DARs), and the complex dynamics of dopamine release. In order to improve our ability to specifically modulate distinct DARs, here we develop a photo-pharmacological strategy using a Membrane anchored Photoswitchable orthogonal remotely tethered agonist for the Dopamine receptor (MP-D). Our design selectively targets D1R/D5R receptor subtypes, most potently D1R (MP-D1 ago ), as shown in HEK293T cells. In vivo, we targeted dorsal striatal medium spiny neurons where the photo-activation of MP-D1 ago increased movement initiation, although further work is required to assess the effects of MP-D1 ago on neuronal function. Our method combines ligand and cell type-specificity with temporally precise and reversible activation of D1R to control specific aspects of movement. Our results provide a template for analyzing dopamine receptors.

59 BASIC BIOLOGICAL SCIENCES↗

Stimulus edges induce orientation tuning in superior colliculus

Orientation columns exist in the primary visual cortex (V1) of cat and primates but not mouse. Intriguingly, some recent studies reported the presence of orientation and direction columns in the mouse superficial superior colliculus (sSC), while others reported a lack of columnar organization therein. Using in vivo calcium imaging of sSC in the awake mouse brain, we found that the presence of columns is highly stimulus dependent. Specifically, we observed orientation and direction columns formed by sSC neurons retinotopically mapped to the edge of grating stimuli. For both excitatory and inhibitory neurons in sSC, orientation selectivity can be induced by the edge with their preferred orientation perpendicular to the edge orientation. Furthermore, we found that this edge-induced orientation selectivity is associated with saliency encoding. These findings indicate that the tuning properties of sSC neurons are not fixed by circuit architecture but rather dependent on the spatiotemporal properties of the stimulus.

59 BASIC BIOLOGICAL SCIENCES↗

ON-OFF neuromorphic ISING machines using Fowler-Nordheim annealers

We introduce NeuroSA, a neuromorphic architecture specifically designed to ensure asymptotic convergence to the ground state of an Ising problem using a Fowler-Nordheim quantum mechanical tunneling based threshold-annealing process. The core component of NeuroSA consists of a pair of asynchronous ON-OFF neurons, which effectively map classical simulated annealing dynamics onto a network of integrate-and-fire neurons. The threshold of each ON-OFF neuron pair is adaptively adjusted by an FN annealer and the resulting spiking dynamics replicates the optimal escape mechanism and convergence of SA, particularly at low-temperatures. To validate the effectiveness of our neuromorphic Ising machine, we systematically solved benchmark combinatorial optimization problems such as MAX-CUT and Max Independent Set. Across multiple runs, NeuroSA consistently generates distribution of solutions that are concentrated around the state-of-the-art results (within 99%) or surpass the current state-of-the-art solutions for Max Independent Set benchmarks. Furthermore, NeuroSA is able to achieve these superior distributions without any graph-specific hyperparameter tuning. For practical illustration, we present results from an implementation of NeuroSA on the SpiNNaker2 platform, highlighting the feasibility of mapping our proposed architecture onto a standard neuromorphic accelerator platform.

42 ENGINEERING↗

Quantum reservoir computing implementation on coherently coupled quantum oscillators

Quantum reservoir computing is a promising approach for quantum neural networks, capable of solving hard learning tasks on both classical and quantum input data. However, current approaches with qubits suffer from limited connectivity. We propose an implementation for quantum reservoir that obtains a large number of densely connected neurons by using parametrically coupled quantum oscillators instead of physically coupled qubits. We analyze a specific hardware implementation based on superconducting circuits: with just two coupled quantum oscillators, we create a quantum reservoir comprising up to 81 neurons. We obtain state-of-the-art accuracy of 99% on benchmark tasks that otherwise require at least 24 classical oscillators to be solved. Our results give the coupling and dissipation requirements in the system and show how they affect the performance of the quantum reservoir. Beyond quantum reservoir computing, the use of parametrically coupled bosonic modes holds promise for realizing large quantum neural network architectures, with billions of neurons implemented with only 10 coupled quantum oscillators.

97 MATHEMATICS AND COMPUTING↗

Neuromorphic spintronics

Neuromorphic computing uses brain-inspired principles to design circuits that can perform computational tasks with superior power efficiency to conventional computers. Approaches that use traditional electronic devices to create artificial neurons and synapses are, however, currently limited by the energy and area requirements of these components. Spintronic nanodevices, which exploit both the magnetic and electrical properties of electrons, can increase the energy efficiency and decrease the area of these circuits, and magnetic tunnel junctions are of particular interest as neuromorphic computing elements because they are compatible with standard integrated circuits and can support multiple functionalities. Here, we review the development of spintronic devices for neuromorphic computing. We examine how magnetic tunnel junctions can serve as synapses and neurons, and how magnetic textures, such as domain walls and skyrmions, can function as neurons. We also explore spintronics-based implementations of neuromorphic computing tasks, such as pattern recognition in an associative memory, and discuss the challenges that exist in scaling up these systems.

42 ENGINEERING↗

Quantum optical classifier with superexponential speedup

Abstract Classification is a central task in deep learning algorithms. Usually, images are first captured and then processed by a sequence of operations, of which the artificial neuron represents one of the fundamental units. This paradigm requires significant resources that scale (at least) linearly in the image resolution, both in terms of photons and computational operations. Here, we present a quantum optical pattern recognition method for binary classification tasks. It classifies objects without reconstructing their images, using the rate of two-photon coincidences at the output of a Hong-Ou-Mandel interferometer, where both the input and the classifier parameters are encoded into single-photon states. Our method exhibits the behaviour of a classical neuron of unit depth. Once trained, it shows a constant $${{\mathcal{O}}}(1)$$ O ( 1 ) complexity in the number of computational operations and photons required by a single classification. This is a superexponential advantage over a classical artificial neuron.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Enhanced neurite outgrowth on electrically conductive carbon aerogel substrates in the presence of an external electric field

Previous works from our laboratory have firmly established that aerogels are a suitable substrate to elicit accelerated neurite extension. On non-conducting aerogels, in the presence of an externally-applied DC bias, neurons extended neurites which were preferentially aligned towards the anode. In this work, we sought to determine whether electrically-conductive carbon aerogels elicited a more robust alignment of neurites toward the anode than non-conductive aerogels due to the capacity of conductive aerogels to sustain a current, thereby providing a direct interface between neurons and the external electrical stimulus. To determine if this was the case, we plated PC12 neuronal cells on electrically conductive carbon aerolges derived from acetic acid-catalized resorcinol formaldehyde aerogels (ARF-CA) and subjected them to an external electric field. The voltages applied at the electrodes of the custom-built electro-stimulation chamber were 0 V, 15 V, and 30 V. For each voltage, the directionality and length of the neurites extended by PC12 cells were determined and compared to those observed when PC12 cells were plated on non-conductive aerogels subjected to the same voltage. The results show that the directionality of neurite extension was similar between conductive and non-conductive aerogels. A higher neurite length difference was observed on conductive aerogels with increasing voltage, 43% and 106% for 0–15 V and 0–30 V respectively, compared to non-conductive aerogels, 12% and 20%. These findings indicate that conductive carbon aerogels have a greater potential as scaffolds for nerve regeneration than non-conductive ones.

36 MATERIALS SCIENCE↗

Functional network inference of the suprachiasmatic nucleus

In the mammalian suprachiasmatic nucleus (SCN), noisy cellular oscillators communicate within a neuronal network to generate precise system-wide circadian rhythms. Although the intracellular genetic oscillator and intercellular biochemical coupling mechanisms have been examined previously, the network topology driving synchronization of the SCN has not been elucidated. This network has been particularly challenging to probe, due to its oscillatory components and slow coupling timescale. In this work, we investigated the SCN network at a single-cell resolution through a chemically induced desynchronization. We then inferred functional connections in the SCN by applying the maximal information coefficient statistic to bioluminescence reporter data from individual neurons while they resynchronized their circadian cycling. Our results demonstrate that the functional network of circadian cells associated with resynchronization has small-world characteristics, with a node degree distribution that is exponential. We show that hubs of this small-world network are preferentially located in the central SCN, with sparsely connected shells surrounding these cores. Lastly, we used two computational models of circadian neurons to validate our predictions of network structure.

97 MATHEMATICS AND COMPUTING↗

A conserved molecular logic for neurogenesis to gliogenesis switch in the cerebral cortex

During development, neural stem cells in the cerebral cortex, also known as radial glial cells (RGCs), generate excitatory neurons, followed by production of cortical macroglia and inhibitory neurons that migrate to the olfactory bulb (OB). Understanding the mechanisms for this lineage switch is fundamental for unraveling how proper numbers of diverse neuronal and glial cell types are controlled. We and others recently showed that Sonic Hedgehog (Shh) signaling promotes the cortical RGC lineage switch to generate cortical oligodendrocytes and OB interneurons. During this process, cortical RGCs generate intermediate progenitor cells that express critical gliogenesis genes Ascl1, Egfr, and Olig2. The increased Ascl1 expression and appearance of Egfr + and Olig2 + cortical progenitors are concurrent with the switch from excitatory neurogenesis to gliogenesis and OB interneuron neurogenesis in the cortex. While Shh signaling promotes Olig2 expression in the developing spinal cord, the exact mechanism for this transcriptional regulation is not known. Furthermore, the transcriptional regulation of Olig2 and Egfr has not been explored. Here, we show that in cortical progenitor cells, multiple regulatory programs, including Pax6 and Gli3, prevent precocious expression of Olig2, a gene essential for production of cortical oligodendrocytes and astrocytes. We identify multiple enhancers that control Olig2 expression in cortical progenitors and show that the mechanisms for regulating Olig2 expression are conserved between the mouse and human. Our study reveals evolutionarily conserved regulatory logic controlling the lineage switch of cortical neural stem cells.

59 BASIC BIOLOGICAL SCIENCES↗

Binary operations on neuromorphic hardware with application to linear algebraic operations and stochastic equations

Abstract Non-von Neumann computational hardware, based on neuron-inspired, non-linear elements connected via linear, weighted synapses—so-called neuromorphic systems—is a viable computational substrate. Since neuromorphic systems have been shown to use less power than CPUs for many applications, they are of potential use in autonomous systems such as robots, drones, and satellites, for which power resources are at a premium. The power used by neuromorphic systems is approximately proportional to the number of spiking events produced by neurons on-chip. However, typical information encoding on these chips is in the form of firing rates that unarily encode information. That is, the number of spikes generated by a neuron is meant to be proportional to an encoded value used in a computation or algorithm. Unary encoding is less efficient (produces more spikes) than binary encoding. For this reason, here we present neuromorphic computational mechanisms for implementing binary two’s complement operations. We use the mechanisms to construct a neuromorphic, binary matrix multiplication algorithm that may be used as a primitive for linear differential equation integration, deep networks, and other standard calculations. We also construct a random walk circuit and apply it in Brownian motion simulations. We study how both algorithms scale in circuit size and iteration time.

97 MATHEMATICS AND COMPUTING↗

Locally adaptive activation functions with slope recovery for deep and physics-informed neural networks

Here we propose two approaches of locally adaptive activation functions namely, layer-wise and neuron-wise locally adaptive activation functions, which improve the performance of deep and physics-informed neural networks. The local adaptation of activation function is achieved by introducing a scalable parameter in each layer (layer-wise) and for every neuron (neuron-wise) separately, and then optimizing it using a variant of stochastic gradient descent algorithm. In order to further increase the training speed, an activation slope-based slope recovery term is added in the loss function, which further accelerates convergence, thereby reducing the training cost. On the theoretical side, we prove that in the proposed method, the gradient descent algorithms are not attracted to sub-optimal critical points or local minima under practical conditions on the initialization and learning rate, and that the gradient dynamics of the proposed method is not achievable by base methods with any (adaptive) learning rates. We further show that the adaptive activation methods accelerate the convergence by implicitly multiplying conditioning matrices to the gradient of the base method without any explicit computation of the conditioning matrix and the matrix–vector product. The different adaptive activation functions are shown to induce different implicit conditioning matrices. Furthermore, the proposed methods with the slope recovery are shown to accelerate the training process.

97 MATHEMATICS AND COMPUTING↗

Ultrafast Neuromorphic Dynamics Using Hidden Phases in the Prototype of Relaxor Ferroelectrics

Materials possessing multiple states are promising to emulate synaptic and neuronic behaviors. Their operation frequency, typically in or below the GHz range, however, limits the speed of neuromorphic computing. Ultrafast THz electric field excitation has been employed to induce nonequilibrium states of matter, called hidden phases in oxides. One may wonder if there are systems for which THz pulses can generate neuronic and synaptic behavior, via the creation of hidden phases. Using atomistic simulations, we discover that relaxor ferroelectrics can emulate all the key neuronic and memristive synaptic features. Their occurrence originates from the activation of many hidden phases of polarization order, resulting from the response of nanoregions to THz pulses. We find such phases further possess different dielectric constants, which is also promising for memcapacitor devices.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A brain-plausible neuromorphic on-the-fly learning system implemented with magnetic domain wall analog memristors

Neuromorphic computing is an approach to efficiently solve complicated learning and cognition problems like the human brain using electronics. To efficiently implement the functionality of biological neurons, nanodevices and their implementations in circuits are exploited. Here, we describe a general-purpose spiking neuromorphic system that can solve on-the-fly learning problems, based on magnetic domain wall analog memristors (MAMs) that exhibit many different states with persistence over the lifetime of the device. The research includes micromagnetic and SPICE modeling of the MAM, CMOS neuromorphic analog circuit design of synapses incorporating the MAM, and the design of hybrid CMOS/MAM spiking neuronal networks in which the MAM provides variable synapse strength with persistence. Using this neuronal neuromorphic system, simulations show that the MAM-boosted neuromorphic system can achieve persistence, can demonstrate deterministic fast on-the-fly learning with the potential for reduced circuitry complexity, and can provide increased capabilities over an all-CMOS implementation.

42 ENGINEERING↗

Selective area doping for Mott neuromorphic electronics

The cointegration of artificial neuronal and synaptic devices with homotypic materials and structures can greatly simplify the fabrication of neuromorphic hardware. We demonstrate experimental realization of vanadium dioxide (VO 2 ) artificial neurons and synapses on the same substrate through selective area carrier doping. By locally configuring pairs of catalytic and inert electrodes that enable nanoscale control over carrier density, volatility or nonvolatility can be appropriately assigned to each two-terminal Mott memory device per lithographic design, and both neuron- and synapse-like devices are successfully integrated on a single chip. Feedforward excitation and inhibition neural motifs are demonstrated at hardware level, followed by simulation of network-level handwritten digit and fashion product recognition tasks with experimental characteristics. Spatially selective electron doping opens up previously unidentified avenues for integration of emerging correlated semiconductors in electronic device technologies.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Plateau Phenomenon in Gradient Descent Training of RELU Networks: Explanation, Quantification, and Avoidance

The ability of neural networks to provide ‘best in class’ approximation across a wide range of applications is well-documented. Nevertheless, the powerful expressivity of neural networks comes to naught if one is unable to effectively train (choose) the parameters defining the network. In general, neural networks are trained by gradient descent type optimization methods,a stochastic variant thereof. In practice, such methods result in the loss function decreases rapidly at the beginning of training but then, after a relatively small number of steps, significantly slow down. The loss may even appear to stagnate over the period of a large number of epochs, only to then suddenly start to decrease fast again for no apparent reason. This so-called plateau phenomenon manifests itself in many learning tasks. The present work aims to identify and quantify the root causes of plateau phenomenon.analysis is carried out in the setting of univariate ReLU networks. No assumptions are made on the number of neurons relative to the number of training data, and our results hold for both the lazy and adaptive regimes. Here, the main findings are: plateaux correspond to periods during which activation patterns remain constant, where activation pattern refers to the number of data points that activate a given neuron; quantification of convergence of the gradient flow dynamics; and, characterization stationary points in terms solutions of local least squares regression lines over subsets of the training data. Based on these conclusions, we propose a new iterative training method, the Active Neuron Least Squares (ANLS), characterised by the explicit adjustment of the activation pattern at each step, which is designed to enable a quick exit from a plateau. Illustrative numerical examples are included throughout.

97 MATHEMATICS AND COMPUTING↗

Physical insights into biological memory using phospholipid membranes

Electrical signals may propagate along neuronal membranes in the brain, thus enabling communication between nerve cells. In doing so, lipid bilayers, fundamental scaffolds of all cell membranes, deform and restructure in response to such electrical activity. These changes impact the electromechanical properties of the membrane, which then physically store biological memory. This memory can exist either over a short or long period of time. Traditionally, biological memory is defined by the strengthening or weakening of transmissions between individual neurons. In this report we show that electrical stimulation may also alter the properties of the lipid membrane, thus pointing toward a novel mechanism for memory storage. Furthermore, based on the analysis of existing electrophysiological data, we study molecular mechanisms underlying the long-term potentiation in phospholipid membranes. Finally, we examine possible relationships between the memory capacitive properties of lipid membranes, neuronal learning, and memory.

59 BASIC BIOLOGICAL SCIENCES↗