Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Synaptic plasticity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Physical insights into biological memory using phospholipid membranes

Electrical signals may propagate along neuronal membranes in the brain, thus enabling communication between nerve cells. In doing so, lipid bilayers, fundamental scaffolds of all cell membranes, deform and restructure in response to such electrical activity. These changes impact the electromechanical properties of the membrane, which then physically store biological memory. This memory can exist either over a short or long period of time. Traditionally, biological memory is defined by the strengthening or weakening of transmissions between individual neurons. In this report we show that electrical stimulation may also alter the properties of the lipid membrane, thus pointing toward a novel mechanism for memory storage. Furthermore, based on the analysis of existing electrophysiological data, we study molecular mechanisms underlying the long-term potentiation in phospholipid membranes. Finally, we examine possible relationships between the memory capacitive properties of lipid membranes, neuronal learning, and memory.

59 BASIC BIOLOGICAL SCIENCES↗

Heterosynaptic plasticity in biomembrane memristors controlled by pH

Abstract In biology, heterosynaptic plasticity maintains homeostasis in synaptic inputs during associative learning and memory, and initiates long-term changes in synaptic strengths that nonspecifically modulate different synapse types. In bioinspired neuromorphic circuits, heterosynaptic plasticity may be used to extend the functionality of two-terminal, biomimetic memristors. In this article, we explore how changes in the pH of droplet interface bilayer aqueous solutions modulate the memristive responses of a lipid bilayer membrane in the pH range 4.97–7.40. Surprisingly, we did not find conclusive evidence for pH-dependent shifts in the voltage thresholds ( V* ) needed for alamethicin ion channel formation in the membrane. However, we did observe a clear modulation in the dynamics of pore formation with pH in time-dependent, pulsed voltage experiments. Moreover, at the same voltage, lowering the pH resulted in higher steady-state currents because of increased numbers of conductive peptide ion channels in the membrane. This was due to increased partitioning of alamethicin monomers into the membrane at pH 4.97, which is below the pKa (~5.3–5.7) of carboxylate groups on the glutamate residues of the peptide, making the monomers more hydrophobic. Neutralization of the negative charges on these residues, under acidic conditions, increased the concentration of peptide monomers in the membrane, shifting the equilibrium concentrations of peptide aggregate assemblies in the membrane to favor greater numbers of larger, increasingly more conductive pores. It also increased the relaxation time constants for pore formation and decay, and enhanced short-term facilitation and depression of the switching characteristics of the device. Modulating these thresholds globally and independently of alamethicin concentration and applied voltage will enable the assembly of neuromorphic computational circuitry with enhanced functionality. Impact statement We describe how to use pH as a modulatory “interneuron” that changes the voltage-dependent memristance of alamethicin ion channels in lipid bilayers by changing the structure and dynamical properties of the bilayer. Having the ability to independently control the threshold levels for pore conduction from voltage or ion channel concentration enables additional levels of programmability in a neuromorphic system. In this article, we note that barriers to conduction from membrane-bound ion channels can be lowered by reducing solution pH, resulting in higher currents, and enhanced short-term learning behavior in the form of paired-pulse facilitation. Tuning threshold values with environmental variables, such as pH, provide additional training and learning algorithms that can be used to elicit complex functionality within spiking neural networks. Graphical abstract

36 MATERIALS SCIENCE↗

Correlative nano-imaging of metals and proteins in primary neurons by synchrotron X-ray fluorescence and STED super resolution microscopy: Experimental validation

It is becoming increasingly clear that biological metals such as iron, copper or zinc are involved in synaptic functions, and in particular in the mechanisms of synaptogenesis and subsequent plasticity. Understanding the role of metals on synaptic functions is a difficult challenge due to the very low concentration of these elements in neurons and to the submicrometer size of synaptic compartments. To address this challenge we have developed a correlative nano-imaging approach combining metal and protein detection. First, stimulated emission depletion (STED) microscopy, a super resolution optical microscopy technique, is applied to locate fluorescently labeled proteins. Then, synchrotron radiation induced X-ray fluorescence (SXRF) is performed on the same regions of interest, e.g. synaptic compartments. Here, we present here the principle scheme that allows this correlative nano-imaging and its experimental validation. We applied this correlative nano-imaging to the study of the physiological distribution of metals in synaptic compartments of primary rat hippocampal neurons. We thus compared the nanometric distribution of metals with that of synaptic proteins, such as PSD95 or cytoskeleton proteins. Compared to correlative imaging approaches currently used to characterize synaptic structures, such as electron microscopy correlated with optical fluorescence, our approach allows for ultra-sensitive detection of trace metals using highly focused synchrotron radiation beams. We provide proof-of-principle for correlative imaging of metals and proteins at the synaptic scale and discuss the present limitations and future developments in this area.

59 BASIC BIOLOGICAL SCIENCES↗

Thin film design of amorphous hafnium oxide nanocomposites enabling strong interfacial resistive switching uniformity

A design concept of phase-separated amorphous nanocomposite thin films is presented that realizes interfacial resistive switching (RS) in hafnium-oxide-based devices. The films are formed by incorporating an average of 7% Ba into hafnium oxide during pulsed laser deposition at temperatures ≤400°C. The added Ba prevents the films from crystallizing and leads to ~20-nm-thin films consisting of an amorphous HfO x host matrix interspersed with ~2-nm-wide, ~5-to-10-nm-pitch Ba-rich amorphous nanocolumns penetrating approximately two-thirds through the films. This restricts the RS to an interfacial Schottky-like energy barrier whose magnitude is tuned by ionic migration under an applied electric field. Resulting devices achieve stable cycle-to-cycle, device-to-device, and sample-to-sample reproducibility with a measured switching endurance of ≥10 4 cycles for a memory window ≥10 at switching voltages of ±2 V. Each device can be set to multiple intermediate resistance states, which enables synaptic spike-timing–dependent plasticity. The presented concept unlocks additional design variables for RS devices.

36 MATERIALS SCIENCE↗

Formation and retrieval of cell assemblies in a biologically realistic spiking neural network model of area CA3 in the mouse hippocampus

The hippocampal formation is critical for episodic memory, with area Cornu Ammonis 3 (CA3) a necessary substrate for auto-associative pattern completion. Recent theoretical and experimental evidence suggests that the formation and retrieval of cell assemblies enable these functions. Yet, how cell assemblies are formed and retrieved in a full-scale spiking neural network (SNN) of CA3 that incorporates the observed diversity of neurons and connections within this circuit is not well understood. Here, we demonstrate that a data-driven SNN model quantitatively reflecting the neuron type-specific population sizes, intrinsic electrophysiology, connectivity statistics, synaptic signaling, and long-term plasticity of the mouse CA3 is capable of robust auto-association and pattern completion via cell assemblies. Our results show that a broad range of assembly sizes could successfully and systematically retrieve patterns from heavily incomplete or corrupted cues after a limited number of presentations. Furthermore, performance was robust with respect to partial overlap of assemblies through shared cells, substantially enhancing memory capacity. These novel findings provide computational evidence that the specific biological properties of the CA3 circuit produce an effective neural substrate for associative learning in the mammalian brain.

hetero-association↗

Defect-engineered monolayer MoS 2 with enhanced memristive and synaptic functionality for neuromorphic computing

Two-dimensional transition metal dichalcogenides (TMDs)-based memristors are promising candidates for realizing artificial synapses in next-generation computing. However, practical implementation faces several challenges, such as high non-linearity and asymmetry in synaptic weight updates, limited dynamic range, and cycle-to-cycle variability. Here, utilizing optimal-power argon plasma treatment, we significantly enhance the performance matrix of memristors fabricated from monolayer MoS 2 . Our approach not only improves linearity and symmetry in synaptic weight updates but also increases the number of available synaptic weight updates and enhances Spike-Time Dependent Plasticity. Notably, it broadens the switching ratio by two orders, minimizes cycle-to-cycle variability, reduces non-linear factors, and achieves an energy consumption of ~30 fJ per synaptic event. Implementation of these enhancements is demonstrated through Artificial Neural Network simulations, yielding a learning accuracy of ~97% on the MNIST hand-written digits dataset. Our findings underscore the significance of defect engineering as a powerful tool in advancing the synaptic functionality of memristors.

97 MATHEMATICS AND COMPUTING↗

Assessment of Postflight Locomotor Performance Utilizing a Test of Functional Mobility: Strategic and Adaptive Responses

Space flight induces adaptive modification in sensorimotor function, allowing crewmembers to operate in the unique microgravity environment. This adaptive state, however, is inappropriate for a terrestrial environment. During a re-adaptation period upon their return to Earth, crewmembers experience alterations in sensorimotor function, causing various disturbances in perception, spatial orientation, posture, gait, and eye-head coordination. Following long duration space flight, sensorimotor dysfunction would prevent or extend the time required to make an emergency egress from the vehicle; compromising crew safety and mission objectives. We are investigating two types of motor learning that may interact with each other and influence a crewmember's ability to re-adapt to Earth's gravity environment. In strategic learning, crewmembers make rapid modifications in their motor control strategy emphasizing error reduction. This type of learning may be critical during the first minutes and hours after landing. In adaptive learning, long-term plastic transformations occur, involving morphological changes and synaptic modification. In recent literature these two behavioral components have been associated with separate brain structures that control the execution of motor strategies: the strategic component was linked to the posterior parietal cortex and the adaptive component was linked to the cerebellum (Pisella, et al. 2004). The goal of this paper was to demonstrate the relative contributions of the strategic and adaptive components to the re-adaptation process in locomotor control after long duration space flight missions on the International Space Station (ISS). The Functional Mobility Test (FMT) was developed to assess crewmember s ability to ambulate postflight from an operational and functional perspective. Sixteen crewmembers were tested preflight (3 sessions) and postflight (days 1, 2, 4, 7, 25) following a long duration space flight (approx 6 months) on the ISS. We have further analyzed the FMT data to characterize strategic and adaptive components during the postflight readaptation period. Crewmembers walked at a preferred pace through an obstacle course set up on a base of 10 cm thick medium density foam (Sunmate Foam, Dynamic Systems, Inc., Leicester, NC). The 6.0m X 4.0m course consisted of several pylons made of foam; a Styrofoam barrier 46.0cm high that crewmembers stepped over; and a portal constructed of two Styrofoam blocks, each 31cm high, with a horizontal bar covered by foam and suspended from the ceiling which was adjusted to the height of the crewmember s shoulder. The portal required crewmembers to bend at the waist and step over a barrier simultaneously. All obstacles were lightweight, soft and easily knocked over. Crewmembers were instructed to walk through the course as quickly and as safely as possible without touching any of the objects on the course. This task was performed three times in the clockwise direction and three times in the counterclockwise direction that was randomly chosen. The dependent measures for each trial were: time to complete the course (seconds) and the number of obstacles touched or knocked down. For each crewmember, the time to complete each FMT trial from postflight days 1, 2, 4, 7 and 25 were further analyzed. A single logarithmic curve using a least squares calculation was fit through these data to produce a single comprehensive curve (macro). This macro curve composed of data spanning 25 days, illustrates the re-adaptive learning function over the longer time scale term. Additionally, logarithmic curves were fit to the 6 data trials within each individual post flight test day to produce 5 separate daily curves. These micro curves, produced from data obtained over the course of minutes, illustrates the strategic learning function exhibited over a relative shorter time scale. The macro curve for all subjects exhibited adaptive motor learning patterns over the 25 day period. Howev, 9/16 crewmembers exhibited significant strategic motor learning patterns in their micro curves, as defined by m > 1 in the equation of the line y=m*LN(x) +b. These data indicate that postflight recovery in locomotor function involves both strategic and adaptive mechanisms. Future countermeasures will be designed to enhance both recovery processes.

Warren, L. E.↗

Biomaterial–Based Solid–Electrolyte Organic Electrochemical Transistors for Electronic and Neuromorphic Applications

In this work a systematic study of biomaterial–based solid–state organic electrochemical transistors (OECTs) is presented in which biogels consisting of gelatin and glycerol, two food–grade materials, are chosen as the model solid electrolyte. Such gels are fundamentally attractive for bioelectronics and wearable applications due to their superior and tunable electrical and mechanical properties, which allow one to fabricate solid–state organic transistors with high ON/OFF ratio and transconductance, possible millisecond–switching speed, and 6–month stability in ambient air. Next, the authors show a good control of the state–retention property of biogel OECTs, demonstrated herein by employing them as artificial synapses with various synaptic functions, such as frequency–based short–term plasticity. This study herein paves the way for the development of biomaterial–based electronics by providing guiding principles for future works that employ biomaterials in OECTs.

36 MATERIALS SCIENCE↗

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli using multi-scale parallel processing. Mimicking neuronal response properties in early visual cortex, images were preprocessed with three different spatial frequency (SF) channels, before they were fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity. We investigate how the quality of the represented objects changes under different SF bands and WTA-I schemes. We demonstrate that a network of 200 spiking neurons tuned to three SFs can efficiently represent objects with as little as 15 spikes per neuron. Furthermore, studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.

59 BASIC BIOLOGICAL SCIENCES↗

A domain wall-magnetic tunnel junction artificial synapse with notched geometry for accurate and efficient training of deep neural networks

Inspired by the parallelism and efficiency of the brain, several candidates for artificial synapse devices have been developed for neuromorphic computing, yet a nonlinear and asymmetric synaptic response curve precludes their use for backpropagation, the foundation of modern supervised learning. Spintronic devices—which benefit from high endurance, low power consumption, low latency, and CMOS compatibility—are a promising technology for memory, and domain-wall magnetic tunnel junction (DW-MTJ) devices have been shown to implement synaptic functions such as long-term potentiation and spike-timing dependent plasticity. In this work, we propose a notched DW-MTJ synapse as a candidate for supervised learning. Using micromagnetic simulations at room temperature, we show that notched synapses ensure the non-volatility of the synaptic weight and allow for highly linear, symmetric, and reproducible weight updates using either spin transfer torque (STT) or spin–orbit torque (SOT) mechanisms of DW propagation. We use lookup tables constructed from micromagnetics simulations to model the training of neural networks built with DW-MTJ synapses on both the MNIST and Fashion-MNIST image classification tasks. Accounting for thermal noise and realistic process variations, the DW-MTJ devices achieve classification accuracy close to ideal floating-point updates using both STT and SOT devices at room temperature and at 400 K. Our work establishes the basis for a magnetic artificial synapse that can eventually lead to hardware neural networks with fully spintronic matrix operations implementing machine learning.

42 ENGINEERING↗

Mechanisms for Antagonistic Regulation of AMPA and NMDA-D1 Receptor Complexes at Postsynaptic Sites

From the analysis of these pathways we conclude that postsynaptic processes that regulate synaptic transmission undergo significant cross-talk with respect to glutamatergic and neuromodulatory (dopamine) signals. The main hypothesis is that of a compensatory regulation, a competitive switch between the induction of increased AMPA conductance by CaMKII-dependent phosphorylation and reduced expression of PP2A, and increased D1 receptor sensitivity and expression by increased PKA, PP2A and decreased PP-1/calcineurin expression. Both types of plasticity are induced by NMDA receptor activation and increased internal calcium, they require different internal conditions to become expressed. Specifically we propose that AMPA regulation and D1 regulation are inversely coupled;The net result may be a bifurcation of synaptic state into predominantly AMPA or NMDA-D1 synapses. This could have functional consequences: stable connections for AMPA and conditional gating for NMDA-D1 synapses.

Schumann, Johann↗

Interlayer Exciton Polarons in Mesoscopic V 2 O 5 for Broadband Optoelectronic Synapses

Persistent photoconductivity and optoelectronic synaptic behavior are demonstrated in solution-processed mesoscopic α-phase vanadium pentoxide (V 2 O 5 ) thin films. First-principles simulations coupled with the two-site Holstein polaron hopping model show that vacancies at the terminal oxygen position lead to long recombination times because photoexcited electrons and holes reside on different layers separated by the van der Waals gap, forming a weakly coupled interlayer exciton polaron. Mid-gap polaronic states also significantly broaden the photoresponse of the films to span across visible and infrared wavelengths. By controlling the amplitude/intensity, duration, and/or number of optical pulses, tunable optoelectronic memory functions, such as short-term and long-term plasticity, are experimentally established in V 2 O 5 -based optoelectronic synapses. Furthermore, device fabrication was extended to mechanically flexible ultrathin glass substrates. Flexible optoelectronic synapses maintained high performance after 150 bending cycles.

Phan, Thanh Luan [National Renewable Energy Labora↗

Skip-Connected Self-Recurrent Spiking Neural Networks with Joint Intrinsic Parameter and Synaptic Weight Training

As an important class of spiking neural networks (SNNs), recurrent spiking neural networks (RSNNs) possess great computational power and have been widely used for processing sequential data like audio and text. However, most RSNNs suffer from two problems. 1. Due to the lack of architectural guidance, random recurrent connectivity is often adopted, which does not guarantee good performance. 2. Training of RSNNs is in general challenging, bottlenecking achievable model accuracy. To address these problems, we propose a new type of RSNNs called Skip-Connected Self-Recurrent SNNs (ScSr-SNNs). Recurrence in ScSr-SNNs is introduced in a stereotyped manner by adding self-recurrent connections to spiking neurons. The SNNs with self-recurrent connections can realize recurrent behaviors similar to those of more complex RSNNs while the error gradients can be more straightforwardly calculated due to the mostly feedforward nature of the network. The network dynamics is enriched by skip connections between nonadjacent layers. Moreover, we propose a new backpropagation (BP) method called backpropagated intrinsic plasticity (BIP) to further boost the performance of ScSr-SNNs by training intrinsic model parameters. Unlike standard intrinsic plasticity rules that adjust the neuron's intrinsic parameters according to neuronal activity, the proposed BIP method optimizes intrinsic parameters based on the backpropagated error gradient of a well-defined global loss function in addition to synaptic weight training. Here, based on challenging speech, neuromorphic speech, and neuromorphic image datasets, the proposed ScSr-SNNs can boost performance by up to 2.85% compared with other types of RSNNs trained by state-of-the-art BP methods.

97 MATHEMATICS AND COMPUTING↗

Electrophysiological Signatures of Visual Recognition Memory across All Layers of Mouse V1

In mouse primary visual cortex (V1), familiar stimuli evoke significantly altered responses when compared with novel stimuli. This stimulus-selective response plasticity (SRP) was described originally as an increase in the magnitude of visual evoked potentials (VEPs) elicited in layer 4 (L4) by familiar phase-reversing grating stimuli. SRP is dependent on NMDA receptors (NMDARs) and has been hypothesized to reflect potentiation of thalamocortical (TC) synapses in L4. However, recent evidence indicates that the synaptic modifications that manifest as SRP do not occur on L4 principal cells. To shed light on where and how SRP is induced and expressed in male and female mice, the present study had three related aims: (1) to confirm that NMDAR are required specifically in glutamatergic principal neurons of V1, (2) to investigate the consequences of deleting NMDAR specifically in L6, and (3) to use translaminar electrophysiological recordings to characterize SRP expression in different layers of V1. We find that knock-out (KO) of NMDAR in L6 principal neurons disrupts SRP. Current-source density (CSD) analysis of the VEP depth profile shows augmentation of short latency current sinks in layers 3, 4, and 6 in response to phase reversals of familiar stimuli. Multiunit recordings demonstrate that increased peak firing occurs in response to phase reversals of familiar stimuli across all layers, but that activity between phase reversals is suppressed. Together, these data reveal important aspects of the underlying phenomenology of SRP and generate new hypotheses for the expression of experience-dependent plasticity in V1. SIGNIFICANCE STATEMENT Repeated exposure to stimuli that portend neither reward nor punishment leads to behavioral habituation, enabling organisms to dedicate attention to novel or otherwise significant features of the environment. The neural basis of this process, which is so often dysregulated in neurologic and psychiatric disorders, remains poorly understood. Learning and memory of stimulus familiarity can be studied in mouse visual cortex by measuring electrophysiological responses to simple phase-reversing grating stimuli. The current study advances knowledge of this process by documenting changes in visual evoked potentials (VEPs), neuronal spiking activity, and oscillations in the local field potentials (LFPs) across all layers of mouse visual cortex. In addition, we identify a key contribution of a specific population of neurons in layer 6 (L6) of visual cortex.

60 APPLIED LIFE SCIENCES↗

Dose-dependent consequences of sub-chronic fentanyl exposure on neuron and glial co-cultures

Fentanyl is one of the most common opioid analgesics administered to patients undergoing surgery or for chronic pain management. While the side effects of chronic fentanyl abuse are recognized (e.g., addiction, tolerance, impairment of cognitive functions, and inhibit nociception, arousal, and respiration), it remains poorly understood what and how changes in brain activity from chronic fentanyl use influences the respective behavioral outcome. Here, we examined the functional and molecular changes to cortical neural network activity following sub-chronic exposure to two fentanyl concentrations, a low (0.01 μM) and high (10 μM) dose. Primary rat co-cultures, containing cortical neurons, astrocytes, and oligodendrocyte precursor cells, were seeded in wells on either a 6-well multi-electrode array (MEA, for electrophysiology) or a 96-well tissue culture plate (for serial endpoint bulk RNA sequencing analysis). Once networks matured (at 28 days in vitro ), co-cultures were treated with 0.01 or 10 μM of fentanyl for 4 days and monitored daily. Only high dose exposure to fentanyl resulted in a decline in features of spiking and bursting activity as early as 30 min post-exposure and sustained for 4 days in cultures. Transcriptomic analysis of the complex cultures after 4 days of fentanyl exposure revealed that both the low and high dose induced gene expression changes involved in synaptic transmission, inflammation, and organization of the extracellular matrix. Collectively, the findings of this in vitro study suggest that while neuroadaptive changes to neural network activity at a systems level was detected only at the high dose of fentanyl, transcriptomic changes were also detected at the low dose conditions, suggesting that fentanyl rapidly elicits changes in plasticity.

59 BASIC BIOLOGICAL SCIENCES↗

Plasticity of Neurovestibular Systems Following Micro- and Hyper-Gravity Exposure and Readaptation to Earth's 1G

The gravity-sensing organs sense the sum of inertial force due to head translation and head orientation relative to gravity. Normally gravity is constant, and yet the neural sensors show remarkable plasticity. When the force of gravity changes, such as in spaceflight or during centrifugation, the neurovestibular system responds by regulating its neural output, and this response is similar for the vertebrate utricular nerve afferents and for the statocyst hair cell in invertebrates. First, we examine the response of utricular afferents in toadfish following exposure to G on two orbital missions (STS-90 and 95). Within the first day after landing, magnitude of neural response to an applied acceleration was significantly elevated, and re-adaptation back to control values occurred within approximately 30 hours. Time course of return to normal approximately parallels the decrease in vestibular disorientation in astronauts following return. Next, we use well-controlled hyper-G experiments in the vertebrate model to address: If G leads to adaptation and subsequent re-adaptation neural processes, does the transfer from 1G to hyper-G impart the opposite effects and do the effects accompanying transfer from the hyper-G back to the 1G conditions resemble as an analog the transfer from 1G to the microG Results show a biphasic pattern in reaction to 3G exposures: an initial sensitivity up-regulation (3- and 4-day) followed by a significant decrease after longer exposure. Return to control values is on the order of 4-8 days. Utricular sensitivity is strongly regulated up or down by gravity load and the duration of exposure. Interestingly, we found no correlation of response and hair cell synaptic body counts despite the large gain difference between 4- and 16-Day subjects. Lastly, we examine responses of statocyst receptors in land snail following exposure to G on two unmanned Russian Orbital missions (Foton M-2 and -3). Here, we have the ability to measure the output directly from the hair cells. Similar to afferents in vertebrates the hair cells increased their response sensitivity to vestibular stimulation. Two major pieces of information are needed: the precise vertebrate hair cell response to altered gravity and the impact of longer duration exposures on sensory plasticity.

Boyle, Richard D.↗

A Hardware and Software Co-design Framework for Energy Efficient Neuromorphic Systems

Neuromorphic systems can be realized by a variety of algorithms and architectures. A common understanding is that spiking neuromorphic designs, which encode information into spatio-temporal spiking events, are both a biologically-accurate and efficient way of processing information. However, representing the information through timing relationships induces sophisticated circuit designs in traditional CMOS-based implementations. In recent years, high-capacity resistive memory (RRAM, aka, memristor) has demonstrated great potential in mimicking synaptic behaviors. Several RRAM-based spiking neuromorphic designs exist, most of which focus on rate coding schemes. These designs simplify circuit implementations of neuron models and explore challenges such as unsatisfactory speed, resolution, and performance. As an alternative, we will explore temporal coding spiking neuromorphic systems that encode information as the relative timing of neuron activations (spikes), which have been proven to be more adaptive and energy-efficient. Developing a neuromorphic system for spiking neural network (SNN) inference and online training, however, faces some major technical challenges: (1) It lacks circuit implementation support for temporal-coding SNN to achieve satisfying power efficiency and accuracy; (2) Although existing research works have investigated memristive synapse and neuron designs for spike-timing-dependent plasticity, the non-ideal conditions in implementation, such as device variations and signal degradation, degrade online learning accuracy of large scale systems; and (3) Non-optimized, inter-layer data traffic in SNNs, leads to unnecessary data communication costs. In this project, we plan to address these challenges by a hardware and software co-design framework that incorporates solutions at the circuit, architecture, and algorithm levels. At the circuit-level, we will elaborate on the in-situ SNN processing element designs for supporting both inference and online training modes. Variation-aware schemes will be studied to improve reliability. At the architecture level, we propose a pipelined, asynchronous architecture to retain the timing resolution of spikes. At the algorithm level, we will investigate an innovative SNN training algorithm for enabling activation sparsification and reducing unnecessary data communication costs. This neuromorphic system will provide an effective solution to real-life energy-constrained applications and significantly contribute to the exploration of next-generation high-performance computing systems under the DOE context.

97 MATHEMATICS AND COMPUTING↗

A Unidirectional Two-Compartment Neuron Circuit with On-chip STDP learning

Most neuromorphic chips implement the single-compartment point neuron model where synapse circuits connect directly to a leaky integrate and fire (LIF) soma circuit. However, when using a biologically plausible soma circuit (e.g., Hodgkin-Huxley neuron model), an interface circuitry, such as a current conveyor circuit, is needed to transmit synaptic current to the soma circuit. This is especially true for ultra-low power neuron circuits, where membrane capacitance is on the order of 20 fF. This need for an interface circuit arises because the parasitic capacitance and leakage current caused by fabrication mismatch and second-order effects of the output transistors in the synapse circuits can disturb the spiking dynamics of the soma circuit if connected without an interface. Using an interface circuit to isolate the soma’s membrane capacitor from synapses resolves this issue. We propose to use a unidirectional resistor (a transconductance circuit) to connect the synapse and soma circuits instead of conventional current conveyor circuits. Using a biologically plausible spike pattern detection model, we show that the on-chip spike-timing-dependent plasticity (STDP) learning performance of the proposed unidirectional two-compartment neuron circuit is similar to a single-compartment circuit (with a current conveyor as an interface) and additionally, it is more power-efficient and biologically plausible. The chip is fabricated in the Taiwan Semiconductor Manufacturing Company (TSMC) 250 nm technology node and comprises a single neuron circuit.

Gautam, Ashish [ORNL]↗