Leveraging stochasticity in memristive synapses for efficient and reliable neuromorphic systems
Not Available
Das, Hritom↗
Engineering topics
Rose, Garrett S.
Publications and source records attributed to Rose, Garrett S..
Enhanced read resolution in reconfigurable memristive synapses for Spiking Neural Networks
Abstract The synapse is a key element circuit in any memristor-based neuromorphic computing system. A memristor is a two-terminal analog memory device. Memristive synapses suffer from various challenges including high voltage, SET or RESET failure, and READ margin issues that can degrade the distinguishability of stored weights. Enhancing READ resolution is very important to improving the reliability of memristive synapses. Usually, the READ resolution is very small for a memristive synapse with a 4-bit data precision. This work considers a step-by-step analysis to enhance the READ current resolution or the read current difference between two resistance levels for a current-controlled memristor-based synapse. An empirical model is used to characterize the $${\hbox {HfO}}_{2}$$ HfO 2 based memristive device. $$1\textrm{st}$$ 1 st and $$2\textrm{nd}$$ 2 nd stage device of our proposed synapse design can be scaled to enhance the READ current margin up to $$\sim$$ ∼ 4.3 $$\times$$ × and $$\sim$$ ∼ 21%, respectively. Moreover, READ current resolution can be enhanced with run-time adaptation techniques such as READ voltage scaling and body biasing. The READ voltage scaling and body biasing can improve the READ current resolution by about 46% and 15%, respectively. TENNLab’s neuromorphic computing framework is leveraged to evaluate the effect of READ current resolution on classification, control, and reservoir computing applications. Higher READ current resolution shows better accuracy than lower resolution even when facing different levels of read noise.
97 MATHEMATICS AND COMPUTING↗
Design of a Robust Memristive Spiking Neuromorphic System with Unsupervised Learning in Hardware
Spiking neural networks (SNN) offer a power efficient, biologically plausible learning paradigm by encoding information into spikes. The discovery of the memristor has accelerated the progress of spiking neuromorphic systems, as the intrinsic plasticity of the device makes it an ideal candidate to mimic a biological synapse. Despite providing a nanoscale form factor, non-volatility, and low-power operation, memristors suffer from device-level non-idealities, which impact system-level performance. To address these issues, this article presents a memristive crossbar-based neuromorphic system using unsupervised learning with twin-memristor synapses, fully digital pulse width modulated spike-timing-dependent plasticity, and homeostasis neurons. Additionally, the implemented single-layer SNN was applied to a pattern-recognition task of classifying handwritten-digits. The performance of the system was analyzed by varying design parameters such as number of training epochs, neurons, and capacitors. Furthermore, the impact of memristor device non-idealities, such as device-switching mismatch, aging, failure, and process variations, were investigated and the resilience of the proposed system was demonstrated.
97 MATHEMATICS AND COMPUTING↗
Dynamical nonlinear memory capacitance in biomimetic membranes
Two-terminal memory elements, or memelements, capable of co-locating signal processing and memory via history-dependent reconfigurability at the nanoscale are vital for next-generation computing materials striving to match the brain’s efficiency and flexible cognitive capabilities. While memory resistors, or memristors, have been widely reported, other types of memelements remain underexplored or undiscovered. Here we report the first example of a volatile, voltage-controlled memcapacitor in which capacitive memory arises from reversible and hysteretic geometrical changes in a lipid bilayer that mimics the composition and structure of biomembranes. We demonstrate that the nonlinear dynamics and memory are governed by two implicitly-coupled, voltage-dependent state variables—membrane radius and thickness. Further, our system is capable of tuneable signal processing and learning via synapse-like, short-term capacitive plasticity. These findings will accelerate the development of low-energy, biomolecular neuromorphic memelements, which, in turn, could also serve as models to study capacitive memory and signal processing in neuronal membranes.
59 BASIC BIOLOGICAL SCIENCES↗
Assembly and Characterization of Biomolecular Memristors Consisting of Ion Channel-doped Lipid Membranes
The ability to recreate synaptic functionalities in synthetic circuit elements is essential for neuromorphic computing systems that seek to emulate the cognitive powers of the brain with comparable efficiency and density. To date, silicon-based three-terminal transistors and two-terminal memristors have been widely used in neuromorphic circuits, in large part due to their ability to co-locate information processing and memory. Yet these devices cannot achieve the interconnectivity and complexity of the brain because they are power-hungry, fail to mimic key synaptic functionalities, and suffer from high noise and high switching voltages. To overcome these limitations, we have developed and characterized a biomolecular memristor that mimics the composition, structure, and switching characteristics of biological synapses. Here, we describe the process of assembling and characterizing biomolecular memristors consisting of a 5 nm-thick lipid bilayer formed between lipid-functionalized water droplets in oil and doped with voltage-activated alamethicin peptides. While similar assembly protocols have been used to investigate biophysical properties of droplet-supported lipid membranes and membrane-bound ion channels, this article focuses on key modifications of the droplet interface bilayer method essential for achieving consistent memristor performance. Specifically, we describe the liposome preparation process and the incorporation of alamethicin peptides in lipid bilayer membranes, and the appropriate concentrations of each constituent as well as their impact on the overall response of the memristors. As a result, we also detail the characterization process of biomolecular memristors, including measurement and analysis of memristive current-voltage relationships obtained via cyclic voltammetry, as well as short-term plasticity and learning in response to step-wise voltage pulse trains.
97 MATHEMATICS AND COMPUTING↗
The TENNLab Exploratory Neuromorphic Computing Framework
Spiking, neuromorphic computing systems are in a period of active exploration by the computing community. While they feature computational expressiveness beyond both von Neumann computing models and feed-forward neural networks, they are also challenging to design and program. The TENNLab exploratory neuromorphic computing framework is a software infrastructure, soon to be open-source, whose goal is to enable potential users of spiking, neuromorphic computing systems to develop applications and evaluate computing architectures, and for architecture researchers to develop and evaluate their architectures with a variety of applications. In this letter, we present the software architecture of the TENNLab framework.
97 MATHEMATICS AND COMPUTING↗
Neuromorphic computing for temporal scientific data classification
In this work, we apply a spiking neural network model and an associated memristive neuromorphic implementation to an application in classifying temporal scientific data. We demonstrate that the spiking neural network model achieves comparable results to a previously reported convolutional neural network model, with significantly fewer neurons and synapses required.
Schuman, Catherine↗
A Unified Hardware/Software Co-Design Framework for Neuromorphic Computing Devices and Applications
Explore the source record for details and available documents.
Plank, James↗
Memristive Mixed-Signal Neuromorphic Systems: Energy-Efficient Learning at the Circuit-Level
Neuromorphic computing is non-von Neumann computer architecture for the post Moore’s law era of computing. Since a main focus of the post Moore’s law era is energy-efficient computing with fewer resources and less area, neuromorphic computing contributes effectively in this research. Here in this paper, we present a memristive neuromorphic system for improved power and area efficiency. Our particular mixed-signal approach implements neural networks with spiking events in a synchronous way. Moreover, the use of nano-scale memristive devices saves both area and power in the system. We also provide device-level considerations that make the system more energy-efficient. The proposed system additionally includes synchronous digital long term plasticity, an online learning methodology that helps the system train the neural networks during the operation phase and improves the efficiency in learning considering the power consumption and area overhead.
77 NANOSCIENCE AND NANOTECHNOLOGY↗
Simulating and Estimating the Behavior of a Neuromorphic Co-Processor
Neuromorphic computing represents one technology likely to be incorporated into future supercomputers. In this work, we present initial results on a potential neuromorphic co-processor, including a preliminary device design that includes memristors, estimates on energy usage for the co-processor, and performance of an on-line learning mechanism. We also present a high-level co-processor simulator used to estimate the performance of the neuromorphic co-processor on real applications. We discuss future use-cases of a potential neuromorphic co-processor in the supercomputing environment, including as an accelerator for supervised learning and for unsupervised, on-line learning tasks. Finally, we discuss plans for future work.
Schuman, Catherine↗