Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Neuromorphic computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Dual-ion ECRAM as a stable and accurate analog synapse

Electrochemical random-access memory (ECRAM) works by tuning the bulk electronic conductance of functional materials via reversible, electrochemical insertion of ions, resulting in stable analog resistive switching, attractive for analog in-memory and neuromorphic computing. However, achieving fast programming for training and long retention for inference has been elusive. Protonic ECRAM demonstrates fast programming but insufficient retention, while oxygen-based ECRAM with excellent retention requires elevated programming temperatures. Cu-based ECRAM offers a compromise, with an activation energy (E A ) of ≈0.76 eV between protons (E A ≈ 0.4 eV) and oxygen (E A > 1 eV), enabling extensive retention and room temperature programming. Combining Cu 2+ ions with protons to form a dual-ion ECRAM, we demonstrate two distinct switching behaviors: fast switching at ≤5 V, (E A ≈ 0.45 eV) via protons, and nonvolatile, room temperature switching at ≥8 V, with E A ≈ 0.76 eV via Cu 2+ ions. In conclusion, the Cu-based state exhibits a wide conductance range, with excellent retention, low noise, and linear current-voltage behavior, achieving digital-equivalent ImageNet inference accuracy.

analog in-memory computing↗

Resilience and Robustness of Spiking Neural Networks for Neuromorphic Systems

Though robustness and resilience are commonly quoted as features of neuromorphic computing systems, the expected performance of neuromorphic systems in the face of hardware failures is not clear. In this work, we study the effect of failures on the performance of four different training algo-rithms for spiking neural networks on neuromorphic systems: two back-propagation-based training approaches (Whetstone and SLAYER), a liquid state machine or reservoir computing approach, and an evolutionary optimization-based approach (EONS). We show that these four different approaches have very different resilience characteristics with respect to simulated hardware failures. We then analyze an approach for training more resilient spiking neural networks using the evolutionary optimization approach. We show how this approach produces more resilient networks and discuss how it can be extended to other spiking neural network training approaches as well.

Schuman, Catherine↗

Two-dimensional materials for bio-realistic neuronal computing networks

Two-dimensional (2D) van der Waals materials have found broad utility in a diverse range of applications including electronics, optoelectronics, renewable energy, and quantum information technologies. Meanwhile, exponentially growing digital data coupled with the ubiquity of artificial intelligence algorithms have generated significant interest in edge neuromorphic computing as an alternative to centralized cloud computing. The drive to incorporate neuroscience principles into computing hardware is motivated by the low power consumption, parallel processing, and reconfigurability of the human brain. The diverse library of 2D materials with atomic-level thicknesses, exceptional electrostatic tunability, and integration versatility is particularly well-suited for realizing bio-realistic synaptic and neuronal functionality. Here, we summarize past and present work in this field and outline the frontier challenges that have not yet been overcome. Here we also delineate potential solutions and suggest that the neuroscience principles of criticality and synchrony have the potential to inspire breakthrough applications of 2D materials in neuronal computing networks.

36 MATERIALS SCIENCE↗

Three Artificial Spintronic Leaky Integrate-and-Fire Neurons

We report that due to their non-volatility and intrinsic current integration capabilities, spintronic devices that rely on domain wall (DW) motion through a free ferromagnetic track have garnered significant interest in the field of neuromorphic computing. Although a number of such devices have already been proposed, they require the use of external circuitry to implement several important neuronal behaviors. As such, they are likely to result in either a decrease in energy efficiency, an increase in fabrication complexity, or even both. To resolve this issue, we have proposed three individual neurons that are capable of performing these functionalities without the use of an external circuitry. To implement leaking, the first neuron uses a dipolar coupling field, the second uses an anisotropy gradient, and the third uses shape variations of the DW track.

neural network crossbar↗

Uncontrolled Learning: Codesign of Neuromorphic Hardware Topology for Neuromorphic Algorithms

Neuromorphic computing has the potential to revolutionize future technologies and our understanding of intelligence, yet it remains challenging to realize in practice. The learning-from-mistakes algorithm, inspired by the brain's simple learning rules of inhibition and pruning, is one of the few brain-like training methods. This algorithm is implemented in neuromorphic memristive hardware through a codesign process that evaluates essential hardware trade-offs. While the algorithm effectively trains small networks as binary classifiers and perceptrons, performance declines significantly with increasing network size unless the hardware is tailored to the algorithm. This work investigates the trade-offs between depth, controllability, and capacity—the number of learnable patterns—in neuromorphic hardware. This highlights the importance of topology and governing equations, providing theoretical tools to evaluate a device's computational capacity based on its measurements and circuit structure. The findings show that breaking neural network symmetry enhances both controllability and capacity. Additionally, by pruning the circuit, neuromorphic algorithms in all-memristive circuits can utilize stochastic resources to create local contrasts in network weights. Through combined experimental and simulation efforts, the parameters are identified that enable networks to exhibit emergent intelligence from simple rules, advancing the potential of neuromorphic computing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

AI-Enhanced Co-Design for Next-Generation Microelectronics: Innovating Innovation (Workshop Report)

The Artificial Intelligence Enhanced Co-Design for Next Generation Microelectronics virtual workshop was held April 4-5, 2023, and attended by subject matter experts from universities, industry, and national laboratories. This was the third in a series of workshops to motivate the research community to identify and address major challenges facing microelectronics research and production. The 2023 workshop focused on a set of topics from materials to computing algorithms, and included discussions on relevant federal legislation and such as the Creating Helpful Incentives to Produce Semiconductors and Science Act (CHIPS Act) which was signed into law in the summer of 2022. Talks at the workshop included edge computing in radiation environments, new materials for neuromorphic computing, advanced packaging for microelectronics, and new AI techniques. We also received project updates from several of the Department of Energy (DOE) microelectronics co-design projects funded in the fall of 2021, and from three of the Energy Frontier Research Centers (EFRCs) that had been funded in the fall of 2022. The workshop also conducted a set of breakout discussions around the five principal research directions (PRDs) from the 2018 Department of Energy workshop report: 1) define innovative material, device, and architecture requirements driven by applications, algorithms, and software; 2) revolutionize memory and data storage; 3) re-imagine information flow unconstrained by interconnects; 4) redefine computing by leveraging unexploited physical phenomena; 5) reinvent the electricity grid through new materials, devices, and architectures. We tasked each breakout group to consider one primary PRD (and other PRDs as relevant topics arose during discussions) and to address questions such as whether the research community has embraced co-design as a methodology and whether new developments at any level of innovation from materials to programming models requires the research community to reevaluate the PRDs developed back in 2018.

97 MATHEMATICS AND COMPUTING↗

Operando characterization of conductive filaments during resistive switching in Mott VO 2

Significance To perform hardware-based neuromorphic computing, novel materials exhibiting a wide variety of electronic properties are currently being explored. VO 2 is well known to exhibit an insulator-to-metal transition as well as volatile resistive switching. Many questions regarding the basic mechanism of the nonvolatile switching in this material are unanswered. In this work, the formation and relaxation of conductive filaments through nonvolatile resistive switching in VO 2 devices have been realized. The V 5 O 9 Magnéli phase conductive filament has been identified. Our results demonstrate that both resistive switching behaviors can be achieved in a single material, crucial for future technology like resistive switching memories or neuromorphic logic.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Kelvin Probe Force Microscopy Imaging of Plasticity in Hydrogenated Perovskite Nickelate Multilevel Neuromorphic Devices

Ion drift in nanoscale electronically inhomogeneous semiconductors is among the most important mechanisms being studied for designing neuromorphic computing hardware. However, nondestructive imaging of the ion drift in operando devices directly responsible for multiresistance states and synaptic memory represents a formidable challenge. Here, we present Kelvin probe force microscopy imaging of hydrogen-doped perovskite nickelate device channels subject to high-speed electric field pulses to directly visualize proton distribution by monitoring surface potential changes spatially, which is also supported with finite element-based electric field distribution studies. First-principles calculations provide mechanistic insights into the origin of surface potential changes as a function of hydrogen donor doping that serves as the contrast mechanism. We demonstrate 128 (7-bit) nonvolatile conductance levels in such devices relevant to in-memory computing applications. The synaptic plasticity measurements are implemented in spiking neural networks and show promising results for classification (SciKit Learn’s Iris and Wine data sets) and control (OpenAI’s CartPole-v1 and BipedalWalker-v3) simulation tasks.

Kelvin probe force microscopy↗

Polaron-induced metal-to-insulator transition in vanadium oxides from density functional theory calculations

Vanadium oxides have been extensively studied as phase-change memory units in artificial synapses for neuromorphic computing due to their metal-insulator transitions (MIT) at or near room temperature. Recently, injection of charge carriers into vanadium oxides, e.g., via optically via a heterostructure, has been proposed as an alternative switching mechanism and also potentially as a means to tune the MIT temperature. In this study, we explore the formation of small polarons in the low temperature (LT) insulating phases for V 3 O 5 ,VO 2 , and V 2 O 3 , and the barriers to their migration using density functional theory calculations. We find that V 3 O 5 exhibits very low hole and electron polaron migration barriers (<100 meV) compared to V 2 O 3 and VO 2 , leading to much higher estimated polaronic conductivity. We also link the relative migration barriers to the amount of distortion that has to travel when the polaron migrate from one site to another. Polarons in V 3 O 5 also have smaller binding energies to vanadium and oxygen vacancy defects. Furthermore, these results suggest that the triggering of the MIT via injection of charge carriers are due to the formation of small polarons that can migrate rapidly through the crystal.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Comparing Exciton-Polariton Couplings in Two-Dimensional MoS2 Cavities

Exciton-polaritons (EPs) are an emerging approach to achieve strong light-matter coupling and robust quantum phenomena, with application to areas such as photonic neuromorphic computing for instance reservoir computing. 2D transition metal dichalcogenides (TMDs) are promising candidates to host EPs due to their potential for strong coupling as evidenced by large Rabi splitting energies, which in the case of few-layer MoS2 has been demonstrated to reach 293 meV when coupled to the C exciton, placing it in the ultrastrong coupling regime, at room temperature. Here we examine how the Rabi splitting of CVD-grown monolayer MoS2 in a cavity can be optimized by tuning two variables: cavity geometry (thickness of silver and dielectric spacers) and the targeted exciton for coupling (A at about 1.9 eV, B at about 2.06 eV, or C at about 2.9 eV). With the cavity geometry, there is a tradeoff between optical field confinement and transmission. With the targeted exciton, there may be a tradeoff between Rabi splitting and lifetime. Transfer matrix simulations are used to inform how thick the cavity layers need to be, and at what angle measurements should be performed, to achieve Rabi splitting at a certain exciton energy. Experimentally, the Rabi splitting is measured by placing the cavity at a specified angle and measuring the optical reflectance and transmittance. By fitting the data, we find Rabi splittings of 124 meV, 194 meV, and 288 meV for the A, B, and C excitons, respectively, which places them in the strong, and on the edge of the ultrastrong, coupling regime.

exciton-polaritons↗

Polarization-controlled volatile ferroelectric and capacitive switching in Sn 2 P 2 S 6

Abstract Smart electronic circuits that support neuromorphic computing on the hardware level necessitate materials with memristive, memcapacitive, and neuromorphic- like functional properties; in short, the electronic response must depend on the voltage history, thus enabling learning algorithms. Here we demonstrate volatile ferroelectric switching of Sn 2 P 2 S 6 at room temperature and see that initial polarization orientation strongly determines the properties of polarization switching. In particular, polarization switching hysteresis is strongly imprinted by the original polarization state, shifting the regions of non-linearity toward zero-bias. As a corollary, polarization switching also enables effective capacitive switching, approaching the sought-after regime of memcapacitance. Landau–Ginzburg–Devonshire simulations demonstrate that one mechanism by which polarization can control the shape of the hysteresis loop is the existence of charged domain walls (DWs) decorating the periphery of the repolarization nucleus. These walls oppose the growth of the switched domain and favor back-switching, thus creating a scenario of controlled volatile ferroelectric switching. Although the measurements were carried out with single crystals, prospectively volatile polarization switching can be tuned by tailoring sample thickness, DW mobility and electric fields, paving way to non-linear dielectric properties for smart electronic circuits.

97 MATHEMATICS AND COMPUTING↗

Exploration of Novel Neuromorphic Methodologies for Materials Applications

Many of today's most interesting questions involve understanding and interpreting complex relationships within graph-based structures. For instance, in materials science, predicting material properties often relies on analyzing the intricate network of atomic interactions. Graph neural networks (GNNs) have emerged as a popular approach for these tasks; however, they suffer from limitations such as inefficient hardware utilization and over-smoothing. Recent advancements in neuromorphic computing offer promising solutions to these challenges. In this work, we evaluate two such neuromorphic strategies known as reservoir computing and hyperdimensional computing. We compare the performance of both approaches for bandgap classification and regression using a subset of the Materials Project dataset. Our results indicate recent advances in hyperdimensional computing can be applied effectively to better represent molecular graphs.

Gobin, Derek [George Mason University, Virginia]↗

Tunable Interfacial to Filamentary Resistive Switching Mechanism in Room-Temperature-Grown Amorphous YBa 2 Cu 3 O x with Excess Cu Addition

Resistive switching technologies have the potential not only to create large efficiency gains in computer memory but also to revolutionize emerging fields such as neuromorphic computing. In this paper, we report on novel resistive switching behavior in devices made from room-temperature-grown Cu-rich amorphous YBa 2 Cu 3 O x (YBCO) films, a material otherwise well-known as a high-temperature superconductor. In Nb:STO substrate/amorphous YBCO film (≈200 nm)/metallic Cu (15 nm)/metallic Pt (15 nm) devices, we demonstrate that the resistive switching can be tuned between mechanisms involving extended areas of the YBCO/electrode interface and a single-point filamentary mechanism simply by changing the Cu content of the deposition target and hence in the films. Changing the Cu content can also be used to optimize the properties of the devices further, with devices with an added 15 mol % of Cu in YBCO initially providing an on/off ratio >100, switching endurance potential >6500 cycles, and state retention >2 × 10 4 s, all at low switching fields of 0.3 MV/cm. The amalgam of promising resistive switching properties, fast growth (150 nm/min) at room temperature, and tuneability of the switching mechanism indicates the strong potential of this proof-of-concept amorphous system for future memory applications.

Cu↗

Predicting Band-Gap of Inorganic Materials Using Neuromorphic Graph Learning

Predicting properties of inorganic materials is a heavily researched topic, with several new prediction approaches emerging as competitors. One such competitor is graph neural networks, which leverage the structure of the graph to aid in the prediction process. In this work, we propose integration of neuromorphic computation into the graph neural network pipeline. We call this approach Neuromorphic Graph Learning (NGL). We utilize the NGL approach to leverage evolutionary algorithms and a novel Spike Pipeline for Raster Analysis (SPIRE) for the prediction of band gap in inorganic materials.

Mulet, Ian [University of Tennessee (UT)]↗

Design of Hopfield Networks Based on Superconducting Coupled Oscillators

The global energy shortage has driven the development of many energy-efficient computational platforms beyond Moore's law, among which brain-inspired neuromorphic computing is one of the promising solutions. Associative memory and pattern recognition are important computations solved by brain-inspired Hopfield networks. Classical Hopfield networks store memories via fixed point attractors of their dynamics. In oscillatory Hopfield networks, these attractors are replaced by periodic orbits. Here, we design an oscillatory Hopfield network based on coupled superconducting oscillators. We first employ a mathematical phase reduction approach to map networks of coupled superconducting rapid single flux quantum (RSFQ) ring oscillators to coupled Kuramoto phase-oscillator networks. We use this theory to numerically optimize the hardware's mutual inductances in order to directly match the phase-reduced superconducting oscillators to a model of phase-oscillator-based Hopfield networks. The resulting network can store multiple oscillatory phase-locked memory patterns and recover the patterns based on the initial phase conditions. As different pattern recognition tasks, or learning, require tunable connectivity strengths between the oscillatory nodes, we further employ a coupler circuit that enables tuning the coupling strength between two oscillators by applying an external flux. We demonstrate the functionality of our design through numerical simulations of a small example network with oscillators operating at 86 GHz and recognizing patterns within 10 ns. Our approach enables the learning and retrieval of dynamical memory patterns with a wide range of applications where rhythmic dynamic output is beneficial.

Cheng, Ran↗

Hydrogen in energy and information sciences

Beyond its fascinating chemistry as the first element in the Periodic Table, hydrogen is of high societal importance in energy technologies and of growing importance in energy-efficient computing. In energy, hydrogen has reemerged as a potential solution to long-term energy storage and as a carbon-free input for materials manufacturing. Its utilization and production rely on the availability of proton-conducting electrolytes and mixed proton–electron conductors for the components in fuel cells and electrolyzers. In computing, proton mediation of electronic properties has garnered attention for electrochemically controlled energy-efficient neuromorphic computing. Incorporation of substitutional and interstitial hydride ions in oxides, though only recently established, enables tuning of electronic and magnetic properties, inviting a range of possible exotic applications. This article addresses common themes in the fundamental science of hydrogen incorporation and transport in oxides as relevant to pressing technological needs. The content covers (1) lattice (or bulk) mechanisms of hydrogen transport, primarily addressing proton transport, but also touching on hydride ion transport; (2) interfacial transport; (3) exploitation of extreme external drivers to achieve unusual response; and (4) advances in methods to probe the hydrogen environment and transport pathway. The snapshot of research activities in the field of hydrogen-laden materials described here underscores exciting recent breakthroughs, remaining open questions, and breathtaking experimental tools now available for unveiling the nature of hydrogen in solid-state matter.

08 HYDROGEN↗

Neuromorphic Graph Algorithms: Cycle Detection, Odd Cycle Detection, and Max Flow

Neuromorphic computing is poised to become a promising computing paradigm in the post Moore’s law era due to its extremely low power usage and inherent parallelism. Spiking neural networks are the traditional use case for neuromorphic systems, and have proven to be highly effective at machine learning tasks such as control problems. More recently, neuromorphic systems have been applied outside of the arena of machine learning, primarily in the field of graph algorithms. Neuromorphic systems have been shown to perform graph algorithms faster and with lower power consumption than their traditional (GPU/CPU) counterparts, and are hence an attractive option for a co-processing unit in future high performance computing systems, where graph algorithms play a critical role. In this paper, we present a neuromorphic implementation of cycle detection, odd cycle detection, and the Ford-Fulkerson max-flow algorithm. We further evaluate the performance of these implementations using the NEST neuromorphic simulator by using spike counts and simulation time as proxies for energy consumption and run time. In addition to gains inherent in neuromorphic systems, we show that within the neuromorphic implementations early stopping criteria can be implemented to further improve performance.

Kay, Bill↗

Magnetic Solitons and Thickness‐Dependent Magnetization Reversal in Interconnected Helical Nanowire Arrays

By expanding magnetic nanostructures into the third dimension, it is possible to introduce new interactions and realize new forms of magnetic textures and emergent phenomena. Consequently, this unlocks new opportunities for applications in data storage, unconventional computing and sensing by utilizing 3D devices with enhanced functionalities. Connected magnetic nanowires offer a unique platform for applications such as neuromorphic computing due to their tunability and the presence of multiple transport pathways. However to realize this promise, it is necessary to further our understanding of how to locally control the magnetization in 3D, nanowire-based geometries. In this work we show the formation of magnetic domain walls, vortices, anti-vortices, and linked vortex-anti-vortex pairs in interconnected helical nanowire arrays. We show how wire diameter and 3D geometric design can control the states that form and reveal the magnetization reversal mechanism. Hence, we demonstrate this to be a highly tunable system, where the magnetization can be readily reconfigured by an external magnetic field.

3D Nanomagnetism↗