Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Neuromorphic”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Photothermally Activated Artificial Neuromorphic Synapses

Biological nervous systems rely on the coordination of billions of neurons with complex, dynamic connectivity to enable the ability to process information and form memories. In turn, artificial intelligence and neuromorphic computing platforms have sought to mimic biological cognition through software-based neural networks and hardware demonstrations utilizing memristive circuitry with fixed dynamics. Here, to incorporate the advantages of tunable dynamic software implementations of neural networks into hardware, we develop a proof-of-concept artificial synapse with adaptable resistivity. This synapse leverages the photothermally induced local phase transition of VO 2 thin films by temporally modulated laser pulses. Such a process quickly modifies the conductivity of the film site-selectively by a factor of 500 to “activate” these neurons and store “memory” by applying varying bias voltages to induce self-sustained Joule heating between electrodes after activation with a laser. These synapses are demonstrated to undergo a complete heating and cooling cycle in less than 120 ns.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Harnessing the Second-Order Metal−Insulator Transition for Neuromorphic Computing

Vanadium oxides are widely studied phase change materials for brain-inspired computing architectures. Systems like VO 2 and V 2 O 3 exhibit first-order metal−insulator transitions (MITs) with hysteresis and percolative switching, increasing stochasticity and device variability. Here, we focus on the less explored Magnéli phase V 4 O 7 , which undergoes a continuous, non-hysteretic, second-order MIT. This surprisingly enables highly reproducible volatile resistive switching in spiking-neuron-type devices. We synthesize V 4 O 7 films, characterize their structural and transport properties, and demonstrate voltage and current-driven threshold switching with electrothermal feedback. In a Pearson–Anson oscillator, V 4 O 7 devices produce stable, tunable spiking across 20–200 kHz, with consistent operation among multiple devices. We introduce a numerical analog leaky-integrate-and-fire (aLIF) model that captures waveform shapes and their dependence on load resistance, temperature, and voltage. Furthermore, these findings suggest that second-order MIT materials like V 4 O 7 are promising for deterministic, scalable spiking neuron arrays for neuromorphic computing.

V4O7↗

Ion Migration Studies in Exfoliated 2D Molybdenum Oxide via Ionic Liquid Gating for Neuromorphic Device Applications

The formation of an electric double layer in ionic liquid (IL) can electrostatically induce charge carriers and/or intercalate ions in and out of the lattice which can trigger a large change of the electronic, optical, and magnetic properties of materials and even modify the crystal structure. Here, we present a systematic study of ionic liquid gating of exfoliated 2D molybdenum trioxide (MoO 3 ) devices and correlate the resultant electrical properties to the electrochemical doping via ion migration during the IL biasing process. A nearly 9 orders of magnitude modulation of the MoO 3 conductivity is obtained for the two types of ionic liquids that are investigated. In addition, notably rapid on/off switching was realized through a lithium-containing ionic liquid whereas much slower modulation was induced via oxygen extraction/intercalation. Time of flight–secondary ion mass spectrometry confirms the Li intercalation. Density functional theory (DFT) calculations have been carried out to examine the underlying metallization mechanism. Results of short-pulse tests show the potential of these MoO 3 devices as neuromorphic computing elements due to their synaptic plasticity.

2D materials↗

Kelvin Probe Force Microscopy Imaging of Plasticity in Hydrogenated Perovskite Nickelate Multilevel Neuromorphic Devices

Ion drift in nanoscale electronically inhomogeneous semiconductors is among the most important mechanisms being studied for designing neuromorphic computing hardware. However, nondestructive imaging of the ion drift in operando devices directly responsible for multiresistance states and synaptic memory represents a formidable challenge. Here, we present Kelvin probe force microscopy imaging of hydrogen-doped perovskite nickelate device channels subject to high-speed electric field pulses to directly visualize proton distribution by monitoring surface potential changes spatially, which is also supported with finite element-based electric field distribution studies. First-principles calculations provide mechanistic insights into the origin of surface potential changes as a function of hydrogen donor doping that serves as the contrast mechanism. We demonstrate 128 (7-bit) nonvolatile conductance levels in such devices relevant to in-memory computing applications. The synaptic plasticity measurements are implemented in spiking neural networks and show promising results for classification (SciKit Learn’s Iris and Wine data sets) and control (OpenAI’s CartPole-v1 and BipedalWalker-v3) simulation tasks.

Kelvin probe force microscopy↗

Shape Anisotropy-Dependent Leaking in Magnetic Neurons for Bio-Mimetic Neuromorphic Computing

Spiking neural networks seek to emulate biological computation through interconnected artificial neuron and synapse devices. Spintronic neurons can leverage magnetization physics to mimic biological neuron functions, such as integration tied to magnetic domain wall (DW) propagation in a patterned nanotrack and firing tied to the resistance change of a magnetic tunnel junction (MTJ), captured in the domain wall-magnetic tunnel junction (DW-MTJ) device. Leaking, relaxation of a neuron when it is not under stimulation, is also predicted to be implemented based on DW drift as a DW relaxes to a low energy position, but it has not been well explored or demonstrated in device prototypes. Here, in this work, we study DW-MTJ artificial neurons capable of leaky integrate-and-fire (LIF) behavior and demonstrate geometry-dependent leaking dynamics that results in repeatable, tunable LIF operation. Studying the behavior of five different device designs, we show tuning the geometry, stimulating fields and currents, and location of electrical contacts results in a wide range of neuron behavior. Additionally, implementation of an asymmetric notch allows for nonlinear pinning which increased expressivity without sacrificing leaking. The measured behavior is implemented in a simulated spiking neural network that outperforms a 1D model of continuous DW motion and approaches the performance of an ideal LIF activation function. The results show that the analog LIF capability of DW-MTJ neurons combines many desirable neuron functions into a single device, which can result in varied forms of multifunctional neuromorphic computing.

42 ENGINEERING↗

High-Resolution Full-Field Structural Microscopy of the Voltage-Induced Filament Formation in VO 2 -Based Neuromorphic Devices

In order to make neuromorphic functions in memristive devices more efficient, information about the structural properties of filament formation at the micro- and mesoscopic scales is necessary. Despite extensive research on VO 2 , a key material due to its filament formation, local operando structural measurements remain challenging and often involve destructive specimen preparation and long rastering times, greatly limiting the scope of experimental studies. Utilizing dark-field X-ray microscopy (DFXM), a fullfield imaging modality, structural signatures of the filament formation process operando are revealed in VO 2 devices. DFXM experiments illustrate that rutile filaments contain isolated monoclinic clusters, indicating structural nonuniformity interior to the filament. The formation of the rutile phase beneath device electrodes was shown to precede filament development, followed by the formation of filament paths guided by nucleation sites within the device. Finally, a medium-term (<30 min) memory mechanism is observed in VO 2 , mediated by sites within the device gap that tend to switch at significantly lower voltages after electrical cycling, a tendency that persists through a brief thermal reset. High spatial resolution, large field-of-view, structure selectivity, and fast signal acquisition of DFXM provided insight into structural features of the filamentary channel and surrounding regions during voltage cycling.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Neuromorphic learning with Mott insulator NiO

Habituation and sensitization (nonassociative learning) are among the most fundamental forms of learning and memory behavior present in organisms that enable adaptation and learning in dynamic environments. Emulating such features of intelligence found in nature in the solid state can serve as inspiration for algorithmic simulations in artificial neural networks and potential use in neuromorphic computing. In this work, we demonstrate nonassociative learning with a prototypical Mott insulator, nickel oxide (NiO), under a variety of external stimuli at and above room temperature. Similar to biological species such as Aplysia, habituation and sensitization of NiO possess time-dependent plasticity relying on both strength and time interval between stimuli. A combination of experimental approaches and first-principles calculations reveals that such learning behavior of NiO results from dynamic modulation of its defect and electronic structure. An artificial neural network model inspired by such nonassociative learning is simulated to show advantages for an unsupervised clustering task in accuracy and reducing catastrophic interference, which could help mitigate the stability–plasticity dilemma. Mott insulators can therefore serve as building blocks to examine learning behavior noted in biology and inspire new learning algorithms for artificial intelligence.

42 ENGINEERING↗

Low-temperature emergent neuromorphic networks with correlated oxide devices

Significance Designing neuromorphic hardware for cryoelectronics is an important area of research as the field of computing paradigms beyond complementary metal-oxide-semiconductor (CMOS) progresses. Superconductivity and metal−insulator transitions are two of the most celebrated emergent, collective properties found in quantum materials such as strongly correlated oxides. Here, we present simulations of artificial neural networks that can be designed by combining superconducting devices (e.g. Josephson junctions) with Mott metal−insulator transition−based tunable resistor devices. Our simulations show that 1) neurons and synapses can be seamlessly created, 2) their functions can be tuned via learning, and 3) controlling disorder by incorporating light ions enables exponential multiplicity of states. The results open up directions for incorporating emergent behavior seen in condensed matter into hardware design for artificial intelligence.

97 MATHEMATICS AND COMPUTING↗

Ionizing radiation effects in SONOS-based neuromorphic inference accelerators

Here, we evaluate the sensitivity of neuromorphic inference accelerators based on Silicon-Oxide-Nitride-Oxide-Silicon (SONOS) charge trap memory arrays to total ionizing dose (TID) effects. Data retention statistics were collected for 16 Mbit of 40 nm SONOS digital memory exposed to ionizing radiation from a Co-60 source, showing good retention of the bits up to the maximum dose of 500 krad(Si). Using this data, we formulate a rate-equation-based model for the TID response of trapped charge carriers in the ONO stack, and predict the effect of TID on intermediate device states between ‘program’ and ‘erase’. This model is then used to simulate arrays of low-power, analog SONOS devices that store 8-bit neural network weights and support in situ matrix-vector multiplication. We evaluate the accuracy of the irradiated SONOS-based inference accelerator on two image recognition tasks – CIFAR-10 and the challenging ImageNet dataset – using state-of-the-art convolutional neural networks, such as ResNet-50. We find that across the datasets and neural networks evaluated, the accelerator tolerates a maximum TID between 10 krad(Si) and 100 krad(Si), with deeper networks being more susceptible to accuracy losses due to TID.

43 PARTICLE ACCELERATORS↗

Real-Time Neuromorphic Processing of Spatiotemporal Data for Scientific Discovery

Spiking Neural Networks (SNNs) are brain-inspired computing models incorporating unique temporal dynamics and event-driven processing. Rich dynamics in both space and time offer great challenges and opportunities for efficient processing of sparse spatiotemporal data compared with conventional artificial neural networks (ANNs). Under this context, the goal of this project is to develop spiking neural network based neuromorphic computing to enable energy-efficient real-time learning and processing of spatiotemporal data. This report summarizes the key results on network architecture design, training methods, and SNN hardware acceleration achieved under this project, demonstrating the promise of spiking neural networks.

97 MATHEMATICS AND COMPUTING↗

Energy-Efficient Neuromorphic Architectures for Nuclear Radiation Detection Applications

A comprehensive analysis and simulation of two memristor-based neuromorphic architectures for nuclear radiation detection is presented. Both scalable architectures retrofit a locally competitive algorithm to solve overcomplete sparse approximation problems by harnessing memristor crossbar execution of vector–matrix multiplications. The proposed systems demonstrate excellent accuracy and throughput while consuming minimal energy for radionuclide detection. To ensure that the simulation results of our proposed hardware are realistic, the memristor parameters are chosen from our own fabricated memristor devices. Based on these results, we conclude that memristor-based computing is the preeminent technology for a radiation detection platform.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

TechEdSat-13: The First Flight of an AI/ML Neuromorphic Processor

Neuromorphic processors, inspired by the wiring of the brain, permit certain classes of Artificial Intelligence/Machine Learning (AI/ML) algorithms to run far more efficiently. Ultimately, such systems will make the small- and nano-satellite platforms even more useful in terms of greatly improved power, communication and internal data management. In addition, on-board processing of images and data will help to not only rapidly interpret the information, but also reduce the amount of data that needs to be transmitted to ground stations. This initial flight experiment uses the Intel/ Loihi processor combined with a custom interface board and three communication channels to run the AI/ML scripts. These will vary with increasing length and complexity during the course of the mission. The algorithms will use the (at first) limited sensor data to ‘learn’ - with comparisons to similar architecture in comparable ground experiments. Some of the applications for successor flights in the TES-n flight series include Cognitive Communications, whereby the overall communication system is optimized per overflight – by optimizing timing and data transmission functions. Lastly, the performance of the Loihi 14nm process technology will be monitored for performance in the LEO radiation environment, thus looking for induced hardware and software errors. This information will help guide future radiation protection techniques to extend the lifetime and overall utility. The TES-13 is a 3U nanosat successfully launched by the Virgin Orbit Launcher-1 on January 13, 2022, and will presage more flights and AI/ML applications to come.

TechEdSat↗

TechEdSat-13: The First Flight of a Neuromorphic Processor

Neuromorphic processors, inspired by the wiring of the brain, permit certain classes of Artificial Intelligence/Machine Learning (AI/ML) algorithms to run far more efficiently. Ultimately, such systems will make the small- and nano-satellite platforms even more useful in terms of greatly improved power, communication and internal data management. In addition, on-board processing of images and data will help to not only rapidly interpret the information, but also reduce the amount of data that needs to be transmitted to ground stations. This initial flight experiment uses the Intel/Loihi processor combined with a custom interface board and three communication channels to run the AI/ML scripts. These will vary with increasing length and complexity during the course of the mission. The algorithms will use the (at first) limited sensor data to ‘learn’ - with comparisons to similar architecture in comparable ground experiments. Some of the applications for successor flights in the TES-n flight series include Cognitive Communications, whereby the overall communication system is optimized per overflight – by optimizing timing and data transmission functions. Lastly, the performance of the Loihi 14nm process technology will be monitored for performance in the LEO radiation environment, thus looking for induced hardware and software errors. This information will help guide future radiation protection techniques to extend the lifetime and overall utility. The TES-13 is a 3U nanosat successfully launched by the Virgin Orbit Launcher-1 on January 13, 2022, and will presage more flights and AI/ML applications to come.

TechEdSat↗

Nanoimaging of Organic Charge Retention Effects: Implications for Nonvolatile Memory, Neuromorphic Computing, and High Dielectric Breakdown Devices

While a large variety of organic and molecular materials have been found to exhibit charge memory effects, the underlying mechanism is not well-understood, which hinders rational device design. Here, we study the charge retention mechanism of a nanoscale memory system, an organic monolayer on a silicon substrate, with Au nanoparticles on top serving as the electrical contact. Combining scanning probe imaging/manipulation and density functional simulations, we observe stable charge retention effects in the system and attributed it to polaron effects at the amine functional groups. Finally, our findings can pave the way for applications in nonvolatile memory, neuromorphic computing, and high dielectric breakdown devices.

36 MATERIALS SCIENCE↗

An Atom-Precise Approach to Damp First-Order Phase Transitions and Its Implications for Neuromorphic Signal Processing

Neuromorphic computing inspired by mammalian intelligence aims to emulate the nonlinear dynamics of biological neurons and synapses to achieve fast, low-energy, and highly efficient information processing. Brain-inspired computing relies on the design and discovery of materials exhibiting nonlinear current–voltage profiles, frequently underpinned by electronic state transitions, to achieve spiking neurons and dynamically tunable synapses. A signature challenge in the design of artificial neurons is controlling the steepness of first-order transitions in active elements, as abrupt transitions are at risk of driving unstable voltage and temperature oscillations, which result in catastrophic device failure. A critical knowledge gap is the lack of structure–function correlations mapping the composition and atomistic structure of crystalline solids to nonlinear dynamical response characteristics. Here, we address the key question of how modification of atomistic structure correlates with alteration of neuron-like functionality. Constructing oscillator circuits from millimeter-scale single crystals enables high-resolution atomic structure solutions, which we use to demonstrate that the selective positioning of Pb cations modifies charge ordering along a one-dimensional CuxV2O5 framework even at low insertion stoichiometries, thereby providing an atom-precise design parameter for damping first-order transitions. We use temperature-variant X-ray diffraction and X-ray spectroscopy to elucidate the suppression of Cu-ion shuttling based on the precise positioning of Pb ions in seven-coordinated tunnel interstitial sites as the mechanistic basis for transition broadening, thus bridging a critical gap between statistical mechanics and quantum chemical descriptions of phase transitions. Such mechanistic understanding thus paves the way to site-selective modification strategies for modulating the sharpness of first-order transitions, with an exemplary demonstration here in tuning neuronal signal processing.

Crystal structure↗

Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing

The accumulation and extrusion of Ca 2+ in the pre- and postsynaptic compartments play a critical role in initiating plastic changes in biological synapses. In order to emulate this fundamental process in electronic devices, we developed diffusive Ag-in-oxide memristors with a temporal response during and after stimulation similar to that of the synaptic Ca 2+ dynamics. In situ high-resolution transmission electron microscopy and nanoparticle dynamics simulations both demonstrate that Ag atoms disperse under electrical bias and regroup spontaneously under zero bias because of interfacial energy minimization, closely resembling synaptic influx and extrusion of Ca 2+ , respectively. Furthermore, the diffusive memristor and its dynamics enable a direct emulation of both short- and long-term plasticity of biological synapses, representing an advance in hardware implementation of neuromorphic functionalities.

36 MATERIALS SCIENCE↗

Metaplastic and energy-efficient biocompatible graphene artificial synaptic transistors for enhanced accuracy neuromorphic computing

CMOS-based computing systems that employ the von Neumann architecture are relatively limited when it comes to parallel data storage and processing. In contrast, the human brain is a living computational signal processing unit that operates with extreme parallelism and energy efficiency. Although numerous neuromorphic electronic devices have emerged in the last decade, most of them are rigid or contain materials that are toxic to biological systems. In this work, we report on biocompatible bilayer graphene-based artificial synaptic transistors (BLAST) capable of mimicking synaptic behavior. The BLAST devices leverage a dry ion-selective membrane, enabling long-term potentiation, with ~50 aJ/µm 2 switching energy efficiency, at least an order of magnitude lower than previous reports on two-dimensional material-based artificial synapses. The devices show unique metaplasticity, a useful feature for generalizable deep neural networks, and we demonstrate that metaplastic BLASTs outperform ideal linear synapses in classic image classification tasks. With switching energy well below the 1 fJ energy estimated per biological synapse, the proposed devices are powerful candidates for bio-interfaced online learning, bridging the gap between artificial and biological neural networks.

97 MATHEMATICS AND COMPUTING↗

Understanding the metal-to-insulator transition in La1−xSrxCoO3−δ and its applications for neuromorphic computing

Abstract Transition metal oxides that exhibit a metal-to-insulator transition (MIT) as a function of oxygen vacancy concentration are promising systems to realize energy-efficient platforms for neuromorphic computing. However, the current lack of understanding of the microscopic mechanism driving the MIT hinders the realization of effective and stable devices. Here we investigate defective cobaltites and we unravel the structural, electronic, and magnetic changes responsible for the MIT when oxygen vacancies are introduced in the material. We show that, contrary to accepted views, cooperative structural distortions instead of local bonding changes are responsible for the MIT, and we describe the subtle interdependence of structural and magnetic transitions. Finally, we present a model, based on first principles, to predict the required electric bias to drive the transition, showing good agreement with available measurements and providing a paradigm to establish design rules for low-energy cost devices.

36 MATERIALS SCIENCE↗