Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Neuromorphic computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Laser-induced quenching of metastability at the Mott insulator to metal transition

There is growing interest in strongly correlated insulator thin films because the intricate interplay of their intrinsic and extrinsic state variables causes memristive behavior that might be used for biomimetic devices in the emerging field of neuromorphic computing. Here, in this study, we find that laser irradiation tends to drive V 2 ⁢O 3 from supercooled/superheated metastable states toward thermodynamic equilibrium, most likely in a nonthermal way. We study thin films of the prototypical Mott-insulator V2⁢O3, which show spontaneous phase separation into metal-insulator herringbone domains during the Mott transition. Here, we use low-temperature microscopy to investigate how these metal-insulator domains can be modified by scanning a focused laser beam across the thin film surface. We find that the response depends on the thermal history: When the thin film is heated from below the Mott transition temperature, the laser beam predominantly induces metallic domains. On the contrary, when the thin film is cooled from a temperature above the transition, the laser beam predominantly induces insulating domains. Very likely, the V 2 ⁢O 3 thin film is in a superheated or supercooled state, respectively, during the first-order phase transition, and the perturbation by a laser beam drives these metastable states into stable ones. This way, the thermal history is locally erased. Our findings are supported by a phenomenological model with a laser-induced lowering of the energy barrier between the metastable and equilibrium states.

Materials Science↗

Ultrafast Neuromorphic Dynamics Using Hidden Phases in the Prototype of Relaxor Ferroelectrics

Materials possessing multiple states are promising to emulate synaptic and neuronic behaviors. Their operation frequency, typically in or below the GHz range, however, limits the speed of neuromorphic computing. Ultrafast THz electric field excitation has been employed to induce nonequilibrium states of matter, called hidden phases in oxides. One may wonder if there are systems for which THz pulses can generate neuronic and synaptic behavior, via the creation of hidden phases. Using atomistic simulations, we discover that relaxor ferroelectrics can emulate all the key neuronic and memristive synaptic features. Their occurrence originates from the activation of many hidden phases of polarization order, resulting from the response of nanoregions to THz pulses. We find such phases further possess different dielectric constants, which is also promising for memcapacitor devices.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Automated Generation of Integrated Digital and Spiking Neuromorphic Machine Learning Accelerators

The growing numbers of application areas for artificial intelligence (AI) methods have led to an explosion of domain-specific accelerators that could support every new machine learning (ML) algorithm advancement, clearly highlighting the need for a capability to quickly and automatically transition from algorithm definition to hardware implementation and explore design space along a variety of SWaP (size, weight and Power). The software defined architectures (SODA) synthesizer implements a compiler-based modular infrastructure for the end-to-end generation of machine learning accelerators from high-level frameworks to hardware description language. At the same time, neuromorphic computing, by mimicking how the brain operates, promises to perform artificial intelligence tasks at efficiencies orders of magnitude higher than the current conventional tensor-processing based accelerators, as demonstrated by a variety of specialized designs leveraging Spiking Neural Networks (SNNs). Nevertheless, the mapping of an artificial neural network (ANN) to solutions supporting SNNs is still a non-trivial and very device-specific task, and completely lack the possibility to design hybrid systems that integrate conventional and spiking neural models. In this paper we discuss the support for such an integrated generation leveraging the SODA Synthesizer framework and its modular structure. In particular, we present a new MLIR dialect (part of the SODA frontend) that allows expressing spiking neural network features (e.g., available resources, spiking sequences, analog signal reading, etc.) and illustrate how it enables mapping to Spiking Neurons and deployment to the related specialized hardware (which, in the digital domain, could be generated through the other existing layers of the SODA Synthesizer). We then discuss the opportunities for even deeper integration afforded by the hardware compilation infrastructure, providing a path towards the generation of complex heterogeneous artificial intelligence systems.

Curzel, Serena↗

Training Spiking Neural Networks Using Combined Learning Approaches

Spiking neural networks (SNNs), the class of neural networks used in neuromorphic computing, are difficult to train using traditional back-propagation techniques. Spike timingdependent plasticity (STDP) is a biologically inspired learning mechanism that can be used to train SNNs. Evolutionary algorithms have also been demonstrated as a method for training SNNs. In this work, we explore the relationship between these two training methodologies. We evaluate STDP and evolutionary optimization as standalone methods for training networks, and also evaluate a combined approach where STDP weight updates are applied within an evolutionary algorithm. We also apply Bayesian hyperparameter optimization as a meta learner for each of the algorithms. We find that STDP by itself is not an ideal learning rule for randomly connected networks, while the inclusion of STDP within an evolutionary algorithm leads to similar performance, with a few interesting differences. This study suggests future work in understanding the relationship between network topology and learning rules.

Elbrecht, Daniel↗

Switching Dynamics in Vanadium Dioxide-Based Stochastic Thermal Neurons

We report on switching dynamics of individual and coupled vanadium dioxide (VO 2 ) devices subject to voltage pulses as the temperature is systematically varied from room temperature spanning the insulator–metal transition (IMT) temperature. The switching voltage of single devices has a strong relationship with both temperature and voltage pulsewidth. Two-step switching in connected VO 2 devices has been noted in current transient plots and was found to depend on temperature, pulsewidth, and pulse amplitude. Experimental switching behavior measured from VO 2 artificial neurons was implemented into a spiking neural network (SNN). During training, modulating the switching voltage via temperature affords a novel method to implement homeostasis with the coupled devices. Simulation results show the efficacy of the stochastic neuronal characteristics and the proposed homeostasis mechanism on a standard digit recognition task. As a result, these studies contribute to ongoing efforts in neuromorphic computing exploiting collective phase transitions.

42 ENGINEERING↗

Modeling the Impacts of Material Properties on Oscillatory Neuron Behavior

In this study, neuromorphic computing, which mimics the functions of biological brains, offers improvements in both latency and energy efficiency over typical von Neumann computing architectures. Spiking neural networks can be especially power-efficient because they encode information temporally and can use more sparse electrical inputs. Here, we study the design of volatile memristors (variable resistors with memory) for neuronal devices, with particular consideration toward the feasibility of all-on-chip oscillation using built-in capacitance. We use circuit simulations to model the behavior of oscillator neurons with a range of realistic material properties. We find that energy inputs increase with insulating-phase resistivity, thermal conductivity, and device aspect ratio. However, we also find that the minimum capacitance needed for oscillation decreases with increasing insulating-phase resistivity, which opposes the constraints for power efficiency. Based on published data on NbO 2 , VO 2 , and EuNiO 3 , we find that existing materials can be engineered for all-on-chip spiking using their parasitic capacitance.

36 MATERIALS SCIENCE↗

Superconducting disordered neural networks for neuromorphic processing with fluxons

In superconductors, magnetic fields are quantized into discrete fluxons (flux quanta Φ 0 ), made of microscopic circulating supercurrents. We introduce a multiterminal synapse network comprising a disordered array of superconducting loops with Josephson junctions. The loops can trap fluxons defining memory, while the junctions allow their movement between loops. Dynamics of fluxons through such a disordered system through a complex reconfigurable energy landscape represents brain-like spiking information flow. In this work, we experimentally demonstrate a three-loop network using YBa 2 Cu 3 O 7 –δ -based superconducting loops and Josephson junctions, which exhibit stable memory configurations of trapped flux in loops that determine the rate of flow of fluxons through synaptic connections. The memory states are, in turn, affected by the applied input signals but can also be externally configured electrically through control current/feedback terminals. These results establish a previously unexplored, biologically similar architectural approach to neuromorphic computing that is scalable while dissipating energy of atto Joules/spike.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Cross-Domain Reasoning for Neuromorphic Model Design

Designing performant neuromorphic models requires reasoning across neuroscience, neuromorphic computing, and machine learning, making it a natural target for cross-domain hypothesis generation. Our primary contribution is a multi-corpus knowledge graph spanning all three domains, which we show substantially increases cross-domain retrieval novelty over single-corpus baselines. We additionally introduce NeuKReAct, an agentic reasoning framework that iteratively retrieves from this graph and synthesizes design hypotheses via a step-by-step blackboard architecture, enabling structured compartmentalization of design decisions. Lastly, we introduce an execution head that translates hypotheses into structured design documents and runnable code. We evaluate novelty using a combinatorial creativity metric that measures cross-domain retrieval distance across the citation graph. Our results confirm that corpus breadth is the dominant driver of novelty. Moreover, we highlight a concrete instance of the novelty-utility tradeoff within NeuKReAct, underscoring a need for joint creativity evaluation, balancing both novelty and utility.

Ramavarapu, Vikram [ORNL] (ORCID:0009000188757213)↗

SuperNeuroABM

A GPU-based multi-agent simulation framework for neuromorphic computing

Gunaratne, Chathika [Oak Ridge National Lab. (ORNL↗

ORNL/superneuro-mat

A matrix-based simulator for neuromorphic computing.

Date, Prasanna [Oak Ridge National Lab. (ORNL), Oa↗

A new era of ferroelectric thin films for nonvolatile memories

Ferroelectric films have potential applications in nonvolatile memory devices. In addition to the well-established perovskite-structure oxide ferroelectrics, hafnia- and wurtzite-based ferroelectrics have recently attracted considerable attention because of the improved scalability of the ferroelectric response (down to nanometer thicknesses), their compatibility with silicon fabrication processes, and the availability of deposition methods that realize three-dimensional structures. Furthermore, due to their high compatibility with silicon processes, these are also expected to be used in emerging energy-efficient applications, such as neuromorphic computing and reservoir computing. In this article, we review the fundamentals of hafnia- and wurtzite-based ferroelectrics and their advantages and issues for developing in nonvolatile memory devices. Then, possible emerging applications are discussed.

36 MATERIALS SCIENCE↗

Tuning the critical Li intercalation concentrations for MoX 2 bilayer phase transitions using classical and machine learning approaches

Transition metal dichalcogenides (TMDs) such as MoX 2 are known to undergo a structural phase transformation as well as a change in the electronic conductivity upon Li intercalation. These properties make them candidates for charge tunable ion-insertion materials that could be used in electro-chemical devices for neuromorphic computing applications. In this work we study the phase stability and electronic structure of Li-intercalated bilayer MoX 2 with X=S, Se or Te. Using first-principles calculations in combination with classical and machine learning modeling approaches we find that the energy needed to stabilize the conductive phase decreases with increasing atomic mass of the chalcogen atom X. A similar decreasing trend is found in the threshold Li concentration where the structural phase transition takes place. While the electronic conductivity increases with increasing ion concentration at low concentrations, we do not observe a conductivity jump at the phase transition point.

36 MATERIALS SCIENCE↗

Mixed-dimensional stackable electronics enabled by freestanding 2D/3D materials

2D material-based devices have received great deal of attention as they can be easily stacked to obtain multifunctionality. With their ultrathin thicknesses, such multifunctioning devices become so flexible and conformal that they can be placed onto any 3D featured surfaces. However, 2D heterostructures are typically demonstrated as stacked flakes where single or few devices can be fabricated due to lack of strategies for layer-by-layer stacking of 2D materials at the wafer scale. In this talk, I will discuss about our unique strategy to isolate wafer-scale 2D materials into monolayers and stack them into a heterostructures by using a layer-resolved splitting (LRS) technique. This technique enables my group at MIT to explore unprecedented wafer-scale 2D heterodevices including integrated photonics, 3D neuromorphic computing, and microLEDs, which will be introduced in my talk. While 2D heterostructures promise interesting futuristic devices, the performance of 2D material-based devices is substantially inferior to that of conventional 3D semiconductor materials. However, 3D materials exist as their bulk form, thus it is challenging to stack them together for heterostructures. Obviously, conformal coating of such single-crystalline bulks on 3D features is impossible. My group at MIT has recently invented a 2D materials-based layer transfer (2DLT) technique that can produce single-crystalline freestanding membranes from any compound materials with their excellent semiconducting performance. This technique is based on remote epitaxy of single-crystalline films on graphene followed by peeling from graphene. Stacking of freestanding 3D material membranes will enable unprecedented 3D heterostructures whose performance is expected to be superior to that of 2D heterostructures. I will talk about our group’s effort to apply single-crystalline freestanding membranes for flexible, conformal electronics as well as for 3D heterostructures. Finally, I will conclude my talk by discussing perspectives of coupling 2D-3D freestanding membranes for 2D-3D mixed heterostructured devices that can be enabled by our LRS and 2DLT techniques.

Kim, Jeehwan↗

Interplay of Magnetism and Superconductivity in van der Waals Heterostructures (Final report)

This project has investigated the magnetic and electric properties of 2D materials, with emphasis on the (anti-)ferromagnetic properties of 2D crystalline magnets and a new concept for stacking engineering of 2D ferroelectricity. The new basic physics fundamental knowledge obtained through this research may have important implications for future technologies based on magnetism and ferroelectricity, for example spintronics, quantum information science, or neuromorphic computing.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Nanoscale X-ray Imaging and Dynamics of Electronic and Magnetic Materials

This project supported cutting-edge nanoscale characterization developments including X-ray Imaging by utilizing the power of Coherent X-ray Diffractive Imaging (CXDI). This research pioneered new directions in studies of nanoscale dynamics using X-ray Photon Correlation Spectroscopy (XPCS) and Ultrafast X-ray Scattering (UXS), extending our understanding of science and technology at the limits of ultrasmall (atomic/nanoscale) and ultrafast (from seconds to femtosecond dynamics). The research funded by this award spans a wide range of condensed matter and materials physics systems, from correlated oxides and nanomaterials to energy-related materials, and quantum materials for neuromorphic computing.

25 ENERGY STORAGE↗

Controlling reversible phase transitions in rare-earth nickelates for novel memory devices

Resistive switching in correlated complex oxides is lucrative for emerging applications in neuromorphic computing, and densely scaled non-volatile memory. Electrical conductance of such complex oxides can be controllable switched across multiple orders of magnitude by either (a) electroforming a conduction channel (e.g., in tungsten oxide), or (b) inducing Mott-Hubbard transition (e.g., in rare-earth nickelates)– both via controlled migration of defects (such as oxygen vacancies) under applied bias. Nevertheless, the promise of such defect-driven electronic transitions are far from realized due to a lack of fundamental understanding of the atomic-scale processes that underlie migration and spatiotemporal evolution of oxygen vacancies over nano-to-mesoscopic length/timescales under applied electric field. In this project, we employ a synergistic integration of density functional theory (DFT) calculations, ab initio/classical molecular dynamics (AIMD/CMD) simulations, machine learning (ML), precision synthesis, and multi-modal X-ray imaging experiments to address this knowledge gap. Such an integrated approach offers to elucidate the correlations between subtle structural distortion and oxidation states; treat localized charge carriers; describe defect/ion transport in the presence of electric field; and, in turn, greatly advance the current understanding of microstructural evolution in complex oxides under applied bias. The fundamental knowledge gained from this work will enable precise control over hierarchical defect structures and unravel new routes to manipulate resistance states in complex oxides. This, in turn, will accelerate design of novel devices with desired set of neural functionalities, and high-speed densely-scaled resistive random access memory technologies.

36 MATERIALS SCIENCE↗

Transmission Electron Microscopy Study on the Effect of Thermal and Electrical Stimuli on Ge2Te3 Based Memristor Devices

Memristor devices fabricated using the chalcogenide Ge 2 Te 3 phase change thin films in a metal-insulator-metal structure are characterized using thermal and electrical stimuli in this study. Once the thermal and electrical stimuli are applied, cross-sectional transmission electron microscopy (TEM) and X-ray energy-dispersive spectroscopy (XEDS) analyses are performed to determine structural and compositional changes in the devices. Electrical measurements on these devices showed a need for increasing compliance current between cycles to initiate switching from low resistance state (LRS) to high resistance state (HRS). The measured resistance in HRS also exhibited a steady decrease with increase in the compliance current. High resolution TEM studies on devices in HRS showed the presence of residual crystalline phase at the top-electrode/dielectric interface, which may explain the observed dependence on compliance current. XEDS study revealed diffusion related processes at dielectric-electrode interface characterized, by the separation of Ge 2 Te 3 into Ge- and Te- enriched interfacial layers. This was also accompanied by spikes in O level at these regions. Furthermore, in-situ heating experiments on as-grown thin films revealed a deleterious effect of Ti adhesive layer, wherein the in-diffusion of Ti leads to further degradation of the dielectric layer. This experimental physics-based study shows that the large HRS/LRS ratio below the current compliance limit of 1 mA and the ability to control the HRS and LRS by varying the compliance current are attractive for memristor and neuromorphic computing applications.

Shallcross, Austin↗

Real Space and Time Imaging of Collective Headgroup Dipole Motions in Zwitterionic Lipid Bilayers

Lipid bilayers are supramolecular structures responsible for a range of processes, such as transmembrane transport of ions and solutes, and sorting and replication of genetic materials, to name just a few. Some of these processes are transient and currently, cannot be visualized in real space and time. Here, we developed an approach using 1D, 2D, and 3D Van Hove correlation functions to image collective headgroup dipole motions in zwitterionic phospholipid bilayers. We show that both 2D and 3D spatiotemporal images of headgroup dipoles are consistent with commonly understood dynamic features of fluids. However, analysis of the 1D Van Hove function reveals lateral transient and re-emergent collective dynamics of the headgroup dipoles—occurring at picosecond time scales—that transmit and dissipate heat at longer times, due to relaxation processes. At the same time, the headgroup dipoles also generate membrane surface undulations due a collective tilting of the headgroup dipoles. A continuous intensity band of headgroup dipole spatiotemporal correlations—at nanometer length and nanosecond time scales—indicates that dipoles undergo stretching and squeezing elastic deformations. Importantly, the above mentioned intrinsic headgroup dipole motions can be externally stimulated at GHz-frequency scale, enhancing their flexoelectric and piezoelectric capabilities (i.e., increased conversion efficiency of mechanical energy into electric energy). In conclusion, we discuss how lipid membranes can provide molecular-level insights about biological learning and memory, and as platforms for the development of the next generation of neuromorphic computers.

59 BASIC BIOLOGICAL SCIENCES↗