Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network acceleration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Networks of electrochemical oxidation of common lithium-ion Battery solvents revealed by NMR spectroscopy

Raising the upper cutoff voltage of lithium-ion batteries (LIBs) to increase energy density often exceeds the electrolyte’s anodic stability limit, accelerating degradation and creating a major durability tradeoff. Designing electrolytes that can sustain long-term high-voltage cycling requires a clearer understanding of the fundamental mechanisms occurring when commercial carbonate solvents oxidize. Here, to this end, simplified single-salt, single-solvent formulations of LiClO 4 and LiPF 6 in dimethyl carbonate (DMC), ethylene carbonate (EC), or ethyl methyl carbonate (EMC) were anodically electrolyzed on inert electrodes and monitored for extended periods of time using 1 H, 13 C, 19 F, and 35 Cl nuclear magnetic resonance (NMR) spectroscopy. The controlled environment of the experiments, coupled to the unique sensitivity of NMR, unveiled novel metastable intermediates and the formation of branching networks of products with temporal evolution. Oxidation of the pristine solvent primarily proceeds through a radical pathway that also produces highly reactive protons but faces competition from a second pathway involving a radical carbocation intermediate. In all cases, the intermediates follow a variety of downstream pathways that can intersect with each other. The concomitant network of reactions represents a significant increase in complexity compared to common descriptions in the literature, yet, critically, it helps explain the wide range of products typically identified in electrolyte oxidation in complete cells. The results highlight the need for refocusing fundamental research on anodic stability to analysis of the hierarchy of reaction networks to better inform efforts to mitigate the detrimental effects on battery performance, including prevention and harvesting of proton and radical products.

Electrolytes↗

MIND-MAC: Multi-Level In-memory Quasi Non-Destructive MAC Operation in Compact 2T-nC FeRAM for Efficient DNN Accelerator

We present MIND-MAC, a compact 2T-nC FeRAM architecture that performs multi-level, quasi-non-destructive in-memory multiply–accumulate (MAC) for deep neural networks. By exploiting voltage-controlled partial domain switching in MFM capacitors and read-transistor amplification, the cell stores multi-bit weights and gates bit-serial inputs to produce an accumulated current on shared lines. We combine TCAD-extracted parasitics with experimentally calibrated ferroelectric models in SPICE to validate device-/circuit-level behavior, and validate multi-level sensing and QNRO with measurements on a fabricated 2T-3C test vehicle. An analytical system model maps MIND-MAC to a 6-GB main-memory in-memory compute (IMC) architecture and benchmarks VGG13 inference in 61.08 ms at 964.99 mJ. Results indicate high density, reduced rewrite overhead, and energy efficiency, positioning 2T-nC FeRAM as a promising IMC candidate for next-generation AI hardware.

36 MATERIALS SCIENCE↗

Adaptive Machine Learning for Robust Diagnostics and Control of Time-Varying Particle Accelerator Components and Beams

Machine learning (ML) is growing in popularity for various particle accelerator applications including anomaly detection such as faulty beam position monitor or RF fault identification, for non-invasive diagnostics, and for creating surrogate models. ML methods such as neural networks (NN) are useful because they can learn input-output relationships in large complex systems based on large data sets. Once they are trained, methods such as NNs give instant predictions of complex phenomenon, which makes their use as surrogate models especially appealing for speeding up large parameter space searches which otherwise require computationally expensive simulations. However, quickly time varying systems are challenging for ML-based approaches because the actual system dynamics quickly drifts away from the description provided by any fixed data set, degrading the predictive power of any ML method, and limits their applicability for real time feedback control of quickly time-varying accelerator components and beams. In contrast to ML methods, adaptive model-independent feedback algorithms are by design robust to un-modeled changes and disturbances in dynamic systems, but are usually local in nature and susceptible to local extrema. In this work, we propose that the combination of adaptive feedback and machine learning, adaptive machine learning (AML), is a way to combine the global feature learning power of ML methods such as deep neural networks with the robustness of model-independent control. We present an overview of several ML and adaptive control methods, their strengths and limitations, and an overview of AML approaches.

97 MATHEMATICS AND COMPUTING↗

Electrochemical Random-Access Memory: Progress, Perspectives, and Opportunities

Non-von Neumann computing using neuromorphic systems based on analogue synaptic and neuronal elements has emerged as a potential solution to tackle the growing need for more efficient data processing, but progress toward practical systems has been stymied due to a lack of materials and devices with the appropriate attributes. Recently, solid state electrochemical ion-insertion, also known as electrochemical random access memory (ECRAM) has emerged as a promising approach to realize the needed device characteristics. ECRAM is a three terminal device that operates by tuning electronic conductance in functional materials through solid-state electrochemical redox reactions. This mechanism can be considered as a gate-controlled bulk modulation of dopants and/or phases in the channel. Early work demonstrating that ECRAM can achieve nearly ideal analogue synaptic characteristics has sparked tremendous interest in this approach. More recently, the realization that electrochemical ion insertion can be used to tune the electronic properties of many types of materials including transition metal oxides, layered two-dimensional materials, organic and coordination polymers, and that the changes in conductance can span orders of magnitude has further attracted interest in ECRAM as the basis for analogue synaptic elements for inference accelerators as well as for dynamical devices that can emulate a wide range of neuronal characteristics for implementation in analogue spiking neural networks. At its core, ECRAM shares many fundamental aspects with rechargeable batteries, where ion insertion materials are used extensively for their ability to reversibly store charge and energy. Computing applications, however, present drastically different requirements: systems will require many millions of devices, scaled down to tens of nanometers, all while achieving reliable electronic-state tuning at scaled-up rates and endurances, and with minimal energy dissipation and noise. Further, in this review, we discuss the history, basic concepts, recent progress, as well as the challenges and opportunities for different types of ECRAM, broadly grouped by their primary mobile ionic charge carrier, including Li, protons, and oxygen vacancies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Prediction on X-ray output of free electron laser based on artificial neural networks

Abstract Knowledge of x-ray free electron lasers’ (XFELs) pulse characteristics delivered to a sample is crucial for ensuring high-quality x-rays for scientific experiments. XFELs’ self-amplified spontaneous emission process causes spatial and spectral variations in x-ray pulses entering a sample, which leads to measurement uncertainties for experiments relying on multiple XFEL pulses. Accurate in-situ measurements of x-ray wavefront and energy spectrum incident upon a sample poses challenges. Here we address this by developing a virtual diagnostics framework using an artificial neural network (ANN) to predict x-ray photon beam properties from electron beam properties. We recorded XFEL electron parameters while adjusting the accelerator’s configurations and measured the resulting x-ray wavefront and energy spectrum shot-to-shot. Training the ANN with this data enables effective prediction of single-shot or average x-ray beam output based on XFEL undulator and electron parameters. This demonstrates the potential of utilizing ANNs for virtual diagnostics linking XFEL electron and photon beam properties.

47 OTHER INSTRUMENTATION↗

A generative artificial intelligence framework for long-time plasma turbulence simulations

Generative deep learning techniques are employed in a novel framework for the construction of surrogate models capturing the spatiotemporal dynamics of 2D plasma turbulence. The proposed Generative Artificial Intelligence Turbulence (GAIT) framework enables the acceleration of turbulence simulations for long-time transport studies. GAIT leverages a convolutional variational auto-encoder and a recurrent neural network to generate new turbulence data from existing simulations, extending the time horizon of transport studies with minimal computational cost. The application of the GAIT framework to plasma turbulence using the Hasegawa–Wakatani (HW) model is presented, evaluating its performance via various analyses. Very good agreement is found between the GAIT and the HW models in the spatiotemporal Fourier and Proper Orthogonal Decomposition spectra, the flow topology characterized by the Okubo–Weiss parameter, and the time autocorrelation function of turbulent fluctuations. Excellent agreement has also been obtained in the probability distribution function of particle displacements and the effective turbulent diffusivity. In-depth analyses of the latent space of turbulent states, choice of hyperparameters and alternative deep learning models for the time prediction are presented. Our results highlight the potential of Artificial Intelligence-based surrogate models to overcome the computational challenges in turbulence simulation, which can be extended to other situations such as geophysical fluid dynamics.

Artificial intelligence↗

Structured electrolytes facilitate Grotthuss-type transport for enhanced proton-coupled electron transfer reactions

Concentrated hydrogen-bonded electrolytes (CoHBEs) are structured, electrochemically stable, less-volatile alternatives to aqueous and dilute nonaqueous electrolytes, however, with high viscosities that limit molecular diffusion. This work provides an understanding of the proton conduction mechanism in CoHBEs based on mixtures of acids and azoles and establishes a link between the structurally dictated transport properties and the proton-coupled electron transfer (PCET) reaction rates that can be leveraged for enhancing electrochemical reactions. Diffusion and relaxation NMR studies suggest a breaking of the viscosity–conductivity tradeoff, where at high azole concentrations (>45 mol%), Grotthuss transport is more likely with lowered proton transfer energy barriers between the azole and the acid according to the machine learning (ML) accelerated ab initio path integral MD (AI-PIMD) simulations. Proton conduction pathways are found to be switchable between the hydrogen bonding networks of the acid and the azole, with imidazole chain forming structures better facilitating Grotthuss hopping. Supported by small-angle neutron scattering studies, the chains are found to have six member molecules on average with maximum of 3 to 4 imidazole/imidazoliums at 50 to 60 mol%. Despite their high viscosities, the measured PCET rates for quinones and phenazines measured in the protic CoHBEs present relatively high electron transfer rate constants (k 0 ~ 10 −4 cm/s), validated by rotating disc electrode and scanning electrochemical microscopy measurements. The results demonstrate that strategic tuning of hydrogen-bond donor–acceptor interactions enables the decoupling of proton transport and viscosity, thereby impacting PCET reactions.

electrokinetics↗

Boundary-Aware Adversarial Learning Domain Adaption and Active Learning for Cross-Sensor Building Extraction

The use of convolutional neural networks (CNNs) for building extraction from remote sensing images has been widely studied and many public datasets have been made available for accelerating development of these CNN models. Yet adapting pretrained models at scale in real-world scenarios remains a challenging task. The main barrier is that certain new labels are still needed to compensate for domain shifting between the labeled data and new images that potentially cover new geographic locations or that are from a different sensor. In this article, we propose to add informatively labeled samples from a new image pool under the paradigm of active learning. To select the most useful samples based on model uncertainty, we first tackle the problem of uncalibrated uncertainty estimation due to distribution shifting by adapting feature extractors with boundary-based adversarial learning. Calibrated uncertainty is used as the query criterion in the active learning process, where the most uncertain samples are selected for annotation and included for model retraining. The proposed workflow was tested with three data pairs in which each workflow represents a scenario often encountered in real-world applications, including adapting pretrained models to new images collected with different sensors or to new geographic areas where appearances and types of buildings are very different. Compared to several baselines, including random sampling, temperature scaling (a well-known uncertainty calibration technique), different query strategies, and active domain adaptation methods, the proposed workflow shows that strategically querying a smaller set of samples for labeling achieves comparable or better building extraction performance. The proposed method reduces the number of labeled samples required to achieve sufficient model accuracy, thus significantly reducing hundreds of person-hours for labeled data creation. In addition, we include a few considerations when deploying this workflow in a GPU cluster that can be easily adapted to achieve operational building extraction model retraining.

97 MATHEMATICS AND COMPUTING↗

Spy in the GPU-box: Covert and Side Channel Attacks on Multi-GPU System

The deep learning revolution has been enabled in large part by GPUs, and more recently accelerators, which make it possible to carry out computationally demanding training and inference in acceptable times. As the size of machine learning networks and workloads continues to increase, multi-GPU machines have emerged as an important platform offered on High Performance Computing and cloud data centers. Since these machines are shared among multiple users, it becomes increasingly important to protect applications against potential attacks. In this paper, we explore the vulnerability of Nvidia's DGX multi-GPU machines to covert and side channel attacks. These machines consist of a number of discrete GPUs that are interconnected through a combination of custom interconnect (NVLink) and PCIe connections. We reverse engineer the interconnected cache hierarchy and show that it is possible for an attacker on one GPU to cause contention on the L2 cache of another GPU. We use this observation to first develop a covert channel attack across two GPUs, achieving the best bandwidth of around 4 MB/s. We also develop a prime and probe attack on a remote GPU allowing an attacker to recover the cache access pattern of another workload. This access pattern can be used in any number of side channel attacks: we demonstrate a proof of concept attack that fingerprints the application running on the remote GPU, with high accuracy. We also develop a proof of concept attack to extract hyperparameters of a machine learning workload. Our work establishes for the first time the vulnerability of these machines to microarchitectural attacks and can guide future research to improve their security.

Dutta, Sankha↗

RU Net for Automatic Characterization of TRISO Fuel Cross Sections

TRistructural ISOtropic (TRISO) particle fuel is a type of nuclear fuel known for its high-temperature and high-burnup performance. Each sub-millimeter diameter TRISO particle consists of uranium-oxycarbide (UCO) or UO2 fuel kernel, coated with buffer, inner pyrolytic carbon (IPyC), silicon carbide (SiC), and outer pyrolytic carbon (OPyC) layers. The SiC layer acts as the main containment barrier for the TRISO particle to retain the fission products, while the IPyC and OPyC layers provide additional barriers to the release of fission products, especially fission gases. During irradiation, phenomena like kernel swelling, buffer densification, and IPyC fracture may impact fuel performance. Post-irradiation microscopy on entire compact cross sections or samples of individual particles deconsolidated from compacts is often used to identify these irradiation-induced changes in morphology. However, each fuel compact generally contains thousands of TRISO particles. To get statistical information on these phenomena, it is cumbersome work if done manually. For example, to get information about swelling/densification behaviors of different layers or kernels after irradiation, researchers previously manually measured the perimeter of each TRISO layer in hundreds of particles after four rounds of iterative grinding and polishing encompassing more than 2000 cross-section images for a total of four fuel compacts. To attempt to reduce the subjectivity inherent in that process and accelerate data analysis, we conducted a study on the automatic TRISO layer segmentation on cross-sectional microscopic images using Convolutional Neural Networks (CNNs). CNNs are a class of machine learning algorithms specifically designed for processing structured grid data that have gained popularity in recent years due to their remarkable performance in various computer vision tasks, including image classification, object detection, and image segmentation. In this research, we have generated the large irradiated TRISO layer dataset with more than 2000 cross-section TRISO microscopic images and the corresponding annotated images. Based on these annotated images, we have employed different CNNs for automatic segmentation of different TRISO layers. These include RU-Net (developed in this study), as well as three existing architectures: U-Net, Residual Network (ResNet), and Attention U-Net. The preliminary results show that the model based on RU-Net has the best performance in terms of intersection-over-union (IoU). Through the aid of these CNN models, we can expedite the analysis of TRISO particle cross-sections, significantly reducing the manual labor involved and improving the objectivity of the segmentation results.

Convolutional Neural Networks↗

DuraMAT (Durable Module Materials Consortium) Annual Report FY 2020

The Durable Module Materials Consortium (DuraMAT) launched in November 2016 with five years of funding as part of the U.S. Department of Energy’s (DOE’s) Energy Materials Network. DuraMAT is a multilab consortium, led by the National Renewable Energy Laboratory (NREL) and Sandia National Laboratories (Sandia), with SLAC National Accelerator Laboratory (SLAC) and Lawrence Berkeley National Laboratory (LBNL) as core research labs. DuraMAT’s overarching goal is to discover, develop, de-risk, and enable the rapid commercialization of improved materials, designs, predictive tests, and models for PV modules that increase performance, extend lifetime, and enable new applications. We work in partnership with our 15-member Industry Advisory Board and the technical management team in DOE’s Solar Energy Technologies Office. This document describes DuraMAT activities in FY20.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Measurement Of The Total Cross-Section Of Muon Neutrino Charged-Current Coherent Pion Production in NOvA Near Detector

Charged Current (CC) coherent neutrino-nucleus pion production is characterized by small momentum transferred to the nucleus, which is left in its ground state. Despite the relatively large uncertainties on the production cross-section, coherent production of mesons by neutrinos represents an important process, as it can shed light on the structure of the weak current and can also constitute a potential source of background for modern neutrino oscillation experiments and searches for Beyond Standard Model (BSM) physics. This Ph.D. thesis presents a new measurement of CC coherent pion production in the NOvA near detector at the Fermi National Accelerator Laboratory (Fermilab). The analysis is based on the use of both particle identification and kinematic selection criteria based on Convolutional Neural Networks (CNN) to achieve a selection purity of 60%. Given the energy range 1-5 GeV accessible with the available NOvA exposure in the NuMI beam, the results will also be relevant for f uture neutrino experiments like the Deep Underground Neutrino Experiment (DUNE).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Hydrogen Consortium: Technical Progress on Renewable Hydrogen Production R&D

HydroGEN (https://www.h2awsm.org/) Energy Materials Network (EMN) is an U.S. Department of Energy (DOE) EERE Hydrogen and Fuel Cell Technologies Office (HFTO)-funded consortium that aims to accelerate the discovery and development of advanced water splitting materials (AWSM) for clean, low-cost hydrogen production. This is in line with the H2@Scale initiative (https://www.energy.gov/eere/fuelcells/h2-scale), with the goal to meet U.S. DOE's Hydrogen Shot production cost target of $1/kg H2 within 1 decade. Materials innovations are key to enhancing performance, durability, and cost of hydrogen generation technologies. Large scale, low cost hydrogen from diverse domestic resources can enable an economically competitive and environmentally beneficial future energy system across multiple sectors. HydroGEN is focused on low technology readiness level AWS technologies, including low- (alkaline exchanged membrane electrolysis) and high-temperature electrolysis (proton-conducting solid oxide electrolysis), photoelectrochecmical (PEC) and solar thermochemical (STCH) water splitting. This presentation will provide an overview of the HydroGEN EMN and technical highlights of a few lab-led and FOA-awarded R&D projects. HydroGEN continues to grow its community of industry, university, and national laboratories, forming a national innovation ecosystem focused on renewable hydrogen production.

clean hydrogen↗

HydroGEN Overview: A Consortium on Advanced Water Splitting Materials

HydroGEN (https://www.h2awsm.org/) Energy Materials Network (EMN) is an U.S. Department of Energy (DOE) EERE Hydrogen and Fuel Cell Technologies Office (HFTO)-funded consortium that aims to accelerate the discovery and development of advanced water splitting materials (AWSM) for clean, low-cost hydrogen production. This is in line with the H2@Scale initiative (https://www.energy.gov/eere/fuelcells/h2-scale), with the goal to meet U.S. DOE's Hydrogen Shot production cost target of $1/kg H2 within 1 decade. Materials innovations are key to enhancing performance, durability, and cost of hydrogen generation technologies. Large scale, low cost hydrogen from diverse domestic resources can enable an economically competitive and environmentally beneficial future energy system across multiple sectors. HydroGEN is focused on low technology readiness level AWS technologies, including low- (alkaline exchanged membrane electrolysis) and high-temperature electrolysis (proton-conducting solid oxide electrolysis), photoelectrochecmical (PEC) and solar thermochemical (STCH) water splitting. This presentation will provide an overview of the HydroGEN EMN and technical highlights of a few lab-led and FOA-awarded R&D projects. HydroGEN continues to grow its community of industry, university, and national laboratories, forming a national innovation ecosystem focused on renewable hydrogen production.

clean hydrogen↗

HydroGEN Consortium: Advancements in Renewable Hydrogen Production

HydroGEN Energy Materials Network (EMN) is an U.S. Department of Energy (DOE) EERE Hydrogen and Fuel Cell Technologies Office (HFTO)-funded consortium that aims to accelerate the discovery and development of advanced water splitting materials (AWSM) for clean, low-cost hydrogen production. Materials innovations are key to enhancing performance, durability, and cost of hydrogen generation technologies. HydroGEN is focused on low technology readiness level AWS technologies, including low- (alkaline exchanged membrane electrolysis) and high-temperature electrolysis (proton-conducting solid oxide electrolysis), photoelectrochecmical (PEC) and solar thermochemical (STCH) water splitting. This presentation will provide an overview of the HydroGEN EMN and technical highlights of a few lab-led and FOA-awarded R&D projects. HydroGEN continues to grow its community of industry, university, and national laboratories, forming a national innovation ecosystem focused on renewable hydrogen production.

clean hydrogen↗

The Metaproteomics Initiative: a coordinated approach for propelling the functional characterization of microbiomes

Through connecting genomic and metabolic information, metaproteomics is an essential approach for understanding how microbiomes function in space and time. The international metaproteomics community is delighted to announce the launch of the Metaproteomics Initiative (www.metaproteomics.org), the goal of which is to promote dissemination of metaproteomics fundamentals, advancements, and applications through collaborative networking in microbiome research. The Initiative aims to be the central information hub and open meeting place where newcomers and experts interact to communicate, standardize, and accelerate experimental and bioinformatic methodologies in this field. We invite the entire microbiome community to join and discuss potential synergies at the interfaces with other disciplines, and to collectively promote innovative approaches to gain deeper insights into microbiome functions and dynamics.

59 BASIC BIOLOGICAL SCIENCES↗

Developing a complete AI-accelerated workflow for superconductor discovery

The quest to identify new superconducting materials with enhanced properties is hindered by the prohibitive cost of computing electron-phonon spectral functions, severely limiting the materials space that can be explored. Here, we introduce a Bootstrapped Ensemble of Equivariant Graph Neural Networks (BEE-NET), a machine-learning model trained to predict the Eliashberg spectral function and superconducting critical temperature with a mean-absolute-error of 0.87 K relative to DFT-based Allen-Dynes calculations. Intriguingly, BEE-NET achieves a true-negative-rate of 99.4%, enabling highly efficient screening for the rare property of superconductivity. Integrated into a multi-stage, AI-accelerated discovery pipeline that incorporates elemental-substitution strategies and machine-learned interatomic potentials, our workflow reduced over 1.3 million candidate structures to 741 dynamically and thermodynamically stable compounds with DFT-confirmed T c > 5 K. We report the successful synthesis and experimental confirmation of superconductivity in two of these previously unreported compounds. This study establishes a data-driven framework that integrates machine learning, quantum calculations, and experiments to systematically accelerate superconductor discovery.

Gibson, Jason B. [Quantum Formatics, Cambridge, MA↗

Accelerating high-order continuum kinetic plasma simulations using multiple GPUs

Kinetic plasma simulations solve the Vlasov-Poisson or Vlasov-Maxwell equations to evolve scalar-variable distribution functions in position-velocity phase space and vector-variable electromagnetic fields in configuration space. The immense computational cost of evolving high-dimensional variables, and their large number of degrees of freedom, often limits the utility of continuum kinetic simulations and presents a challenge when it comes to accurately simulating real-world physical phenomena. To address this challenge, we present techniques that accelerate and minimize the computational work required for a scalable Vlasov-Poisson solver. We show theoretical hardware compute and communication bounds for solving a fourth-order finite-volume Vlasov-Poisson system. These bounds are then used to inform and evaluate the design of performance portable algorithms for a multiple graphics processing unit (GPU) accelerated version of the Vlasov-Poisson solver VCK-CPU [1]. We demonstrate that the multi-GPU Vlasov solver implementation, VCK-GPU, simultaneously minimizes required inter-process data transfer while also being bounded by the machine network performance limits. This results in an overall strong scaling speedup per timestep of up to 40x in three-dimensional phase space (one position, two velocity coordinates) and 54x in four dimensional phase space (two position, two velocity coordinates) and a 341x increase in simulation throughput of the GPU accelerated code over the existing CPU code. The GPU code is also able to weak scale up to 256 compute nodes and 1024 GPUs. In conclusion, we demonstrate that the improved compute performance enables exploring configurations which were previously computationally infeasible, including resolving fine-scale distribution function filamentation and multi-species dynamics with realistic electron-proton mass ratios.

Continuum kinetics↗