Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep energy method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Detecting and Characterizing Fracture Zones Using a Convolutional Neural Network

This project directly supports the Geothermal Technologies Office (GTO) objectives outlined in the Multi-Year Program Plan (MYPP) by advancing two key research areas: “Exploration and Characterization” and “Data, Modeling, and Analysis.” This project has successfully demonstrated a pre-drilling ability to image and characterize the distribution and connectivity of subsurface faults and fractures, key parameters for identifying permeable pathways that enable geothermal fluids to circulate and produce energy. Specifically, we developed and implemented innovative machine learning methodologies to enhance geothermal exploration. Large-scale faults were detected using a Convolutional Neural Network (CNN), while small-scale fractures were characterized using a novel Double-Beam Neural Network (DBNN). These tools have proven both technically effective and cost-efficient by reducing reliance on expensive exploratory drilling. Through collaboration with our geothermal industry partner, this research has significantly advanced techniques for identifying hidden geothermal systems and extending the productive lifespan of existing geothermal fields. We applied our methods to two geothermal fields—Soda Lake (Nevada) and Lightning Dock (New Mexico)—to identify shallow steam-charged fracture zones and characterize deep faults at depths of 1.5-2 km. The steam zone identified at the Soda Lake geothermal field showed excellent agreement with prior drilling data, validating the effectiveness of our approaches. In addition, the analysis revealed three new prospective drilling targets for further development and verification. The outcomes of this project improve our scientific understanding of geothermal reservoir behavior, enhance exploration efficiency, extend the economic life of existing geothermal plants. Ultimately, these advancements contribute to GTO’s goal of achieving more sustainable, affordable, and data-driven geothermal energy development across the United States.

15 GEOTHERMAL ENERGY↗

Identification of Auger mechanisms responsible for low energy electron emission from graphene on copper using Auger-gamma coincidence spectroscopy

We have applied positron annihilation induced Auger-gamma coincidence spectroscopy to identify important mechanisms responsible for the emission of low energy electrons following the sudden creation of holes in bilayer graphene on copper substrate. The novel surface spectroscopic method measures the energy of the Doppler shifted annihilation gamma photon in coincidence with the Auger electron emitted following the relaxation of the hole created by the annihilation of a surface electron with a surface trapped positron. By extracting and theoretically modelling the annihilation gamma spectra coincident with low energy electrons, we associate majority of the intensity in the low energy (7 eV–25 eV) region of the Auger spectrum to electron emission following Auger decays of 2s holes in adsorbed oxygen and deep valence holes in graphene. We provide additional support to this conclusion by showing that most of the Auger electrons with energy less than ~ 25 eV are coincident with gamma photons with small Doppler shift (511 keV–512 keV) indicating that the primary electron whose annihilation resulted in low energy Auger electron emission had small momentum parallel to the gamma emission direction. On the other hand, majority of the Auger electrons measured in coincidence with the photons having maximum Doppler shift (515 keV–521 keV) were emitted following the decay of core holes (C 1s and O 1s). Furthermore, by selecting annihilation gamma photons coincident only with the O KVV (from surface adsorbed oxygen), C KVV (graphene), and Cu MVV (copper substrate) Auger electrons, we have also experimentally derived the energy spectrum of Doppler shifted gamma photons resulting from the annihilation of positrons with 1s electrons of O, 1s electrons of C and 3p electrons of Cu respectively. Model Doppler broadened gamma spectra produced using ab-initio calculations agree well with the experimentally derived line shapes. This demonstrates the ability of Auger-gamma coincidence method to experimentally resolve the Doppler broadened annihilation gamma spectrum from surfaces into its veiled electronic level constituents which has, heretofore, relied solely on theoretical analysis. Our results also demonstrate that the line shape of the Doppler broadened annihilation gamma peak reflect the chemical composition of the topmost atomic layer and can thus be used to characterize both external and inaccessible surfaces of porous materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

NLML: A Deep Neural Network Emulator for the Exact Nonlinear Interactions in a Wind Wave Model

Nonlinear wave interactions describe the resonant energy transfer between wave components, playing a fundamental role in the evolution of ocean wave spectra. Nonlinear wave interactions significantly influence wave growth and development, making them essential for accurate wave modeling. However, resolving the full six-dimensional Boltzmann integral of the exact nonlinear wave interactions (Webb-Resio-Tracy method, WRT) is computationally expensive, limiting its application in real-time operational wave forecasting and for research purposes. Current approximations, such as the Discrete Interaction Approximation (DIA), prioritize computational speed over accuracy, resulting in significant errors in wave mean parameters. Here, we introduce NLML, a machine learning (ML) emulator designed to approximate the exact nonlinear wave interactions within WAVEWATCH III (WW3), with the goal of achieving the accuracy of WRT while maintaining the stability and computational speed of DIA. By leveraging GPU capabilities such as half precision inference, we achieved substantial speedups, up to 136x mathematical equation faster than the WRT and only a modest 1.04x mathematical equation slowdown relative to DIA, while achieving 2x mathematical equation the accuracy of DIA in global wave spectral energy and mean wave parameters, with up to 7x mathematical equation higher accuracy in some regions. Unlike previous ML approaches, NLML maintained inherent stability throughout model integration in a standalone, year-long WW3 simulation, without requiring additional constraints. Our new ML parameterization bridges the gap between accuracy and efficiency, offering a promising alternative for improving wave modeling in operational settings and research purposes.

16 TIDAL AND WAVE POWER↗

Solving key challenges in collider physics with foundation models

Foundation models are neural networks that are capable of simultaneously solving many problems. Large language foundation models like ChatGPT have revolutionized many aspects of daily life, but their impact for science is not yet clear. In this paper, we use a new foundation model for hadronic jets to solve three key challenges in collider physics. In particular, we show how experiments can (1) save significant computing power when developing reconstruction algorithms, (2) perform a complete uncertainty quantification for high-dimensional measurements, and (3) search for new physics with model agnostic methods using low-level inputs. In each case, there are significant computational or methodological challenges with current methods that limit the science potential of deep learning algorithms. By solving each problem, we take jet foundation models beyond proof-of-principle studies and into the toolkit of practitioners.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Deep Learning and Natural Language Processing for Accelerated Inverse Design of Optical Metamaterials

Optical metamaterial device design has enjoyed a long track of success over the past 50 years leading to the manipulation of light over a wide range of wavelengths spanning the ultraviolet to the far infrared. The manipulation of light over such wavelengths has already led to many technological advancements such as the design of selective radiative absorbers for solar energy, daytime passive cooling using deep space, and optical invisibility cloaks for defense applications. Further disruptive advancements in energy, defense, computing, and biomedical fields could be enabled or enhanced by future optical metamaterial devices. These technologies could lead to increased energy efficiency and hence reduced national primary energy consumption, cheap long duration energy storage, and next generation solid-state heat engines. But historically the methods to invent and develop all of these devices have been time- consuming and based mostly on intuition and iteration. Finding an optimal design can take years.

36 MATERIALS SCIENCE↗

Deep Learning and Natural Language Processing for Accelerated Inverse Design of Optical Metamaterials

Optical metamaterial device design has enjoyed a long track of success over the past 50 years leading to the manipulation of light over a wide range of wavelengths spanning the ultraviolet to the far infrared. The manipulation of light over such wavelengths has already led to many technological advancements such as the design of selective radiative absorbers for solar energy, daytime passive cooling using deep space, and optical invisibility cloaks for defense applications. Further disruptive advancements in energy, defense, computing, and biomedical fields could be enabled or enhanced by future optical metamaterial devices. These technologies could lead to increased energy efficiency and hence reduced national primary energy consumption, cheap long duration energy storage, and next generation solid-state heat engines. But historically the methods to invent and develop all of these devices have been time- consuming and based mostly on intuition and iteration. Finding an optimal design can take years. In this project we developed a machine learning-based algorithm capable of automatically generating device designs to produce desired optical properties, reducing the design cycle life in certain situations to be almost instantaneous.

36 MATERIALS SCIENCE↗

Z-Target Radiography Postprocessing With A Deep Convolution Neural Network

Analyzing X-ray radiographs is crucial for understanding target behavior in Inertial Confinement Fusion (ICF) and High Energy Density (HED) platforms. However, the density of Magneto Raleigh Taylor (MRT) bands and limitations of target materials often obscure relevant spike growth and density information. To address this issue, machine learning postprocessing techniques can be applied to remove darkened regions in radiography images. In this study, a novel method is presented for removing MRT darkened regions from z-target radiographs using a convolutional neural network (CNN). The CNN, consisting of six layers, treats the darkened regions as noise and employs a mixed loss function and end-to-end frameworks to suppress them while preserving sharpness. The six-layer architecture is designed to effectively learn features when provided with a larger volume of learning space. Each layer is optimized using a mixed loss function that combines a standard loss pixel approach with a multi-scaled structural similarity index loss, which considers luminance, contrast, and structure in local neighborhoods. This approach is particularly beneficial for capturing the stochastic structure of MRT limbs. Due to the limited availability of experimental data, training is conducted using synthetic target radiography from 3D Alegra simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Improving the representation of shallow cumulus convection with the simplified-higher-order-closure–mass-flux (SHOC+MF v1.0) approach

Abstract. Parameterized boundary layer turbulence and moist convection remain some of the largest sources of uncertainty in general circulation models. High-resolution climate modeling aims to reduce that uncertainty by explicitly attempting to resolve deep moist convective motions. An example of such a model is the Simple Cloud-Resolving E3SM Atmosphere Model (SCREAM) with a target global resolution of 3.25 km, allowing for a more accurate representation of complex mesoscale deep convective dynamics. Yet, small-scale planetary boundary layer turbulence and shallow convection still need to be parameterized, which in SCREAM is accomplished through the turbulent-kinetic-energy-based (TKE-based) simplified higher-order closure (SHOC) – a simplified version of the assumed-double-Gaussian-PDF (probability density function) higher-order-closure method. In this paper, we implement a stochastic-multiplume mass-flux (MF) parameterization of dry and shallow convection in SCREAM to go beyond the limitations of double-Gaussian-PDF closures and couple it to SHOC (SHOC+MF). The new parameterization implemented in a single-column model type version of SCREAM produces results for two shallow cumulus convection cases (marine and continental shallow convection) that agree well with the reference data from large-eddy simulations, thus improving the general representation of the thermodynamic quantities and their turbulent fluxes as well as cloud macrophysics in the model. Furthermore, SHOC+MF parameterization shows weak sensitivity to the vertical grid resolution and model time step.

54 ENVIRONMENTAL SCIENCES↗

Molecular dynamics simulation of Fe-Si alloys using a neural network machine learning potential

Interatomic potential development using machine learning (ML) approaches has attracted a lot of attention in recent years because these potentials can effectively describe the structural and dynamical properties of complex materials at the atomistic level. Here, in this work, we present the development of a neural network (NN) deep ML interatomic potential for Fe-Si alloys, and we demonstrate the effectiveness of the NN-ML potential in predicting the structures and energies of liquid and crystalline phases of Fe-Si alloys in comparison with the results from ab initio molecular dynamics simulations or experimental data. The developed NN-ML potential is also used to perform molecular dynamics simulations to study the structures of Fe-Si alloys with various compositions under rapid solidification conditions. The short-ranged orders in the rapidly solidified Fe-Si alloys are also analyzed by a cluster alignment method.

36 MATERIALS SCIENCE↗

Exploring for Superhot Geothermal Targets in Magmatic Settings: 2022 Field Campaign at Newberry Volcano

This paper presents preliminary results from a subset of work carried out as part of a multinational research project entitled DErisking Exploration for multiple geothermal Plays in magmatic ENvironments (DEEPEN), supported by the U.S. Department of Energy (DOE) and Geothermica, a joint effort by EU member states and associated countries. The DEEPEN project will develop a customized approach to exploration for supercritical and superhot geothermal plays in magmatic systems, which will be applied to two demonstration sites. This paper summarizes field activities carried out at the U.S. demonstration site, Newberry Volcano in central Oregon. The objective of this work effort is to refine the subsurface model of Newberry Volcano, with special focus on deeper zones including the magmatic plumbing system and other key geologic elements. New data collection included gravity and wideband magnetotelluric (MT) surveys, as well as reinstallation of a seismic network. The National Renewable Energy Laboratory (NREL) and Enthalpion Energy LLC (Enthalpion) worked with the Deschutes National Forest Fort Rock District to use a low ground disturbance method of MT deployment to collect MT data inside the caldera and other restricted areas inside the National Volcanic Monument. This opened these areas to geophysical exploration for the first time in decades. Sites along and adjacent to the south rim of the volcano constituted the primary survey objectives. A team from Lawrence Berkeley National Laboratory (LBNL), the U.S. Geological Survey (USGS), and AltaRock also began the process of reinstalling the seismic network from the AltaRock enhanced geothermal system (EGS) demonstration in anticipation of further development activities at the site. The data ingestion, reduction, and analysis phase of the project is ongoing. We are currently processing the MT and gravity data and are developing a new, highly GPU-accelerated, 3D joint MT and gravity inversion to better localize the south rim/south flank conductive target and better understand its relationship to deep heat, fluid sources, and surface extrusive features. Joint inversions, which have not yet been undertaken at Newberry, will allow us to obtain constraints on the geologic model that cannot be determined from each method in isolation, improving our ability to image key geologic features at depth.

geophysics↗

Protein sequence design with a learned potential

The task of protein sequence design is central to nearly all rational protein engineering problems, and enormous effort has gone into the development of energy functions to guide design. Here, we investigate the capability of a deep neural network model to automate design of sequences onto protein backbones, having learned directly from crystal structure data and without any human-specified priors. The model generalizes to native topologies not seen during training, producing experimentally stable designs. We evaluate the generalizability of our method to a de novo TIM-barrel scaffold. The model produces novel sequences, and high-resolution crystal structures of two designs show excellent agreement with in silico models. Our findings demonstrate the tractability of an entirely learned method for protein sequence design.

59 BASIC BIOLOGICAL SCIENCES↗

Smart Methane Emission Detection System Development (Final Report)

Working with the Department of Energy’s National Energy Technology Laboratory, Southwest Research Institute® (SwRI®) developed a system to identify methane leaks reliably, accurately, and autonomously at critical midstream sections of the natural gas distribution network in real- time for the purpose of mitigating methane emissions using Optical Gas Imaging (OGI) cameras. SwRI’s Smart Leak Detection – Methane (SLED/M) adds a high degree of automation to the process of methane leak detection to minimize sources of human error, minimize response time to a leak event, and maximize midstream visibility. Furthermore, SwRI has been working towards integrating Quantitative OGI (QOGI) capabilities into this existing technology. By leveraging Deep Learning, SwRI now has the capability to estimate fugitive emission leak rates quickly and reliably, which allows operators to detect emissions, quantify leak rate, prioritize repairs, and validate the repairs in a single instrument. The next generation QOGI technology leverages the same cameras used in Leak Detection and Repair (LDAR) programs, with improvements in safety and speed for traditional quantification-based repairs, ultimately leading to less overhead cost for the operators. The goals for this research were to develop two types of models with the following goals: 1. Run in real-time on the edge (≥ 12 Hz) 2. Classification: Achieve less than 5% false positive detection 3. Classification: Achieve ≥ 95% methane plume detection rate 4. Regression: achieve ≤ 10 standard cubic feet per hour (scfh) prediction > 70% of the time In order to achieve these results, multiple infrared (IR) and other sensors were investigated in tandem with the midwave IR (MWIR) OGI to provide additional information to train the underlying models. Information on atmospheric conditions including humidity, temperature, pressure, and solar radiation was provided by a weather station. Several machine learning and deep learning architectures and methods, including looking at quantized classification networks and regressions networks, were explored. As further data was collected, curated, and labeled, it allowed for more refined regressive networks to be adequately trained, leading to better insight into the true flow rates being observed. An important valuable deliverable of this research effort was the development of an advanced network which underwent multiple iterations capable of giving a continuous output. The current network has a predicted mean average percentage error (MAPE) of 12.3% just outside our target goal of 10.00%, but an accuracy of 97.78% at ±50 scfh, well within the overall goal for the Department of Energy (DOE) program. Upon closer inspection, it was observed that more than 10% of datapoints contributing to the MAPE predictions were the result of low flow rate predictions and are beyond the sensitivity of instrument measurement as a result of normal operational variation and noise.

03 NATURAL GAS↗

Smart Readout of Nondestructive Image Sensors with Single Photon-Electron Sensitivity

Image sensors with nondestructive charge readout provide single-photon or single-electron sensitivity, but at the cost of long readout times. We present a smart readout technique to allow the use of these sensors in visible light and other applications that require faster readout times. The method optimizes the readout noise and time by changing the number of times pixels are read out either statically, by defining an arbitrary number of regions of interest in the array, or dynamically, depending on the charge or energy of interest in the pixel. This technique is tested in a Skipper CCD showing that it is possible to obtain deep subelectron noise, and therefore, high resolution of quantized charge, while dynamically changing the readout noise of the sensor. These faster, low noise readout techniques show that the skipper CCD is a competitive technology even where other technologies such as electron multiplier charge coupled devices, silicon photo multipliers, etc. are currently used. This technique could allow skipper CCDs to benefit new astronomical instruments, quantum imaging, exoplanet search and study, and quantum metrology.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Deep Reinforcement Scheduling of Energy Storage Systems for Real-time Voltage Regulation in Unbalanced LV Networks with High PV Penetration

The ever-growing higher penetration of distributed energy resources (DERs) in low-voltage (LV) distribution systems brings both opportunities and challenges to voltage support and regulation. This paper proposes a deep reinforcement learning (DRL)-based scheduling scheme of energy storage systems (ESSs) to mitigate system voltage deviations in unbalanced LV distribution networks. The ESS-based voltage regulation problem is formulated as a multi-stage quadratic stochastic program, with the objective of minimizing the expected total daily voltage regulation cost while satisfying operational constraints. While existing voltage regulation methods are mostly focused on onetime- step control, this paper explores a day-horizon systemwide voltage regulation problem. In other words, the size of action and state spaces are extremely high-dimensional and need to be delicately handled. Furthermore, in order to overcome the difficulty of modeling uncertainties and develop a realtime solution, a learn-to-schedule feedback control framework is proposed by adapting the problem to a model-free DRL setting. The proposed algorithm is tested on a customized 6-bus system and a modified IEEE 34-bus system. Simulation results validate the effectiveness and near-optimality of voltage regulation by ESS in comparison with a deterministic quadratic program solution.

Wang, Shengyi↗

Cyber-Informed Engineering Briefing for ABET

Cyber-Informed Engineering (CIE) is an emerging method to integrate cybersecurity considerations into the conception, design, development, and operation of any physical system, energy or otherwise, to mitigate or even eliminate avenues for cyber-enabled attacks.?CIE concepts use design decisions and engineering controls to prioritize defense against the worst possible consequences of cyberattacks facing critical infrastructure systems and asset owners. These slides offer a deep dive into Cyber-Informed Engineering for engineering educators.

42 - ENGINEERING↗

Synthesis of CdZnTeSe single crystals for room temperature radiation detector fabrication: mitigation of hole trapping effects using a convolutional neural network

In this article, we report the growth of Cd 0.9 Zn 0.1 Te 0.97 Se 0.03 (CZTS) wide bandgap semiconductor single crystals for room temperature gamma-ray detection using a modified vertical Bridgman method. Charge transport properties measured in the radiation detectors, fabricated from the grown CZTS crystals, indicated signs of hole trapping. Hole traps inhibit high-resolution radiation detection especially for energetic gamma rays. Machine learning (ML) applications are gaining tremendous mpetus in improving device and sensor performance by compensating for limi tations arising from such intrinsic material properties. In this article, we describe a deep convolutional neural network (CNN) that has demonstrated remarkable efficiency in identifying the energy of a gamma photon detected by a CZTS detector. The CNN has been trained using simulated data that resemble output pulses from actual CZTS detectors when exposed to 662-keV gamma photons. The device properties required for the simulation have been derived from radiation detection measurements on a real Cd 0.9 Zn 0.1 Te 0.97 Se 0.03 detector fabricated in our laboratory. The CNN has been trained with detector pulses arising through photoelectric (PE) and Compton scattering (CS) separately. The percentage error in predicting the detected energies, within an extremely small duration of 0.28 ms, was found to be lower than 0.1% for gamma energies above 50 keV and for training datasets con taining PE and CS events separately. The CNN was also validated for a mixed PE and CS dataset to obtain a prediction error of 1%. Additionally, the effect of detector resolution on the efficiency of the CNN was also explored.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Learning local equivariant representations for large-scale atomistic dynamics

Abstract A simultaneously accurate and computationally efficient parametrization of the potential energy surface of molecules and materials is a long-standing goal in the natural sciences. While atom-centered message passing neural networks (MPNNs) have shown remarkable accuracy, their information propagation has limited the accessible length-scales. Local methods, conversely, scale to large simulations but have suffered from inferior accuracy. This work introduces Allegro, a strictly local equivariant deep neural network interatomic potential architecture that simultaneously exhibits excellent accuracy and scalability. Allegro represents a many-body potential using iterated tensor products of learned equivariant representations without atom-centered message passing. Allegro obtains improvements over state-of-the-art methods on QM9 and revMD17. A single tensor product layer outperforms existing deep MPNNs and transformers on QM9. Furthermore, Allegro displays remarkable generalization to out-of-distribution data. Molecular simulations using Allegro recover structural and kinetic properties of an amorphous electrolyte in excellent agreement with ab-initio simulations. Finally, we demonstrate parallelization with a simulation of 100 million atoms.

74 ATOMIC AND MOLECULAR PHYSICS↗