Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep energy method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Adaptive Hierarchical Cyber Attack Detection and Localization in Active Distribution Systems

Development of a cyber security strategy for the active distribution systems is challenging due to the inclusion of distributed renewable energy generations. Here this paper proposes an adaptive hierarchical cyber attack detection and localization framework for distributed active distribution systems via analyzing electrical waveforms. Cyber attack detection is based on a sequential deep learning model, via which even minor cyber attacks can be identified. The two-stage cyber attack localization algorithm first estimates the cyber attack sub-region, and then localize the specified cyber attack within the estimated subregion. We propose a modified spectral clustering-based network partitioning method for the hierarchical cyber attack ‘coarse’ localization. Next, to further narrow down the cyber attack location, a normalized impact score based on waveform statistical metrics is proposed to obtain a ‘fine’ cyber attack location by characterizing different waveform properties. Finally, compared with classical and state-of-art methods, a comprehensive quantitative evaluation with two case studies shows promising estimation results of the proposed framework.

42 ENGINEERING↗
DOE OSTI2020

Wattile: Probabilistic Deep Learning-based Forecasting of Building Energy Consumption [SWR-20-94]

Accurate energy forecasting is becoming critical due to many reasons: i ) optimal distributed energy resources operations and dispatch, ii) fault detection and diagnostics, and iii) meeting operational energy efficiency targets. Wattile uses deep learning (DL) for the building's short-term load forecasting application. Two specific types of neural networks called, Long Short Term Memory (LSTM) and Sequence-to-Sequence (S2S) models are used to make predictions. Forecasting models are trained using online historical weather and occupancy indicator data streams from the Intelligent Campus Program's data acquisition systems at the National Renewable Energy Laboratory (NREL) for main meters and sub-meters of multiple building types. These models use probabilistic methods to provide quantile-based forecasts in addition to nominal conditional median predictions of electricity consumption.

Frank, Stephen↗
DOE OSTI2023

Understanding hadronic interactions using advanced reconstruction techniques

ProtoDUNE-SP served as the prototype of the future Deep Underground Neutrino Experiment (DUNE). With a total liquid argon mass of 0.77 kt, it stood as the most extensive monolithic single-phase Liquid Argon Time Projection Chamber (LArTPC) ever constructed. Strategically located and operated at CERN, ProtoDUNE-SP benefited from a specialized charged-particle test beam, offering a momentum range of 0.3 - 7 GeV/c. This setup provided a unique opportunity to conduct in-depth studies on hadronic interactions within argon. Hadronic interactions play a fundamental role in neutrino physics, particularly in the intricacies of neutrino detection. We depend on analyzing the outcomes of these interactions to accurately determine both the flavor and energy of the interacting neutrinos. Pions, as one of the primary byproducts of neutrino interactions, are crucial for understanding the overall dynamics and kinematics of these processes. Accurately characterizing and understanding the interaction of pions with argon can significantly enhance the precision of neutrino simulations and measurements.Being a Liquid Argon Time Projection Chamber (LArTPC), ProtoDUNE-SP is distinguished by its ability to produce high-definition images of charged particles as they traverse through the detector's active volume. Yet, accurately reconstructing these particle interactions and determining their kinematic attributes remains a challenging task. The successes of deep learning in diverse domains, especially in image recognition, provide a promising approach for addressing this challenge in ProtoDUNE. This thesis discusses a measurement of the Piplus - argon inelastic cross section in the energy range of 2400 to 3000 MeV, using data taken by protoDUNE during the fall of 2018. Additionally, panoptic segmentation, a machine learning technique, is introduced and validated through its application in the reconstruction of the neutral pion rest mass. The aim is to showcase how these advanced methods can enhance the quality of event reconstruction.

Sarasty Segura, Carlos Eduardo↗
DOE OSTI2025

Applications of explainable artificial intelligence in renewable energy research

Researchers in renewable energy are applying deep learning (DL) to a variety of problems from diverse renewable energy domains, such as biofuels, wind, solar, power systems, buildings, vehicles, and transportation systems. Improvements in accuracy may be demonstrated using DL in laboratory settings. However, the lack of interpretability of DL models poses a practical limitation to their utility in advancing scientific knowledge and in the deployment of DL models in safety-critical energy systems. In this article, we discuss explainable artificial intelligence (XAI) as one pathway toward more interpretable DL models. We explore a brief timeline of U.S. national laboratory interest in XAI, an overview and taxonomy of methods in the field of XAI, and a selection of applications across renewable energy research domains. We conclude by highlighting pivotal areas where XAI can accelerate innovation in artificial intelligence for renewable energy research and other essential future directions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A global DSCOVR/EPIC-based hourly/daily shortwave radiation/PAR dataset

Accurate characterization of the global downward shortwave (SW) and photosynthetically active radiation (PAR) is fundamental for Earth system modeling and global change research. Combined with a machine-learning method, we used the Earth Polychromatic Imaging Camera (EPIC) data onboard the Deep Space Climate Observatory (DSCOVR) to generate the global SW/PAR dataset at both hourly and daily temporal scales and 0.1degree×0.1degree spatial resolution. Covering a period from June, 2015 to June (about 4 years), 2019, the dataset consists of total SW/PAR and their direct and diffuse components. Our dataset will be valuable for understanding the diurnal cycles and seasonal patterns of ecosystem processes, as well as the solar energy utilizations

14 SOLAR ENERGY↗
DOE OSTI2021

Deep Learning the Electromagnetic Properties of Metamaterials—A Comprehensive Review

Deep neural networks (DNNs) are empirically derived systems that have transformed traditional research methods, and are driving scientific discovery. Here, artificial electromagnetic materials (AEMs)—including electromagnetic metamaterials, photonic crystals, and plasmonics—are research fields where DNN results valorize the data driven approach; especially in cases where conventional methods have failed. In view of the great potential of deep learning for the future of artificial electromagnetic materials research, the status of the field with a focus on recent advances, key limitations, and future directions is reviewed. Strategies, guidance, evaluation, and limits of using deep networks for both forward and inverse AEM problems are presented.

14 SOLAR ENERGY↗
DOE OSTI2022

Deep Reinforcement Learning for Distribution System Restoration Using Distributed Energy Resources and Tie-Switches

Distributed energy resources (DERs), such as solar PVs and energy storage, can be used to restore distribution system critical loads after the extreme weather events to increase grid resilience. However, coordinating multiple DERs together with tie-switches for multi-step restoration process under renewable uncertainty is challenging. This paper proposes a deep reinforcement learning to control discrete actions of switching on/off tie switches and DERs for critical load restoration. The restoration problem is first cast into the Markov decision process suitable for DRL. Then, the original soft actor critic (SAC) method for continuous actions has been extended to handle discrete and continuous actions. Numerical comparison results with other stochastic optimization-based approaches on the modified IEEE 33-bus system show that the proposed method can achieve fast critical load restoration in the presence of substation power outage while maintaining system voltage limit throughout the restoration process.

active distribution systems↗
DOE OSTI2025

Deep Learning with Reflection High-Energy Electron Diffraction Images to Predict Cation Ratio in Sr 2 x Ti 2(1– x ) O 3 Thin Films

Machine learning (ML) with in-situ diagnostics offers a transformative approach to accelerate, understand, and control thin film synthesis by uncovering relationships between synthesis conditions and material properties. In this study, we demonstrate the application of deep learning to predict the stoichiometry of Sr 2x Ti 2(1–x) O 3 thin films using reflection high-energy electron diffraction images acquired during pulsed laser deposition. A gated convolutional neural network trained for regression of the Sr atomic fraction achieved accurate predictions with a small dataset of 31 samples. Explainable AI techniques revealed a previously unknown correlation between diffraction streak features and cation stoichiometry in Sr 2x Ti 2(1–x) O 3 thin films. Here, our results demonstrate how ML can be used to transform a ubiquitous in-situ diagnostic tool, that is usually limited to qualitative assessments, into a quantitative surrogate measurement of continuously valued thin film properties. Such methods are critically needed to enable real-time control, autonomous workflows, and accelerate traditional synthesis approaches.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2021

TEMImageNet training library and AtomSegNet deep-learning models for high-precision atom segmentation, localization, denoising, and deblurring of atomic-resolution images

Abstract Atom segmentation and localization, noise reduction and deblurring of atomic-resolution scanning transmission electron microscopy (STEM) images with high precision and robustness is a challenging task. Although several conventional algorithms, such has thresholding, edge detection and clustering, can achieve reasonable performance in some predefined sceneries, they tend to fail when interferences from the background are strong and unpredictable. Particularly, for atomic-resolution STEM images, so far there is no well-established algorithm that is robust enough to segment or detect all atomic columns when there is large thickness variation in a recorded image. Herein, we report the development of a training library and a deep learning method that can perform robust and precise atom segmentation, localization, denoising, and super-resolution processing of experimental images. Despite using simulated images as training datasets, the deep-learning model can self-adapt to experimental STEM images and shows outstanding performance in atom detection and localization in challenging contrast conditions and the precision consistently outperforms the state-of-the-art two-dimensional Gaussian fit method. Taking a step further, we have deployed our deep-learning models to a desktop app with a graphical user interface and the app is free and open-source. We have also built a TEM ImageNet project website for easy browsing and downloading of the training data.

25 ENERGY STORAGE↗
DOE OSTI2021

BraggNN : fast X-ray Bragg peak analysis using deep learning

X-ray diffraction based microscopy techniques such as high-energy diffraction microscopy (HEDM) rely on knowledge of the position of diffraction peaks with high precision. These positions are typically computed by fitting the observed intensities in detector data to a theoretical peak shape such as pseudo-Voigt. As experiments become more complex and detector technologies evolve, the computational cost of such peak-shape fitting becomes the biggest hurdle to the rapid analysis required for real-time feedback in experiments. To this end, we propose BraggNN, a deep-learning based method that can determine peak positions much more rapidly than conventional pseudo-Voigt peak fitting. When applied to a test dataset, peak center-of-mass positions obtained from BraggNN deviate less than 0.29 and 0.57 pixels for 75 and 95% of the peaks, respectively, from positions obtained using conventional pseudo-Voigt fitting (Euclidean distance). When applied to a real experimental dataset and using grain positions from near-field HEDM reconstruction as ground-truth, grain positions using BraggNN result in 15% smaller errors compared with those calculated using pseudo-Voigt. Recent advances in deep-learning method implementations and special-purpose model inference accelerators allow BraggNN to deliver enormous performance improvements relative to the conventional method, running, for example, more than 200 times faster on a consumer-class GPU card with out-of-the-box software.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Extraction of Drell-Yan Angular Parameters in $pp$ Collisions with a 120 GeV Beam Energy Using a Deep-Learning Unfolding Algorithm

Dilepton production in pp collisions through the Drell-Yan process provides a crucial tool for studying the internal quark-gluon structure of the nucleon. By precisely measuring the $\cos2\phi$ asymmetry, where $\phi$ represents the azimuthal angle of the $l^{+}l^{-}$ pair in the Collins-Soper frame, we can gain valuable insights into the proton’s structure and the transverse momentum ($q_{T}$) dependence of the $\cos2\phi$ asymmetry. SeaQuest, a fixed-target Drell-Yan experiment at Fermilab, involved an unpolarized proton beam colliding with unpolarized LH$_{2}$ and LD$_{2}$ targets. Measurements obtained from experiments typically require corrections for detector inefficiencies, smearing, and acceptance. Traditionally, these corrections involve “unfolding” the detector-level measurements through matrix operations. However, in higher-dimensional phase space, these conventional methods fail to scale effectively. To overcome these limitations, we employ an unbinned unfolding method that utilizes deep neural networks for unfolding higher-dimensional phase space. In this presentation, we will explain the design of the neural network architecture, our training strategies, and outline our plans to achieve conclusive results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Towards Compact Neural Networks via End-to-End Training: A Bayesian Tensor Approach with Automatic Rank Determination

Post-training model compression can reduce the inference costs of deep neural networks, but uncompressed training still consumes enormous hardware resources and energy. To enable low-energy training on edge devices, it is highly desirable to directly train a compact neural network from scratch with a low memory cost. Low-rank tensor decomposition is an effective approach to reduce the memory and computing costs of large neural networks. However, directly training low-rank tensorized neural networks is a very challenging task because it is hard to determine a proper tensor rank a priori, and the tensor rank controls both model complexity and accuracy. Here, this paper presents a novel end-to-end framework for low-rank tensorized training. We first develop a Bayesian model that supports various low-rank tensor formats (e.g., CANDECOMP/PARAFAC, Tucker, tensor-train, and tensor-train matrix) and reduces neural network parameters with automatic rank determination during training. Then we develop a customized Bayesian solver to train large-scale tensorized neural networks. Our training methods shows orders-of-magnitude parameter reduction and little accuracy loss (or even better accuracy) in the experiments. On a very large deep learning recommendation system with over 4.2 ×10 9 model parameters, our method can reduce the parameter number to 1.6 ×10 5 automatically in the training process (i.e., by 2.6 ×10 4 times) while achieving almost the same accuracy. Code is available at https://github.com/colehawkins/bayesian-tensor-rank-determination.

compact neural networks↗
DOE OSTI2023

Evaluating uncertainty-based active learning for accelerating the generalization of molecular property prediction

Deep learning models have proven to be a powerful tool for the prediction of molecular properties for applications including drug design and the development of energy storage materials. However, in order to learn accurate and robust structure–property mappings, these models require large amounts of data which can be a challenge to collect given the time and resource-intensive nature of experimental material characterization efforts. Additionally, such models fail to generalize to new types of molecular structures that were not included in the model training data. The acceleration of material development through uncertainty-guided experimental design has the promise to significantly reduce the data requirements and enable faster generalization to new types of materials. To evaluate the potential of such approaches for electrolyte design applications, we perform comprehensive evaluation of existing uncertainty quantification methods on the prediction of two relevant molecular properties - aqueous solubility and redox potential. We develop novel evaluation methods to probe the utility of the uncertainty estimates for both in-domain and out-of-domain data sets. Finally, we leverage selected uncertainty estimation methods for active learning to evaluate their capacity to support experimental design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Forward modeling fluctuations in the DESI LRGs target sample using image simulations

We use the forward modeling pipeline, Obiwan, to study the imaging systematics of the Luminous Red Galaxies (LRGs) targeted by the Dark Energy Spectroscopic Instrument (DESI). Imaging systematics refers to the false fluctuation of galaxy densities due to varying observing conditions and astrophysical foregrounds corresponding to the imaging surveys from which DESI LRG target galaxies are selected. We update the Obiwan pipeline, which we previously developed to simulate the optical images used to target DESI data, to further simulate WISE images in the infrared. This addition allows simulating the DESI LRGs sample, which utilizes WISE data in the target selection. Deep DESI imaging data combined with a method to account for biases in their shapes is used to define a truth sample of potential LRG targets. We inject these data evenly throughout the DESI Legacy Imaging Survey footprint at declinations between -30 and 32.375 degrees. We simulate a total of 15 million galaxies to obtain a simulated LRG sample (Obiwan LRGs) that predicts the variations in target density due to imaging properties. We find that the simulations predict the trends with depth observed in the data, including how they depend on the intrinsic brightness of the galaxies. We observe that faint LRGs are the main contributing source of the imaging systematics trend induced by depth. We also find significant trends in the data against Galactic extinction that are not predicted by Obiwan. These trends depend strongly on the particular map of Galactic extinction chosen to test against, implying systematic contamination in the Galactic extinction maps is a likely root cause (e.g., Cosmic-Infrared Background, dust temperature correction). We additionally observe a morphological change of the DESI LRGs population evidenced by a correlation between OII emission line average intensity and the size of the z-band PSF. This effect most likely results from uncertainties in background subtraction. The detailed findings we present should be used to guide any observational systematics mitigation treatment for the clustering of the DESI LRGs sample.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Measuring Solvation Interactions of Deep Eutectic Solvents Formed by Metal Chlorides and an Imidazolium Salt by Inverse Gas Chromatography

Deep eutectic solvents (DESs) represent a class of solvents that offer a number of advantages including minimal toxicity, affordability, low vapor pressure, and simple, environmentally friendly preparation methods. They have found utility in areas, such as gas absorption, metal plating, and extractions. However, the relationship between their solvation properties and chemical composition remains poorly understood. In this study, a broad range of Type I DESs composed of metal chlorides and an imidazolium salt were prepared, employed as gas chromatographic stationary phases, and characterized using the Abraham solvation parameter model by inverse gas chromatography. The Abraham solvation parameter model allows for the study of DES solvation properties and the effects of varying structural components on system constants using a linear-free energy relationship. The DESs were investigated by systematically varying their composition, including the type of metal chloride and the molar ratio between the metal chloride and the imidazolium salt. The results show that hydrogen bond acidity, hydrogen bond basicity, and dipolarity/polarizability interactions are strongly influenced by the type of metal chloride within the DES and the ratio of metal chloride to imidazolium salt in the eutectic mixture. Furthermore, a column pretreatment procedure is presented that enables the effective coating of highly polar DESs onto open tubular capillary gas chromatography columns.

deep eutectic solvent↗
DOE OSTI2021

Reducing roughness and improving efficiency of MAPbI3 perovskite solar cells made by high-throughput photonic curing

For perovskite solar cells (PSCs) to be commercially viable, the slow and energy-insufficient thermal annealing step must be eliminated. Among the photo-irradiation methods proposed to replace thermal annealing, photonic curing is the fastest conversion method. Photonic curing delivers short (20 μs to 100 ms) but intense light pulses from a broadband (200-1500 nm) xenon flash lamp, making it the only method to convert perovskite under 20 ms. This processing time can be extrapolated to a roll-to-roll web speed of 40 m/min based on laboratory processing conditions. However, most reported PSCs made by photonic curing under 1 second have inferior performance (~10% PCE). Although SEM images show dense and pinhole-free perovskite films, AFM images indicate secondary wavy features of 500 nm-wide ridge and 80 nm-deep trenches on photonically cured perovskite films, the existence of which correlates with poor device performance. We suggest that this morphology feature is produced by volatile solvent evaporation during the fast photonic curing process. Two approaches have been made to remedy this issue: (1) adding CH2I2 as the third solvent in the conventional DMF-DMSO system and (2) applying a controlled air-blowing step before photonic curing to remove excess solvent further. Combining these two approaches produces photonically- cured perovskite films with a comparable film roughness and device performance. Alkyl halide additives have been reported to enhance PSC performance by modulated solvent-solute interactions and C-X (X = Cl, Br, and I) cleavage. Photonic curing can cleave CH2I2, producing disassociated iodide ions to replenish iodine loss induced by photonic curing, which is confirmed by EDX. As a co-solvent, the high boiling point of CH2I2 can also make the solvent less volatile, reducing surface roughness in photonically cured perovskite films. Additionally, photonically-cured perovskite films have longer PL lifetimes and a higher recombination resistance compared to thermally-annealed counterparts. As a result, we demonstrate that photonic curing is a suitable method to replace thermal annealing in high-throughput PSC fabrication.

14 SOLAR ENERGY↗
DOE OSTI2021

Natural evolutionary strategies for variational quantum computation

Abstract Natural evolutionary strategies (NES) are a family of gradient-free black-box optimization algorithms. This study illustrates their use for the optimization of randomly initialized parameterized quantum circuits (PQCs) in the region of vanishing gradients. We show that using the NES gradient estimator the exponential decrease in variance can be alleviated. We implement two specific approaches, the exponential and separable NES, for parameter optimization of PQCs and compare them against standard gradient descent. We apply them to two different problems of ground state energy estimation using variational quantum eigensolver and state preparation with circuits of varying depth and length. We also introduce batch optimization for circuits with larger depth to extend the use of ES to a larger number of parameters. We achieve accuracy comparable to state-of-the-art optimization techniques in all the above cases with a lower number of circuit evaluations. Our empirical results indicate that one can use NES as a hybrid tool in tandem with other gradient-based methods for optimization of deep quantum circuits in regions with vanishing gradients.

Anand, Abhinav (ORCID:0000000280812310)↗
DOE OSTI2025

Web-Based Tools for Data-Informed Remedy Optimization: Software Theory and User Guide

This report documents the development and application of two web-based decision-support tools for pump-and-treat (P&T) groundwater remediation systems: PTOLEMY (Pump-and-Treat Optimized Location Evaluation to Maximize Yields) and OPTIMA (Optimization for Pump-and-Treat Implementation, Management, & Assessment). These tools enhance remedy design and management by leveraging advanced computational methods – specifically deep learning and multi-objective optimization – within a user-friendly platform. By integrating data-driven models with established hydrogeological knowledge, PTOLEMY and OPTIMA enable more efficient evaluation of well placement and operational strategies, helping site managers balance multiple remediation objectives under complex conditions. Both tools are implemented as modules within the SOCRATES (Suite Of Comprehensive Rapid Analysis Tools for Environmental Sites) web platform, which provides data access, visualization, and analytics to support remedy optimization across sites in the U.S. Department of Energy Office of Environmental Management complex. PTOLEMY is a rapid screening module designed to identify promising locations for new extraction wells. It employs a multi-channel three-dimensional convolutional neural network (MC3D-CNN) trained on high-fidelity simulation data to predict the relative performance (in terms of contaminant mass recovery) of potential well sites. Through an interactive web interface, PTOLEMY visualizes the probability of high performance across a site, highlighting areas where an extraction well is likely to yield above-threshold contaminant removal over a multi-year period. PTOLEMY’s map-based displays and exportable results support transparent communication of screening analyses. By focusing attention on the most favorable candidate locations, the tool augments traditional engineering judgment and physics-based modeling, providing a data informed basis for subsequent detailed evaluations. OPTIMA is a multi objective optimization module designed to find wellfield layouts and operating schedules that meet various cleanup goals. It quickly evaluates thousands of candidate setups – combinations of well locations, timing, and rates – and returns a small set of best trade-off options for comparison. At its core, OPTIMA uses a U-Net-based surrogate model – a deep-learning emulator of a groundwater flow and transport simulator – to dramatically accelerate scenario evaluations. Coupling this fast surrogate with the NSGA-II (Non-dominated Sorting Genetic Algorithm II) evolutionary algorithm, OPTIMA explores a wide decision space of well locations and schedules to identify Pareto-optimal solutions that trade off key objectives (e.g., minimizing cleanup time, maximizing contaminant mass removal, and minimizing plume extent). The tool outputs a family of optimal configurations and visualizes their trade-offs (Pareto frontiers of cleanup metrics and maps of optimized well placements). Site managers can use these results to understand the range of viable strategies and to select candidate designs for more detailed verification. OPTIMA is currently under active development and not yet fully released; this guide provides early documentation to support planning and gather user feedback.

54 ENVIRONMENTAL SCIENCES↗