Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Gradient information”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Ultrasonic measurement of temperature distributions in extreme environments: Electrical power plants testing in utility-scale steam generators

Thermal heterogeneities within energy conversion and storage, material processing, nuclear processes, aerospace, and military applications are often inaccessible to characterization by insertion sensors. When sensor deployment is possible, conventional pointwise temperature probes quickly degrade when inserted into harsh environments typical of such processes. We developed spatially-resolved ultrasonic thermometry to noninvasively measure the spatial distributions of thermal properties in such applications, even when sizable thermal gradients are present. Our method divides the path of ultrasonic propagation into segments bound by echogenic features, which create echoes in pulse-echo mode, encoding the information about interior temperature distributions. We use the acquired ultrasonic responses to estimate the internal temperature distributions by solving an inverse problem or concatenating segmental estimates. This work describes the implementation and industrial testing of the developed method at a coal-fired electrical power generation plant. We inserted an echogenically segmented Inconel 625 waveguide into the combustion zone of the utility-scale boiler and continuously acquired ultrasonic data while keeping sensitive components away from the damaging combustion environment. The accuracy of the time-dependent temperature distributions reconstructed from the ultrasonic measurements was comparable to that of thermocouples. The resiliency of ultrasonic thermometry to harsh combustion conditions was far superior to conventional insertion sensors. The measurements obtained during plant operation captured daily steam generation cycles in response to changing customer demand and intermittent contributions of renewable power sources to the power grid. These measurements have revealed new insights into the relationship between the dynamic power generation load and the conditions inside the steam generator. As a result, the successful industrial testing of spatially-resolved ultrasonic thermometry in solids indicates that the developed technology has matured to become an attractive alternative to conventional sensing in solving challenging problems of long-term thermal characterizations in extreme environments.

42 ENGINEERING↗
DOE OSTI2020

Thermodynamic Consistent Neural Networks for Learning Material Interfacial Mechanics

For multilayer materials in thin substrate systems, interfacial failure is one of the most challenges. The traction-separation relations (TSR) quantitatively describe the mechanical behavior of a material interface undergoing openings, which is critical to understand and predict interfacial failures under complex loadings. However, existing theoretical models have limitations on enough complexity and flexibility to well learn the real-world TSR from experimental observations. A neural network can fit well along with the loading paths but often fails to obey the laws of physics, due to a lack of experimental data and understanding of the hidden physical mechanism. In this paper, we propose a thermodynamic consistent neural network (TCNN) approach to build a data-driven model of the TSR with sparse experimental data. The TCNN leverages recent advances in physics-informed neural networks (PINN) that encode prior physical information into the loss function and efficiently train the neural networks using automatic differentiation. We investigate three thermodynamic consistent principles, i.e., positive energy dissipation, steepest energy dissipation gradient, and energy conservative loading path. All of them are mathematically formulated and embedded into a neural network model with a novel defined loss function. A real-world experiment demonstrates the superior performance of TCNN, and we find that TCNN provides an accurate prediction of the whole TSR surface and significantly reduces the violated prediction against the laws of physics.

Zhang, Jiaxin↗
DOE OSTI2022

Leveraging gradient weighted class activation mapping to improve classification effectiveness: Case study in transportation infrastructure characterization

Roadway “corners†are common for pedestrian use, whether designated with markings or not. Different types of markings have been deployed, ranging from simple parallel lines to more complex designs. Understanding the impact of different types of crosswalks is important for public safety. In this work we explore methods to improve the logging of marked crosswalk types. We used the Roadway Information Database from the Second Strategic Highway Research Project and used active learning methods with transfer learning to identify the crosswalk types (marked or unmarked). Upon completion we found our classifiers were unable to perform above roughly 94% correct classifications. To improve their efficacy, we separated the crosswalks into their “fine grained†types and used Gradient-Weighted Class Activation Mapping to isolate and study the features that classified the crosswalks. We compared this with sampled manually marked crosswalks and present findings. We believe this use case can represent a process to improve the active learning method for some visual machine learning applications.

Karnowski, Thomas↗
DOE OSTI2023

Finding simplicity: unsupervised discovery of features, patterns, and order parameters via shift-invariant variational autoencoders *

Abstract Recent advances in scanning tunneling and transmission electron microscopies (STM and STEM) have allowed routine generation of large volumes of imaging data containing information on the structure and functionality of materials. The experimental data sets contain signatures of long-range phenomena such as physical order parameter fields, polarization, and strain gradients in STEM, or standing electronic waves and carrier-mediated exchange interactions in STM, all superimposed onto scanning system distortions and gradual changes of contrast due to drift and/or mis-tilt effects. Correspondingly, while the human eye can readily identify certain patterns in the images such as lattice periodicities, repeating structural elements, or microstructures, their automatic extraction and classification are highly non-trivial and universal pathways to accomplish such analyses are absent. We pose that the most distinctive elements of the patterns observed in STM and (S)TEM images are similarity and (almost-) periodicity, behaviors stemming directly from the parsimony of elementary atomic structures, superimposed on the gradual changes reflective of order parameter distributions. However, the discovery of these elements via global Fourier methods is non-trivial due to variability and lack of ideal discrete translation symmetry. To address this problem, we explore the shift-invariant variational autoencoders (shift-VAEs) that allow disentangling characteristic repeating features in the images, their variations, and shifts that inevitably occur when randomly sampling the image space. Shift-VAEs balance the uncertainty in the position of the object of interest with the uncertainty in shape reconstruction. This approach is illustrated for model 1D data, and further extended to synthetic and experimental STM and STEM 2D data. We further introduce an approach for training shift-VAEs that allows finding the latent variables that comport to known physical behavior. In this specific case, the condition is that the latent variable maps should be smooth on the length scale of the atomic lattice (as expected for physical order parameters), but other conditions can be imposed. The opportunities and limitations of the shift VAE analysis for pattern discovery are elucidated.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Date Release Report for Large Surface Explosion Coupling Experiment (LSECE) Nevada National Security Site

The DTRA sponsored 2020-2022 Large Surface Explosion Coupling Experiment (LSECE) consists of two large ground surface chemical explosions, data collection, analysis and modeling carried out in 2020-2022. The LSECE chemical explosions were carried out at the site of prior NNSA sponsored buried chemical explosions that were part of the Source Physics Experiment (SPE) Phase II in Dry Alluvium Geology (DAG). This report described the data collected under LSECE that is being made publicly available. The prior buried explosion DAG data are described in a separate report (https://www.osti.gov/biblio/1825534) and are also publicly available. The LSECE explosions, data analysis and numerical modeling work sponsored by DTRA were intended to address three objectives: 1) Generate seismo-acoustic data to test and improve numerical models of explosion energy coupling in dry alluvium geology; 2) To improve seismo-acoustic yield estimation techniques as a function of depth and medium properties; 3) To study and improve acoustic propagation modeling under two different atmospheric conditions. The LSECE data that were collected have expanded the prior DAG buried explosion dataset to include surface chemical explosions recorded on a common set of seismo-acoustic stations. They have allowed a more detailed study of above and below surface seismo-acoustic energy coupling with applications to explosion monitoring and assessment. The two approximately 1-ton TNT equivalent yield LSECE explosions were detonated at different times of the day to explore the effects of the different atmospheric conditions. The first chemical explosion “Artemis” was conducted before dawn when temperature inversions were present. The second chemical explosion “Apollo” was conducted on a sunny afternoon when the temperature gradient was more linear. The LSECE chemical explosion data were also collected across a variety of different sensor types to allow evaluation of their effectiveness in recovering useful information. The LSECE instrumentation included fiber optic or Distributed Acoustic Sensing (DAS), a dense array or Large-N array of seismometers, borehole accelerometers, DAS and a velocity meter, airborne acoustic instruments and a variety of visual and remote sensing data.

58 GEOSCIENCES↗
DOE OSTI2025

Harvesting Reactor Pressure Vessel Beltline Material from the Decommissioned Zion Nuclear Power Plant Unit 1

The decommissioning of the Zion Nuclear Power Plant (NPP) provided a unique opportunity to harvest and study service-aged reactor pressure vessel (RPV) beltline materials. This work, conducted through the U.S. Department of Energy’s Light Water Reactor Sustainability (LWRS) Program, aims to improve the understanding of radiation-induced embrittlement to support extended nuclear plant operations. Material segments containing the Linde 80 flux, wire heat 72105 (WF-70) beltline weld and the A533B Heat B7835-1 base metal, obtained from the intermediate shell region with a peak fluence of 0.7 × 10 19 n/cm 2 (E > 1.0 MeV), were extracted, cut into blocks, and machined into test specimens for mechanical and microstructural characterization. The segmentation process involved oxy-propane torch-cutting, followed by precision machining using wire saws and electrical discharge machining (EDM). A chemical composition analysis confirmed the expected variations in alloying elements, with copper levels being notably higher in the weld metal. The harvested specimens enable a detailed evaluation of through-wall embrittlement gradients, a comparison with the existing surveillance data, and the validation of predictive embrittlement models. This study provides critical data for assessing long-term reactor vessel integrity, informing aging-management strategies, and supporting regulatory decisions to extend the life of nuclear plants. This article is a revised and expanded version of a paper entitled, “Current Status of the Characterization of RPV Materials Harvested from the Decommissioned Zion Unit 1 Nuclear Power Plant”, PVP2017-65090, which was accepted and presented at the ASME 2017 Pressure Vessels and Piping Conference, Waikoloa, HI, USA, 16–20 July 2017.

harvesting beltline material↗
DOE OSTI2023

Physics-Driven Convolutional Autoencoder Approach for CFD Data Compressions: Preprint

With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been proposed and shown to be effective at producing reduced representations of turbulent flow data. However, these approaches focus solely on training the model using point-wise sample reconstruction losses that do not take advantage of the physical properties of turbulent flows. In this paper, we show that training autoencoders with additional physics-informed regularizations, e.g., enforcing incompressibility and preserving enstrophy, improves the compression model in three ways: (i) the compressed data better conform to known physics for homogeneous isotropic turbulence without negatively impacting point-wise reconstruction quality, (ii) inspection of the gradients of the trained model uncovers changes to the learned compression mapping that can facilitate the use of explainability techniques, and (iii) as a performance byproduct, training losses are shown to converge up to 12x faster than the baseline model.

auto-encoders↗
DOE OSTI2020

Gaining Perspective on Unconventional Well Design Choices through Play-level Application of Machine Learning Modeling

The recent development of unconventional oil and gas (O&G) reservoirs has led to an abundant hydrocarbon supply, both domestically and globally. However, there is a continued push to develop new and innovative approaches to improve exploration and extraction efficiencies and overall well productivity moving forward. Substantial improvements in unconventional O&G development are expected through optimized well completion and stimulation strategies aimed at maximizing well productivity. Optimizing well designs will require tailoring to the distinctive geologic conditions present for any newly placed well. To better evaluate the impact of well design attributes and their associated interactions on productivity in a major unconventional play, multivariate machine learning-based models that use empirical datasets were developed. A gradient boosted regression tree (GBRT) algorithm was applied. GBRT has been narrowly investigated for O&G applications but enables straightforward parametric importance and influence evaluation, as well as assessment of parameter interaction effects. Models were trained on well design and locational parameters that serve as a proxy for variable geologic conditions to estimate two types of productivity indicator response variables strongly correlated to estimated ultimate recovery (EUR). The dataset utilized consists of over 7,000 well observations that cover the majority of the productive region of the Marcellus Shale. Model performance was evaluated and algorithm parameters tuned by analyzing the goodness-of-fit for simulated results against observed data in a cross-validation approach. Models were found capable of 73–79 percent prediction accuracy on held out testing data of gas equivalent production and can be used to inform future well design and placement decisions for increasing EUR per well and improving overall field-level recovery. Study results indicate that Marcellus well performance improves most with upscaling perforated interval lengths and water and proppant volumes per foot; but relative productivity improvements are spatially dependent across the play. Finally, optimal combinations of water and proppant on well performance were found to vary depending on well location, emphasizing the utility of data-driven models capable of broad application across a play of interest for informing tailored well design approaches prior to their field deployment.

04 OIL SHALES AND TAR SANDS↗
DOE OSTI2021

In situ synchrotron investigation of degenerate graphite nodule evolution in ductile cast iron

Ductile cast irons (DCIs) are of increasing importance in the renewable energy and transportation sectors. The distribution and morphology of the graphite nodules, in particular the formation of degenerate features during solidification, dictate the mechanical performance of DCIs. In situ high-speed synchrotron X-ray tomography was used to capture the evolution of graphite nodules during solidification of DCI, including degenerate features and the effect of the carbon concentration field. The degeneration of nodules is observed to increase with re-melting cycles, which is attributed to Mg-loss. The dendritic primary austenite and carbon concentration gradients in the surrounding liquid phase were found to control nodule morphology by locally restricting and promoting growth. A coupled diffusion-mechanical model was developed, confirming the experimentally informed hypothesis that protrusions form through liquation cracking of the austenite shell and subsequent localised growth. In conclusion, these results provide valuable insights into the solidification kinetics of cast irons, supporting the design of advanced alloys.

36 MATERIALS SCIENCE↗
DOE OSTI2023

An autoencoder compression approach for accelerating large-scale inverse problems

Abstract Partial differential equation (PDE)-constrained inverse problems are some of the most challenging and computationally demanding problems in computational science today. Fine meshes required to accurately compute the PDE solution introduce an enormous number of parameters and require large-scale computing resources such as more processors and more memory to solve such systems in a reasonable time. For inverse problems constrained by time-dependent PDEs, the adjoint method often employed to compute gradients and higher order derivatives efficiently requires solving a time-reversed, so-called adjoint PDE that depends on the forward PDE solution at each timestep. This necessitates the storage of a high-dimensional forward solution vector at every timestep. Such a procedure quickly exhausts the available memory resources. Several approaches that trade additional computation for reduced memory footprint have been proposed to mitigate the memory bottleneck, including checkpointing and compression strategies. In this work, we propose a close-to-ideal scalable compression approach using autoencoders to eliminate the need for checkpointing and substantial memory storage, thereby reducing the time-to-solution and memory requirements. We compare our approach with checkpointing and an off-the-shelf compression approach on an earth-scale ill-posed seismic inverse problem. The results verify the expected close-to-ideal speedup for the gradient and Hessian-vector product using the proposed autoencoder compression approach. To highlight the usefulness of the proposed approach, we combine the autoencoder compression with the data-informed active subspace (DIAS) prior showing how the DIAS method can be affordably extended to large-scale problems without the need for checkpointing and large memory.

Mathematics↗
DOE OSTI2023

The Circular Velocity Curve of the Milky Way from 5–25 kpc Using Luminous Red Giant Branch Stars

We present a sample of 254,882 luminous red giant branch (LRGB) stars selected from the APOGEE and LAMOST surveys. By combining photometric and astrometric information from the Two Micron All Sky Survey and Gaia survey, the precise distances of the sample stars are determined by a supervised machine-learning algorithm: the gradient-boosted decision trees. To test the accuracy of the derived distances, member stars of globular clusters (GCs) and open clusters are used. The tests by cluster member stars show a precision of about 10% with negligible zero-point offsets, for the derived distances of our sample stars. The final sample covers a large volume of the Galactic disk(s) and halo of 0 < R < 30 kpc and |Z| ≤ 15 kpc. The rotation curve (RC) of the Milky Way across the radius of 5 ≲ R ≲ 25 kpc has been accurately measured with ~54,000 stars of the thin disk population selected from the LRGB sample. The derived RC shows a weak decline along R with a gradient of -1.83 ± 0.02 (stat.) ± 0.07 (sys.) km s -1 kpc -1 , in excellent agreement with the results measured by previous studies. The circular velocity at the solar position, yielded by our RC is 234.04 ± 0.08 (stat.) ± 1.36 (sys.) km s -1 , again in great consistency with other independent determinations. From the newly constructed RC, as well as constraints from other data, we have constructed a mass model for our Galaxy, yielding a mass of the dark matter halo of M 200 = (8.05 ± 1.15) × 10 11 M ⊙ with a corresponding radius of R 200 = 192.37 ± 9.24 kpc and a local dark matter density of 0.39 ± 0.03 GeV cm -3 .

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Separable physics-informed DeepONet: Breaking the curse of dimensionality in physics-informed machine learning

The deep operator network (DeepONet) has shown remarkable potential in solving partial differential equations (PDEs) by mapping between infinite-dimensional function spaces using labeled datasets. However, in scenarios lacking labeled data, the physics-informed DeepONet (PI-DeepONet) approach, which utilizes the residual loss of the governing PDE to optimize the network parameters, faces significant computational challenges, particularly due to the curse of dimensionality. This limitation has hindered its application to high-dimensional problems, making even standard 3D spatial with 1D temporal problems computationally prohibitive. Additionally, the computational requirement increases exponentially with the discretization density of the domain. Here, to address these challenges and enhance scalability for high-dimensional PDEs, we introduce the Separable physics-informed DeepONet (Sep-PI-DeepONet). This framework employs a factorization technique, utilizing sub-networks for individual one-dimensional coordinates, thereby reducing the number of forward passes and the size of the Jacobian matrix required for gradient computations. By incorporating forward-mode automatic differentiation (AD), we further optimize computational efficiency, achieving linear scaling of computational cost with discretization density and dimensionality, making our approach highly suitable for high-dimensional PDEs. We demonstrate the effectiveness of Sep-PI-DeepONet through three benchmark PDE models: the viscous Burgers’ equation, Biot’s consolidation theory, and a parameterized heat equation. Our framework maintains accuracy comparable to the conventional PI-DeepONet while reducing training time by two orders of magnitude. Notably, for the heat equation solved as a 4D problem, the conventional PI-DeepONet was computationally infeasible (estimated 289.35 h), while the Sep-PI-DeepONet completed training in just 2.5 h. These results underscore the potential of Sep-PI-DeepONet in efficiently solving complex, high-dimensional PDEs, marking a significant advancement in physics-informed machine learning.

Neural operator↗
DOE OSTI2020

Chapter 6: An Improved Leaf Protoplast System for Highly Efficient Transient Expression in Switchgrass (Panicum virgatum L.)

As a robust perennial C4-type monocot plant and a native species to North America, switchgrass (Panicum virgatum) has been evaluated and designated as a strong candidate bioenergy crop by the U.S. DOE. Although genetic modifications of switchgrass have been used to successfully reduce the recalcitrance of switchgrass biomass for biofuel production, the generation of transgenic switchgrass is still a slow and laborious process. A transient protoplast system can provide an excellent platform to accelerate the selection of genes-of-interest for tailoring switchgrass biomass. However, partially due to the lack of the complete genomic information, the attempts to optimize the transient protoplast system for switchgrass remain scarce. In this chapter, we provide an improved protocol for switchgrass protoplast isolation, increased transformation efficiency using CsCl gradient ultracentrifugation-derived plasmid DNA and extended application of the transient switchgrass protoplast system to analyze protein expression using western blot.

BASIC BIOLOGICAL SCIENCES,BIOMASS FUELS↗
DOE OSTI2025

Personalized Tucker Decomposition: Modeling Commonality and Peculiarity on Tensor Data

In this paper, we propose a personalized Tucker decomposition (perTucker) to address the limitations of traditional tensor decomposition methods in capturing heterogeneity across different datasets. perTucker decomposes tensor data into shared global components and personalized local components. We introduce an order orthogonality assumption and develop a proximal gradient regularized block coordinate descent algorithm guaranteed to converge to a stationary point. The unique and common representations learned by perTucker reveal intrinsic statistical patterns in data and provide valuable information for a wide range of downstream analytics, including anomaly detection, source classification, and clustering. We demonstrate perTucker’s effectiveness through a simulation study and two case studies on solar flare detection and tonnage signal classification.

14 SOLAR ENERGY↗
DOE OSTI2023

Building a genome-based understanding of bacterial pH preferences

The environmental preferences of many microbes remain undetermined. This is the case for bacterial pH preferences, which can be difficult to predict a priori despite the importance of pH as a factor structuring bacterial communities in many systems. We compiled data on bacterial distributions from five datasets spanning pH gradients in soil and freshwater systems (1470 samples), quantified the pH preferences of bacterial taxa across these datasets, and compiled genomic data from representative bacterial taxa. While taxonomic and phylogenetic information were generally poor predictors of bacterial pH preferences, we identified genes consistently associated with pH preference across environments. We then developed and validated a machine learning model to estimate bacterial pH preferences from genomic information alone, a model that could aid in the selection of microbial inoculants, improve species distribution models, or help design effective cultivation strategies. More generally, we demonstrate the value of combining biogeographic and genomic data to infer and predict the environmental preferences of diverse bacterial taxa.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Randomized Sketching Algorithms for Low-Memory Dynamic Optimization

This paper develops a novel limited-memory method to solve dynamic optimization problems. The memory requirements for such problems often present a major obstacle, particularly for problems with PDE constraints such as optimal flow control, full waveform inversion, and optical tomography. In these problems, PDE constraints uniquely determine the state of a physical system for a given control; the goal is to find the value of the control that minimizes an objective. While the control is often low dimensional, the state is typically more expensive to store. This paper suggests using randomized matrix approximation to compress the state as it is generated and shows how to use the compressed state to reliably solve the original dynamic optimization problem. Concretely, the compressed state is used to compute approximate gradients and to apply the Hessian to vectors. The approximation error in these quantities is controlled by the target rank of the sketch. This approximate first- and second-order information can readily be used in any optimization algorithm. As an example, we develop a sketched trust-region method that adaptively chooses the target rank using a posteriori error information and provably converges to a stationary point of the original problem. Numerical experiments with the sketched trust-region method show promising performance on challenging problems such as the optimal control of an advection-reaction-diffusion equation and the optimal control of fluid flow past a cylinder.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Resolving intragranular stress fields in plastically deformed titanium using point-focused high-energy diffraction microscopy

Abstract The response of a polycrystalline material to a mechanical load depends not only on the response of each individual grain, but also on the interaction with its neighbors. These interactions lead to local, intragranular stress concentrations that often dictate the initiation of plastic deformation and consequently the macroscopic stress–strain behavior. However, very few experimental studies have quantified intragranular stresses across bulk, three-dimensional volumes. In this work, a synchrotron X-ray diffraction technique called point-focused high-energy diffraction microscopy (pf-HEDM) is used to characterize intragranular deformation across a bulk, plastically deformed, polycrystalline titanium specimen. The results reveal the heterogenous stress distributions within individual grains and across grain boundaries, a stress concentration between a low and high Schmid factor grain pair, and a stress gradient near an extension twinning boundary. This work demonstrates the potential for the future use of pf-HEDM for understanding the local deformation associated with networks of grains and informing mesoscale models. Graphical abstract

36 MATERIALS SCIENCE↗
DOE OSTI2022

Deep Learning At Depth: Estimating subsurface parameters from geophysical monitoring data

Geophysical imaging techniques are a non-invasive way to image the subsurface and understand both subsurface solid (rock/soil) and fluid property distributions and their evolution in time. Inversions of the geophysical data, such as Electrical Resistance Tomography (ERT) data, are solved to estimate the subsurface property distributions, such as conductivity, and many inversion techniques smooth out sharp gradients in rock or fluid property distributions. Sharp gradients in subsurface properties tend to be present in situations with complex subsurface structures, which are common in many subsurface applications. We have successfully demonstrated that it is possible to inform, or constrain, inversions with neural networks trained on synthetic data with complex subsurface structures. Initial results suggest this process may be optimizable to yield property distributions that better represent the true property distributions than the same inversion process without the neural network constraint. Future work would optimize the neural network performance for this application and then apply the synthetic-data trained neural network to real data to understand the utility and performance of this technique for real data sets.

47 OTHER INSTRUMENTATION↗