Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

New-generation geostationary satellite reveals widespread midday depression in dryland photosynthesis during 2020 western U.S. heatwave

Emerging new-generation geostationary satellites have broadened the scope for studying the diurnal cycle of ecosystem functions. We exploit observations from the Geostationary Operational Environmental Satellite-R series to examine the effect of a severe U.S. heatwave in 2020 on the diurnal variations of ecosystem photosynthesis. We find divergent responses of photosynthesis to the heatwave across vegetation types and aridity gradients, with drylands exhibiting widespread midday and afternoon depression in photosynthesis. The diurnal centroid and peak time of dryland gross primary production (GPP) substantially shift toward earlier morning times, reflecting notable water and heat stress. Our geostationary satellite-based method outperforms traditional radiation-based upscaling methods from polar-orbiting satellite snapshots in estimating daily GPP and GPP loss during heatwaves. These findings underscore the potential of geostationary satellites for diurnal photosynthesis monitoring and highlight the necessity to consider the increased diurnal asymmetry in GPP under stress when evaluating carbon-climate interactions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

End-to-End Differentiable Modeling and Management of the Environment

Focal Area: (2) Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization. We emphasize the importance of leveraging optimization techniques from AI/machine learning (ML) to solve challenging problems in Earth system modeling. Science Challenge: Automatic differentiation has had a transformative effect on ML by allowing the calculation of gradients of arbitrary functions in an incredibly large class of models. We can potentially realize similar improvements in parameter estimation and control for Earth system models (ESMs) by reimplementing them in computational frameworks from ML. Practitioners working with large (>10 7 parameters) models in ML and AI can obtain good predictive performance in a range of spatiotemporal tasks by making use of optimization via stochastic gradient descent and incorporating prior knowledge at multiple levels. We propose writing ESMs in open-source computational frameworks such as Torch, Tensorflow, and JAX to greatly expand the scope of environmental forecasting and management challenges, which can be addressed by leveraging automatic differentiation and gradient descent-like algorithms. We do not call for a wholesale replacement of physical models with data-driven surrogates, but rather advocate for interleaving physical and empirical equations in a manner that is most faithful to the extent of our scientific knowledge and observational data. Central to this topic is the merging of differentiable physical simulations with differentiable optimization layers, which are now both beginning to come to the forefront.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Plasma Processing of SRF Cavities at Jefferson Lab

Jefferson Lab has an ongoing R&D program in plasma processing which is close to going into production pro-cessing in the CEBAF accelerator. Plasma processing is a common technique for removing hydrocarbons from surfaces, which increases the work function and reduces the secondary emission coefficient [1]. The initial focus of the effort is processing C100 cavities by injecting RF power into the HOM coupler ports. The goal will be to improve the operational gradients and the energy margin of the CEBAF linacs by processing cryomodules in situ. Results from processing a cryomodule in the cryomodule test bunker as well as cavity vertical test results will be presented. This work describes the systems and methods used at JLAB for processing cavities using an ar-gon/oxygen gas mixture.

Powers, T.↗
DOE OSTI2025

The rigorous upscaling of advection-dominated transport in heterogeneous porous media via the Method of Finite Averages

Systems involving advection-dominated transport through heterogeneous porous and fractured media are ubiquitous in subsurface engineering applications. However, upscaling such systems continues to challenge rigorous modeling efforts, particularly when advection is stronger than diffusion at fine spatial scales (i.e., when the Péclet number is greater than one at length scales that characterize a system’s unit-cells, representative elementary volumes, or averaging regions). Here, in this work, we propose and validate a strategy for extending the Method of Finite Averages (MoFA), a rigorous upscaling methodology for heterogeneous porous media, to upscale transport systems experiencing stronger advection than diffusion at fine scales (i.e., fine-scale Péclet numbers greater than one). We detail the strategy, the physical conditions under which it can be applied while retaining a priori modeling error guarantees, and implement the strategy to obtain a MoFA model for advective-diffusive transport that accommodates advective physics at fine spatial scales. We then perform two numerical experiments considering systems with system-scale Péclet numbers of 300 and 1000 — which correspond to fine-scale Péclet numbers of 30 and 100, respectively — to verify that the error guarantees are met under the strategy. After, we conduct a numerical study to demonstrate the strategy’s advantages over the original MoFA methodology. The results suggest that rigorously-upscaled transport models for heterogeneous porous media experiencing advective physics at finer spatial scales can be derived through MoFA and resolved orders of magnitude faster than their pore-scale counterparts. The results also suggest that the presented strategy is limited to modeling shallow concentration gradients when there are large differences between the time scales related to advection and a system’s temporally-varying boundary conditions. This limitation hinders the strategy’s practicality in modeling more advective systems, and as such, opportunity exists for developing additional strategies that accommodate rapidly-varying boundary conditions — and consequentially, steeper concentration gradients — while modeling advective systems with MoFA.

36 MATERIALS SCIENCE↗
DOE OSTI2026

A Stochastic Quasi-Newton Method in the Absence of Common Random Numbers

We present Q-SASS, a quasi-Newton method for unconstrained stochastic optimization that does not rely on common random numbers. Most existing quasi-Newton approaches leverage common random numbers to construct second-order updates. However, motivated by challenges in variational quantum algorithms—where such coordination is not possible—we consider the setting in which function values and gradients are accessible only through noisy probabilistic zeroth- and first-order oracles, and no common random numbers can be exploited. We derive high-probability tail bounds on the iteration complexity of our algorithm for nonconvex, convex, and strongly convex (more generally, those satisfying the PL condition) objective functions. Finally, we demonstrate the empirical benefits of our quasi-Newton updating scheme on both synthetic and quantum chemistry problems.

Complexity bound↗
DOE OSTI2020

Seawater pH reconstruction using boron isotopes in multiple planktonic foraminifera species with different depth habitats and their potential to constrain pH and <i>p</i>CO<sub>2</sub> gradients

Boron isotope systematics of planktonic foraminifera from core-top sediments and culture experiments have been studied to investigate the sensitivity ofδ11B of calcite tests to seawater pH. However, our knowledge of the relationship between δ11B and pH remains incomplete for many taxa. Thus, to expand the potential scope of application of this proxy, we report δ11B data for seven different species of planktonic foraminifera from sediment core tops. We utilize a method for the measurement of small samples of foraminifera and calculate the δ11B-calcite sensitivity to pH for Globigerinoides ruber, Trilobus sacculifer (sacc or without sacc), Orbulina universa, Pulleniatina obliquiloculata, Neogloboquadrina dutertrei, Globorotalia menardii, and Globorotalia tumida, including for unstudied core tops and species. These taxa have diverse ecological preferences and are from sites that span a range of oceanographic regimes, including some that are in regions of air–sea equilibrium and others that are out of equilibrium with the atmosphere. The sensitivity of δ11Bcarbonate to δ11Bborate (e.g., Δδ11Bcarbonate/Δδ11Bborate) in core tops is consistent with previous studies for T. sacculifer and G. ruber and close to unity for N. dutertrei, O. universa, and combined deep-dwelling species. Deep-dwelling species closely follow the core-top calibration fo rO. universa, which is attributed to respiration-driven microenvironments likely caused by light limitation and/or symbiont–host interactions. Our data support the premise that utilizing boron isotope measurements of multiple species within a sediment core can be utilized to constrain vertical profiles of pH andpCO2 at sites spanning different oceanic regimes, thereby constraining changes in vertical pH gradients and yielding insights into the past behavior of the oceanic carbon pumps.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A novel method for quantifying irradiation damage in nuclear graphite using Raman spectroscopy

Raman spectroscopy has long been used in studying irradiation damage in carbon/graphite materials. It is however unclear if the measurements from different types of materials are directly comparable. Further, decoupling the contribution from irradiation temperature and fluence to the total damage in nuclear graphite possessing irradiation damage gradient is currently not readily feasible as it requires a complete set of test reactor irradiation experiments over the relevant temperature and fluence range. A novel methodology has therefore been proposed and developed to quantify total irradiation damage evolution at crystal level based on graphite Raman G-band position shift. Specifically, G-band positions derived from a large number of spectra collected from the fractured surface of microfine-grained POCO ZXF-5Q graphite possessing proton irradiation damage gradient were plotted with open literature Raman data on HOPG, BEPO (AXGP graphite), PCEA and IG-110 graphite as a function of dpa. The total damage level within 2σ beam radius in this POCO graphite was estimated to be equivalent to ~2–5 dpa at ~350–370 °C. Derived G-band positions were then mapped to the three-stage amorphization trajectory model indicating beam centre area has entered the second stage, i.e., transitioning from nanocrystalline graphite into amorphous carbon. G-band position relative shift (ΔG) curve with a ‘turn-around’ peak as a function of total damage can be used for in-service lifetime prediction. Importantly, the developed methodology has the potential to ‘unify’ total damage levels across different grades of nuclear graphite caused by ion, neutron and proton irradiation at different temperatures.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Decoy selection for protein structure prediction via extreme gradient boosting and ranking

Background: Identifying one or more biologically-active/native decoys from millions of non-native decoys is one of the major challenges in computational structural biology. The extreme lack of balance in positive and negative samples (native and non-native decoys) in a decoy set makes the problem even more complicated. Consensus methods show varied success in handling the challenge of decoy selection despite some issues associated with clustering large decoy sets and decoy sets that do not show much structural similarity. Recent investigations into energy landscape-based decoy selection approaches show promises. However, lack of generalization over varied test cases remains a bottleneck for these methods. Results: We propose a novel decoy selection method, ML-Select, a machine learning framework that exploits the energy landscape associated with the structure space probed through a template-free decoy generation. The proposed method outperforms both clustering and energy ranking-based methods, all the while consistently offering better performance on varied test-cases. Moreover, ML-Select shows promising results even for the decoy sets consisting of mostly low-quality decoys. Conclusions: ML-Select is a useful method for decoy selection. This work suggests further research in finding more effective ways to adopt machine learning frameworks in achieving robust performance for decoy selection in template-free protein structure prediction.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Enhanced descriptor identification and mechanism understanding for catalytic activity using a data-driven framework: revealing the importance of interactions between elementary steps

We report accurate identification of descriptors for catalytic activities has long been essential to the in-depth understanding of catalysis and recently to set the basis for catalyst screening. However, commonly used methods suffer from low accuracy in predictability. This study reports an enhanced approach to accurately identify the descriptors from a kinetic dataset using a machine learning (ML) surrogate model. CO hydrogenation to methanol over Cu-based catalysts was taken as a case study. Our model captures not only the contribution from individual elementary steps but also the interaction between relevant steps within a reaction network, which was found to be essential for high accuracy. As a result, six effective descriptors are identified, which are accurate enough to ensure the trained gradient boosted regression (GBR) model for good prediction of the methanol turnover frequency (TOF) over metal (M)-doped Cu(111) model surfaces (M = Au, Cu, Pd, Pt, Ni). More importantly, going beyond the purely mathematical ML model, the catalytic role of each identified descriptor can be revealed by using model-agnostic interpretation tools, which enhances the insight into the promoting effect of alloying. The trained GBR model outperforms the conventional derivative-based methods in terms of both the predictability and the mechanism understanding. It opens alternative possibilities toward accurate descriptor-based rational catalyst optimization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Large deformation and brittle failure calculated using the dual-domain material point method

The dual domain material point (DDMP) method is explored as a candidate to be implemented in a general purpose code to perform simulations of materials with complex geometry that undergo large history-dependent deformation and failure. To test its candidacy, we study its mesh convergence, its sensitivity to mesh orientation, and its ability to handle softening and failure of a material. Simulations of large deformation and simulations of mechanical failure are performed using both DDMP and the material point method (MPM). When cell-crossing of material points is not an issue and when there are a sufficient number of material points in each computation cell, the numerical error decreases with the square of the cell size as expected for both MPM and DDMP. DDMP has reduced error compared with MPM when there are many instances of material points crossing cell boundaries due to the continuous nature of the modified gradient of the shape functions. Simulations of a specimen under tension are also performed where the background mesh is aligned and misaligned with the tension direction. MPM displays a significant mesh-dependent stress field, DDMP shows negligible mesh dependency. Despite a mesh orientation-dependent stress field from MPM, the critical tension and failure mode from both MPM and DDMP calculations have negligible mesh dependency when using a non-local failure model. If only the failure mode is important (i.e., local stresses are unimportant), MPM with a non-local failure model is a suitable method for modeling failure with small deformations. However, if local stresses are also important or if there are large deformations with many cell-crossings before failure, DDMP should be the method that is used. A needed improvement for DDMP is identified from our numerical simulations.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Machine Learning Moment Closure Models for the Radiative Transfer Equation III: Enforcing Hyperbolicity and Physical Characteristic Speeds

This is the third paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation. In our previous work (Huang et al. in J Comput Phys 453:110941, 2022), we proposed an approach to learn the gradient of the unclosed high order moment, which performs much better than learning the moment itself and the conventional $P_N$ closure. However, while the ML moment closure has better accuracy, it is not able to guarantee hyperbolicity and has issues with long time stability. In our second paper (Huang et al., in: Machine learning moment closure models for the radiative transfer equation II: enforcing global hyperbolicity in gradient based closures, 2021. arXiv:2105.14410), we identified a symmetrizer which leads to conditions that enforce that the gradient based ML closure is symmetrizable hyperbolic and stable over long time. The limitation of this approach is that in practice the highest moment can only be related to four, or fewer, lower moments. In this paper, we propose a new method to enforce the hyperbolicity of the ML closure model. Motivated by the observation that the coefficient matrix of the closure system is a lower Hessenberg matrix, we relate its eigenvalues to the roots of an associated polynomial. Here, we design two new neural network architectures based on this relation. The ML closure model resulting from the first neural network is weakly hyperbolic and guarantees the physical characteristic speeds, i.e., the eigenvalues are bounded by the speed of light. The second model is strictly hyperbolic and does not guarantee the boundedness of the eigenvalues. Several benchmark tests including the Gaussian source problem and the two-material problem show the good accuracy, stability and generalizability of our hyperbolic ML closure model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Cost function dependent barren plateaus in shallow parametrized quantum circuits

Variational quantum algorithms (VQAs) optimize the parameters θ of a parametrized quantum circuit V(θ) to minimize a cost function C. While VQAs may enable practical applications of noisy quantum computers, they are nevertheless heuristic methods with unproven scaling. Here, we rigorously prove two results, assuming V(θ) is an alternating layered ansatz composed of blocks forming local 2-designs. Our first result states that defining C in terms of global observables leads to exponentially vanishing gradients (i.e., barren plateaus) even when V(θ) is shallow. Hence, several VQAs in the literature must revise their proposed costs. On the other hand, our second result states that defining C with local observables leads to at worst a polynomially vanishing gradient, so long as the depth of V(θ) is Ο(logn). Our results establish a connection between locality and trainability. We illustrate these ideas with large-scale simulations, up to 100 qubits, of a quantum autoencoder implementation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Machine learning-enabled discovery of ionic liquid–solvent electrolytes exhibiting high ionic conductivity

Ionic liquids (ILs), which are a class of materials with versatile nature and growing popularity, are facing impediments toward widespread usage as electrolytes due to various factors such as low ionic conductivity, high viscosity, high market price etc. One of the ways these limitations can be addressed is by mixing ILs with a molecular solvent. In a combinatorial sense, there exists an immense number of specific IL–solvent combinations. An exhaustive experimental or even simulation-based investigation of the chemical space spanned by such combinations can be extremely time-consuming, expensive, and nearly impossible. An alternative approach is to employ machine learning-based models developed from available databases. Although there exists prior literature that integrates machine learning to investigate mixtures of specific solvents with ILs, these models lack generalization necessitating development of a large number of ML models to handle various solvents. To remedy this shortcoming, as a part of designing green electrolytes with high ionic conductivity that can have potential applications in next-generation batteries and solar cells, this work aims to develop a unified machine learning model to predict ionic conductivity of any IL–solvent mixture system. In this regard, three models, namely, Random Forest, extreme gradient boosting (XGBoost), and artificial neural network (ANN) were formulated using the NIST ILThermo database. The dataset contained 549 unique ionic liquids from 16 cation families and 81 unique solvents, representing a total of 23 712 datapoints. SHAPLEY additive explanation (SHAP) method was used to assess the impact of various features on model prediction and their significance was compared with literature to gain physical insight about the model behavior. Finally, using the developed models, approximately 2.5 million IL–solvent mixtures at five different compositions were screened at room temperature. The high-throughput screening yielded nearly 19 000 IL–solvent mixtures for which ionic conductivity was found to exceed the ionic conductivity of conventional Li-ion battery electrolyte.

25 ENERGY STORAGE↗
DOE OSTI2024

Advancing attenuation estimation through integration of the Hessian in multiparameter viscoacoustic full-waveform inversion

Accurate seismic attenuation models of subsurface structures not only enhance subsequent migration processes by improving fidelity, resolution, and facilitating amplitude-compliant angle gather generation but also provide valuable constraints on subsurface physical properties. Leveraging full-wavefield information, multiparameter viscoacoustic full-waveform inversion ( Q-FWI) simultaneously estimates seismic velocity and attenuation ( Q) models. However, a major challenge in Q-FWI is the contamination of crosstalk artifacts, where inaccuracies in the velocity model are mistakenly mapped to the inverted attenuation model. While incorporating the Hessian is expected to mitigate these artifacts, the explicit implementation is prohibitively expensive due to its formidable computational cost. In this study, we formulate and develop a Q-FWI algorithm via the Newton-conjugate gradient (CG) framework, where the search direction at each iteration is determined through an internal CG loop. In particular, the Hessian is integrated into each CG step in a matrix-free fashion using the second-order adjoint-state method. We find through synthetic experiments that our Newton-CG Q-FWI significantly mitigates crosstalk artifacts compared with the limited-memory Broyden-Fletcher-Goldfarb-Shanno method and the CG method, albeit with a notable computational cost. In the discussion of several key implementation details, we also determine the significance of the approximate Gauss-Newton Hessian, the second-order adjoint-state method, and the two-stage inversion strategy.

Geochemistry & Geophysics↗
DOE OSTI2025

Metagenome-assembled genomes from topsoils along a hillslope water gradient across early snowmelt to late summer in East River, CO

Drought is changing the American Mountain West at unprecedented rates with unknown consequences to soil microbiome composition and function. As a part of LBNL Watershed Science Focus Area (SFA), we investigated shifts in microbial community and transcriptional activity on a subalpine conifer-meadow transition zone throughout the summer of 2023 as soil dried down. This work took place in Crested Butte, CO on Snodgrass mountain, using a proxy for drought conditions.Here we present metagenome assembled genomes (MAGs) for the bacterial and archaeal community at 0-10cm from three sites along a hillslope water gradient across five timepoints from early snowmelt to late summer. 42 metagenomes were sequenced at Joint Genome Institute (JGI) and can be found under the JGI GOLD (Genomes Online Database) sequencing project Gs0166660. Metagenomes were assembled through an inhouse pipeline (see methods), binned using four autobinners (concoct, maxbin2, metabat2, and vamb) and consolidated using dastool. The consolidated bins from all metagenomes were pooled, filtered by completeness (>70%) and contamination (<10%), and dereplicated at 95% ANI using drep. This dataset (1) a zip file of 157 MAGs (as fasta files, Gs0166660_bins_tar.gz), (2) sample metadata file with sample IGSNs (International Generic Sample Numbers) (samples.csv), (3) bounding box coordinates for the sampled locations (Gs0166660.kml), (4) metagenome assembly and coassembly metadata file listing IMG/M (Integrated Microbial Genomes/Metagenomes) metagenome accessions linking samples to metagenomes (EastRiver_Drought_ESSDive_Metadata.csv), (5) location metadata file (locations.csv), (6) file-level metadata file (flmd.csv) and (7) data dictionary (dd.csv) file.This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

In Situ Plasma Processing of Superconducting Cavities at JLab

Jefferson Lab has an ongoing R&D program in plasma processing which is close to going into production pro-cessing in the CEBAF accelerator. Plasma processing is a common technique for removing hydrocarbons from surfaces, which increases the work function and reduces the secondary emission coefficient[1]. The initial focus of the effort is processing C100 cavities by injecting RF power into the HOM coupler ports. The goal will be to improve the operational gradients and the energy margin of the CEBAF linacs by processing cryomodules in situ. Results from processing cryomodule in the cryomodule test bunker as well as vertical test results will be present-ed. This work will describe the systems and methods used at JLAB for processing cavities using an argon oxygen gas mixture. Before and after plasma processing results will also be presented.

Powers, T.↗
DOE OSTI2025

Methods in PES-Learn: Direct-Fit Machine Learning of Born–Oppenheimer Potential Energy Surfaces

The release of PES-L EARN version 1.0 as an open-source software package for the automatic construction of machine learning models of semi-global molecular potential energy surfaces (PESs) is presented. Improvements to PES-L EARN ’s interoperability are stressed with new Python API that simplifies workflows for PES construction via interaction with QCSchema input and output infrastructure. In addition, a new machine learning method is introduced to PES-L EARN : kernel ridge regression (KRR). The capabilities of KRR are emphasized with examination of select semi-global PESs. All machine learning methods available in PES-L EARN are benchmarked with benzene and ethanol datasets from the rMD17 database to illustrate PES-L EARN ’s performance ability. Fitting performance and timings are assessed for both systems. Finally, the ability to predict gradients with neural network models is presented and benchmarked with ethanol and benzene. PES-L EARN is an active project and welcomes community suggestions and contributions.

kernel ridge regression↗
DOE OSTI2023

Multi-objective, robust constraints enforced global topology optimizer for optical devices

A method for optimization of photonic devices is disclosed. The method includes receiving a set of unconstrained latent variables; mapping the set of unconstrained latent variables to a constrained space to generate a constrained device; calculating the permittivity across each element of the constrained device; determining a permittivity-constrained width gradient based at least partially on the permittivity across each element; and optimizing the set of unconstrained latent variables by at least partially using the permittivity-constrained width gradient.

Fan, Jonathan↗