Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Estimating cluster masses from SDSS multiband images with transfer learning

ABSTRACT The total masses of galaxy clusters characterize many aspects of astrophysics and the underlying cosmology. It is crucial to obtain reliable and accurate mass estimates for numerous galaxy clusters over a wide range of redshifts and mass scales. We present a transfer-learning approach to estimate cluster masses using the ugriz-band images in the SDSS Data Release 12. The target masses are derived from X-ray or SZ measurements that are only available for a small subset of the clusters. We designed a semisupervised deep learning model consisting of two convolutional neural networks. In the first network, a feature extractor is trained to classify the SDSS photometric bands. The second network takes the previously trained features as inputs to estimate their total masses. The training and testing processes in this work depend purely on real observational data. Our algorithm reaches a mean absolute error (MAE) of 0.232 dex on average and 0.214 dex for the best fold. The performance is comparable to that given by redMaPPer, 0.192 dex. We have further applied a joint integrated gradient and class activation mapping method to interpret such a two-step neural network. The performance of our algorithm is likely to improve as the size of training data set increases. This proof-of-concept experiment demonstrates the potential of deep learning in maximizing the scientific return of the current and future large cluster surveys.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls

Here, this paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.

Frequency control↗
DOE OSTI2021

Separation of Lanthanide Isotopes from Mixed Fission Product Samples

The measurement of radioactive fission products from nuclear events has important implications for nuclear data production, environmental monitoring, and nuclear forensics. In a previous paper, the authors reported the optimization of an intra-group lanthanide separation using LN extraction resin from Eichrom Technologies®, Inc. and a nitric acid gradient. In this work, the method was demonstrated for the separation and quantification of multiple short-lived fission product lanthanide isotopes from a fission product sample produced from the thermal irradiation of highly enriched uranium. The separations were performed in parallel in quadruplicate with reproducible results and high decontamination factors for 153 Sm, 156 Eu, and 161 Tb. Based on the results obtained here, the fission yields for 144 Ce, 153 Sm, 156 Eu, and 161 Tb are consistent with published fission yields. This work demonstrates the effectiveness of the separations for the intended application of short-lived lanthanide fission product analysis requiring high decontamination factors.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2022

Median bed-material sediment particle size across rivers in the contiguous US

Abstract. Bed-material sediment particle size data, particularly the median sediment particle size (D50), are critical for understanding and modeling riverine sediment transport. However, sediment particle size observations are primarily available at individual sites. Large-scale modeling and assessment of riverine sediment transport are limited by the lack of continuous regional maps of bed-material sediment particle size. We hence present a map of D50 over the contiguous US in a vector format that corresponds to approximately 2.7 million river segments (i.e., flowlines) in the National Hydrography Dataset Plus (NHDPlus) dataset. We develop the map in four steps: (1) collect and process the observed D50 data from 2577 U.S. Geological Survey stations or U.S. Army Corps of Engineers sampling locations; (2) collocate these data with the NHDPlus flowlines based on their geographic locations, resulting in 1691 flowlines with collocated D50 values; (3) develop a predictive model using the eXtreme Gradient Boosting (XGBoost) machine learning method based on the observed D50 data and the corresponding climate, hydrology, geology, and other attributes retrieved from the NHDPlus dataset; and (4) estimate the D50 values for flowlines without observations using the XGBoost predictive model. We expect this map to be useful for various purposes, such as research in large-scale river sediment transport using model- and data-driven approaches, teaching environmental and earth system sciences, planning and managing floodplain zones, etc. The map is available at https://doi.org/10.5281/zenodo.4921987 (Li et al., 2021a).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

In-Pile Loss of Coolant Accident Testing at TREAT

Several hot-cell based LOCA test apparatuses still exist in various institutions across the world. These facilities typically surround rods with infrared electrical heaters to simulate LOCA conditions on the cladding. Despite its utility for cladding-focused testing, the furnace-based external heating method creates an inverted temperature gradient in fuel pellets compared to a true LOCA where radioisotope decay heat generates internal heat. Capturing the correct temperature gradient is essential in simulating the thermomechanical stress in fuel pellets, and hence a crucial design parameter investigating FFRD during a postulated LOCA. This thermomechanical stress state, for which the evolution of fuel pellet centerline and cladding temperatures is a good figure of merit, was the primary parameter investigated during conception of the LOCA-SERTTA device.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Three-dimensional cooperative inversion of airborne magnetic and gravity gradient data using deep-learning techniques

Using multiple geophysical methods has become a prevailing approach in numerous geophysical applications to investigate subsurface structures and parameters. These multimethod-based exploration strategies have the potential to greatly diminish uncertainties and ambiguities encountered during geophysical data analysis and interpretation. One of the applications is the cooperative inversion of airborne magnetic and gravity gradient data for the interpretation of data obtained in mineral, oil and gas, and geothermal explorations. In this paper, a unified cooperative inversion framework is designed by combining the standard separate inversions with a deep neural network (DNN), which serves as the link between different types of data. A well-trained DNN takes the separately inverted susceptibility and density models as the inputs and provides improved models that will be used as the initial models of deterministic inversions. A two-round iteration strategy is adopted to guarantee the reasonability of the recovered models and overall efficiency of the inversion. In addition, this deep-learning (DL)-based framework demonstrates excellent generalization abilities when tested on models that are entirely distinct from the training data sets. The framework can easily incorporate multiphysics without necessitating any structural changes to the network. Synthetic experiments validate that our DL-based method outperforms conventional separate inversions and cross-gradient-based joint inversion in view of the accuracy of the recovered models and inversion efficiency. Successful application to field data further verifies the effectiveness of our DL-based method.

Geochemistry & Geophysics↗
DOE OSTI2020

Quandary

Quandary numerically simulates and optimizes the time-evolution of open quantum systems. The underlying dynamics are modelled by Lindblad's master equation, a linear ordinary differential equation (ODE) describing quantum systems interacting with the environment. Quandary solves this ODE numerically by applying a time-stepping integration scheme, and utilizes a gradient-based optimization approach to determine optimal control pulses that drive the quantum system to a desired target state. Two optimization objectives are considered: (a) Unitary gate optimization that finds controls to realize a unitary gate transformation, and (b) optimal reset that aims to drive the quantum system to the ground states. Gradient-based optimization schemes utilizing Petsc's Tao optimization package are applied to generate control pulses that minimize the respective measure. To evaluate the gradient of the objective function, the discrete adjoint method is used while leveraging techniques from Algorithmic Differentiation to produce exact and consistent gradients. To mitigate excessive execution run times, the software can be build together with the XBraid software library which provides a parallelization strategy to distribute the time-evolution of the underlying dynamics onto multiple processor.

Petersson, NilsA.↗
DOE OSTI2024

Autonomous hybrid optimization of a SiO 2 plasma etching mechanism

Computational modeling of plasma etching processes at the feature scale relevant to the fabrication of nanometer semiconductor devices is critically dependent on the reaction mechanism representing the physical processes occurring between plasma produced reactant fluxes and the surface, reaction probabilities, yields, rate coefficients, and threshold energies that characterize these processes. The increasing complexity of the structures being fabricated, new materials, and novel gas mixtures increase the complexity of the reaction mechanism used in feature scale models and increase the difficulty in developing the fundamental data required for the mechanism. This challenge is further exacerbated by the fact that acquiring these fundamental data through more complex computational models or experiments is often limited by cost, technical complexity, or inadequate models. In this paper, we discuss a method to automate the selection of fundamental data in a reduced reaction mechanism for feature scale plasma etching of SiO 2 using a fluorocarbon gas mixture by matching predictions of etch profiles to experimental data using a gradient descent (GD)/Nelder–Mead (NM) method hybrid optimization scheme. These methods produce a reaction mechanism that replicates the experimental training data as well as experimental data using related but different etch processes.

36 MATERIALS SCIENCE↗
DOE OSTI2021

The dependence of the gradients of oxygen and nitrogen-to-oxygen on stellar age in MaNGA galaxies

For this work, we derived the oxygen abundance (O/H), the nitrogen-to-oxygen (N/O) abundance ratio, and their corresponding radial gradients for a sample of 1431 galaxies from the MaNGA DR15 survey using two different realisations of the strong line method: empirical R calibration and the Bayesian model-based HII-CHI-MISTRY (HCM) code. We find that both abundance calculation methods reveal a correlation between the O/H gradient and the stellar mass of a galaxy. This relation is non-linear, with the steepest average gradients in the intermediate mass range and flatter average gradients for high- and low-mass galaxies. The relation between the N/O gradient and the stellar mass is, on average, non-linear with the steepest gradients in the intermediate mass range (log(M/M ⊙ )~10), flatter gradients for high-mass galaxies, and the flattest gradients for low-mass galaxies. However, the general trend of steepening N/O gradients for higher masses, as reported in previous studies, remains evident. We find a dependence between the O/H and N/O gradients and the galaxy mean stellar age traced by the D(4000) index. For galaxies of lower masses, both gradients are, generally, steeper for intermediate values of D(4000) and flatter for low and high values of D(4000). Only the most massive galaxies do not show this correlation. We interpret this behaviour as an evolution of the metallicity gradients with the age of stellar population. Though the galaxies with a positive slope of the D(4000) radial gradient tend to have flatter O/H and N/O gradients, as compared to those with a negative D(4000) gradient.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Elastic Flow Modeling for Hydropower Digital Twins

This report details the elastic, unsteady, one-dimensional flow equations that are used to model flow through a penstock in a hydropower facility. The elastic flow model is accurate even in cases of fast transients, long penstock length, and high gravitation head. The compressibility of the water and elasticity of the pipe walls are explicitly accounted for in the developed models so that the water hammer phenomena can be accurately captured. The elastic flow model is coupled to a mechanistic turbine model to resolve the dynamic feedbacks between the elastic water column and the turbine rotation rate. A finite volume method is employed to solve the governing equations, and the method is shown to have low numerical diffusion in sharp gradient phenomena, such as those encountered when simulating water hammer. The method is applied to single dimensional linear advection benchmark problem and numerical results are compared with analytic results. This is followed on by an application to a full hydropower system with a coupled turbine. The elastic flow model results are compared against an inelastic model.

13 HYDRO ENERGY↗
DOE OSTI2023

Yet another parameter-free shape optimization method

The use of node coordinates as design variables in shape optimization offers a larger design space than computer-aided design (CAD)-based shape parameterizations. It also allows for the optimization of legacy designs, i.e., a finite element mesh from an existing design can be readily optimized to meet new performance requirements without involving a CAD model. However, it is well known that the node coordinate parameterization method is fraught with numerical difficulties, which makes it impractical to use. This has led to several of “parameter-free” shape optimization methods that seek the advantages and avoid the pitfalls of the naïve node coordinate parameterization method. These methods come in two main varieties: sensitivity filtering (or gradient smoothing) and consistent filtering. The latter is analogous to the density filter method used in topology optimization (TO). In this work, we use the PDE filter from TO and energy-based filters to implement consistent shape optimization filtering schemes easily and efficiently. Numerical experiments demonstrate that consistent methods are more robust than sensitivity filtering methods.

42 ENGINEERING↗
DOE OSTI2025

Chelation ion chromatography as an automated, and cost-effective analytical technique for REE determination: method development and applications

Rare earth elements (REEs), as critical minerals, have important uses in modern energy and technologies, yet are vulnerable to potential supply chain disruptions. To establish domestic REE supply chain, efficient REE detection methods for resource characterization and mineral processing will be needed to accelerate innovations for domestic REE recovery. This study developed a rapid, novel, and cost-effective for REE detection method using ion chromatography (IC) for aqueous samples. Various REE-targeted eluent gradients and post-column agent compositions were tested on the chelation ion chromatography (CIC) with UV-vis detector for optimal separation and quantification of REEs within approximately 20 min. The single-channel pump to deliver the post-column solution to UV-vis detector was replaced with a 4-channel gradient pump, to increase operation and maintenance efficiencies. After method optimization, resulting calibration curves for more than ten REEs achieved high coefficients of determination (R2>0.999) and low relatively standard deviations (below 3.24%), demonstrating sub-ppm level detection limits (0.0897 to 0.1149 mg/L). The reliability of the CIC method was validated through comparison with inductively coupled plasma mass spectrometry (ICP-MS), showing strong agreement in REE recovery from certified standards. The impact of metal ions and salts on REE recovery using CIC was also systematically investigated. CIC consistently exhibited reliable performance in the presence of salt solutions such as NaCl and Na₂SO₄ (up to 10,000 mg/L). Our study also found the presence of high concentrations of Al ions (at 10,000 mg/L) significantly influenced REE determination, and elevated concentrations of Ca ions affected the recovery of specific REEs, including La, Ce, and Pr. The CIC method was further tested on REE-containing eluents from solvent extraction tests out of fly ash leachates. REE detection from these real processing fluids were reported to achieve 90% to 100% recovery rate from our IC method, compared to ICP-MS results. This study underscores the potential of CIC as a reliable and efficient alternative for REE determination in complex matrices. It also highlights the importance of minimizing select interfering metal ions in solutions to ensure accurate results. The REE CIC method presents a promising, low-maintenance, salt-tolerant, and cost-effective alternative to traditional analytical methods for REE analysis.

detection of rare earth elements (REE)↗
DOE OSTI2023

Fast model-based scenario optimization in NSTX-U enabled by analytic gradient computation

Model-based optimization offers a systematic approach to advanced scenario planning. In this case, the feedforward-control inputs (actuator trajectories) that are needed to attain and sustain a desired scenario are obtained by solving a nonlinear constrained optimization problem. This class of problems generally minimize a cost function that measures the difference between desired and actual plasma states. Several numerical optimization algorithms, such as sequential quadratic programming, require repeated calculation of the cost function gradients with respect to the input trajectories. Calculating these gradients numerically can be computationally intensive, increasing the time needed to solve the feedforward-control optimization problem. Here, this work introduces a method to analytically calculate these cost function gradients from the current profile evolution model. This can significantly reduce the computational time and allow for fast feedforward-control optimization, which would eventually enable optimal scenario planning between discharges. The performance of the feedforward optimizer with analytical gradients is compared to a traditional optimization algorithm based on numerical gradients for different NSTX-U scenarios. The plasma dynamics in the optimization algorithm are simulated using the Control Oriented Transport SIMulator (COTSIM). Results of the work show that analytical gradients consistently reduce the computation time while achieving trajectories that are comparable to those obtained by traditional optimization algorithms based on numerical gradients.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Quantitative Separation of Unknown Organic–Metal Complexes by Liquid Chromatography–Inductively Coupled Plasma-Mass Spectrometry

Dissolved organic matter (DOM) is widely recognized to control the solubility and reactivity of trace metals in the environment. However, the mechanisms that govern metal-DOM complexation remain elusive, primarily due to the analytical challenge of fractionating and quantifying metal–organic species within the complex mixture of organic compounds that comprise DOM. Here, we describe a quantitative method for fractionation and element-specific detection of organic–metal complexes using liquid chromatography with online inductively coupled plasma mass spectrometry (LC–ICP-MS). The method implements a post-column compensation gradient to stabilize ICP–MS elemental response across the LC solvent gradient, thereby overcoming a major barrier to achieving quantitative accuracy with LC–ICP-MS. With external calibration and internal standard correction, the method yields concentrations of organic–metal complexes that were consistently within 6% of their true values, regardless of the complex’s elution time. We used the method to evaluate the effects of four stationary phases (C18, phenyl, amide, and pentafluoroylphenyl propyl) on the recovery and separation of environmentally relevant trace metals (Mn, Fe, Co, Ni, Cu, Zn, Cd, and Pb) in Suwannee River Fulvic Acid and Suwannee River Natural Organic Matter. The C18, amide, and phenyl phases generally yielded optimal metal recoveries (>75% for all metals except Pb), with the phenyl phase separating polar species to a greater extent than C18 or amide. We also fractionated organic-bound Fe, Cu, and Ni in oxidized and reduced soils, revealing divergent metal-DOM speciation across soil redox environments. Finally, by enabling quantitative fractionation of DOM-bound metals, our method offers a means for advancing a mechanistic understanding of metal–organic complexation throughout the environment.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Robust wind farm layout optimization

Wake interactions in wind farms cause losses in annual energy production (AEP) on the order of 10%. Wind farm designers optimize the layout of the farm to mitigate wake losses, especially in the dominant site-specific wind directions. As wind turbines and wind farms grow in scale, optimization becomes more complex. Offshore wind farms regularly comprise more than 100 wind turbines and are characterized by complex boundaries due to shipping lanes, neighboring wind farms, and other constraints. Layout optimization methods are broadly split between gradient-based and gradient-free approaches. Gradient-based approaches can converge quickly and perform well for smaller, academic problems but are often sensitive to initial conditions and tuning parameters and require expert knowledge to use. On the other hand, gradient-free approaches can be more robust to problem complexities. We present a robust layout optimization approach based on a random search algorithm. The algorithm is intended for those who are not optimization experts and has few tuning parameters that need specification to achieve satisfactory results. Unlike off-the-shelf methods, which use generally available, non-domain-specific optimization routines that accept as inputs an optimization function and constraint definitions, this approach takes advantage of the relative computational costs of the different evaluations by evaluating cheaper computations first (boundary and minimum distance constraints) and running expensive AEP evaluations only if all other checks pass. Moreover, an outer genetic algorithm allows multiple solutions to evolve in parallel, enabling rapid solution development on high-performance computers. We discuss the relative ease of selecting necessary tuning parameters and demonstrate the efficacy of the genetic random search on a complex layout problem consisting of placing 70 turbines in a nonconvex and unconnected boundary region.

17 WIND ENERGY↗
DOE OSTI2022

Wavefront shaping with a Hadamard basis for scattering soil imaging

Here, soil is a scattering medium that inhibits imaging of plant-microbial-mineral interactions that are essential to plant health and soil carbon sequestration. However, optical imaging in the complex medium of soil has been stymied by the seemingly intractable problems of scattering and contrast. Here, we develop a wavefront shaping method based on adaptive stochastic parallel gradient descent optimization with a Hadamard basis to focus light through soil mineral samples. Our approach allows a sparse representation of the wavefront with reduced dimensionality for the optimization. We further divide the used Hadamard basis set into subsets and optimize a certain subset at once. Simulation and experimental optimization results demonstrate our method has an approximately seven times higher convergence rate and overall better performance compared to that with optimizing all pixels at once. The proposed method can benefit other high-dimensional optimization problems in adaptive optics and wavefront shaping.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

PDG: A Composite Method Based on the Resolution of the Identity

The Gaussian-3 (G3) composite approach for thermochemical properties is revisited in light of the enhanced computational efficiency and reduced memory costs by applying the resolution-of-the-identity (RI) approximation for two-electron repulsion integrals (ERIs) to the computationally demanding component methods in the G3 model: the energy and gradient computations via the second-order Møller–Plesset perturbation theory (MP2) and the energy computations using the coupled-cluster singles–doubles method augmented with noniterative triples corrections [CCSD(T)]. Efficient implementation of the RI-based methods is achieved by employing a hybrid distributed/shared memory model based on MPI and OpenMP. The new variant of the G3 composite approach based on the RI approximation is termed the RI-G3 scheme, or alternatively the PDG method. The accuracy of the new RI-G3/PDG scheme is compared to the “standard” G3 composite approach that employs the memory-expensive four-center ERIs in the MP2 and CCSD(T) calculations. Taking the computation of the heats of formation of the closed-shell molecules in the G3/99 test set as a test case, it is demonstrated that the RI approximation introduces negligible changes to the mean absolute errors relative to the standard G3 model (less than 0.1 kcal/mol), while the standard deviations remain unaltered. Furthermore, the efficiency and memory requirements for the RI-MP2 and RI-CCSD(T) methods are compared to the standard MP2 and CCSD(T) approaches, respectively. The hybrid MPI/OpenMP-based RI-MP2 energy plus gradient computation is found to attain a 7.5× speedup over the standard MP2 calculations. For the most demanding CCSD(T) calculations, the application of the RI approximation is found to nearly halve the memory demand, confer about a 4–5× speedup for the CCSD iterations, and reduce the computational time for the compute-intensive triples correction step by several hours.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Ptychographic phase retrieval by proximal algorithms

We derive a set of ptychography phase-retrieval iterative engines based on proximal algorithms originally developed in convex optimization theory, and discuss their connections with existing ones. The use of proximal operator creates a simple frame work that allows us to incorporate the effect of noise from a maximum-likelihood (ML) principle. We focus on three particular algorithms, namely proximal minimization, alternating direction method of multiplier and accelerated proximal gradient (APG). We benchmark their performance with numerical simulations, and discuss their optimal conditions for convergence and accuracy. An experimental dataset is used to demonstrate their effectiveness as well, in which case an array of cubic Au nanoparticles with a size of 50 nm is imaged. We show that with the presence of Poisson noise, a dataset with photon counts up to 10 4 at one detector pixel already requires ML-based methods to achieve a stable convergence. Among the three algorithms derived in this work, APG method is reported first time for its application in ptychographic reconstruction and shows superior performance in terms of both accuracy and convergence rate with a noisy dataset.

36 MATERIALS SCIENCE↗