Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Accuracy of predictions made by machine learned models for biocrude yields obtained from hydrothermal liquefaction of organic wastes

Hydrothermal liquefaction (HTL) has potential for converting abundant wet organic wastes into renewable fuels. Because HTL consists of a complex reaction network, deterministic, physics-based prediction of its biocrude yield is prohibitively difficult. Data-driven methods provide an alternative to the physics-based approach; however, rigorous testing must be performed to ensure the accuracy of predictions made by data-driven methods. To this end, a data set was assembled consisting of 570 data points appearing in the open literature. The data set was divided into training, validation, and test sub-sets and used for evaluating different machine learning regression approaches to predict biocrude yield. Among the tested algorithms, Random Forest and eXtreme Gradient Boosting (XGBoost) predicted biocrude yields in a test set that had not been used for training with the greatest accuracy, with root mean square errors (RMSE) of 8.34 and 8.57, respectively. Further refinement of the Random Forest model reduced its RMSE to 8.07. In comparison, predictions of a series of literature models resulted in RMSE ranging from 9.16 in the most accurate case to 27.6 in the least accurate; most literature models yielded RMSE values > 10. Using biocrude yield predictions from the most accurate Random Forest model and a probabilistic economic analysis found that the model accuracy is sufficient to prioritize allocation of resources based on projected minimum fuel selling price. In our report the models and analysis represent a major advance in the ability to use readily available data to predict biocrude yields on new feedstocks that have not previously been studied.

42 ENGINEERING↗
DOE OSTI2024

Segmentation and Classification of Fission as Pores in Reactor Irradiated Annular U–10Zr Metallic Fuel Using Machine Learning Models

Metallic fuels, particularly U—10Zr, are promising candidates for next-generation sodium-cooled fast reactors. Irradiation of nuclear fuels in reactors can lead to the formation of solid and gas fission product which subsequently forms microstructural pores, deteriorating fuel performance. Due to the massive amount of pores and complex phases formed, a quantitative description of fission gas pores is not yet available, preventing the development of microstructure-informed fuel performance modeling for fuel qualification. This paper applied a pre-trained deep learning model to ~10,260 high magnification scanning electron microscopy images. This method increased the accuracy of fission gas pore segmentation and allows statistical features to be extracted which cannot be achieved manually. A pre-trained decision tree model worked on the segemenation results and further classified the pores into different categories to produce a correlation between the pores, movement of lanthanides, and temperature gradient during irradiation. Finally, this paper emphasizes the potentials of machine learning models to accelerate fuel research, development, and qualification for advanced reactors.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Multipacting Processing in Cryomodules For LCLS-II And LCLS-II-HE

Multipacting (MP) is a phenomenon which can affect stability in particle accelerators and limit performance in superconducting radio frequency cavities. In the TESLA shaped, 1.3 GHz, 9-cell cavities used in the LCLS-II (L2) and LCLS-II-HE (HE) projects, the MP-band (~17-24 MV/m) lies within the required accelerating gradients. For HE, the operating gradient of 20.8 MV/m lies well within the MP-band and cryomodule testing has confirmed that this is an issue. As such, MP processing for the HE cryomodule test program will be discussed. Early results on MP processing in cryomodules installed in the L2 linac will also be presented, demonstrating that the methods used in cryomodule acceptance testing are also successful at conditioning MP in the accelerator and that this processing is preserved in the mid-term.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Crossing The Gap Using Variational Quantum Eigensolver: A Comparative Study

Within the evolving domain of quantum computational chemistry, the Variational Quantum Eigensolver (VQE) has been developed to explore not only the ground state but also the excited states of molecules. In this study, we compare the performance of Variational Quantum Deflation (VQD) and Subspace-Search Variational Quantum Eigensolver (SSVQE) methods in determining the low-lying excited states of $LiH$. Our investigation reveals that while VQD exhibits a slight advantage in accuracy, SSVQE stands out for its efficiency, allowing the determination of all low-lying excited states through a single parameter optimization procedure. We further evaluate the effectiveness of optimizers, including Gradient Descent (GD), Quantum Natural Gradient (QNG), and Adam optimizer, in obtaining $LiH$'s first excited state, with the Adam optimizer demonstrating superior efficiency in requiring the fewest iterations. Moreover, we propose a novel approach combining Folded Spectrum VQE (FS-VQE) with either VQD or SSVQE, enabling the exploration of highly excited states. We test the new approaches for finding all three $H_4$'s excited states. Folded Spectrum SSVQE (FS-SSVQE) can find all three highly excited states near $-1.0$ Ha with only one optimizing procedure, but the procedure converges slowly. In contrast, although Folded spectrum VQD (FS-VQD) gets highly excited states with individual optimizing procedures, the optimizing procedure converges faster.

Chen, I-Chi↗
DOE OSTI2021

Explicit physics-informed neural networks for nonlinear closure: The case of transport in tissues

In upscaling methods, closures for nonlinear problems present a well-known challenge. While a number of theoretical methods have been proposed for handling such closures, nonlinearities still remain a significant obstacle for many problems. In this work, we use a combination of formal upscaling and data-driven machine learning for explicitly closing a nonlinear transport and reaction process in multiscale tissues. The classical effectiveness factor model is used to formulate the macroscale reaction kinetics. We train a multilayer perceptron network using training data generated by direct numerical simulations over microscale examples. Once trained, the network is used in an algorithm for numerically solving the upscaled (coarse-grained) differential equation describing mass transport and reaction in two example tissues. The network is described as being explicit in the sense that the network is trained using macroscale concentrations and gradients of concentration as components of the feature space rather than incorporating them as part of a constraint in the optimization process. Network training and solutions to the macroscale transport equations were computed for two different tissues. The two tissue types (brain and liver) exhibit markedly different geometrical complexity and spatial scale (cell size and sample size). The upscaled solutions for the average concentration are compared with numerical solutions derived from the microscale concentration fields by a posteriori averaging. There are three outcomes of this work of particular note. 1) Our overall approach results in an upscaled nonlinear PDE. The PDE is closed using a neural network, and our approach results in the definition of the classical effectiveness factor for effecting closure. 2) We identify particular source terms for the closure problem that are important for representing the structure of the closure. These source terms involve macroscale concentrations and their gradients. We adopt these source terms to use as explicit features in the learning algorithm. We find the trained networks that include the macroscale source terms generate models that are able to predict the correction factor with increased fidelity over those that do not. 3) We find that the trained network exhibits good generalizability, and it is able to predict the effectiveness factor with high fidelity for realistically-structured tissues despite the significantly different scale and geometrical complexity of the two example tissue types. This latter result emphasizes our purposeful connection between conventional averaging methods with the use of machine learning for closure; this contrasts with some machine learning methods for upscaling where the exact form of the macroscale equation remains unknown.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A persistent adjoint method with dynamic time-scaling and an application to mass action kinetics

In this article, we consider an optimization problem where the objective function is evaluated at the fixed-point of a contraction mapping parameterized by a control variable, and optimization takes place over this control variable. Since the derivative of the fixed-point with respect to the parameter can usually not be evaluated exactly, an adjoint dynamical system can be used to estimate gradients. Using this estimation procedure, the optimization algorithm alternates between derivative estimation and an approximate gradient descent step. We analyze a variant of this approach involving dynamic time-scaling, where after each parameter update the adjoint system is iterated until a convergence threshold is passed. Here, we prove that, under certain conditions, the algorithm can find approximate stationary points of the objective function. We demonstrate the approach in the settings of an inverse problem in chemical kinetics, and learning in attractor networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A convection-permitting dynamically downscaled dataset over the Midwestern United States

Climate change is expected to have far-reaching effects at both the global and regional scale, but local effects are difficult to determine from coarse-resolution climate studies. Dynamical downscaling can provide insight into future climate projections on local scales. Here, we present a new dynamically downscaled dataset for Indiana and the surrounding regions. Output from the Community Earth System Model (CESM) version 1 is downscaled using the Weather Research and Forecasting model (WRF). Simulations are run with a 24-hr reinitialization strategy and a 12-hr spin-up window. WRF output is bias corrected to the National Centers for Environmental Protection/National Center for Atmospheric Research 40-year Reanalysis project (NCEP) using a modified quantile mapping method. Bias-corrected 2-m air temperature and accumulated precipitation are the initial focus, with additional variables planned for future releases. Regional climate change signals agree well with larger global studies, and local fine-scaled features are visible in the resulting dataset, such as urban heat islands, frontal passages, and orographic temperature gradients. This high-resolution climate dataset could be used for down-stream applications focused on impacts across the domain, such as urban planning, energy usage, water resources, agriculture and public health.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

The Influence of Soil Properties on Sea-Breeze Circulations in the Southeast U.S.

Sea-breeze circulations (SBCs) are common weather phenomena at and near coastal regions. They form because of a thermal gradient between the land surface at the coast and the sea surface. In a mid-day regime, a “thermal low” generated at the warm coast will lead to rising air motion, creating a wind shift coming from the sea near the surface displacing the coastal air. A “return flow” moving back towards the sea is generated by upper-level divergence because of the rising motion from the thermal low. SBCs propagate and serve as a method of urban pollutant dispersion in the Los Angeles region of California and are constrained to the coast due to the topography of surrounding mountains serving as a boundary for further inland propagation. Within the northeast U.S. SBCs are seen in the warm season but tend to remain coastally bound due to Coriolis distortion over long distances. Within the southeast U.S. (SEUS), the paradigmatic example of SBCs occurs over the Florida peninsula, where thunderstorms form on a nearly daily occurrence due to the convergence of SBCs from the east and west sides of the peninsula. However, there are further examples of sea-breezes in the SEUS that warrant study. Within the region bordering the SEUS and the Mid-Atlantic, just east of the southern Appalachian Mountains, warm-season SBCs form at the coast of Georgia and the Carolinas. Relatively flat topography ~150-200km inland allows for mostly unimpeded inland SBC propagation. Through visual analysis, Viner et al. catalogued several SBCs that propagated as far inland as the Central Savannah River Area surrounding Augusta, Georgia. Wermter et al. found that while the land-sea thermal gradient at the coast can influence coastal SBC genesis, the inland-coastal thermal gradient over the land is the primary influencer on the speed and depth of inland propagation of SBCs in this region. Additionally, soil moisture itself is a known correlative factor to sea-breeze formation, as it influences the soil temperature and the thermal gradient needed for SBC genesis and inland penetration. Physick determined that higher latent heat fluxes associated with wetter soil dampen the land-sea thermal gradient and suppress the formation of a SBC. Physick determined that higher latent heat fluxes associated with wetter soil dampen the land-sea thermal gradient and suppress the formation of a SBC. Conversely, drier soil enhances the thermal gradient and promotes SBC formation. However, while there is an inverse relationship between soil moisture and SBCs, higher soil moisture can actually promote more convective rainfall following a SBC if it does not significantly impact the thermal gradient. While the relationship between soil moisture and SBC formation has been conceptually explored and modeled numerically, there is a research gap in observed connections. The Soil Moisture Active Passive (SMAP) satellite mission has been operational since 2015 and has been used to create high-resolution re-analytical Level 4 (L4) datasets of soil moisture and soil temperature at different soil depths: the surface (0-5cm) and rootzone (0-1m). The surface soil temperature effectively acts as the “skin temperature” of the surface at these levels, and a spatial map of the land-sea as well as the coastal-inland thermal gradients can be represented. SMAP data are also assimilated in some atmospheric models such at the High Resolution Rapid Refresh (HRRR) mesoscale model. We propose leveraging the use of SMAP products to fill in spatial gaps left by weather and mesonet stations within the SEUS region, as well as assessing the effectiveness of utilizing SMAP products towards SBC forecasting in both deterministic and machine learning (ML) models.

58 GEOSCIENCES↗
DOE OSTI2025

Effects of an External Magnetic Field on Keyhole Mode Laser Melting of 316 Stainless Steel

Keyhole-mode laser melting is an efficient method for joining or cutting large, thick components, but controlling keyhole depth and fluctuations has remained challenging. Applying an external magnetic field can control melt pool flows and indirectly influence keyhole morphology and dynamics. The induced Lorentz force, comprising Seebeck and damping components, plays a crucial role in the melt pool dynamics, depending on temperature gradient, flow rates, and magnetic field orientation and magnitude. This research investigates the effects of an external magnetic field on keyhole behavior during laser spot melting of 316 stainless steel using synchronized high-speed synchrotron X-ray and thermal imaging. Findings revealed that a longitudinal magnetic field (120 mT) increased keyhole depth but exacerbated lateral fluctuations, resulted in a 20% increase in the melt pool temperature gradient and a 27% decrease in cooling rate. Conversely, a transverse magnetic field (760 mT) reduced keyhole depth and improved porosity formation. The findings suggest that a decrease in keyhole depth correlates with a decrease in fluctuations, and vice versa. These insights enhance understanding of external magnetic fields’ impact on laser melting, with implications for improving part quality.

Alamdari, Aslan Bafahm [The Ohio State Univ., Colu↗
DOE OSTI2020

Three-Dimensional Analysis of Particle Distribution on Filter Layers inside N95 Respirators by Deep Learning

The global COVID-19 pandemic has changed many aspects of daily lives. Wearing personal protective equipment, especially respirators (face masks), has become common for both the public and medical professionals, proving to be effective in preventing spread of the virus. Nevertheless, a detailed understanding of respirator filtration-layer internal structures and their physical configurations is lacking. Here, we report three-dimensional (3D) internal analysis of N95 filtration layers via X-ray tomography. Using deep learning methods, we uncover how the distribution and diameters of fibers within these layers directly affect contaminant particle filtration. The average porosity of the filter layers is found to be 89.1%. Contaminants are more efficiently captured by denser fiber regions, with fibers <1.8 μm in diameter being particularly effective, presumably because of the stronger electric field gradient on smaller diameter fibers. This study provides critical information for further development of N95-type respirators that combine high efficiency with good breathability.

42 ENGINEERING↗
DOE OSTI2021

Valence Effects of Fe Impurity for Recovered LiNi 0.6 Co 0.2 Mn 0.2 O 2 Cathode Materials

Iron impurities are generally included in the obtained leaching liquor solution during the hydrometallurgical recycling method of spent lithium-ion batteries (LIBs) due to the usage of iron in battery casings and machinery parts of recycling equipment, which would definitely affect the physical and electrochemical features of the recovered active materials. In this paper, the effects of iron impurity with different valence states (Fe 2+ and Fe 3+ ) and gradient concentrations (0.2, 1.0, and 5.0 at. %) for the obtained LiNi 0.6 Co 0.2 Mn 0.2 O 2 (NCM622) cathodes are fully studied. It is found that Fe3+ impurity could easily lower the tap density and average size of NCM622 particles and even introduce some impurity phases in the NCM622 structure at high concentration (5.0 at. %), leading to much lower specific capacity, worse rate capability, and cycling performance of the Fe 3+ -based NCM622 cathode. On contrast, with certain concentrations of Fe 2+ impurity (0.2 and 1.0 at. %), the NCM622 cathode material exhibits comparable and much better electrochemical properties compared with the virgin NCM622 materials. Based on these results, the valence of Fe impurity should be considered and controlled as well as its concentration during the recycling process design for spent LIBs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Pragmatic Uncertainty Quantification and Propagation in Inverse Estimation of Structural Dynamics Parameters given Material Property Uncertainties and Limited Sensor Data

In this report we demonstrate some relatively simple and inexpensive methods to effectively account for various sources of epistemic lack-of-knowledge type uncertainty in inverse problems. The demonstration problem involves inverse estimation of six parameters of a bolted joint that attaches a kettlebell shaped object to a thick plate. The parameters are efficiently inverted in a modal-based model calibration using gradient-based optimization. Two material properties of the kettlebell are treated as uncertain to within given epistemic uncertainty bounds. We apply and test interval and sparse-sample probabilistic approaches to account for uncertainty in the estimated parameters (and various scalar functionals of the parameters as generic quantities of interest, QOIs) due to uncertainties in the material properties. We also investigate the error effects of limited numbers of vibration sensors (accelerometers) on the kettlebell and plate, and therefore abbreviated excitation/response information in the parameter inversions. We propose and demonstrate a Leave-K-Sensors-Out “cross-prediction” UQ approach to estimate related uncertainties on the parameters and QOI functionals. We indicate how uncertainties from material properties and limited sensors are treated in a combined manner. The economical combined UQ approach involves just three to five samples (i.e. three to five inverse simulations), with no added complication or error/uncertainty from use of surrogate models for affordability. Finally, we describe a related economical UQ approach for handling potential parameter solution non-uniqueness and numerical optimization related precision uncertainties in the estimated parameter values. Indicated further research is identified.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Comparison of stellar populations in simulated and real post-starburst galaxies in MaNGA

ABSTRACT Recent integral field spectroscopic (IFS) surveys have revealed radial gradients in the optical spectral indices of post-starburst (PSB) galaxies, which can be used to constrain their formation histories. We study the spectral indices of post-processed mock IFS datacubes of binary merger simulations, carefully matched to the properties of the MaNGA IFS survey, with a variety of black hole (BH) feedback models, progenitor galaxies, orbits, and mass ratios. Based on our simulation sample, we find that only major mergers on prograde–prograde or retrograde–prograde orbits in combination with a mechanical BH feedback model can form galaxies with weak enough ongoing star formation, and therefore absent H α emission, to be selected by traditional PSB selection methods. We find strong fluctuations in nebular emission line strengths, even within the PSB phase, suggesting that H α selected PSBs are only a subsample of the underlying population. The global PSB population can be more robustly identified using stellar continuum-based approaches. The difficulty in reproducing the very young PSBs in simulations potentially indicates that new sub-resolution star formation recipes are required to properly model the process of star formation quenching. In our simulations, we find that the starburst peaks at the same time at all radii, but is stronger and more prolonged in the inner regions. This results in a strong time evolution in the radial gradients of the spectral indices that can be used to estimate the age of the starburst without reliance on detailed star formation histories from spectral synthesis models.

Zheng, Yirui↗
DOE OSTI2022

Machine Learning with Gradient-Based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints

Gekko is an optimization suite in Python that solves optimization problems involving mixed-integer, nonlinear, and differential equations. The purpose of this study is to integrate common Machine Learning (ML) algorithms such as Gaussian Process Regression (GPR), support vector regression (SVR), and artificial neural network (ANN) models into Gekko to solve data based optimization problems. Uncertainty quantification (UQ) is used alongside ML for better decision making. These methods include ensemble methods, model-specific methods, conformal predictions, and the delta method. An optimization problem involving nuclear waste vitrification is presented to demonstrate the benefit of ML in this field. ML models are compared against the current partial quadratic mixture (PQM) model in an optimization problem in Gekko. GPR with conformal uncertainty was chosen as the best substitute model as it had a lower mean squared error of 0.0025 compared to 0.018 and more confidently predicted a higher waste loading of 37.5 wt% compared to 34 wt%. The example problem shows that these tools can be used in similar industry settings where easier use and better performance is needed over classical approaches. Future works with these tools include expanding them with other regression models and UQ methods, and exploration into other optimization problems or dynamic control.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

"Hidden" hydrothermal technical potential & technoeconomics: Revealing permeability & fluids with more data

Historical hydrothermal estimates have largely relied on temperature or heat flow estimates ignoring the need for natural flowing fluids. More accurate hydrothermal estimates require some indication of permeability and fluids that naturally exist in the subsurface. This paper describes a novel approach that includes proxies of permeability and fluids in hydrothermal estimates by leveraging the relatively data-rich Great Basin. Specifically, nameplate capacities (megawatts) of operating geothermal plants, negative (0 megawatt) locations and 48 geophysical and geologic features are used to used in eXtreme Gradient Boosting (XGBoost) regression to make hydrothermal capacity predictions. Additionally, this work inputs the XGBoost-based hydrothermal predictions into the Renewable Energy Potential (reV) model to quantify technical capacity, its uncertainty and techno-economics. Compared to historical hydrothermal estimates, these predictions adhere to the 37 operating geothermal plants and negative locations. We present a method for subsampling the negative sites to bring the labels into balance that uses the geologic domain knowledge to proportionally represent negatives. Overall, the distributions of the hydrothermal technical capacity and the site levelized cost of energy are respectively much tighter, lower and more accurate than the previous estimates for the Great Basin, as they include geological and geophysical surrogates for permeability and fluids. Percentile (50th and 90th, median and high estimate, respectively) models provide bookends for these metrics.

13 HYDRO ENERGY↗
DOE OSTI2021

Periodic boundary conditions for arbitrary deformations in molecular dynamics simulations

A generalization of the Lees-Edwards periodic boundary conditions (gLE-PBC) for molecular dynamics (MD) simulations is developed to allow for arbitrary deformations to be applied to the domain. The gLE-PBC domain remains a rectangular cuboid regardless of the applied deformation in contrast with the Lagrangian-rhomboid periodic boundary conditions (LR-PBC) where the domain deforms according to the applied deformation. Furthermore, the kinematics of gLE-PBC are validated against pure shear. The gLE-PBC method for interacting systems is then validated against the LR-PBC method and analytical solutions for a solid under isotropic compression, one-dimensional shearing, three-dimensional extension and shearing and for a liquid under Couette flow. Bulk physical properties extracted from the gLE-PBC simulations agree well with values calculated from equilibrium MD simulations. Three dimensional shearing and a deformation with a full velocity gradient matrix are also simulated, showing the range of problems gLE-PBC can explore.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2024

Metric Learning to Accelerate Convergence of Operator Splitting Methods

Recent developments in machine learning have led to promising advances in accelerating the solution of constrained optimization problems. Increasing demand for real-time decision-making capabilities in applications such as artificial intelligence and optimal control has led to a variety of proposed strategies for learning to produce fast solutions to optimization problems. For example, recent works have shown that it is possible to accelerate the convergence of optimization algorithms by learning to select their parameters, such as gradient descent stepsizes. This work proposes a new approach, in which the underlying metric spaces of proximal operator splitting algorithms are learned to maximize convergence rate. While prior works in optimization theory have derived optimal metrics in simple cases, no such result exists for many practical problem forms including general Quadratic Programming (QP). This paper shows how differentiable optimization can enable the end-to-end learning of proximal metrics, enhancing the convergence of proximal algorithms for QP problems beyond what is possible based on known theory. Additionally, the results illustrate a strong connection between the learned proximal metrics and active constraints at the optima, leading to an interpretation in which the predicted proximal metrics can be viewed as a form of active set prediction.

King, Ethan [BATTELLE (PACIFIC NW LAB)]↗