Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “surrogate systems modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Online Modelling and Optimization of Nonlinear Integrable Systems

Nonlinear integrable optics was recently proposed as a design approach to increase the limits on beam brightness and intensity imposed by fast collective instabilities. To study these systems experimentally, a new research electron and proton storage ring, the Integrable Optics Test Accelerator, was constructed and recently commissioned at Fermilab. Beam-based diagnostics and online modelling of nonlinear systems presents unique challenges - in this paper, we report on our efforts to develop optimization methods suited for such lattices. We explore the effectiveness of neural networks as fast online surrogate estimators, and integrate them into a beam-based tuning algorithm. We also develop a method of knob dimensionality reduction and subsequent robust multivariate optimization for maximizing key performance metrics under complicated lattice optics constraints.

43 PARTICLE ACCELERATORS↗
DOE OSTI2020

Constrained Bayesian Optimization of Criticality Experiments [Slides]

The design of criticality experiments is typically an iterative process that employs a Monte Carlo transport code. The goal is to find a design that optimizes some variable, like the sensitivity of a response to a cross section, while simultaneously ensuring criticality. The high fidelity of the Monte Carlo code is a great asset, but it makes exploring the design space computationally expensive. Herein, we present how a constrained Bayesian optimization algorithm can be used to efficiently design a criticality experiment. It uses Gaussian processes as a surrogate model to probe the design space and to reduce the number of code executions that are needed to find the optimum. We demonstrate constrained Bayesian optimization with a Pu-239/polyethylene solution system and a TEX experiment that is designed for criticality safety validation of a nuclear waste model at the Hanford Site. For both systems, a global optimum was found within 75 Monte Carlo simulations.

42 ENGINEERING↗
DOE OSTI2020

Constrained Bayesian Optimization of Criticality Experiments at LLNL [Slides]

The design of criticality experiments is typically an iterative process that employs a Monte Carlo transport code. The goal is to find a design that optimizes some variable, like the sensitivity of a response to a cross section, while simultaneously ensuring criticality. The high fidelity of the Monte Carlo code is a great asset, but it makes exploring the design space computationally expensive. Herein, we present how a constrained Bayesian optimization algorithm can be used to efficiently design a criticality experiment. It uses Gaussian processes as a surrogate model to probe the design space and to reduce the number of code executions that are needed to find the optimum. We demonstrate constrained Bayesian optimization with a Pu-239/polyethylene solution system and a TEX experiment that is designed for critical ity safety validation of a nuclear waste model at the Hanford Site. For both systems, a global optimum was found within 75 Monte Carlo simulations.

42 ENGINEERING↗
DOE OSTI2023

A machine learning approach targeting parameter estimation for plant functional type coexistence modeling using ELM-FATES (v2.0)

Tropical forest dynamics play a crucial role in the global carbon, water, and energy cycles. However, realistically simulating the dynamics of competition and coexistence between different plant functional types (PFTs) in tropical forests remains a significant challenge. This study aims to improve the modeling of PFT coexistence in the Functionally Assembled Terrestrial Ecosystem Simulator (FATES), a vegetation demography model implemented in the Energy Exascale Earth System Model (E3SM) land model (ELM), ELM-FATES. Specifically, we explore (1) whether plant trait relationships established from field measurements can constrain ELM-FATES simulations and (2) whether machine learning (ML)-based surrogate models can emulate the complex ELM-FATES model and optimize parameter selections to improve PFT coexistence modeling. We conducted three ensembles of ELM-FATES experiments at a tropical forest site near Manaus, Brazil. By comparing the ensemble experiments without (Exp-CTR) and with (Exp-OBS) consideration of observed trait relationships, we found that accounting for these relationships slightly improves the simulations of water, energy, and carbon variables when compared to observations but degrades the simulation of PFT coexistence. Using ML-based surrogate models trained on Exp-CTR, we optimized the trait parameters in ELM-FATES and conducted another ensemble of experiments (Exp-ML) with these optimized parameters. The proportion of PFT coexistence experiments significantly increased from 21 % in Exp-CTR to 73 % in Exp-ML. After filtering the experiments that allow for PFT coexistence to agree with observations (within 15 % tolerance), 33 % of the Exp-ML experiments were retained, which is a significant improvement compared to the 1.4 % in Exp-CTR. Exp-ML also accurately reproduces the annual means and seasonal variations in water, energy, and carbon fluxes and the field inventory of aboveground biomass. This study represents a reproducible method that utilizes machine learning to identify parameter values that improve model fidelity against observations and PFT coexistence in vegetation demography models for diverse ecosystems. Our study also suggests the need for new mechanisms to enhance the robust simulation of coexisting plants in ELM-FATES and has significant implications for modeling the response and feedbacks of ecosystem dynamics to climate change.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Materials Informatics at NASA GRC: Machine Learning Surrogate Modeling, Data Management, and Integrated Toolsets for Establishing/Maintaining the Digital Thread

Integrated Computational Materials Engineering (ICME) has recently received widespread attention due to its promises in reducing dependence on physical testing for engineering design by relying on simulation, reducing both time and cost to market for various applications. ICME however requires validated multiscale material models, which heavily depend on available test data with full material and test pedigree, including material processing, test and measurement equipment, raw data collection, and analysis methodology and results that is findable and usable, along with integrated, efficient toolsets for effectively passing information across various length and time scales across such models. At the NASA Glenn Research Center under the Transformational Tools and Technologies Project, significant recent efforts have been directed towards establishing the required cyberinfrastructure to enable optimized ICME processes and the design of “fit-for-purpose” materials to achieve the goals outlined in the NASA Vision 2040 report. Such efforts include development of multiscale physics-based material models, which can be used to train highly efficient surrogate machine learning models, development of best practices and infrastructure for effective, traceable materials information management, and development of toolsets that integrate with physics-based codes, machine learning models, and an information management system to enable high throughput of materials data collection and analysis, establishment of digital twins and the digital thread, and automation of the ICME design process for material optimization.

Machine Learning↗
DOE OSTI2025

The Impact of Sound Ordinances on the Land-Based Wind Technical Potential of the United States

The rapid rise of sound ordinances has affected wind energy siting across state, county and local jurisdictions. Quantifying this impact on wind energy potential is required for effective energy planning. However, complex turbine sound modelling combined with evolving policies have contributed to limited understanding of these policies' impact on national wind technical potential. Here we develop an approach to evaluate wind turbine sound profiles across the United States and calculate setback distances from residential structures to translate sound-related policies into spatial turbine siting criteria. Compared to a baseline scenario that ignores sound, we find an 8% reduction in wind energy capacity when accounting for existing sound ordinances. Further, extrapolating a 45-A-weighted decibel (dBA) limit nationwide shows a 29% decline, disproportionately taken from high-quality and low-cost wind capacity. This reveals sound ordinances as a major factor in determining wind technical potential that could challenge US decarbonization goals reliant on wind energy.

17 WIND ENERGY↗
DOE OSTI2021

Manifold learning for coarse-graining atomistic simulations: Application to amorphous solids

In this work, we introduce a generalized machine learning framework to probabilistically parameterize upper-scale models in the form of nonlinear PDEs consistent with a continuum theory, based on coarse-grained atomistic simulation data of mechanical deformation and flow processes. The proposed framework utilizes a hypothesized coarse-graining methodology with manifold learning and surrogate-based optimization techniques. Coarse-grained high-dimensional data describing quantities of interest of the multiscale models are projected onto a nonlinear manifold whose geometric and topological structure is exploited for measuring behavioral discrepancies in the form of manifold distances. A surrogate model is constructed using Gaussian process regression to identify a mapping between stochastic parameters and distances. Derivative-free optimization is employed to adaptively identify a unique set of parameters of the upper-scale model capable of rapidly reproducing the system's behavior while maintaining consistency with coarse-grained atomic-level simulations. The proposed method is applied to learn the parameters of the shear transformation zone (STZ) theory of plasticity that describes plastic deformation in amorphous solids as well as coarse-graining parameters needed to translate between atomistic and continuum representations. We show that the methodology is able to successfully link coarse-grained microscale simulations to macroscale observables and achieve a high-level of parity between the models across scales.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Data-driven Mori–Zwanzig modeling of Lagrangian particle dynamics in turbulent flows

The dynamics of Lagrangian particles in turbulence play a crucial role in mixing, transport, and dispersion in complex flows. Their trajectories exhibit highly nontrivial statistical behavior, motivating the development of surrogate models that can reproduce these trajectories without incurring the high computational cost of direct numerical simulations of the full Eulerian field. This task is particularly challenging because reduced-order models typically lack access to the full set of interactions with the underlying turbulent field. Novel data-driven machine learning techniques can be powerful in capturing and reproducing complex statistics of the reduced-order/surrogate dynamics. In this work, we show how one can learn a surrogate dynamical system that is able to evolve a turbulent Lagrangian trajectory in a way that is point-wise accurate for short-time predictions (with respect to Kolmogorov time) and stable and statistically accurate at long times. This approach is based on the Mori–Zwanzig formalism, which prescribes a mathematical decomposition of the full dynamical system into resolved dynamics that depend on the current state and the past history of a reduced set of observables, and the unresolved orthogonal dynamics due to unresolved degrees of freedom of the initial state. We show how by training this reduced order model on a point-wise error metric on short time-prediction, we are able to correctly learn the dynamics of Lagrangian turbulence, such that also the long-time statistical behavior is stably recovered at test time. This opens up a range of applications, for example, for the control of active Lagrangian agents in turbulence.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Modelling of a Flow-Induced Oscillation, Two-Cylinder, Hydrokinetic Energy Converter Based on Experimental Data

The VIVACE Converter consists of cylindrical oscillators in tandem subjected to transverse flow-induced oscillations (FIOs) that can be improved by varying the system parameters for a given in-flow velocity: damping, stiffness, and in-flow center-to-center spacing. Compared to a single isolated cylinder, tandem cylinders can harness more hydrokinetic energy due to synergy in FIO. Experimental and numerical methods have been utilized to analyze the FIO and energy harnessing of VIVACE. A surrogate-based model of two tandem cylinders is developed to predict the power harvesting and corresponding efficiency by introducing a backpropagation neural network. It is then utilized to reduce excessive experimental or computational testing. The effects of spacing, damping, and stiffness on harvested power and efficiency of the established prediction-model are analyzed. At each selected flow velocity, optimization results of power harvesting using the prediction-model are calculated under different combinations of damping and stiffness. The main conclusions are: (1) The surrogate model, built on extensive experimental data for tandem cylinders, can predict the cylinder oscillatory response accurately. (2) Increasing the damping ratio range from 0–0.24 to 0–0.30 is beneficial for improving power efficiency, but has no significant effect on power harvesting. (3) In galloping, a spacing ratio of 1.57 has the highest optimal harnessed power and efficiency compared with other spacing values. (4) Two tandem cylinders can harness 2.01–4.67 times the optimal power of an isolated cylinder. In addition, the former can achieve 1.46–4.01 times the efficiency of the latter. (5) The surrogate model is an efficient predictive tool defining parameters of the Converter for improved energy acquisition.

backpropagation neural network↗
DOE OSTI2020

Dynamic PRA-Based Estimation of PWR Coping Time Using a Surrogate Model for Accident Tolerant Fuel

In this study, we propose an interpolation-based response surface surrogate methodology to manage a large number of scenarios in dynamic probabilistic risk assessment. It adopts the shape Dynamic Time Warping algorithm to cluster the interpolation neighborhood from time series sample data. The interpolation method was adapted from Taylor Kriging to allow a reduced-order model of the Taylor series. In order to demonstrate its applicability to complex issues in risk assessment for nuclear engineering, an example risk response surface to estimate emergency core cooling system (ECCS) criteria for triplex silicon carbide (SiC) accident-tolerant fuel was constructed. The response surface was exploited to estimate the cumulative failure probability of the fuel cladding structure due to the uncertainties in operator actions and safety systems. The functional failures were assessed based on a combination of individual layer failures computed by coupling Risk Analysis Virtual Environment software with a pressurized water reactor 1000-MW(electric) RELAP5 model and the in-house fuel performance assessment module. Results showed that SiC cladding failure probability spiked less than 1 min after a large-break loss-of- coolant accident whenever the current ECCS criteria for Zircaloy-4 (Zr-4) cladding was used. However, it still provides an increased safety margin of three orders of magnitude compared to Zr-4. This positive margin could be utilized to relax active ECCS requirements by allowing deviations of up to 450 s in its actuation time. The proposed surrogate methodology generated a response surface of SiC cladding failure probability reasonably well, with a significant savings of computation time. This methodology is expected to be useful in the analysis of system response with complex uncertainty sources.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

A Bayesian Approach for Estimating Uncertainty in Stochastic Economic Dispatch considering Wind Power Penetration

The increasing penetration of renewable energy resources in power systems, represented as random processes, converts the traditional deterministic economic dispatch problem into a stochastic one. To estimate the uncertainty in this stochastic economic dispatch problem for forecasting purposes, the conventional Monte-Carlo method is prohibitively time-consuming for practical applications. To overcome this problem, here we propose a novel Gaussian-process-emulator-based approach to quantify the uncertainty in the stochastic economic dispatch considering wind power penetration. Facing high-dimensional real-world data representing the correlated uncertainties from wind generation, a manifold-learning-based Isomap algorithm is proposed to efficiently represent the low-dimensional hidden probabilistic structure of the data. In this low-dimensional latent space, with Latin hypercube sampling as the computer experimental design, a Gaussian-process emulator is used, for the first time, to serve as a nonparametric, surrogate model for the original complicated stochastic economic dispatch model. This reduced-order representative allows us to evaluate the economic dispatch solver at sampled values with a negligible computational cost while maintaining a desirable accuracy. Simulation results conducted on the IEEE 118-bus test system reveal the impressive performance of the proposed method.

17 WIND ENERGY↗
DOE OSTI2020

Constrained Bayesian optimization of criticality experiments

The design of criticality experiments is typically an iterative process that employs a Monte Carlo transport code. The goal is to find a design that optimizes some variable, like the sensitivity of a response to a cross section, while simultaneously ensuring criticality. The high fidelity of the Monte Carlo code is a great asset, but it makes exploring the design space computationally expensive. Herein, we present how a constrained Bayesian optimization algorithm can be used to efficiently design a criticality experiment. It uses Gaussian processes as a surrogate model to probe the design space and to reduce the number of code executions that are needed to find the optimum. Furthermore, we demonstrate constrained Bayesian optimization with a Pu-239/polyethylene solution system and a TEX experiment that is designed for criticality safety validation of a nuclear waste model at the Hanford Site. For both systems, a global optimum was found within 75 Monte Carlo simulations.

42 ENGINEERING↗
DOE OSTI2024

Towards verifiable cancer digital twins: tissue level modeling protocol for precision medicine

Cancer exhibits substantial heterogeneity, manifesting as distinct morphological and molecular variations across tumors, which frequently undermines the efficacy of conventional oncological treatments. Developments in multiomics and sequencing technologies have paved the way for unraveling this heterogeneity. Nevertheless, the complexity of the data gathered from these methods cannot be fully interpreted through multimodal data analysis alone. Mathematical modeling plays a crucial role in delineating the underlying mechanisms to explain sources of heterogeneity using patient-specific data. Intra-tumoral diversity necessitates the development of precision oncology therapies utilizing multiphysics, multiscale mathematical models for cancer. This review discusses recent advancements in computational methodologies for precision oncology, highlighting the potential of cancer digital twins to enhance patient-specific decision-making in clinical settings. We review computational efforts in building patient-informed cellular and tissue-level models for cancer and propose a computational framework that utilizes agent-based modeling as an effective conduit to integrate cancer systems models that encode signaling at the cellular scale with digital twin models that predict tissue-level response in a tumor microenvironment customized to patient information. Furthermore, we discuss machine learning approaches to building surrogates for these complex mathematical models. These surrogates can potentially be used to conduct sensitivity analysis, verification, validation, and uncertainty quantification, which is especially important for tumor studies due to their dynamic nature.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2001

Consequences of contamination of the spacecraft environment: immunologic consequences

Long-term space voyages pose numerous known and unknown health hazards, to the human immune system. Well-studied clinical examples of secondary immunodeficiencies created on Earth, lead one to predict that the conditions of prolonged space flight would weaken the human immune responses that normally hold infection and cancer in check. From evidence gathered from humans flown for prolonged periods in space and from human models of space flight studied on Earth it is reasonable to suspect that space travelers to the planet Mars would experience a weakening of immunity. Subtle defects of immune cell structure and function have been observed in astronauts, such as weakening of specific T-lymphocyte recall of specific antigens. Ground-based models also have demonstrated alterations of immune function, such as the elevation of neuroendocrine immune system messengers, interleukin-6, and soluble tumor necrosis factor-alpha receptor in sleep deprivation. Since severe immune compromise the clinical consequences of reactivation of latent virus infections and the development of cancer, has yet to be seen in space flight or in the Earth models, it is extremely important to begin to quantify early changes in immunity to predict the development of immune system collapse with poor clinical outcomes. This approach is designed to validate a number of surrogate markers that will predict trouble ahead. Inherent in this research is the development of countermeasures to reduce the risks of infection and cancer in the first humans going to Mars.

Non-NASA Center↗
DOE OSTI2025

Data-Efficient Methods for Determining Flory–Huggins χ Parameters in Multicomponent Polymer Formulations

Polymer formulations are essential in diverse applications including personal care products, coatings, paints, adhesives, and plastic materials. Designing these formulations requires navigating large, complex design spaces, where phase and self-assembly behavior critically impact performance. The Flory–Huggins χ parameter, which quantifies segmental miscibility, is widely used to parametrize the excess free energy of mixing in formulation models. In this work, we introduce two data-efficient, top-down methods for estimating χ parameters using the Random Phase Approximation (RPA): (i) Boundary Nonlinear Regression (Boundary-NLR), which fits theoretical spinodal boundaries to experimental phase boundaries, and (ii) Surrogate Model Inverse Parameter Estimation (SMIPE), which uses a Gaussian Process Classifier to fit sparse phase maps via a surrogate model. Both methods allow rapid parametrization of polymer field-theoretic models without the need for additional experiments. We evaluate these approaches on data sets involving polymer–solvent–nonsolvent ternary mixtures and block copolymer–solvent systems, demonstrating their robustness to experimental noise and their relevance for real-world formulation design.

copolymers↗
DOE OSTI2024

Active learning of ternary alloy structures and energies

Abstract Machine learning models with uncertainty quantification have recently emerged as attractive tools to accelerate the navigation of catalyst design spaces in a data-efficient manner. Here, we combine active learning with a dropout graph convolutional network (dGCN) as a surrogate model to explore the complex materials space of high-entropy alloys (HEAs). We train the dGCN on the formation energies of disordered binary alloy structures in the Pd-Pt-Sn ternary alloy system and improve predictions on ternary structures by performing reduced optimization of the formation free energy, the target property that determines HEA stability, over ensembles of ternary structures constructed based on two coordinate systems: (a) a physics-informed ternary composition space, and (b) data-driven coordinates discovered by the Diffusion Maps manifold learning scheme. Both reduced optimization techniques improve predictions of the formation free energy in the ternary alloy space with a significantly reduced number of DFT calculations compared to a high-fidelity model. The physics-based scheme converges to the target property in a manner akin to a depth-first strategy, whereas the data-driven scheme appears more akin to a breadth-first approach. Both sampling schemes, coupled with our acquisition function, successfully exploit a database of DFT-calculated binary alloy structures and energies, augmented with a relatively small number of ternary alloy calculations, to identify stable ternary HEA compositions and structures. This generalized framework can be extended to incorporate more complex bulk and surface structural motifs, and the results demonstrate that significant dimensionality reduction is possible in thermodynamic sampling problems when suitable active learning schemes are employed.

Chemistry↗
NASA NTRS2019

Improving Accuracy of Structural Dynamic Modification with Augmented Residual Vectors

It is often important to perform sensitivity analysis to determine how a structural model will be impacted by design changes. Often, the structural analysts will manually make changes to the finite element model (FEM) to determine the effects. But when dealing with a large FEM with millions of degrees of freedom these manual changes can be cumbersome and calculation of the effects can computationally expensive. Therefore, it is desirable to determine the effects of model changes through approximation methods. One common technique is to determine the analytical sensitivity of the FEM model with respect to the given change. These analytical sensitivities are valid when small changes are made to the structural model, but invalid if large changes need to be assessed. Another approach is to use Structural Dynamic Modification (SDM) to create a surrogate model to analyze model changes. SDM is a widely-used sensitivity method and is used in applications of model updating, uncertainty quantification, and model design studies. SMD is valid for moderate (10-20 percent) changes in the structural model, but model approximations are often needed for large parameter changes (greater than 20 percent). Structural Dynamic Modification can be improved by using residual vectors to augment the surrogate model formulation from SDM. Adding the residual modes increases the fidelity of the surrogate model while keeping the computational cost low. This paper discusses the application and limitations of the augmented residual modes method to two structures: the Integrated Spacecraft and Payload Element (ISPE) of the Space Launch System (SLS) and the full SLS as it is configured during its Integrated Modal Test (IMT).

Stewart, Eric C.↗
DOE OSTI2022

Corrosion of U233-Doped Uranium Oxide using Microfluidics Methods

The aim of work this year has been to investigate the role of alpha (α)-radiation and hydrogen (H 2 ) on the corrosion of uranium oxide (UO 2 ) using a microfluidic device. The microfluidic device, termed the Particle-Attached Microfluidic Electrochemical Cell, (PAMEC), enables monitoring of the UO 2 electrochemical corrosion potential (E corr ) under different environments, including de-aerated conditions and in the presence of dissolved H 2 . The Si 3 N 4 window allows us to study morphological and chemical changes under an electron microscope. We have previously demonstrated that the PAMEC matches the results from bulk electrochemical tests with UO 2 [1]. We used the high specific activity uranium (U) isotope, 233 U, (t 1/2 = 160,000 years) incorporated into UO 2 , to generate a localized a-field. The objective of the experiments were to mimic the radiation environment that would be experience at the surface of aged spent nuclear fuel (SNF) during long-term geologic disposal under anoxic conditions. Wittman et al. [2] predicted that in the presence of a pure a-radiation field and under H 2 conditions, the concentration of the radiolytic oxidant H 2 O 2 would be suppressed or even eliminated. In a UO 2 corrosion experiment this would be exhibited through a lowering of the measured UO 2 corrosion potential compared to identical conditions in the absence of dissolved H 2 . We found that the predictions of Wittman and co-workers were supported and that the corrosion potential of the 233 U-doped UO 2 in solution lowered with presence of H 2 gas and increased in the absence of H 2 , when under anoxic conditions. The PAMEC experiments indicate that H 2 O 2 has been eliminated in a solution sparged with H 2 while exposed to an a-radiation field. The corrosion potential of the a-doped 233 U(10%)- 238 UO 2 in a solution sparged with Ar/H 2 matched the corrosion potential of 238 UO 2 in solution sparged with air. This clearly demonstrated that the H 2 O 2 had been eliminated and that the only oxidant present was O 2 in this system in complete agreement with the modeling results of Wittman et al. These results point to the need to improve the Fuel Matrix Degradation (FMD) Process Model training data set that is being used in the FMD surrogate model that is being developed for the repository program. The incorporation of realistic radiation chemistry will improve the scientific basis for the FMD Model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗