Mixed-integer Programming Representations of Linear Model Decision Tree Surrogates
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Here, we introduce a hybrid computational framework that merges HPC-based numerical solvers with physics-informed ML surrogates for efficient modeling of magnon-photon interactions. By running short-duration, high-fidelity Maxwell-LLG simulations and feeding their results into an ML model, we substantially cut simulation time while achieving accurate predictions across larger spatiotemporal domains.
A coupled thermal-hydrologic-airflow model is developed, solving for the transport processes within a waste emplacement drift and the surrounding rockmass together at the proposed nuclear waste repository at Yucca Mountain. Natural, convective air flow as well as heat and mass transport in a representative emplacement drift during post-closure are explicitly simulated, using the MULTIFLUX model. The conjugate, thermal-hydrologic transport processes in the rockmass are solved with the TOUGH2 porous-media simulator in a coupled way to the in-drift processes. The new simulation results show that large-eddy turbulent flow, as opposed to small-eddy flow, dominate the drift air space for at least 5000 years following waste emplacement. The size of the largest, longitudinal eddy is equal to half of the drift length, providing a strong axial heat and moisture transport mechanism from the hot to the cold drift sections. The in-drift results are compared to those from simplified models using a surrogate, dispersive model with an equivalent dispersion coefficient for heat and moisture transport. Results from the explicit, convective velocity simulation model provide higher axial heat and moisture fluxes than those estimated from the previously published, simpler, equivalent-dispersion models, in addition to showing differences in temperature, humidity and condensation rate distributions along the drift length. A new dispersive model is also formulated, giving a time- and location-variable function that runs generally about ten times higher in value than the highest dispersion coefficient currently used in the Yucca Mountain Project as an estimate for the equivalent dispersion coefficient in the emplacement drift. The new dispersion coefficient variation, back-calculated from the convective model, can adequately describe the heat and mass transport processes in the emplacement drift example.
Crystal plasticity finite element method (CPFEM) models are widely used to simulate the deformation behaviour of polycrystalline materials, but their calibration is often limited by their high computational cost and the non-convexity of the optimisation landscape. Here, this study develops a multi-objective surrogate-assisted calibration workflow that couples a multi-objective genetic algorithm (MOGA) with an adaptively trained deep neural network (DNN) surrogate model to efficiently identify CPFEM parameters from experimental data. The workflow is demonstrated on three crystal plasticity (CP) formulations of increasing complexity — Voce hardening (VH), two-coefficient latent hardening (LH2), and six-coefficient latent hardening (LH6) — using in situ electron backscatter diffraction (EBSD) measurements of Alloy 617 under uniaxial tensile loading. The CPFEM models are calibrated against the experimentally observed stress–strain response and reorientation trajectories of eight grains, then validated against eight additional trajectories and overall texture evolution. Across the CP formulations, the macroscopic response was reproduced reliably, while differences emerged in the robustness and accuracy of the grain-scale predictions. Including grain reorientation trajectories in the multi-objective calibration improved texture evolution predictions and filtered out physically inconsistent parameter sets that can arise from calibrating against only the stress–strain data. The workflow also demonstrates good transferability of calibrated parameters from a low- to a high-fidelity microstructural model. These results provide practical guidance for integrating in situ microstructural data into CPFEM through efficient, repeatable, and physically meaningful multi-objective calibration.
To plan and optimize energy storage demands that account for Li-ion battery aging dynamics, techniques need to be developed to diagnose battery internal states accurately and rapidly. Here, this study seeks to reduce the computational resources needed to determine a battery's internal states by replacing physics-based Li-ion battery models - such as the single-particle model (SPM) and the pseudo-2D (P2D) model - with a physics-informed neural network (PINN) surrogate. The surrogate model makes high-throughput techniques, such as Bayesian calibration, tractable to determine battery internal parameters from voltage responses. This manuscript is the first of a two-part series that introduces PINN surrogates of Li-ion battery models for parameter inference (i.e., state-of-health diagnostics). In this first part, a method is presented for constructing a PINN surrogate of the SPM. A multi-fidelity hierarchical training, where several neural nets are trained with multiple physics-loss fidelities is shown to significantly improve the surrogate accuracy when only training on the governing equation residuals. The implementation is made available in a companion repository (https://github.com/NREL/PINNSTRIPES). The techniques used to develop a PINN surrogate of the SPM are extended in Part II for the PINN surrogate for the P2D battery model, and explore the Bayesian calibration capabilities of both surrogates.
Contamination of a model drinking water system with surrogate radioisotopes was examined with respect to persistence on and decontamination of infrastructure surfaces. Cesium and cobalt chloride salts were used as surrogates for cesium-137 and cobalt-60. Studies were conducted in biofilm annular reactors containing heavily corroded iron surfaces formed under shear and constantly submerged in drinking water. Cesium was not detected on the corroded iron surface after equilibration with 10 and 100 mg L{sup -1} solutions of cesium chloride, but cobalt was detected on corroded iron coupons at both initial concentrations. The amount of adhered cobalt decreased over the next six weeks, but was still present when monitoring stopped. X-ray absorption near-edge spectroscopy (XANES) showed that adhered cobalt was in the III oxidation state. The adsorbed cobalt was strongly resistant to decontamination by various physicochemical methods. Simulated flushing, use of free chlorine and dilute ammonia were found to be ineffective whereas use of aggressive methods like 14.5 M ammonia and 0.36 M sulfuric acid removed 37 and 92% of the sorbed cobalt, respectively.
Many advanced nuclear reactor concepts currently being developed are targeting higher operating temperatures relative to the current fleet of light water nuclear reactors, for efficiency gains and other operational considerations. The design of high temperature structural components with reliable long-term operational performance will depend on material models that accurately capture the inelastic deformation mechanisms active in these environments. In this work, we perform a detailed parameter sensitivity analysis of two unified elasto-viscoplastic Grade 91 material models capable of capturing long term high temperature creep deformation. The first model is a phenomelogical material model from the Nuclear Engineering Material Library (NEML) developed at Argonne National Lab. The NEML model parameters and their uncertainty were fit to a range of Grade 91 experimental data using Bayesian Markov Chain Monte Carlo analysis. The second model is a LAROMance data-driven surrogate material model developed at Los Alamos National Lab. The LAROMance model is fit to a large database of responses produced by a mechanistic crystal plasticity based polycrystal model. Parameters for the LAROMance surrogate material model reflect the pedigree of the Grade 91 microstructure. Both material models have been integrated into the Grizzly code, based on the open-source MOOSE multiphysics simulation framework, to simulate both the progression of aging mechanisms and the effects of that aging on nuclear power plant structures. Grizzly is used analyze a three-dimensional Grade 91 piping system to compare the long-term inelastic response predicted by these two fundamentally different models and assess the sensitivity of the material model input parameters on this quantity of interest.
In this paper and its companion, Differential Equation Approximation Using Gradient-Boosted Quantile Regression, Robison et al., we examine an approach to quantifying model uncertainty with the aim of increasing the trustworthiness of computational models in human-machine interactions. In Differential Equation Approximation Using Gradient-Boosted Quantile Regression, we focus on gradient-boosted decision trees, while in this one, we give more details about deep ensembles. Uncertainty quantification is crucial for building trustworthy autonomous decision-making agents in human-machine teams. There are two types of uncertainties: aleatoric and epistemic. The former is related to the inherent stochasticity (noise) of the process, whereas the latter is associated with the lack of knowledge or representation capability of models, such as neural networks. By lack of knowledge, we mean the model’s inability to accurately predict outputs for all possible inputs. The aleatory uncertainty can be estimated fairly easily with, for example, filters, whereas epistemic uncertainty is challenging to compute. This paper uses deep ensembles to quantify both aleatory and epistemic uncertainty. It can act as an uncertainty-aware surrogate transition model for decision-making frameworks. "Uncertainty-aware" means that the surrogate transition model should make predictions along with confidence in those predictions. In the context of decision-making, the transition models are ordinary differential equations (ODEs). Since ODEs can be simulated to make one-step or multi-step predictions, a good surrogate model for them should perform reasonably well in both modes. In a multi-step approach, the trajectory sampling method TS∞ was used to propagate uncertainty over multiple steps. The cartpole dynamical system was selected to demonstrate the ability of deep ensembles as good surrogate transition models for decision-making frameworks. The deep ensembles modeled the dynamics of cartpole ODEs and made uncertainty-aware predictions in single-step and multi-step transition modes.
The finite element method can be used to compute accurate stress intensity factors (SIFs) for cracks with complex geometries and boundary conditions. In contrast, handbook solutions act as surrogate SIF models that provide significantly faster evaluation times. However, the development of conventional surrogate SIF models relies on manual development based on low-order parameterizations. This limits surrogate model accuracy and generalizability. Here, in this paper, we develop a framework for the automated development of mechanics-guided handbook SIF solutions by using interpretable machine learning via genetic programming for symbolic regression (GPSR). Formalizing the mechanics-based approach of Raju and Newman, SIF training data is decomposed into multiple subsets. This decomposition enables parallel GPSR model development of subfunctions, each of which accounts for specific geometrical corrections with respect to a known analytical model. Using this mechanics-based approach with GPSR allows for equations to be learned with improved accuracy and reduced complexity relative to the Raju Newman equations while maintaining the inherent interpretability of mathematical expressions. In this paper, we present equations that match the complexity of the Raju Newman equations while having reduced error, as well as equations with similar errors and reduced complexity.
Abstract Switchgrass ( Panicum virgatum ) intercropping is a novel forest management practice for biomass production intended to generate cellulosic feedstocks within intensively managed loblolly pine‐dominated landscapes. These pine plantations are important for early‐successional bird species, as short rotation times continually maintain early‐successional habitat. We tested the efficacy of using community models compared to individual surrogate species models in understanding influences on nest survival. We analysed nest data to test for differences in habitat use for 14 bird species in plots managed for switchgrass intercropping and controls within loblolly pine ( Pinus taeda ) plantations in Mississippi, USA. We adapted hierarchical models using hyper‐parameters to incorporate information from both common and rare species to understand community‐level nest survival. This approach incorporates rare species that are often discarded due to low sample sizes, but can inform community‐level demographic parameter estimates. We illustrate use of this approach in generating both species‐level and community‐wide estimates of daily survival rates for songbird nests. We were able to include rare species with low sample size (minimum n = 5) to inform a hyper‐prior, allowing us to estimate effects of covariates on daily survival at the community level, then compare this with a single‐species approach using surrogate species. Using single‐species models, we were unable to generate estimates below a sample size of 21 nests per species. Community model species‐level survival and parameter estimates were similar to those generated by five single‐species models, with improved precision in community model parameters. Covariates of nest placement indicated that switchgrass at the nest site (<4 m) reduced daily nest survival, although intercropping at the forest stand level increased daily nest survival. Synthesis and applications . Community models represent a viable method for estimating community nest survival rates and effects of covariates while incorporating limited data for rarely detected species. Intercropping switchgrass in loblolly pine plantations slightly increased daily nest survival at the research plot scale (0.1 km 2 ), although at a local scale (50 m 2 ) switchgrass negatively influenced nest survival. A likely explanation is intercropping shifted community composition, favouring species with greater disturbance tolerance.
Not Available
Here, predictions of the mechanical response of structural elements are conditioned by the accuracy of constitutive models used at the engineering length-scale. In this regard, a prospect of mechanistic crystal-plasticity-based constitutive models is that they could be used for extrapolation beyond regimes in which they are calibrated. However, their use for assessing the performance of a component is computationally onerous. To address this limitation, a new approach is proposed whereby a surrogate constitutive model (SM) of the inelastic response of 316H steel is derived from a mechanistic crystal plasticity-based polycrystal model tracking the evolution of dislocation densities on all slip systems. The latter is used to generate a database of the expected plastic response and dislocation content evolution associated with several instances of creep loading. From the database, a SM is developed. It relies on the use of orthogonal polynomial regression to describe the evolution of the dislocation content. The SM is then validated against predictions of the dead load creep response given by the polycrystal model across a range of temperatures and stresses. When the SM is used to predict the response of 316H during complex non monotonic loading, extrapolating to new loading conditions, it is found that predictions compare particularly well against those from the physics-based polycrystal model.
Making reliable predictions in the presence of uncertainty is critical to high-consequence modeling and simulation activities, such as those encountered at Sandia National Laboratories. Surrogate or reduced-order models are often used to mitigate the expense of performing quality uncertainty analyses with high-fidelity, physics-based codes. However, phenomenological surrogate models do not always adhere to important physics and system properties. This project develops surrogate models that integrate physical theory with experimental data through a maximally-informative framework that accounts for the many uncertainties present in computational modeling problems. Correlations between relevant outputs are preserved through the use of multi-output or co-predictive surrogate models; known physical properties (specifically monotoncity) are also preserved; and unknown physics and phenomena are detected using a causal analysis. By endowing surrogate models with key properties of the physical system being studied, their predictive power is arguably enhanced, allowing for reliable simulations and analyses at a reduced computational cost.
Integrating genome-scale metabolic networks with reactive transport models (RTMs) provides a detailed description of the dynamic changes in microbial growth and metabolism. Despite promising demonstrations in the past, computational inefficiency has been pointed out as a critical issue to overcome because it requires repeated application of linear programming (LP) to obtain flux balance analysis (FBA) solutions in every time step and spatial grid. To address this challenge, we propose a new simulation method where we train and validate artificial neural networks (ANNs) using randomly sampled FBA solutions and incorporate the resulting surrogate FBA model (represented as algebraic equations) into RTMs as source/sink terms. We demonstrate the efficiency of our method via a case study of Shewanella oneidensis MR-1. During aerobic growth on lactate, S. oneidensis produces metabolic byproducts (such as pyruvate and acetate), which are subsequently consumed as alternative carbon sources when the preferred nutrients are depleted. To effectively simulate these complex dynamics, we used a cybernetic approach that models metabolic switches as the outcome of dynamic competition among multiple growth options. In both zero-dimensional batch and one-dimensional column configurations, the ANN-based surrogate models achieved substantial reduction of computational time by several orders of magnitude compared to the original LP-based FBA models. Moreover, the ANN models produced robust solutions without any special measures to prevent numerical instability. These developments significantly promote our ability to utilize genome-scale networks in complex, multi-physics, and multi-dimensional ecosystem modeling.
This work presents a detailed case study on using Generative AI (GenAI) to develop AI surrogates for simulation models in fusion energy research. The scope includes the methodology, implementation, and results of using GenAI to assist in model development and optimization, comparing these results with previous manually developed models.
Purpose: To develop a tumor tracking method based on a surrogate-driven motion model, which provides noninvasive dynamic localization of extracranial targets for the compensation of respiration-induced intrafraction motion in high-precision radiation therapy. Methods and Materials: The proposed approach is based on a patient-specific breathing motion model, derived a priori from 4-dimensional planning computed tomography (CT) images. Model parameters (respiratory baseline, amplitude, and phase) are retrieved and updated at each treatment fraction according to in-room radiography acquisition and optical surface imaging. The baseline parameter is adapted to the interfraction variations obtained from the daily cone beam (CB) CT scan. The respiratory amplitude and phase are extracted from an external breathing surrogate, estimated from the displacement of the patient thoracoabdominal surface, acquired with a noninvasive surface imaging device. The developed method was tested on a database of 7 lung cancer patients, including the synchronized information on internal and external respiratory motion during a CBCT scan. Results: About 30 seconds of simultaneous acquisition of CBCT and optical surface images were analyzed for each patient. The tumor trajectories identified in CBCT projections were used as reference and compared with the target trajectories estimated from surface displacement with the a priori motion model. The resulting absolute differences between the reference and estimated tumor motion along the 2 image dimensions ranged between 0.7 and 2.4 mm; the measured phase shifts did not exceed 7% of the breathing cycle length. Conclusions: We investigated a tumor tracking method that integrates breathing motion information provided by the 4-dimensional planning CT with surface imaging at the time of treatment, representing an alternative approach to point-based external–internal correlation models. Although an in-room radiograph-based assessment of the reliability of the motion model is envisaged, the developed technique does not involve the estimation and continuous update of correlation parameters, thus requiring a less intense use of invasive imaging.