Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Mixed-Integer Linear Programming Formulation with Embedded Machine Learning Surrogates for the Design of Chemical Process Families

In previous work, we introduced process family design. The main idea is to design a platform of common elements, and, allowing us to capture additional cost savings, simultaneously design a family of processes, and reducing both engineering and deployment timelines. We formulate this as an optimization problem, specifically a nonlinear generalized disjunctive program (GDP). We have proposed two approaches for reformulating and solving this problem: one based on full-discretization of the design space and one that uses Machine Learning (ML) surrogates to replace the nonlinear process models. Using ML surrogates to predict required system costs and performance indicators allows us to reformulate the nonlinearities in the GDP generate an efficient MILP formulation. In this work, we apply the ML surrogate approach to two case studies. One case study involves designing a family of carbon capture systems to cover a set of different flue gas flow rates and inlet CO 2 concentrations, where we consider the absorber and stripper as common unit module types. The second case study focuses on a water-desalination process, where we design a family of these processes for a variety of salt concentrations and flow rates. In both of these case studies, we demonstrate a scalable optimization approach that enables the design of multiple processes simultaneously, reducing the time-to-market and overall costs by maximizing the cost savings due to both economies of scale and economies of numbers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Autocalibration of the E3SM Version 2 Atmosphere Model Using a PCA-Based Surrogate for Spatial Fields

Global Climate Model tuning (calibration) is a tedious and time-consuming process, with high-dimensional input and output fields. Experts typically tune by iteratively running climate simulations with hand-picked values of tuning parameters. Many, in both the statistical and climate literature, have proposed alternative calibration methods, but most are impractical or difficult to implement. We present a practical, robust, and rigorous calibration approach on the atmosphere-only model of the Department of Energy's Energy Exascale Earth System Model (E3SM) version 2. Our approach can be summarized into two main parts: (a) the training of a surrogate that predicts E3SM output in a fraction of the time compared to running E3SM, and (b) gradient-based parameter optimization. To train the surrogate, we generate a set of designed ensemble runs that span our input parameter space and use polynomial chaos expansions on a reduced output space to fit the E3SM output. We use this surrogate in an optimization scheme to identify values of the input parameters for which our model best matches gridded spatial fields of climate observations. To validate our choice of parameters, we run E3SMv2 with the optimal parameter values and compare prediction results to expertly-tuned simulations across 45 different output fields. This flexible, robust, and automated approach is straightforward to implement, and we demonstrate that the resulting model output matches present day climate observations as well or better than the corresponding output from expert tuned parameter values, while considering high-dimensional output and operating in a fraction of the time.

54 ENVIRONMENTAL SCIENCES↗

Accelerating phase-field-based microstructure evolution predictions via surrogate models trained by machine learning methods

Abstract The phase-field method is a powerful and versatile computational approach for modeling the evolution of microstructures and associated properties for a wide variety of physical, chemical, and biological systems. However, existing high-fidelity phase-field models are inherently computationally expensive, requiring high-performance computing resources and sophisticated numerical integration schemes to achieve a useful degree of accuracy. In this paper, we present a computationally inexpensive, accurate, data-driven surrogate model that directly learns the microstructural evolution of targeted systems by combining phase-field and history-dependent machine-learning techniques. We integrate a statistically representative, low-dimensional description of the microstructure, obtained directly from phase-field simulations, with either a time-series multivariate adaptive regression splines autoregressive algorithm or a long short-term memory neural network. The neural-network-trained surrogate model shows the best performance and accurately predicts the nonlinear microstructure evolution of a two-phase mixture during spinodal decomposition in seconds, without the need for “on-the-fly” solutions of the phase-field equations of motion. We also show that the predictions from our machine-learned surrogate model can be fed directly as an input into a classical high-fidelity phase-field model in order to accelerate the high-fidelity phase-field simulations by leaping in time. Such machine-learned phase-field framework opens a promising path forward to use accelerated phase-field simulations for discovering, understanding, and predicting processing–microstructure–performance relationships.

36 MATERIALS SCIENCE↗

Prediction of grain structure after thermomechanical processing of U-10Mo alloy using sensitivity analysis and machine learning surrogate model

Abstract Hot rolling and annealing are critical intermediate steps for controlling microstructures and thickness variations when fabricating uranium alloyed with 10% molybdenum (U-10Mo), which is highly relevant to worldwide nuclear non-proliferation efforts. This work proposes a machine-learning surrogate model combined with sensitivity analysis to identify and predict U-10Mo microstructure development during thermomechanical processing. Over 200 simulations were collected using physics-based microstructure models covering a wide range of thermomechanical processing routes and initial alloy grain features. Based on the sensitivity analysis, we determined that an increase in rolling reduction percentage at each processing pass has the strongest effect in reducing the grain size. Multi-pass rolling and annealing can significantly improve recrystallization regardless of the reduction percentage. With a volume fraction below 2%, uranium carbide particles were found to have marginal effects on the average grain size and distribution. The proposed stratified stacking ensemble surrogate predicts the U-10Mo grain size with a mean square error four times smaller than a standard single deep neural network. At the same time, with a significant speedup (1000×) compared to the physics-based model, the machine learning surrogate shows good potential for U-10Mo fabrication process optimization.

36 MATERIALS SCIENCE↗

Machine learning surrogates for surface complexation model of uranium sorption to oxides

Abstract The safety assessments of the geological storage of spent nuclear fuel require understanding the underground radionuclide mobility in case of a leakage from multi-barrier canisters. Uranium, the most common radionuclide in non-reprocessed spent nuclear fuels, is immobile in reduced form (U(IV) and highly mobile in an oxidized state (U(VI)). The latter form is considered one of the most dangerous environmental threats in the safety assessments of spent nuclear fuel repositories. The sorption of uranium to mineral surfaces surrounding the repository limits their mobility. We quantify uranium sorption using surface complexation models (SCMs). Unfortunately, numerical SCM solvers often encounter convergence problems due to the complex nature of convoluted equations and correlations between model parameters. This study explored two machine learning surrogates for the 2-pK Triple Layer Model of uranium retention by oxide surfaces if released as U(IV) in the oxidizing conditions: random forest regressor and deep neural networks. Our surrogate models, particularly DNN, accurately reproduce SCM model predictions at a fraction of the computational cost without any convergence issues. The safety assessment of spent fuel repositories, specifically the migration of leaked radioactive waste, will benefit from having ultrafast AI/ML surrogates for the computationally expensive sorption models that can be easily incorporated into larger-scale contaminant migration models. One such model is presented here.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Single-site Lennard-Jones models via polynomial chaos surrogates of Monte Carlo molecular simulation

In this work, two Polynomial Chaos (PC) surrogates were generated to reproduce Monte Carlo (MC) molecular simulation results of the canonical (single-phase) and the NVT-Gibbs (two-phase) ensembles for a system of normalized structureless Lennard-Jones (LJ) particles. The main advantage of such surrogates, once generated, is the capability of accurately computing the needed thermodynamic quantities in a few seconds, thus efficiently replacing the computationally expensive MC molecular simulations. Benefiting from the tremendous computational time reduction, the PC surrogates were used to conduct large-scale optimization in order to propose single-site LJ models for several simple molecules. Experimental data, a set of supercritical isotherms, and part of the two-phase envelope, of several pure components were used for tuning the LJ parameters (ε, σ). Based on the conducted optimization, excellent fit was obtained for different noble gases (Ar, Kr, and Xe) and other small molecules (CH{sub 4}, N{sub 2}, and CO). On the other hand, due to the simplicity of the LJ model used, dramatic deviations between simulation and experimental data were observed, especially in the two-phase region, for more complex molecules such as CO{sub 2} and C{sub 2} H{sub 6}.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Gaussian process based surrogate approach for the optimization of cylindrical targets

Simulating direct-drive inertial confinement experiments presents significant computational challenges, both due to the complexity of the codes required for such simulations and the substantial computational expense associated with target design studies. Machine learning models, and in particular, surrogate models, offer a solution by replacing simulation results with a simplified approximation. In this study, we apply surrogate modeling and optimization techniques that are well established in the existing literature to one-dimensional simulation data of a new cylindrical target design containing deuterium–tritium fuel. These models predict yields without the need for expensive simulations. We find that Bayesian optimization with Gaussian process surrogates enhances sampling efficiency in low-dimensional design spaces but becomes less efficient as dimensionality increases. Nonetheless, optimization routines within two-dimensional and five-dimensional design spaces can identify designs that maximize yield, while also aligning with established physical intuition. Optimization routines, which ignore constraints on hydrodynamic instability growth, are shown to lead to unstable designs in 2D, resulting in yield loss. However, routines that utilize 1D simulations and impose constraints on the in-flight aspect ratio converge on novel cylindrical target designs that are stable against hydrodynamic instability growth in 2D and achieve high yield.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Surrogate-constructed scalable-circuits adaptive variational quantum eigensolver in the Schwinger model

Inspired by recent advancements in simulating periodic systems on quantum computers, we develop an approach to further advance the simulation of these systems, named (SC) 2 -ADAPT-VQE. Our approach extends the scalable-circuits ADAPT-VQE framework, which builds an ansatz from a pool of coordinate-invariant operators defined for arbitrarily large, though not arbitrarily small, volumes. Our method uses a classically tractable “surrogate constructed” method to remove irrelevant operators from the pool, reducing the minimum size for which the scalable circuits are defined. Bringing together the scalable circuits and the surrogate constructed approaches forms the core of the (SC) 2 methodology. Our approach allows for a wider set of classical computations on small volumes, which can be used for a more robust extrapolation protocol. While developed in the context of lattice models, the surrogate construction portion is applicable to a wide variety of problems where information about the relative importance of operators in the pool is available. As an example, we use it to compute the properties of the Schwinger model—quantum electrodynamics for a single, massive fermion in 1 +1 dimensions—and show that our method can be used to accurately extrapolate to the continuum limit.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Spin differences in the Zr 90 compound nucleus induced by ( p , p ' ) , ( p , d ) , and ( p , t ) surrogate reactions

Here, the effect of the production mechanism on the decay of a compound nucleus is investigated. The nucleus 90 Zr was produced by three different reactions, namely 90 Zr (p,p') 90 Zr, 91 Zr (p,d) 90 Zr, and 92 Zr (p,t) 90 Zr , which served as surrogate reactions for 89 Zr (n,γ). The spin-parity (J π ) distributions of the states populated by these reactions were studied to investigate the surrogate reaction approach, which aims at indirectly determining cross sections for compound-nuclear reactions involving unstable targets such as 89 Zr. Discrete γ rays, associated with transitions in 90 Zr and 89 Zr, were measured in coincidence with light ions for scattering angles of 25°–60° and 90 Zr excitation energies extending above the neutron separation energy. The measured transition systematics were used to gain insights into the J π distributions of 90 Zr. The 90 Zr (p,p') reaction was found to produce fewer γ rays associated with transitions involving high spin states (J = 6–8 ℏ) than the other two reactions, suggesting that inelastic scattering preferentially populates states in 90 Zr that have lower spins than those populated in the transfer reactions investigated. The γ-ray production was also observed to vary by factors of 2–3 with the angle at which the outgoing particle was detected. These findings are relevant to the application of the surrogate reaction approach.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

First Measurement of the Neutron-Emission Probability with a Surrogate Reaction in Inverse Kinematics at a Heavy-Ion Storage Ring

Neutron-induced reaction cross sections of short-lived nuclei are imperative to understand the origin of heavy elements in stellar nucleosynthesis and for societal applications, but their measurement is extremely complicated due to the radioactivity of the targets involved. One way of overcoming this issue is to combine surrogate reactions with the unique possibilities offered by heavy-ion storage rings. In this work, we describe the first surrogate-reaction experiment in inverse kinematics, which we successfully conducted at the Experimental Storage Ring (ESR) of the GSI/FAIR facility, using the 208 Pb⁢(p,p') reaction as a surrogate for neutron capture on 207 Pb. Thanks to the outstanding detection efficiencies possible at the ESR, we were able to measure for the first time the neutron-emission probability as a function of the excitation energy of 208 Pb. We have used this probability to select different descriptions of the γ -ray strength function and nuclear level density, and provide reliable results for the neutron-induced radiative capture cross section of 207 Pb at energies for which no experimental data exist.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Accelerating Traction Motor Optimization Design with AI Surrogate Models

The advancement of artificial intelligence systems enables the use of data-driven physics-based surrogate models to explore design spaces rapidly and deeply for engineering projects. This work presents a surrogate model workflow that accelerates electric traction motor design optimization by replacing finite element analysis (FEA) with an artificial neural network (ANN) and using this model in a genetic algorithm for design optimization. A baseline interior permanent-magnet motor is parameterized and sampled to generate FEA-labeled training data, after which a feed-forward ANN predicts key outputs (e.g., loss components and weight). The validated surrogate enables genetic-algorithm optimization and deep search over the design space without new FEA runs, producing Pareto-optimal trade-offs between weight and losses and set of optimized designs for rapid downselection of manufacturable motor designs.

Ribeiro, Pedro [ORNL] (ORCID:0009000921026641)↗

Navigating Uncertainty: Challenges in Visualizing Ensemble Data and Surrogate Models for Decision Systems

Uncertainty visualization plays a critical role in transforming ensemble simulation data into actionable insights by effectively communicating various dimensions of uncertainty within a system. The emergence of artificial intelligence-driven surrogate models trained on multirun ensemble data offers a transformative opportunity to replace computationally intensive simulations with fast estimates, enabling users to explore data spaces with unprecedented depth and interactivity. However, integrating ensemble data and surrogate models into decision-making workflows and tools introduces novel challenges for uncertainty visualization. These include reconciling and clearly communicating the unique uncertainties associated with ensembles and their surrogate model estimates, and leveraging these approximations to inform actionable decisions. This work explores these challenges in the context of high-dimensional data visualization, bridging discrete datasets with their continuous representations and addressing the complexities of systems that support iterative navigation between input and output spaces. We evaluate the role of uncertainty visualization in fostering intuitive, actionable interactions and identify critical hurdles in advancing this frontier of computational simulation.

97 MATHEMATICS AND COMPUTING↗

Active Learning Surrogates for Integrating Electron Microscopy and Computational Insights from Simulations in Autonomous Experiments

Artificial Intelligence (AI) combined with simulations and experiments has great potential to accelerate scientific discovery across technology and pharmaceuticals. However, the gap between simulations and experiments is challenging due to disparities in time and scale, making it difficult to estimate properties like energy and electronic states from experiments, and to provide feedback based on theoretical insights.Our research addresses the challenge by developing unique deep kernel based surrogate models that learns from microscopic images, mapping structural features to energy differences from defect formation. We start with full-training using simulated images to determine optimal settings, establishing a baseline for active learning. Using these settings from the baseline, active learning is trained, and predicts structures along simulation trajectories based on uncertainty and energetic stability, thus reducing data requirements, simulation time and computational costs. The results demonstrate that the model achieves a low average error margin of approximately 0.03 meV, indicating good performance. To enhance feature extraction and reconstruction capabilities, we developed an autoencoder-decoder as additional surrogate to create latent space to capture essential features, enabling precise comparisons between simulations and experiments. The results from this model achieved a reconstruction loss of around 0.2 and accurately reconstructed molecular structures.Overall, this work advances the steering of experiments through computational simulations by employing a surrogate models that actively predicts the trajectories of structural evolution, achieving time-to-solution comparable to experimental measurements.

Saranathan, Gayathri [Hewlett-Packard]↗

Surrogate Model for Distribution Networks Influenced by Weather

Here, we propose a method for generating reduced representations of time series and for constructing low dimensional surrogate models for time dependent calculations of power and voltage in distribution networks. We employ Fourier polynomials. The surrogate model strategy is aimed at reducing the computational cost of time dependent simulations, albeit, at the expense of fidelity. The reduced representation is achieved by identifying a small and most consequential subset of degrees of freedom. In power and voltage distribution networks dynamics that are heavily influenced by strong cyclic weather events, e.g., the hourly, diurnal and seasonal cycles, the weather/climate time series spectrum exposes these most energetic components. Once the degrees of freedom are identified their amplitudes are optimized using training data. The key challenge in using spectral methods in power network surrogates is addressing the computation of quotients. For this we propose a numerically-stable deconvolution strategy.

Weather events↗

SU-E-J-73: Generation of Volumetric Images with a Respiratory Motion Model Based On An External Surrogate Signal

Purpose: Respiratory motion during radiotherapy treatment can differ significantly from motion observed during imaging for treatment planning. Our goal is to use an initial 4DCT scan and the trace of an external surrogate marker to generate 3D images of patient anatomy during treatment. Methods: Deformable image registration is performed on images from an initial 4DCT scan. The deformation vectors are used to develop a patient-specific linear relationship between the motion of each voxel and the trajectory of an external surrogate signal. Correlations in motion are taken into account with principal component analysis, reducing the number of free parameters. This model is tested with digital phantoms reproducing the breathing patterns of ten measured patient tumor trajectories, using five seconds of data to develop the model and the subsequent thirty seconds to test its predictions. The model is also tested with a breathing physical anthropomorphic phantom programmed to reproduce a patient breathing pattern. Results: The error (mean absolute, 95th percentile) over 30 seconds in the predicted tumor centroid position ranged from (0.8, 1.3) mm to (2.2, 4.3) mm for the ten patient breathing patterns. The model reproduced changes in both phase and amplitude of the breathing pattern. Agreement between prediction and truth over the entire image was confirmed by assessing the global voxel intensity RMS error. In the physical phantom, the error in the tumor centroid position was less than 1 mm for all images. Conclusion: We are able to reconstruct 3D images of patient anatomy with a model correlating internal respiratory motion with motion of an external surrogate marker, reproducing the expected tumor centroid position with an average accuracy of 1.4 mm. The images generated by this model could be used to improve dose calculations for treatment planning and delivered dose estimates. This work was partially funded by a research grant from Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗

TH-C-12A-11: Target Correlation of a 3D Surface Surrogate for Left Breast Irradiation Using the Respiratory-Gated Deep-Inspiration Breath-Hold Technique

Purpose: To evaluate the use of 3D optical surface imaging as a new surrogate for respiratory motion gated deep-inspiration breath-hold (DIBH) technique for left breast cancer patients. Methods: Patients with left-sided breast cancer after lumpectomy or mastectomy were selected as candidates for DIBH technique for their external beam radiation therapy. Treatment plans were created on both free breathing (FB) and DIBH CTs to determine whether DIBH was beneficial in reducing heart doses. The Real-time Position Management (RPM) system was used to acquire patient's breathing trace during DIBH CT acquisition and treatment delivery. The reference 3D surface models from FB and DIBH CTs were generated and transferred to the “AlignRT” system for patient positioning and real-time treatment monitoring. MV Cine images were acquired for each beam as quality assurance for intra-fractional position verification. The chest wall excursions measured on these images were used to define the actual target position during treatment, and to investigate the accuracy and reproducibility of RPM and AlignRT. Results: Reduction in heart dose can be achieved for left-sided breast patients using DIBH. Results showed that RPM has poor correlation with target position, as determined by the MV Cine imaging. This indicates that RPM may not be an adequate surrogate in defining the breath-hold level when used alone. Alternatively, the AlignRT surface imaging demonstrated a better correlation with the actual CW excursion during DIBH. Both the vertical and magnitude real-time deltas (RTDs) reported by AlignRT can be used as the gating parameter, with a recommend threshold of ±3 mm and 5 mm, respectively. Conclusion: 3D optical surface imaging serves as a superior target surrogate for the left breast treatment when compared to RPM. Working together with the realtime MV Cine imaging, they ensure accurate patient setup and dose delivery, while minimizing the imaging dose to patients.

60 APPLIED LIFE SCIENCES↗

SU-F-BRF-10: Deformable MRI to CT Validation Employing Same Day Planning MRI for Surrogate Analysis

Purpose: To compare rigid and deformable registrations of the prostate in the multi-modality setting (diagnostic-MRI to planning-CT) by utilizing a planning-MRI as a surrogate. The surrogate allows for the direct quantitative analysis which can be difficult in the multi-modality domain where intensity mapping differs. Methods: For ten subjects, T2 fast-spin-echo images were acquired at two different time points, the first several weeks prior to planning (diagnostic-MRI) and the second on the same day in which the planning CT was collected (planning-MRI). Significant effort in patient positioning and bowel/bladder preparation was undertaken to minimize distortion of the prostate in all datasets. The diagnostic-MRI was deformed to the planning-CT utilizing a commercially available deformable registration algorithm synthesized from local registrations. The deformed MRI was then rigidly aligned to the planning MRI which was used as the surrogate for the planning-CT. Agreement between the two MRI datasets was scored using intensity based metrics including Pearson correlation and normalized mutual information, NMI. A local analysis was performed by looking only within the prostate, proximal seminal vesicles, penile bulb and combined areas. A similar method was used to assess a rigid registration between the diagnostic-MRI and planning-CT. Results: Utilizing the NMI, the deformable registrations were superior to the rigid registrations in 9 of 10 cases demonstrating a 15.94% improvement (p-value < 0.001) within the combined area. The Pearson correlation showed similar results with the deformable registration superior in the same number of cases and demonstrating a 6.97% improvement (p-value <0.011). Conclusion: Validating deformable multi-modality registrations using spatial intensity based metrics is difficult due to the inherent differences in intensity mapping. This population provides an ideal testing ground for MRI to CT deformable registrations by obviating the need for multi-modality comparisons which are inherently more challenging. Deformable registrations generated in this work significantly outperformed rigid alignments. Research reported in this abstract was supported by the NIH National Cancer Institute R21CA153826 “MRI-Guided Radiotherapy and Biomarkers for Prostate Cancer” and Bankhead-Coley Cancer Research Program 10BT-03 “MRI-Guided Radiotherapy and Biomarkers for Prostate Cancer”.

60 APPLIED LIFE SCIENCES↗

Technical Note: Radiological properties of tissue surrogates used in a multimodality deformable pelvic phantom for MR-guided radiotherapy

Purpose: Phantom surrogates were developed to allow multimodal [computed tomography (CT), magnetic resonance imaging (MRI), and teletherapy] and anthropomorphic tissue simulation as well as materials and methods to construct deformable organ shapes and anthropomorphic bone models. Methods: Agarose gels of variable concentrations and loadings were investigated to simulate various soft tissue types. Oils, fats, and Vaseline were investigated as surrogates for adipose tissue and bone marrow. Anthropomorphic shapes of bone and organs were realized using 3D-printing techniques based on segmentations of patient CT-scans. All materials were characterized in dual energy CT and MRI to adapt CT numbers, electron density, effective atomic number, as well as T1- and T2-relaxation times to patient and literature values. Results: Soft tissue simulation could be achieved with agarose gels in combination with a gadolinium-based contrast agent and NaF to simulate muscle, prostate, and tumor tissues. Vegetable oils were shown to be a good representation for adipose tissue in all modalities. Inner bone was realized using a mixture of Vaseline and K{sub 2}HPO{sub 4}, resulting in both a fatty bone marrow signal in MRI and inhomogeneous areas of low and high attenuation in CT. The high attenuation of outer bone was additionally adapted by applying gypsum bandages to the 3D-printed hollow bone case with values up to 1200 HU. Deformable hollow organs were manufactured using silicone. Signal loss in the MR images based on the conductivity of the gels needs to be further investigated. Conclusions: The presented surrogates and techniques allow the customized construction of multimodality, anthropomorphic, and deformable phantoms as exemplarily shown for a pelvic phantom, which is intended to study adaptive treatment scenarios in MR-guided radiation therapy.

61 RADIATION PROTECTION AND DOSIMETRY↗