Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Equipping Neural Network Surrogates with Uncertainty for Propagation in Physical Systems

Coarse-grained or filtered models typically rely on closure models to account for unresolved scales. For instance, large eddy simulation for modeling turbulent fluid flows explicitly resolves the largest scales, but requires modeling closure terms to account for the sub-filter scales. With the vast amount of data available from high-fidelity simulations, there are unique opportunities to leverage data-driven modeling techniques to formulate expressive and flexible closure models. Despite their flexibility, data-driven models struggle in domain shift settings, i.e. when deployed in configurations not captured in the training dataset. In particular, the efficacy of neural network surrogates is difficult to assess a priori due to the deterministic, point-estimate nature of predictions. In high-consequence applications, such models require reliable uncertainty estimates in the data-informed and out-of-distribution regimes. To quantify uncertainties in both regimes, we employ Bayesian neural networks which are able to capture both epistemic and aleatoric uncertainties. We will discuss challenges associated with the training and evaluation of these networks. Furthermore, we will discuss uncertainty embedding strategies to enable efficient sampling and propagation of uncertainty through high-fidelity simulations.

Bayesian neural networks↗

A Graph Neural Network Surrogate Model for hls4ml

Recent advancements in use of machine learning (ML) techniques on field-programmable gate arrays (FPGAs) have allowed for the implementation of embedded neural networks with extremely low latency. This is invaluable for particle detectors at the Large Hadron Collider, where latency and used area are strictly bounded. The hls4ml framework is a procedure that converts trained ML model software to a synthesis result to can be used on an FPGA. However, running the pipeline is a time-consuming procedure, and there is a strong risk of failure. In particular, it may not be possible to successfully convert a model into a synthesis result, or the resource consumption of the model may exceed the resources of the target FPGA. To aid with this development, we introduce wa-hls4ml, a surrogate model using a graph neural network to emulate the structure of the source models. The goal is to estimate the chance of success and resource consumption of a given model when passed through the hls4ml pipeline, without needing to run the pipeline.

Plotnikov, Dennis↗

Milestone 1.2.16. Reconciling the Impacts of Thermal Pretreatment on Radiation-Induced H2 Generation from Aluminum-Clad Spent Nuclear Fuel Surrogate Materials

To support the technical basis for the extended dry storage of aluminum-clad spent nuclear fuel (ASNF), thermal pretreatment procedures to minimize the radiation-induced generation of molecular hydrogen (H2) have been investigated. The aim of thermal pretreatment is to eliminate the residual adsorbed water content on the ASNF’s corrosion layers, precursors for H2 generation. To date, irradiation studies in this area have found conflicting results for the effectiveness of thermal pretreatment procedures. The aim of this study was to reconcile those differences. However, the presented results, which utilized a modified in situ thermal pretreatment procedure, afforded H2 yield data that further indicates that thermal pretreatment does not significantly reduce the radiation-induced yield of H2 from gamma irradiated ASNF surrogate materials. Assessment of the differences between thermal pretreatment studies suggests that stainless-steel—present in the irradiation setup of studies that demonstrated a reduction in the yield of H2 with thermal pretreatment—may afford not only unanticipated interfacial chemistry, but also the formation and radiolytic contribution of iron oxides to the chemistry underpinning the formation of H2 in these systems. Given the Department of Energy Standard Canister—proposed for the extended dry storage of ASNF—is predominantly composed of stainless-steel, the potential contribution of stainless-steel and its corrosion layers to radiolytic H2 production should be further investigated. This research was funded by the U.S. Department of Environmental Management, Office of Technology Development, under contract DE-AC07-05ID14517.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Surrogate Neural Architecture Codesign Package (SNAC-Pack)

Neural Architecture Search is a powerful approach for automating model design, but existing methods struggle to accurately optimize for real hardware performance, often relying on proxy metrics such as bit operations. We present Surrogate Neural Architecture Codesign Package (SNAC-Pack), an integrated framework that automates the discovery and optimization of neural networks focusing on FPGA deployment. SNAC-Pack combines Neural Architecture Codesign's multi-stage search capabilities with the Resource Utilization and Latency Estimator, enabling multi-objective optimization across accuracy, FPGA resource utilization, and latency without requiring time-intensive synthesis for each candidate model. We demonstrate SNAC-Pack on a high energy physics jet classification task, achieving 63.84% accuracy with resource estimation. When synthesized on a Xilinx Virtex UltraScale+ VU13P FPGA, the SNAC-Pack model matches baseline accuracy while maintaining comparable resource utilization to models optimized using traditional BOPs metrics. This work demonstrates the potential of hardware-aware neural architecture search for resource-constrained deployments and provides an open-source framework for automating the design of efficient FPGA-accelerated models.

Weitz, Jason [UC, San Diego] (ORCID:00090004631535↗

Insights from Surrogate Industries on Remote Operations for Advanced Reactors

With development of advanced reactors, understanding the human factors considerations related to remote operations remains an important topic. This work presents insights captured from reviewing relevant surrogate industries with remote operations, as they may apply to advanced reactor development. This work provides insights into important human factors considerations for remote operations to ensure safe and reliable adoption of these prospective reactor technologies.

99 - GENERAL AND MISCELLANEOUS↗

Effect of ionizing radiation on PuO2 and surrogate oxide materials under storage conditions

The stockpile of plutonium separated from used nuclear fuel amounts to many 100s of tonnes. The majority of this plutonium is stored as PuO2 powder packaged in multi-can containers. The conditions during the packaging of reprocessed PuO2 for long term storage are closely controlled to limit water uptake as radiolytic decomposition of any adsorbed water will lead to the formation of both a potentially flammable atmosphere containing molecular hydrogen as well as reactive oxygen species which may be incorporated into the oxide phase. Consequently, the safety case for the long-term storage of PuO2 requires a complete understanding of the fundamental physical, chemical and materials degradation processes occurring at the water-oxide interface inside the storage canisters. This study investigates the effect of ionizing radiation on PuO2 and various surrogate oxides under atmospheres potentially encountered in storage canisters.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

SLIP (Surrogate Launching and Integration Platform)

SLIP (Surrogate Launching and Integration Platform) is a software ecosystem for downloading and running ML/AI benchmarks. SLIP automatically downloads and sets up the code and data running a benchmark. The large data sets and model code are cached locally with a specific ID within a designated cache directory.

Brown, Cade↗

Retention of radionuclides in sol–gel surrogate nuclear explosive debris

Sol–gel vitrification can be used to rapidly produce solid, vitreous materials to support nuclear forensics research. Here, this work investigates three sol–gel synthetic approaches’ ability to retain fission products within the glass as a function of drying temperature. Eight of the ten fission products studied were quantitatively retained (less than 5% losses) at temperatures up to 600 °C for glasses prepared using an acidic catalyst and at temperatures up to 300 °C for glasses prepared using a basic catalyst. Both systems show partial loss of ruthenium and complete loss of iodine at temperatures above 300 and 100 °C, respectively.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Investigating sol–gel matrix loading capacity toward producing surrogate nuclear explosive debris with realistic composition

Post detonation nuclear forensic materials which resemble the size, color, elemental composition, and radionuclide content of real nuclear debris would be valuable for developing and validating new nuclear forensic techniques. As nuclear fallout types vary significantly, the ability to tailor each of these parameters accurately is desired to produce materials capable of testing analytical methods under a wide array of forensic scenarios. Sol–gel synthesis techniques can provide tunability of size, shape and composition for producing a wide variety of solid nuclear forensics benchmarking materials. Further, the sol–gel process consists of forming a metal oxide material, often silica, through polymerization of a metal-alkoxy precursor. In this work, we characterize the ability to load sol–gel particles with secondary elemental components such as iron, aluminum, and calcium toward producing benchmarking materials approximating the elemental composition of historic nuclear debris from the Nevada National Security Site. We also demonstrate quantitative radionuclide encapsulation toward producing benchmarking materials with controllable radionuclide content. Finally, we employ these techniques to produce nuclear debris benchmarking materials with controllable elemental matrix composition and radionuclide content and compare these samples with the composition of a historic fallout sample previously reported from the Nevada National Security Site.

36 MATERIALS SCIENCE↗

Model-parallel Fourier neural operators as learned surrogates for large-scale parametric PDEs

Fourier neural operators (FNOs) are a recently introduced neural network architecture for learning solution operators of partial differential equations (PDEs), which have been shown to perform significantly better than comparable deep learning approaches. Once trained, FNOs can achieve speed-ups of multiple orders of magnitude over conventional numerical PDE solvers. However, due to the high dimensionality of their input data and network weights, FNOs have so far only been applied to two-dimensional or small three-dimensional problems. To remove this limited problem-size barrier, we propose a model-parallel version of FNOs based on domain-decomposition of both the input data and network weights. Here, we demonstrate that our model-parallel FNO is able to predict time-varying PDE solutions of over 2.6 billion variables on Perlmutter using up to 512 A100 GPUs and show an example of training a distributed FNO on the Azure cloud for simulating multiphase CO 2 dynamics in the Earth’s subsurface.

58 GEOSCIENCES↗

Surrogate-assisted optimization under uncertainty for design for remanufacturing considering material price volatility

Remanufacturing is a well-established end-of-life (EOL) strategy that promises significant savings in energy and carbon emissions. However, the current design practices are not remanufacturing-inclusive, i.e., the majority of products are designed for a single life cycle. As a result, potential products that can sustain multiple life cycles are deprived of additional benefits of being designed for remanufacturing, such as reduced material usage, lower cost, and improved environmental impact. Moreover, the uncertainty in design, material selection, and economics are not considered to produce remanufacturable designs. Accordingly, this research proposes a design for remanufacturing (DfRem) framework that accounts for design uncertainty and material price volatility. The framework systematically explores the design space, performs design optimization under uncertainty, followed by topology optimization to provide additional mass savings, and finally, a price volatility analysis for plausible design material choices. The candidate designs are evaluated based on their design mass, material price volatility, failure mode characteristics, carbon footprint, and embodied energy impacts. The proposed framework's utility is demonstrated via the use of an engine cylinder head case study subjected to thermo-mechanical loads along with fatigue and wear failure. Considering grey cast iron and aluminum alloy as the design material choices, it was found that the cast iron design reduced the initial design mass by 6% as opposed to a 5% decrease for aluminum. On the other hand, about 8% area of the cast iron design failed due to fatigue, compared to 3% for aluminum. Here, we further observed that although the aluminum design provided better mechanical performance than the cast iron design, this material was more expensive and volatile in price.

36 MATERIALS SCIENCE↗

Conditioned quantum-assisted deep generative surrogate for particle-calorimeter interactions

Particle collisions at accelerators like the Large Hadron Collider (LHC), recorded by experiments such as ATLAS and CMS, enable precise standard model measurements and searches for new phenomena. Simulating these collisions significantly influences experiment design and analysis but incurs immense computational costs, projected at millions of CPU-years annually during the high luminosity LHC (HL-LHC) phase. Currently, simulating a single event with Geant4 consumes around 1000 CPU seconds, with calorimeter simulations especially demanding. To address this, we propose a conditioned quantum-assisted generative model, integrating a conditioned variational autoencoder (VAE) and a conditioned restricted Boltzmann machine (RBM). Our RBM architecture is tailored for D-Wave’s Pegasus-structured advantage quantum annealer for sampling, leveraging the flux bias for conditioning. This approach combines classical RBMs as universal approximators for discrete distributions with quantum annealing’s speed and scalability. We also introduce an adaptive method for efficiently estimating effective inverse temperature, and validate our framework on Dataset 2 of CaloChallenge.

97 MATHEMATICS AND COMPUTING↗

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗