Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Surrogate Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

Radiation-Spray Coupling for Realistic Flow Configurations

Three Large Eddy Simulations (LES) for a lean-direct injection (LDI) combustor are performed and compared. In addition to the cold flow simulation, the effect of radiation coupling with the multi-physics reactive flow is analyzed. The flame let progress variable approach is used as a subgrid combustion model combined with a stochastic subgrid model for spray atomization and an optically thin radiation model. For accurate chemistry modeling, a detailed Jet-A surrogate mechanism is utilized. To achieve realistic inflow, a simple recycling technique is performed at the inflow section upstream of the swirler. Good comparison is shown with the experimental data mean and root mean square profiles. The effect of combustion is found to change the shape and size of the central recirculation zone. Radiation is found to change the spray dynamics and atomization by changing the heat release distribution and the local temperature values impacting the evaporation process. The simulation with radiation modeling shows wider range of droplet size distribution by altering the evaporation rate. The current study proves the importance of radiation modeling for accurate prediction in realistic spray combustion configurations, even for low pressure systems.

El-Asrag, Hossam↗

A consistent chemical mechanism for oxidation of substituted aromatic species

Computational studies of combustion in engines are typically performed by modeling the real fuel as a surrogate mixture of various hydrocarbons. Aromatic species are crucial components in these surrogate mixtures. In this work, a consistent chemical mechanism to predict the high temperature combustion characteristics of toluene, styrene, ethylbenzene, 1,3-dimethylbenzene (m-xylene), and 1-methylnaphthalene is presented. The present work builds on a detailed chemical mechanism for high temperature oxidation of smaller hydrocarbons developed by Blanquart et al. [Combust. Flame 156 (2009) 588-607]. The base mechanism has been validated extensively in the previous work and is now extended to include reactions of various substituted aromatic compounds. The reactions representing oxidation of the aromatic species are taken from the literature or are derived from those of the lower aromatics or the corresponding alkane species. The chemical mechanism is validated against plug flow reactor data, ignition delay times, species profiles measured in shock tube experiments, and laminar burning velocities. The combustion characteristics predicted by the chemical model compare well with those available from experiments for the different aromatic species under consideration. (author)

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

WE-H-207A-06: Hypoxia Quantification in Static PET Images: The Signal in the Noise

Purpose: Quantification of hypoxia from PET images is of considerable clinical interest. In the absence of dynamic PET imaging the hypoxic fraction (HF) of a tumor has to be estimated from voxel values of activity concentration of a radioactive hypoxia tracer. This work is part of an effort to standardize quantification of tumor hypoxic fraction from PET images. Methods: A simple hypoxia imaging model in the tumor was developed. The distribution of the tracer activity was described as the sum of two different probability distributions, one for the normoxic (and necrotic), the other for the hypoxic voxels. The widths of the distributions arise due to variability of the transport, tumor tissue inhomogeneity, tracer binding kinetics, and due to PET image noise. Quantification of HF was performed for various levels of variability using two different methodologies: a) classification thresholds between normoxic and hypoxic voxels based on a non-hypoxic surrogate (muscle), and b) estimation of the (posterior) probability distributions based on maximizing likelihood optimization that does not require a surrogate. Data from the hypoxia imaging model and from 27 cervical cancer patients enrolled in a FAZA PET study were analyzed. Results: In the model, where the true value of HF is known, thresholds usually underestimate the value for large variability. For the patients, a significant uncertainty of the HF values (an average intra-patient range of 17%) was caused by spatial non-uniformity of image noise which is a hallmark of all PET images. Maximum likelihood estimation (MLE) is able to directly optimize for the weights of both distributions, however, may suffer from poor optimization convergence. For some patients, MLE-based HF values showed significant differences to threshold-based HF-values. Conclusion: HF-values depend critically on the magnitude of the different sources of tracer uptake variability. A measure of confidence should also be reported.

60 APPLIED LIFE SCIENCES↗

Propellant Chemistry for CFD Applications

Current concepts for reusable launch vehicle design have created renewed interest in the use of RP-1 fuels for high pressure and tri-propellant propulsion systems. Such designs require the use of an analytical technology that accurately accounts for the effects of real fluid properties, combustion of large hydrocarbon fuel modules, and the possibility of soot formation. These effects are inadequately treated in current computational fluid dynamic (CFD) codes used for propulsion system analyses. The objective of this investigation is to provide an accurate analytical description of hydrocarbon combustion thermodynamics and kinetics that is sufficiently computationally efficient to be a practical design tool when used with CFD codes such as the FDNS code. A rigorous description of real fluid properties for RP-1 and its combustion products will be derived from the literature and from experiments conducted in this investigation. Upon the establishment of such a description, the fluid description will be simplified by using the minimum of empiricism necessary to maintain accurate combustion analyses and including such empirical models into an appropriate CFD code. An additional benefit of this approach is that the real fluid properties analysis simplifies the introduction of the effects of droplet sprays into the combustion model. Typical species compositions of RP-1 have been identified, surrogate fuels have been established for analyses, and combustion and sooting reaction kinetics models have been developed. Methods for predicting the necessary real fluid properties have been developed and essential experiments have been designed. Verification studies are in progress, and preliminary results from these studies will be presented. The approach has been determined to be feasible, and upon its completion the required methodology for accurate performance and heat transfer CFD analyses for high pressure, tri-propellant propulsion systems will be available.

Farmer, R. C.↗

Fuel Assembly Shaker Test Simulation

This report describes the modeling of a PWR fuel assembly under dynamic shock loading in support of the Sandia National Laboratories (SNL) shaker test campaign. The focus of the test campaign is on evaluating the response of used fuel to shock and vibration loads that a can occur during highway transport. Modeling began in 2012 using an LS-DYNA fuel assembly model that was first created for modeling impact scenarios. SNL’s proposed test scenario was simulated through analysis and the calculated results helped guide the instrumentation and other aspects of the testing. During FY 2013, the fuel assembly model was refined to better represent the test surrogate. Analysis of the proposed loads suggested the frequency band needed to be lowered to attempt to excite the lower natural frequencies of the fuel assembly. Despite SNL’s expansion of lower frequency components in their five shock realizations, pretest predictions suggested a very mild dynamic response to the test loading. After testing was completed, one specific shock case was modeled, using recorded accelerometer data to excite the model. Direct comparison of predicted strain in the cladding was made to the recorded strain gauge data. The magnitude of both sets of strain (calculated and recorded) are very low, compared to the expected yield strength of the Zircaloy-4 material. The model was accurate enough to predict that no yielding of the cladding was expected, but its precision at predicting micro strains is questionable. The SNL test data offers some opportunity for validation of the finite element model, but the specific loading conditions of the testing only excite the fuel assembly to respond in a limited manner. For example, the test accelerations were not strong enough to substantially drive the fuel assembly out of contact with the basket. Under this test scenario, the fuel assembly model does a reasonable job of approximating actual fuel assembly response, a claim that can be verified through direct comparison of model results to recorded test results. This does not offer validation for the fuel assembly model in all conceivable cases, such as high kinetic energy shock cases where the fuel assembly might lift off the basket floor to strike to basket ceiling. This type of nonlinear behavior was not witnessed in testing, so the model does not have test data to be validated against.a basis for validation in cases that substantially alter the fuel assembly response range. This leads to a gap in knowledge that is identified through this modeling study. The SNL shaker testing loaded a surrogate fuel assembly with a certain set of artificially-generated time histories. One thing all the shock cases had in common was an elimination of low frequency components, which reduces the rigid body dynamic response of the system. It is not known if the SNL test cases effectively bound all highway transportation scenarios, or if significantly greater rigid body motion than was tested is credible. This knowledge gap could be filled through modeling the vehicle dynamics of a used fuel conveyance, or by collecting acceleration time history data from an actual conveyance under highway conditions.

Klymyshyn, Nicholas A.↗

Evaluation of Thompson-type trend and monthly weather data models for corn yields in Iowa, Illinois, and Indiana

An evaluation was made of Thompson-Type models which use trend terms (as a surrogate for technology), meteorological variables based on monthly average temperature, and total precipitation to forecast and estimate corn yields in Iowa, Illinois, and Indiana. Pooled and unpooled Thompson-type models were compared. Neither was found to be consistently superior to the other. Yield reliability indicators show that the models are of limited use for large area yield estimation. The models are objective and consistent with scientific knowledge. Timely yield forecasts and estimates can be made during the growing season by using normals or long range weather forecasts. The models are not costly to operate and are easy to use and understand. The model standard errors of prediction do not provide a useful current measure of modeled yield reliability.

French, V.↗

TH-CD-207A-05: Lung Surface Deformation Vector Fields Prediction by Monitoring Respiratory Surrogate Signals

Purpose: In this study, we developed and evaluated a method for predicting lung surface deformation vector fields (SDVFs) based on surrogate signals such as chest and abdomen motion at selected locations and spirometry measurements. Methods: A Patient-specific 3D triangular surface mesh of the lung region at end-expiration (EE) phase was obtained by threshold-based segmentation method. For each patient, a spirometer recorded the flow volume changes of the lungs; and 192 selected points at a regular spacing of 2cm X 2cm matrix points over a total area of 34cm X 24cm on the surface of chest and abdomen was used to detect chest wall motions. Preprocessing techniques such as QR factorization with column pivoting (QRCP) were employed to remove redundant observations of the chest and abdominal area. To create a statistical model between the lung surface and the corresponding surrogate signals, we developed a predictive model based on canonical ridge regression (CRR). Two unique weighting vectors were selected for each vertex on the surface of the lung, and they were optimized during the training process using the all other phases of 4D-CT except the end-inspiration (EI) phase. These parameters were employed to predict the vertices locations of a testing data set, which was the EI phase of 4D-CT. Results: For ten lung cancer patients, the deformation vector field of each vertex of lung surface mesh was estimated from the external motion at selected positions on the chest wall surface plus spirometry measurements. The average estimation of 98th percentile of error was less than 1 mm (AP= 0.85, RL= 0.61, and SI= 0.82). Conclusion: The developed predictive model provides a non-invasive approach to derive lung boundary condition. Together with personalized biomechanical respiration modelling, the proposed model can be used to derive the lung tumor motion during radiation therapy accurately from non-invasive measurements.

60 APPLIED LIFE SCIENCES↗

Joint Non-Parametric Correction Estimator for Excess Relative Risk Regression in Survival Analysis with Exposure Measurement Error

Summary Observational epidemiological studies often confront the problem of estimating exposure–disease relationships when the exposure is not measured exactly. We investigate exposure measurement error in excess relative risk regression, which is a widely used model in radiation exposure effect research. In the study cohort, a surrogate variable is available for the true unobserved exposure variable. The surrogate variable satisfies a generalized version of the classical additive measurement error model, but it may or may not have repeated measurements. In addition, an instrumental variable is available for individuals in a subset of the whole cohort. We develop a non-parametric correction estimator by using data from the subcohort and further propose a joint non-parametric correction estimator using all observed data to adjust for exposure measurement error. An optimal linear combination estimator of the joint non-parametric correction and non-parametric correction is further developed. The estimators proposed are non-parametric, which are consistent without imposing a covariate or error distribution, and are robust to heteroscedastic errors. Finite sample performance is examined via a simulation study. We apply the developed methods to data from the Radiation Effects Research Foundation, in which chromosome aberration is used to adjust for the effects of radiation dose measurement error on the estimation of radiation dose responses.

Wang, Ching-Yun↗

Expansion of the surrogate method to measure the prompt fission neutron multiplicity for Pu 241 [Prompt Fission Neutron Multiplicity for Pu-241 using the Surrogate Method]

Fission neutron multiplicity data are imperative for nuclear models that support criticality safety, nuclear nonproliferation, and stockpile stewardship. This work presents the first experimental measurement to determine the average neutron multiplicity ($\bar{ν}$) and the neutron multiplicity distribution using a surrogate reaction. 241 Pu has a short half-life of 14.3 yr. To circumvent experimental difficulties, inelastic scattering of 53.96-MeV α particles on 242 Pu served as a surrogate for 241 Pu (n , f). The present text reports and discusses the average neutron multiplicity, in addition to the neutron multiplicity moments and distribution for equivalent neutron energies up to 20 MeV. Finally, the $\bar{ν}$ measured in this experiment agrees with previous measurements until 12 MeV, where discrepancies arise due to preequilibrium neutron emission.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Resolving turbulent magnetohydrodynamics: a hybrid operator-diffusion framework

We present a hybrid machine learning framework that combines physics-informed neural operators (PINOs) with score-based generative diffusion models to simulate the full spatio-temporal evolution of two-dimensional, incompressible, resistive magnetohydrodynamic turbulence across a broad range of Reynolds numbers (Re). The framework leverages the equation-constrained generalization capabilities of PINOs to predict coherent, low-frequency dynamics, while a conditional diffusion model stochastically corrects high-frequency residuals, enabling accurate modeling of fully developed turbulence. Trained on a comprehensive ensemble of high-fidelity simulations with Re ϵ {100, 250, 500, 750, 1000, 3000, 10000}, the approach achieves state-of-the-art accuracy in regimes previously inaccessible to deterministic surrogates. At Re = 1000 and 3000, the model faithfully reconstructs the full spectral energy distributions of both velocity and magnetic fields late into the simulation, capturing non-Gaussian statistics, intermittent structures, and cross-field correlations with high fidelity. At extreme turbulence levels (Re = 10 000), it remains the first surrogate capable of recovering the high-wavenumber evolution of the magnetic field, preserving large-scale morphology and enabling statistically meaningful predictions.

Diffusion-Integrated Neural Operators↗

Reduced Chemistry for Butanol Isomers at Engine-Relevant Conditions

Butanol has received significant research attention as a second-generation biofuel in the past few years. In the present study, skeletal mechanisms for four butanol isomers were generated from two widely accepted, well-validated detailed chemical kinetic models for the butanol isomers. The detailed models were reduced using a two-stage approach consisting of the directed relation graph with error propagation and sensitivity analysis. During the reduction process, issues were encountered with pressure-dependent reactions formulated using the logarithmic pressure interpolation approach; these issues are discussed and recommendations are made to avoid ambiguity in its future implementation in mechanism development. The performance of the skeletal mechanisms generated here was compared with that of detailed mechanisms in simulations of autoignition delay times, laminar flame speeds, and perfectly stirred reactor temperature response curves and extinction residence times, over a wide range of pressures, temperatures, and equivalence ratios. Good agreement was observed between the detailed and skeletal mechanisms, demonstrating the adequacy of the resulting reduced chemistry for all the butanol isomers in predicting global combustion phenomena. In addition, the skeletal mechanisms closely predicted the time-histories of fuel mass fractions in homogeneous compression-ignition engine simulations. The performance of each butanol isomer was additionally compared with that of a gasoline surrogate with an antiknock index of 87 in a homogeneous compression-ignition engine simulation. The gasoline surrogate was consumed faster than any of the butanol isomers, with tert -butanol exhibiting the slowest fuel consumption rate. As a result, while n -butanol and isobutanol displayed the most similar consumption profiles relative to the gasoline surrogate, the two literature chemical kinetic models predicted different orderings.

09 BIOMASS FUELS↗

Potential Impact of Interfacial Bonding Efficiency on High-Burnup Spent Nuclear Fuel Vibration Integrity during Normal Transportation

Finite element analysis (FEA) was used to investigate the impacts of interfacial bonding efficiency at pellet pellet and pellet clad interfaces on spent nuclear fuel (SNF) vibration integrity. The FEA simulation results were also validated and benchmarked with reverse bending fatigue test results on surrogate rods consisting of stainless steel (SS) tubes with alumina-pellet inserts. Bending moments (M) are applied to the FEA models to evaluate the system responses of the surrogate rods. From the induced curvature, , the flexural rigidity EI can be estimated as EI=M/ . The impacts of interfacial bonding efficiency on SNF vibration integrity include the moment carrying capacity distribution between pellets and clad and the impact of cohesion on the flexural rigidity of the surrogate rod system. The result also indicates that the immediate consequences of interfacial de-bonding are a load carrying capacity shift from the fuel pellets to the clad and a reduction of the composite rod flexural rigidity. Therefore, the flexural rigidity of the surrogate rod and the bending moment bearing capacity between the clad and fuel pellets are strongly dependent on the efficiency of interfacial bonding at the pellet pellet and pellet clad interfaces. The above-noted phenomenon was calibrated and validated by reverse bending fatigue testing using a surrogate rod system.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Combustion characteristics and detailed simulations of surrogates for a Tier II gasoline certification fuel

An experimental and numerical study of combustion of a gasoline certification fuel (‘indolene’), and four (S4) and five (S5) component surrogates for it, is reported for the configurations of an isolated droplet burning with near spherical symmetry in the standard atmosphere, and a single cylinder engine designed for advanced compression ignition of pre-vaporized fuel. The intent was to compare performance of the surrogate for these different combustion configurations and to assess the broader applicability of the kinetic mechanism and property database for the simulations. A kinetic mechanism comprised of 297 species and 16,797 reactions was used in the simulations that included soot formation and evolution, and accounted for unsteady transport, liquid diffusion inside the droplet, radiative heat transfer, and variable properties. The droplet data showed a clear preference for the S5 surrogate in terms of burning rate. The simulations showed generally very good agreement with measured droplet, flame, and soot shell diameters. Measurements of combustion timing, in-cylinder pressure, and mass-averaged gas temperature were also well predicted with a slight preference for the S5 surrogate. Preferential vaporization was not evidenced from the evolution of droplet diameter but was clearly revealed in simulations of the evolution of mixture fractions inside the droplets. Here, the influence of initial droplet diameter (D o ) on droplet burning was strong, with S5 burning rates decreasing with increasing D o due to increasing radiation losses from the flame. Flame extinction was predicted for D o =3.0 mm as a radiative loss mechanism but not predicted for smaller D o for the conditions of the simulations.

42 ENGINEERING↗

SU-C-303-03: Dosimetric Model of the Beagle Needed for Pre-Clinical Testing of Radiopharmaceuticals

Purpose: Large animal models, most popularly beagles, have been crucial surrogates to humans in determining radiation safety levels of radiopharmaceuticals. This study aims to develop a detailed beagle phantom to accurately approximate organ absorbed doses for therapy nuclear medicine preclinical studies. Methods: A 3D NURBS model was created subordinate to a whole body CT of an adult beagle. Bones were harvested and CT imaged to offer macroscopic skeletal detail. Samples of trabecular spongiosa were cored and imaged to offer microscopic skeletal detail for bone trabeculae and marrow volume fractions. Results: Organ masses in the model are typical of an adult beagle. Trends in volume fractions for skeletal dosimetry are fundamentally similar to those found in existing models of other canine species. Conclusion: This work warrants its use in further investigations of radiation transport calculation for electron and photon dosimetry. This model accurately represents the anatomy of a beagle, and can be directly translated into a useable geometry for a voxel-based Monte Carlo radiation transport program such as MCNP6. Work supported by a grant from the Hyundai Hope on Wheels Foundation for Pediatric Cancer Research.

60 APPLIED LIFE SCIENCES↗

Sequence modeling of higher-order wave modes of quasi-circular, spinning, non-precessing binary black hole mergers

Higher-order gravitational wave modes from quasi-circular, spinning, non-precessing binary-black-hole (BBH) mergers encode rich information about the nonlinear dynamics of strong-field gravity. We present a transformer-based sequence-completion surrogate that, given an early-inspiral segment, forecasts the subsequent late inspiral, merger, and ringdown. The intended applications are (i) patching or completing expensive or interrupted numerical-relativity (NR) simulations and (ii) providing late-time cross-checks and rapid hybridization studies. The training set is built from the NRHybSur3dq8 surrogate, which provides spherical-harmonic modes up to $\ell$ ≤ 4 (excluding (4, 0) and (4,±1), and including (5, 5)) for mass ratios q ≤ 8, dimensionless spin components s$^{z}_{1,2}$ ϵ[–0.8, 0.8], and inclination angles θ ϵ [0, π]. Waveforms are supplied on the interval t ϵ [–5000M, –100 M) and the model autoregressively generates the plus and cross polarizations (h + , h x ) on t ϵ [–100 M, 130M]. Training on the Delta supercomputer with 16 NVIDIA A100 GPUs required ~15 h on more than 14 million hybrid waveforms. Evaluation on a held-out test set of 840,000 samples yields mean and median overlaps of 0.996 and 0.997, respectively, with respect to the surrogate ground truth.

black-hole merger↗

A rat retinal damage model predicts for potential clinical visual disturbances induced by Hsp90 inhibitors

In human trials certain heat shock protein 90 (Hsp90) inhibitors, including 17-DMAG and NVP-AUY922, have caused visual disorders indicative of retinal dysfunction; others such as 17-AAG and ganetespib have not. To understand these safety profile differences we evaluated histopathological changes and exposure profiles of four Hsp90 inhibitors, with or without clinical reports of adverse ocular effects, using a rat retinal model. Retinal morphology, Hsp70 expression (a surrogate marker of Hsp90 inhibition), apoptotic induction and pharmacokinetic drug exposure analysis were examined in rats treated with the ansamycins 17-DMAG and 17-AAG, or with the second-generation compounds NVP-AUY922 and ganetespib. Both 17-DMAG and NVP-AUY922 induced strong yet restricted retinal Hsp70 up-regulation and promoted marked photoreceptor cell death 24 h after the final dose. In contrast, neither 17-AAG nor ganetespib elicited photoreceptor injury. When the relationship between drug distribution and photoreceptor degeneration was examined, 17-DMAG and NVP-AUY922 showed substantial retinal accumulation, with high retina/plasma (R/P) ratios and slow elimination rates, such that 51% of 17-DMAG and 65% of NVP-AUY922 present at 30 min post-injection were retained in the retina 6 h post-dose. For 17-AAG and ganetespib, retinal elimination was rapid (90% and 70% of drugs eliminated from the retina at 6 h, respectively) which correlated with lower R/P ratios. These findings indicate that prolonged inhibition of Hsp90 activity in the eye results in photoreceptor cell death. Moreover, the results suggest that the retina/plasma exposure ratio and retinal elimination rate profiles of Hsp90 inhibitors, irrespective of their chemical class, may predict for ocular toxicity potential. - Highlights: • In human trials some Hsp90 inhibitors cause visual disorders, others do not. • Prolonged inhibition of Hsp90 in the rat eye results in photoreceptor cell death. • Retina/plasma ratio and retinal elimination rate are linked to toxicity potential. • Rat retinotoxic responses to individual Hsp90 inhibitors reflect clinical profiles. • Rodent modeling may be used to assess ocular risks of targeted Hsp90 compounds.

60 APPLIED LIFE SCIENCES↗

Design of Experiments, Model Calibration and Data Assimilation

This presentation provides an overview of emulation, calibration and experiment design for computer experiments. Emulation refers to building a statistical surrogate from a carefully selected and limited set of model runs to predict unsampled outputs. The standard kriging approach to emulation of complex computer models is presented. Calibration refers to the process of probabilistically constraining uncertain physics/engineering model inputs to be consistent with observed experimental data. An initial probability distribution for these parameters is updated using the experimental information. Markov chain Monte Carlo (MCMC) algorithms are often used to sample the calibrated parameter distribution. Several MCMC algorithms commonly employed in practice are presented, along with a popular diagnostic for evaluating chain behavior. Space-filling approaches to experiment design for selecting model runs to build effective emulators are discussed, including Latin Hypercube Design and extensions based on orthogonal array skeleton designs and imposed symmetry requirements. Optimization criteria that further enforce space-filling, possibly in projections of the input space, are mentioned. Designs to screen for important input variations are summarized and used for variable selection in a nuclear fuels performance application. This is followed by illustration of sequential experiment design strategies for optimization, global prediction, and rare event inference.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Accelerating Hamiltonian Monte Carlo for Bayesian inference in neural networks and neural operators

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high dimensionality of the network’s parameter space and the non-convexity of their posterior distributions. Therefore, various approximation techniques, such as variational inference (VI) or stochastic gradient MCMC, are often employed to infer the posterior distribution of the network parameters. Such approximations introduce inaccuracies in the inferred distributions, resulting in unreliable uncertainty estimates. In this work, we propose a hybrid approach that combines inexpensive VI and accurate HMC methods to efficiently and accurately quantify uncertainties in neural networks and neural operators. The proposed approach leverages an initial VI training on the full network. We examine the influence of individual parameters on the prediction uncertainty, which shows that a large proportion of the parameters do not contribute substantially to uncertainty in the network predictions. This information is then used to significantly reduce the dimension of the parameter space, and HMC is performed only for the subset of network parameters that strongly influence prediction uncertainties. This yields a framework for accelerating the full batch HMC for posterior inference in neural networks. We demonstrate the efficiency and accuracy of the proposed framework on deep neural networks and operator networks, showing that inference can be performed for large networks with tens to hundreds of thousands of parameters. Finally, we show that this method can effectively learn surrogates for complex physical systems by modeling the operator that maps from upstream conditions to wall-pressure data on a cone in hypersonic flow.

Bayesian inference↗