Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Sensitivity of the active neutron coincidence collar response during simulated and experimental fresh fuel assay

Verification of the fissile (and fertile) content in fresh nuclear fuel assemblies is conducted by the IAEA to enforce the Nuclear Non-Proliferation Treaty using the UNCL (Uranium Neutron Collar — Light Water Reactor Fuel). The UNCL uses an uncorrelated AmLi neutron source to interrogate the fuel, producing a signal of coincident fission neutrons (Doubles rate) used to assay 235 U content of the fuel. The cost of producing calibration assemblies and limited availability of diverse commercial assemblies at any one time historically restricted the ability to explore the full parameter space experimentally. Monte Carlo simulations can overcome this, but introduce additional sources of uncertainty. In this work, the sensitivity of simulations and measurements to various parameters is assessed for a reference 1616 PWR assembly of uniform 3.2% enrichment. Uncertainty contributions in this evaluation include: simulated AmLi neutron source spectrum, AmLi neutron emission rate, AmLi anisotropicity, high density polyethylene (HDPE) density, the precise position of the fuel assembly within the detector, and experimentally the statistical uncertainty. The overall total systematic uncertainty estimate for the simulation of the absolute/relative Doubles rates responses are estimated to be approximately 2.0%/1.5%, and for experimental measurements systematic uncertainty reduces to 1.1%. This analysis supports further work using the relative Doubles rates in place of measurements for updating and extending the UNCL analysis methodology as systematic uncertainty is reasonably small.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Simultaneous inference of equation of state parameters and unknown data errors with uncertainty quantification via hierarchical Bayesian posterior maximization

Equations of state (EOSs) are a key component in running hydrodynamic simulations as they relate the thermodynamic states for the material. The Davis reactants EOS is commonly used for modeling high explosives (HEs), and the EOS model parameters are calibrated using material specific data. The calibrations are often performed with uncertainty quantification via Bayesian inference to account for uncertainty in the data and generate ensembles of likely parameters. However, there are relatively few HE data sets to use for calibration and many are historical and lack error information. In this work, we simultaneously calibrate the Davis reactants EOS model parameters and unknown data error terms for the high explosive PBX 9501. To quantify the uncertainty in the models and the data, we use a Bayesian framework for the calibration and compute the hierarchical Bayesian posterior distribution with both a posteriori maximization approach and Markov Chain Monte Carlo. In general, we find that, given our assumptions, the two approaches result in similar calibrated parameters, posterior covariance matrices, and insights about the parameters but that the posterior maximization requires far less computational resources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A better understanding of the mechanics of borehole breakout utilizing a finite strain gradient-enhanced micropolar continuum model

Borehole breakout denotes the failure in rock mass subjected to drilling, caused by stress concentrations exceeding the material strength. Depending on the material properties, the preexisting in situ stress state, and the borehole dimensions, different types of borehole breakout, such as spiral-shaped breakout or v-shaped breakout, are distinguished in the literature. In the present work, we address the influence of the material properties on the predicted borehole breakout mode in a comprehensive finite element study. To this end, herein we employ a gradient-enhanced micropolar damage-plasticity model based on the Mohr–Coulomb strength criterion, formulated in the finite strain regime, which is calibrated based on experimental results from plane strain compression tests on Red Wildmoor sandstone. In the numerical study, the influence of the in situ stress state, the material friction angle, plastic dilation, post peak residual strength, and the inherent material length scale parameters are investigated. Thereby, we demonstrate that depending on the material parameters, substantially different failure modes, characterized by strongly localized shear bands or diffuse failure zones, are predicted. It is shown that in particular the brittleness of the material in the post peak regime has a major influence on the predicted breakout type. Moreover, a statistical validation of the results is obtained by considering different random field distributions of the initial material strength.

58 GEOSCIENCES↗
DOE OSTI2024

Accurate field-level weak lensing inference for precision cosmology

We present miko, a catalog-to-cosmology pipeline for general flat-sky field-level inference, which provides access to cosmological information beyond the two-point statistics. In the context of weak lensing, we identify several new field-level analysis systematics (such as aliasing, Fourier mode-coupling, and density-induced shape noise), quantify their impact on cosmological constraints, and correct the biases to a percent level. Next, we find that model misspecification can lead to both absolute bias and incorrect uncertainty quantification for the inferred cosmological parameters in realistic simulations. The Gaussian map prior infers unbiased cosmological parameters, regardless of the true data distribution, but it yields overconfident uncertainties. The log-normal map prior quantifies the uncertainties accurately, although it requires careful calibration of the shift parameters for unbiased cosmological parameters. Here, we demonstrate systematics control down to the 2% level for both models, making them suitable for ongoing weak lensing surveys.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Implementing belowground controls on nutrient uptake in ELMv2-SPRUCE improves representation of a boreal peatland ecosystem

Boreal peatlands store 13 %–32 % of the global soil carbon (C) stock, a service dependent on plant-mycorrhizal fungi associations. In these nutrient poor systems, ectomycorrhizal and ericoid mycorrhizal fungi supply up to >80 % of the nutrient requirements of their plant hosts, partly with mined nitrogen (N) and phosphorus (P) from soil organic matter that are otherwise inaccessible to plants. Despite the ecological significance, mycorrhizal associations are only represented in a few land surface or ecosystem models. We modify the peatland branch of version 2 of the Energy Exascale Earth System Land Model (ELMv2-SPRUCE) to replace the default photosynthesis-driven inorganic N and P (NP) uptake process with a more realistic representation of the process via three pathways: (1) direct inorganic NP uptake by uncolonized fine roots, (2) indirect inorganic NP acquisition and (3) indirect NP acquisition from organic sources by mycorrhizal roots. We systematically evaluated the performance of the default and modified models with field observations from a whole ecosystem warming and carbon dioxide fertilization experimental site: Spruce and Peatland Responses Under Changing Environment (SPRUCE), in northern Minnesota, USA. The modified model reduces the underestimation of the growth response of shrubs in the default model to warming from 40 %–80 % to 17 %–35 % and reduces the overall relative absolute error on C fluxes from 1.61 to 1.54 in calibration. Improvements on modeled shrub growths and shrub-moss community net ecosystem exchanges are also seen in validation. The improved growth response of shrubs to warming is accompanied by several-fold increase in direct inorganic NP uptake and decrease in fungal colonization rate. The modified model simulates a smaller magnitude of transition of the ecosystem from C sink to C source under warming due to alleviation of plant nutrient limitation. Equifinality analysis shows the newly added parameters in the modified model can be constrained by the observed C fluxes. Sensitivity analysis shows the newly added parameters have stronger statistical interactions than the preexisting parameters in the default model. Overall, the modified model is an improvement over the default ELMv2-SPRUCE and will be a useful tool for understanding boreal peatland change.

Wang, Yaoping [Oak Ridge National Laboratory (ORNL↗
DOE OSTI2020

Uncertainty about the Uncertainty [Slides]

A golden standard in science is to repeat an experiment a statistically significant number of times, recording data using the same set of detectors and the same data analysis methodology. In such case experimental error includes both the range of true values generated by repetitions of the experiment, and measurement uncertainty caused by the detector. They are independent. It is a huge and too frequently used simplification, to assume that one can measure multiple repetitions of an identical experiment, resulting in identical true experimental value. Repetitions, as similar is it is experimentally achievable result in a range of the true values rather than in a single value. When modern, very sensitive and well calibrated measurement systems are used, this range is not negligible, and sometimes dominates, in comparison to the measurement uncertainty. Range of true values depends on the physics of the experiment, while measurement uncertainty depends on the measurement method (properties of the detector not of the experiment). When data from one–of–a kind experiment are analyzed, only the measurement uncertainty is reported. It gives no information about the range, in which the true values of experiment would spread if the experiment was repeated. A frequently used approximation, that if a physical quantity is measured as a function of time, only measurement of this quantity, produces uncertainty is also in some real experiments fare to strong. Example: In reaction history time measurement uncertainty propagated to alpha dominated under certain conditions over the flux measurement uncertainty propagated to alpha. Reliability of a data point is in general independent from its measurement uncertainty. However, in practice reliable measurement methods frequently have high measurement uncertainty, while low reliability methods are applied to limit measurement uncertainty. Comparison of reliable data with high measurement uncertainty to not so reliable data measured with low uncertainty is discussed – in different scenarios different data analysis methods are applicable.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

An integrated approach to derive relative permeability from capillary pressure

Surface tension affects all aspects of fluid flow in porous media. Through measurements of surface tension interaction under multiphase conditions, a relative permeability curve can be determined. Relative permeability is a numerical description of the interaction between two or more fluids and the porous media. It is a critical parameter for various tools that characterize subsurface multiphase flow systems, such as numerical simulation for carbon sequestration, oil and gas development, and groundwater contamination remediation. Therefore, it is critical to get a good statistical distribution of relative permeability in the porous media under study. Empirical formula for determining relative permeability from capillary pressure are already well established but do not provide the needed flexibility that is required to match laboratory-derived relative permeability curves. By expanding the existing methods for calculating relative permeability from capillary pressure data, it is possible to create both two and three-phase relative permeability curves. Mercury intrusion capillary pressure (MICP) data from the Morrow 'B' Sandstone coupled with interfacial tension and contact angle measurements were used to create a suite of relative permeability curves. Furthermore, these curves were then calibrated to a small sample of existing laboratory curves to elucidate common fitting parameters for the formation that were then used to create relative permeability curves from MICP data that does not have an associated laboratory-measured relative permeability curve.

58 GEOSCIENCES↗
DOE OSTI2022

Worldwide Physics-Based Lifetime Prediction of c-Si Modules Due to Solder-Bond Failure

Lifetime prediction of the fielded c-Si solar modules due to location-specific weather conditions has been an important topic of photovoltaic research and the economic viability of solar energy. Data analytic techniques such as the performance ratio method, Statistical clear sky model, and Suns-Vmp methods quantify the degradation from measured data of a solar farm, however, the nonlinear time-dependence and correlated degradations make it difficult to use the empirical degradation rates for ultimate lifetime projection. In this article, we propose a complementary physics-based model to predict the solder bond failure caused by mechanical stress associated with the variations of the temperature. Integrating the worldwide weather information from NASA/NSRDB databases, the model predicts the location-specific output-power degradation and the lifetime of a module due to solder bond failure. The model parameters are calibrated against qualification tests involving thermal cycling of specific batches of modules from a specific technology/manufacturer. The results may be summarized as: 1) Modules installed at higher latitudes show a longer lifetime due to reduced damage accumulation. 2) The reduction of temperature fluctuation close to large bodies of water, such as seashores, increases solder bond lifetime significantly. 3) Relatively speaking, modules installed close to the Tropic of Cancer/Capricorn (23.5 degrees North/South) suffer from a higher solder bond damage and have a shorter lifetime, suggesting a conservative design. This model should serve as a building block of a comprehensive reliability framework that can predict the lifetime of a module that experiences simultaneous and correlated degradation mechanisms involving yellowing, corrosion, and potential-induced degradation.

14 SOLAR ENERGY↗
DOE OSTI2024

Model run output for WM-ABM 2024 HESS Publication

Model output for computational experiments introducing WM-ABM. See associated HESS publication here: https://egusphere.copernicus.org/preprints/2023/egusphere-2023-1604/ all_nldas_cdl_data_v3.txt - Cropland Data Layer data aggregated to 1/8 degree resolution for input into the PMP calibration process. Variables include NLDAS ID, crop type, year, the count of pixels in the grid cell of the crop type, CDL crop ID, and GCAM crop ID. 20230115 ABM runs - WM-ABM model outputs for various scenarios described in HESS publication. If multiple versions exist (e.g., v2, v3, etc.) latest version indicates dataset generated for manuscript. The "baseline" run is the primary run, where as the "memXX" runs indicate sensitivity runs testing different parameters of agent memory. Output files starting with "abm_results_" include groundwater irrigated acres and surface water irrigated acres for each farm/agent combination. Other CSV outputs provide summary statistics of various agent and water shortage outcomes, used for generation of figures in the HESS manuscript.

ABM↗
DOE OSTI2021

A hierarchical Bayesian model for background variation in radiation source localization

In this paper, we apply a new model to account for varying background radiation in radiological source localization. We present a hierarchical Bayesian model that simultaneously infers background and source location parameters without requiring separate estimation of the background radiation at each detector location. We employ a simplified photon transport model to reduce the computational expense of Bayesian model calibration. Furthermore, we demonstrate the model accuracy by localizing a cesium-137 source in a simulated city block, and we analyze experimental field measurements with varying background. In both cases, the model provides sufficient fidelity that we can locate the source while simultaneously estimating background radiation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

An Efficient Bayesian Approach to Learning Droplet Collision Kernels: Proof of Concept Using “Cloudy,” a New n -Moment Bulk Microphysics Scheme

The small-scale microphysical processes governing the formation of precipitation particles cannot be resolved explicitly by cloud resolving and climate models. Instead, they are represented by microphysics schemes that are based on a combination of theoretical knowledge, statistical assumptions, and fitting to data (“tuning”). Historically, tuning was done in an ad hoc fashion, leading to parameter choices that are not explainable or repeatable. Recent work has treated it as an inverse problem that can be solved by Bayesian inference. The posterior distribution of the parameters given the data—the solution of Bayesian inference—is found through computationally expensive sampling methods, which require over $\mathcal{O}$(10 5 ) evaluations of the forward model; this is prohibitive for many models. We present a proof of concept of Bayesian learning applied to a new bulk microphysics scheme named “Cloudy,” using the recently developed Calibrate-Emulate-Sample (CES) algorithm. Cloudy models collision-coalescence and collisional breakup of cloud droplets with an adjustable number of prognostic moments and with easily modifiable assumptions for the cloud droplet mass distribution and the collision kernel. The CES algorithm uses machine learning tools to accelerate Bayesian inference by reducing the number of forward evaluations needed to $\mathcal{O}$(10 2 ). It also exhibits a smoothing effect when forward evaluations are polluted by noise. In a suite of perfect-model experiments, we show that CES enables computationally efficient Bayesian inference of parameters in Cloudy from noisy observations of moments of the droplet mass distribution. In an additional imperfect-model experiment, a collision kernel parameter is successfully learned from output generated by a Lagrangian particle-based microphysics model.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

SENTRA: A Modular Computational Graph Framework for Critical Mineral and Materials Supply Chains: Part I: Network Construction Latent-Quantity Estimation, and Temporal Graph Forecasting

Global supply chains for critical minerals and materials are complex, evolving networks of countries, products, production stages, and trade relationships. Existing analytical approaches are limited by fragmented data and static network representations that do not capture the dynamic production dependencies linking raw materials, intermediate products, and final goods across multiple countries. Trade and production statistics provide only a partial view of domestic production, inventories, and material flows, making it difficult to identify indirect sourcing pathways, hidden dependencies, and embedded foreign exposures. This paper introduces the Supply Chain Exposure Network Tracking and Risk Assessment (SENTRA) framework, a modular graph-based computational framework for constructing, analyzing, and forecasting dynamic supply chain networks. As the first paper in a three-part methodological series, it establishes the computational foundation of SENTRA by constructing a temporal attributed multi-relational graph whose nodes represent product–country pairs and whose edges encode observed trade and within-country value-chain relationships. Statistical estimation and constrained optimization recover latent production, final demand, and product input dependency coefficients while enforcing economic accounting constraints. Graph-derived exposure measures quantify direct, transshipment, value-chain, and multi-hop supply chain dependencies independently of the forecasting model. A temporal graph forecasting architecture based on a relational graph neural network then forecasts the evolution of the graph under mass-balance constraints with distribution-free conformal uncertainty quantification. Validation on the global aluminum supply chain shows that the learned graph representations recover economically meaningful supply chain structure, accurately forecast out-of-sample trade relationships, and produce well-calibrated prediction intervals. Subsequent papers apply this computational foundation to exposure assessment, disruption analysis, and scenario-based policy analysis, and extend the framework to multimaterial supply chain modeling and decision support.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Trace Element Analyses of Micron-Size Particles and Statistical Determination of Minimum Detection Limits

Savannah River National Laboratory (SRNL) has developed expertise in producing homogeneous, ca. 1 m-diameter spherical particles of mixed-element components, wherein dopants can be varied from a trace constituent (ppm) to wt.% concentrations. The samples used for this work are nickel-doped cerium oxide microspheres produced by SRNL. They were initially selected as analogs for plutonium-doped uranium oxide particles and analyzed as part of a larger study to evaluate whether electron probe microanalyzers (EPMA) can be used to characterize nuclear materials as an alternative or complementary method to mass spectrometers. The five samples used in this study contained nominal compositions of 0, 0.004, 0.04, 0.4 and 4 wt.% Ni. They were analyzed by both an Agilent 7900 Q-ICP-MS at SRNL and the JEOL JXA8530F Plus EPMA at the University of Minnesota. In addition to EPMA results (calibrated with high-precision Q-ICP-MS analyses) suggesting that the EPMA could address outstanding nuclear material characterization needs, these samples 1) showcase the ability of the EPMA to quantify not just trace concentrations, but trace concentrations in microparticles (1 m diameter, Fig. 1), and 2) offer a unique opportunity to evaluate the methodology for assessing the minimum detection limits of EPMA analyses.

McSwiggen, Peter [JEOL USA, 11 Dearborn Road, Peab↗
DOE OSTI2023

Measurement of the muon anomalous precession frequency at the Muon g − 2 Experiment at Fermilab

The anomalous magnetic moment of the muon, $a_\mu = \frac{g-2}{2}$ is the fractional deviation of the muon $g$-factor from the value of 2. It emerges as the cumulative effect of the virtual particles participating in the muon interaction with a magnetic field via quantum loop corrections. Its value encodes all the possible interactions between the virtual particles and, for this reason, represents an important test of the Standard Model (SM). In particular, any deviation from the SM theoretical evaluation could be due to new physics contributions. The new Muon $g-2$ (E989) Experiment at Fermilab is currently operating to repeat and improve the previous E821 experiment at Brookhaven National Laboratory (BNL), aiming to reduce the experimental error by a factor of 4 to the final accuracy of 140 parts per billion (ppb). On April 7th, 2021, the E989 collaboration published the first result based on the first year of data taking (Run-1), measuring $a_\mu = 0.001~165~920~40(54)$ with a precision of 460 ppb. The measured value is consistent with the BNL measurement and strengthens the long-standing tension with the data-driven SM prediction to a combined discrepancy of 4.2$\sigma$. On the theory side, however, new efforts involving lattice-QCD techniques are starting to question the current consensus on the theoretical prediction, demanding new improvements on both the experimental and theoretical sides. The E989 collaboration is now finalizing the analysis of Run-2 and Run-3 data and a new publication is expected in the first half of 2023 with a combined statistical uncertainty of 200 ppb. The anomalous magnetic moment $a_\mu$ is measured as the ratio between the muon spin anomalous precession frequency, $\omega_a$, and the average magnetic field experienced by the muons as they circulate in the storage ring. This thesis presents a precession frequency analysis of the Run-1 data and an evaluation of the related systematic uncertainties. A new positron reconstruction developed for the analysis of the subsequent data-taking periods, aiming to reduce some of the major systematic uncertainties of the $\omega_a$ measurement, is presented. The author's involvement in the production of the Run-2/5 data and in the precise calibration of the detectors is discussed. Finally, the complete Run-1 $a_\mu$ result is presented.

43 PARTICLE ACCELERATORS↗
DOE OSTI2026

Ripening of Rh Nanoparticle Catalysts in Reverse Water–Gas Shift via a Data-Driven Model Combining Physics, Theory, and Experiment

Degradation via sintering is an ongoing challenge that impedes the broad commercial success of supported metallic nanoparticle catalysts. To mitigate degradation via informed catalyst design and process operations, here we aim to disambiguate the underlying mechanisms of sintering by combining theory and experiment in a quantitative framework. While mechanistic sintering models exist, they only model a single sintering pathway, even though multiple sintering mechanisms can occur simultaneously or dominate at different stages of the process. Data-driven machine learning models have emerged as a means to represent complex processes through data regression. However, machine learning models have very large data needs and lack mechanistic insights due to their black-box encoding. To develop an interpretive model of catalyst degradation via sintering, we constructed a hybrid model combining mechanistic “physics-based” models and data-driven methods to obtain both reliable predictions and mechanistic insights regarding experimentally observed sintering phenomena. Focusing on nanoparticle sintering in the Rh–TiO 2 catalyst for the reverse water–gas shift (RWGS) reaction, the hybrid model couples a mechanistic term for Ostwald ripening with energy values calculated via density functional theory (DFT) with a parametric, data-driven discrepancy function term for unmodeled mechanisms. The hybrid model is trained using Bayesian inference with data collected from small-angle X-ray scattering (SAXS) in situ experiments wherein average nanoparticle diameter versus time was measured at three relevant operating temperatures. The calibrated hybrid model results show that an Ostwald ripening-only model parameterized with fixed DFT energies does not fully capture the time and temperature dependence of the SAXS-observed sintering kinetics, and that an additional functional contribution, or DFT energy calibration, is required to reconcile simulation and experiment. Analysis of the hybrid-model error confirms that the hybrid model outperforms both the purely mechanistic and purely data-driven alternatives in terms of expected predictive accuracy for time-evolving average particle sizes. Furthermore, the results support the hypothesis that the Ostwald ripening mechanism is less important for explaining the sintering phenomena as operating temperature increases under an assumed fixed DFT parameterization. This could be explained in one of two ways: either latent, unmodeled sintering mechanisms dominate at higher temperatures, or the DFT uncertainty increases with temperature. The proposed modeling approach directly links theory to experiments and simulations via a statistical hybrid modeling framework and can be extended to other catalytic systems to improve predictive models and mechanistic understanding.

Bayesian hybrid modeling↗
DOE OSTI2025

Comparisons of the v11.1 Orbiting Carbon Observatory‐2 (OCO‐2) X CO2 Measurements With GGG2020 TCCON

The Orbiting Carbon Observatory 2 (OCO-2) is NASA's first Earth observation satellite mission dedicated to studying the sources and sinks of carbon dioxide (CO 2 ) on a global scale. The observations of reflected sunlight are inverted in a retrieval algorithm to produce estimates of the dry air mole-fractions of CO 2 (X CO2 ). The OCO-2 Level 2 data release, version 11.1 (v11.1) retrievals from the Atmospheric Carbon Observations from Space (ACOS) algorithm, includes significant improvements in the X CO2 data product compared to older OCO-2 data versions. This work compares the v11.1 X CO2 from OCO-2 against X CO2 estimates collected from a global ground-based network known as the Total Carbon Column Observing Network (TCCON), OCO-2's primary validation source. The OCO-2 project provides a version of the Level 2 data product, called “lite” files that include calibrated and bias-corrected XCO2 values, accessible together with all OCO-2 data products through the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). This work shows that OCO-2 X CO2 observations made between September 2014 and December 2023, after quality filtering and the application of an averaging kernel correction, agree well with coincident TCCON data for all OCO-2 observational modes of land (nadir, glint, target) and ocean (glint). The aggregated, bias-corrected, and quality-filtered absolute average bias values are less than or equal to 0.20 parts per million (ppm) globally for all OCO-2 observation modes, where the biases do not indicate a statistically significant time dependence. The land nadir/glint mode has the lowest bias value of −0.03 ± 0.85 ppm.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Deep inference of simulated strong lenses in ground-based surveys

The large number of strong lenses discoverable in future astronomical surveys will likely enhance the value of strong gravitational lensing as a cosmic probe of dark energy and dark matter. However, leveraging the increased statistical power of such large samples will require further development of automated lens modeling techniques. We show that deep learning and simulation-based inference (SBI) methods produce informative and reliable estimates of parameter posteriors for strong lensing systems in ground-based surveys. We present the examination and comparison of two approaches to lens parameter estimation for strong galaxy-galaxy lenses — Neural Posterior Estimation (NPE) and Bayesian Neural Networks (BNNs). We perform inference on 1-, 5-, and 12-parameter lens models for ground-based imaging data that mimics the Dark Energy Survey (DES). We find that NPE outperforms BNNs, producing posterior distributions that are more accurate, precise, and well-calibrated for most parameters. For the 12-parameter NPE model, the calibration is consistently within <10% of optimal calibration for all parameters, while the BNN is rarely within 20% of optimal calibration for any of the parameters. Similarly, residuals for most of the parameters are smaller (by up to an order of magnitude) with the NPE model than the BNN model. This work takes important steps in the systematic comparison of methods for different levels of model complexity.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Comparing Individualized Survival Predictions From Random Survival Forests and Multistate Models in the Presence of Missing Data: A Case Study of Patients With Oropharyngeal Cancer

Background: In recent years, interest in prognostic calculators for predicting patient health outcomes has grown with the popularity of personalized medicine. These calculators, which can inform treatment decisions, employ many different methods, each of which has advantages and disadvantages. Methods: We present a comparison of a multistate model (MSM) and a random survival forest (RSF) through a case study of prognostic predictions for patients with oropharyngeal squamous cell carcinoma. The MSM is highly structured and takes into account some aspects of the clinical context and knowledge about oropharyngeal cancer, while the RSF can be thought of as a black-box non-parametric approach. Key in this comparison are the high rate of missing values within these data and the different approaches used by the MSM and RSF to handle missingness. Results: We compare the accuracy (discrimination and calibration) of survival probabilities predicted by both approaches and use simulation studies to better understand how predictive accuracy is influenced by the approach to (1) handling missing data and (2) modeling structural/disease progression information present in the data. We conclude that both approaches have similar predictive accuracy, with a slight advantage going to the MSM. Conclusions: Although the MSM shows slightly better predictive ability than the RSF, consideration of other differences are key when selecting the best approach for addressing a specific research question. These key differences include the methods’ ability to incorporate domain knowledge, and their ability to handle missing data as well as their interpretability, and ease of implementation. Ultimately, selecting the statistical method that has the most potential to aid in clinical decisions requires thoughtful consideration of the specific goals.

60 APPLIED LIFE SCIENCES↗