Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Probabilistic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Dose Consequence and Probabilistic Risk Assessment Integration into Digital Documented Safety Analysis

This is an intern poster presentation. The current reactor authorization process is complex and error prone. The development of a digital Documented Safety Analysis has been proposed to provide an automated and integrated solution to enhance the design and authorization process. The digital DSA will consist of interlinked models, analyses, and reports, all of which will be updated using automated workflows when design changes are made. This poster examines the integration of the probabilistic risk assessment (PRA) with the transient and dose consequence analyses. A PRA for a generic high temperature gas-cooled reactor (HTGR) has been constructed which will drive the input parameters for a transient analysis model currently being constructed. Dose consequence will be determined using the results of the transient analysis and the Radiation Safety Analysis Computer (RSAC) code. Dose consequence data will then be input back into the PRA to drive design parameters.

42 ENGINEERING↗
DOE OSTI2023

Quantifying the effect of late bombardment on terrestrial zircons

The first 500 million years of Earth history is thought to be a period of intense planetary bombardment, but the timing and flux of this meteorite bombardment is poorly understood. In particular, on the basis of an inferred lunar impact history, some workers have hypothesized a ~3.9 Ga terminal cataclysm (TC) in which there was marked increase in the impact flux affecting the Moon, the Earth and possibly other terrestrial planets. Minerals that survived this enigmatic period offer a way to test early planetary bombardment models as they may contain telltale micro- to nanoscale shock features. Here, we present results from a numerical modeling calculation that assesses the probability that a zircon residing in the crust would escape shock melting or shock deformation during a TC bombardment event. Even with conservative pressure estimates for zircon shock deformation and intermediate bombardment intensities, we find that only ~6% of ≥4.0 Ga crust would be expected to survive a 3.9 Ga cataclysm without experiencing either complete melting or zircon shock metamorphism. In this study, we couple this modeling with a search for shock effects in the oldest zircons from the Acasta Gneiss Complex, which would have been present in the Earth's crust during a putative 3.9 Ga TC. Spatially correlated electron and NanoSIMS ion microscopy of 4.02 Ga igneous zircons from Acasta reveals no evidence of ancient shock. These data, together with similar results from other Hadean zircon suites, confirm that a post-Hadean TC is unlikely to have occurred. We suggest that the dearth of pre-3.9 Ga terrestrial crust and zircons is instead best explained by endogenic processes related to the mechanisms of early crust formation. Our modeling allows us to evaluate bombardment scenarios from the terrestrial zircon record by applying probabilistic interpretations to zircon shock deformation data. This approach will be valuable for other planetary bodies, allowing broader conclusions to be drawn from geographically limited datasets.

58 GEOSCIENCES↗
DOE OSTI2023

Wildfire Risk Evaluation Framework for Grid Operations and Planning

The United States (US) environmental protection agency's (EPA's) climate change indicators for wildfires show a long-term trend of increased annual wildfire activity, larger wildfire size, and more variable dynamics in wildfire behavior. This has caused more frequent preemptive public safety power shutoff (PSPS) events in the regions with recognized high wildfire risk. These preemptive power shutoffs attempt to prevent the ignition of a wildfire but it nonetheless renders the transmission line non-operational, which often sheds load of downstream communities. As wildfires and PSPS events become more frequent, it is crucial to find the communities most at risk of load shedding. To that end, this paper proposes the wildfire risk evaluation of the system (WiRES) framework, which is a performance-based framework that translates extreme weather-related and PSPS event probabilities into a cumulative probability of a non-operational transmission line. This study also provides a geospatial visualization tool that breaks down the entire western electrical coordinating council (WECC) region into 50 km grid cells which can be used to 1) filter out transmission lines with higher than a threshold outage probability, and 2) graphically discover the affected regions and their biophysical and socioeconomic metrics. %such as the social vulnerability index, population density, gross domestic product, etc. Lastly, an impact assessment study is conducted which connects the results of the proposed framework to python and powerworld-based contingency analysis to highlight the applicability of the framework.

Wildfire, Resilience, Extreme Events, Grid Reslien↗
DOE OSTI2021

Developing Generic Prior Distributions for Common Cause Failure Alpha Factors and Causal Alpha Factors

This report is a revision of the original report, INL/LTD-17-43723. Distribution of the original report was to the Nuclear Regulatory Commission (NRC) only, and the report was not made available to the public. The original report was revised as this report for public distribution. This report presents the latest update of generic prior distributions for common cause failure (CCF) alpha factors, as well as the development of new generic prior distributions for CCF causal alpha factors. The history of CCF treatment and parameter estimations is reviewed. The existing process for developing generic prior distributions is reviewed and used to develop new priors for CCF alpha factors and causal alpha factors. For causal alpha factors, different priors are developed for the five different CCF cause groups: Component (GC), Design (GD), Environment (GE), Human (GH), and Other (GO). These generic prior distributions could be used in the Standardized Plant Analysis Risk (SPAR) models for CCF parameter estimation. The issues and preliminary thoughts regarding prior distribution development are documented. Potential future work is then proposed for improving the process of developing priors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

On the quantification and efficient propagation of imprecise probabilities with copula dependence

This paper addresses the problem of quantification and propagation of uncertainties associated with dependence modeling when data for characterizing probability models are limited. Practically, the system inputs are often assumed to be mutually independent or correlated by a multivariate Gaussian distribution. However, this subjective assumption may introduce bias in the response estimate if the real dependence structure deviates from this assumption. In this work, we overcome this limitation by introducing a flexible copula dependence model to capture complex dependencies. Here, a hierarchical Bayesian multimodel approach is proposed to quantify uncertainty in dependence model-form and model parameters that result from small data sets. This approach begins by identifying, through Bayesian multimodel inference, a set of candidate marginal models and their corresponding model probabilities, and then estimating the uncertainty in the copula-based dependence structure, which is conditional on the marginals and their parameters. The overall uncertainties integrating marginals and copulas are probabilistically represented by an ensemble of multivariate candidate densities. A novel importance sampling reweighting approach is proposed to efficiently propagate the overall uncertainties through a computational model. Through an example studying the influence of constituent properties on the out-of-plane properties of transversely isotropic E-glass fiber composites, we show that the composite property with copula-based dependence model converges to the true estimate as data set size increases, while an independence or arbitrary Gaussian correlation assumption leads to a biased estimate.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Hazards and Probabilistic Risk Assessments of Advanced Nuclear Reactors Coupled with Industrial Facilities

This report provides a roadmap and tool kit for site specific risk assessments across a broad range of industrial customers co-located with advanced nuclear power plants (ANPP) that are not currently built and operating in the U.S. This report builds upon the body of work sponsored by the Department of Energy (DOE) Integrated Energy Systems Pathway that has produced industrial requirements studies and techno-economic assessments on the topics of feasibility of ANPP supported industrial processes. This report also leverages the DOE Light Water Reactor Sustainability (LWRS) program that has presented hazards assessment and generic probabilistic risk assessments (PRAs) for the addition of a heat extraction system (HES) to light-water reactors (LWRs) co-located with hydrogen production facilities. Many of the hazard assessments and risk assessments performed for the LWRS report are agnostic to whether the nuclear reactor is an ANPP or were adapted to the ANPP focus. The report performs hazards assessments to include industrial facilities: an oil refinery, a methanol plant, a synthetic fuel (synfuel) plant, the production of synthetic gas (syngas) as part of the methanol and synfuel plants, wood pulp and paper mills, and hydrogen production. Hydrogen production facilities are assessed in depth through prior reports in the LWRS program and the results are leveraged in this report. All these facilities are specified through industrial process and requirements research performed by national laboratories, universities, and interaction with industry. Many of the processes used in this report are pre-conceptual designs to use for decarbonization of the current technology facilities. A process of failure modes and effects analysis (what can go wrong) and accidentology (what has historically gone wrong) was used to determine the hazards presented to the nuclear power plant by the addition of the HES and the industrial customer. Chemical properties of feedstocks and products are summarized as part of the hazards assessment. Example analysis procedures are provided for each of the hazard types identified. These deterministic analyses can be used to assess adherence to licensing criteria. They can also be used to meet other safety goals like protection of the public, workers, or industrial facility equipment. A modular high temperature gas-cooled reactor (MHTGR) PRA only existing on paper was modeled and verified in modern PRA software. This will provide a tool for representative ANPP probabilistic analyses for future research.

10 SYNTHETIC FUELS↗
DOE OSTI2024

Learning Constrained Parametric Differentiable Predictive Control Policies With Guarantees

We present differentiable predictive control (DPC), a method for offline learning of constrained neural control policies for nonlinear dynamical systems with performance guarantees. We show that the sensitivities of the parametric optimal control problem can be used to obtain direct policy gradients. Specifically, we employ automatic differentiation (AD) to efficiently compute the sensitivities of the model predictive control (MPC) objective function and constraints penalties. To guarantee safety upon deployment, we derive probabilistic guarantees on closed-loop stability and constraint satisfaction based on indicator functions and Hoeffding’s inequality. We empirically demonstrate that the proposed method can learn neural control policies for various parametric optimal control tasks. In particular, we show that the proposed DPC method can stabilize systems with unstable dynamics, track time-varying references, and satisfy nonlinear state and input constraints. Our DPC method has practical time savings compared to alternative approaches for fast and memory-efficient controller design. Specifically, DPC does not depend on a supervisory controller as opposed to approximate MPC based on imitation learning. We demonstrate that, without losing performance, DPC is scalable with greatly reduced demands on memory and computation compared to implicit and explicit MPC while being more sample efficient than model-free reinforcement learning (RL) algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Surrogate Modeling For Efficiently Accurately and Conservatively Estimating Measures of Risk

We present a surrogate modeling framework for conservatively estimating measures of risk from limited realizations of an expensive physical experiment or computational simulation. We adopt a probabilistic description of risk that assigns probabilities to consequences associated with an event and use risk measures, which combine objective evidence with the subjective values of decision makers, to quantify anticipated outcomes. Given a set of samples, we construct a surrogate model that produces estimates of risk measures that are always greater than their empirical estimates obtained from the training data. These surrogate models not only limit over-confidence in reliability and safety assessments, but produce estimates of risk measures that converge much faster to the true value than purely sample-based estimates. We first detail the construction of conservative surrogate models that can be tailored to the specific risk preferences of the stakeholder and then present an approach, based upon stochastic orders, for constructing surrogate models that are conservative with respect to families of risk measures. The surrogate models introduce a bias that allows them to conservatively estimate the target risk measures. We provide theoretical results that show that this bias decays at the same rate as the L 2 error in the surrogate model. Our numerical examples confirm that risk-aware surrogate models do indeed over-estimate the target risk measures while converging at the expected rate.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Sequential Decision Making (SDM) for Mesh Refinement and Model Selection in Multiscale, Multi-Physics Applications

Intelligent automation and decision support are needed to enhance computational efficiency and robustness in multiscale and multi-physics problems, including materials science, manufacturing, and climate and weather modeling. Current scientific computing approaches for enabling decisions by scientists fail to explore the role of learning, reasoning, and probabilistic planning. Often these decisions are not performed in real-time during the computation but are made prior to the start of the computation, which must be interrupted in order to make changes to the prior choices. Such interruptions at different stages of the computation increase the total computing time and the need for a human expert to frequently monitor the results. State of art scientific computing methods consist of rule-based algorithms that cannot automatically adapt to a dynamically changing computing environment. The development of a Sequential Decision Making (SDM) framework will automate scientific computing by optimizing the policies for mesh refinement, time-stepping, model and algorithm selection, resource allocation, and pre and post-processing. Our agent SDM framework for scientific computing will consist of data-driven learning (Classifier), automated reasoning (contextual knowledge), and probabilistic planning (Reinforcement Learning). In this project, we focused on three problems to demonstrate our SDM framework on a set of ordinary and partial differential equations. Classification of Lorenz system regions using Feed-Forward Neural Networks examined learning in the SDM framework. On the other hand, reasoning and planning in the SDM framework were used in two problems: adaptive time-stepping for nonlinear ODEs using on-policy RL algorithms, and adaptive mesh refinement for 2-D PDEs using off-policy RL algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The WRF-Solar Ensemble Prediction System to Provide Solar Irradiance Probabilistic Forecasts

In this study, we introduce the recently developed WRF-Solar Ensemble System (WRF-Solar EPS) and a calibration method. The performances of forecast models are evaluated using the National Solar Radiation Data Base (NSRDB) observational analysis for day-ahead solar irradiance predictions. The results demonstrate that the ensemble forecast improves the quality of the forecasts by taking into account the uncertainty of each ensemble member. The Analog Ensemble (AnEn) calibration contributed to the reduction of positive bias and an overall improvement in the probabilistic attributes such as reliability and statistical consistency.

analog ensemble↗
DOE OSTI2022

Uncertainty-Informed Operation Coordination in a Water-Energy Nexus

The widespread deployment of smart heterogeneous technologies and the growing complexity in our modern society calls for effective coordination of the interdependent lifeline networks. In particular, operation coordination of electric power and water infrastructures is urgently needed as the water system is one of the most energy-intensive networks, an interruption in which may quickly evolve into a dramatic societal concern. This paper develops a novel analytic for uncertainty-aware day-ahead operation optimization of the interconnected power and water systems (PaWS). Joint probabilistic constraint (JPC) programming is employed to capture the uncertainties in wind resources and water demand forecasts. The proposed integrated stochastic model is presented as a non-linear non-convex optimization problem, where the non-linear hydraulic constraints in the water network are linearized using piece-wise linearization technique, and the non-convexity is efficiently tackled with a solution methodology to convert the proposed model with JPCs to a tractable mixed-integer linear programming (MILP) formulation that can be quickly solved to optimality. Here, the suggested framework is applied to a 15-node commercial-scale water network jointly operated with a power transmission system using a modified IEEE 57-bus test system. The numerical results demonstrate the of the proposed stochastic framework, resulting in cost reduction (13% on average when compared to the traditional setting) and energy saving of the integrated model under different realizations of uncertain renewable energy sources (RESs) and water demand scenarios. Additionally, the scalability of the proposed model is tested on a modified IEEE 118-bus test system connected to five water networks.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Neutrino-Argon Cross Sections in MicroBooNE: Measurements Spanning Multiple Interaction Channels, Final States, and Neutrino Fluxes

Neutrinos are one of the most elusive particles in the Standard Model of particle physics due to their tiny interaction cross section, which makes them challenging to detect and study. There are three known flavors of neutrinos, and any given neutrino probabilistically oscillates between them as a function of the particle's energy and propagation distance. Experimental characterization of these oscillations elucidates fundamental properties of the neutrino and the Standard Model. Meeting the precision goals of ongoing and future oscillation measurements requires detailed modeling of the way neutrinos interact with nuclear matter. Precision modeling of these interactions is a challenging theoretical problem, rich with intricate physics effects to explore, and requires input from equally precise measurements of neutrino-nucleus interaction cross sections spanning a broad range of scattering channels. To fill this need, there is an ongoing multi-experiment effort to measure these cross sections across energies, interaction channels, and nuclear targets. This thesis describes three analyses reporting neutrino-argon cross section measurements with data from the MicroBooNE liquid argon time projection chamber detector. These span multiple interaction channels, final state topologies, and neutrino fluxes. The first analysis is a set of inclusive charged current muon neutrino cross section measurements for final states with and without protons, which provides a unique view of the hadronic final state produced in these interactions. Second is a set of cross section measurements for neutral current neutral pion production, which provides a vital dataset on this under-characterized channel. Third is significant progress on measuring neutrinos produced by kaons decaying at rest, which represents a unique opportunity to measure cross sections with a mono-energetic flux of neutrinos. These measurements are accompanied by a modeling study in the GiBUU theory framework, which probes the sensitivity of the muon neutrino and pion production measurements to the modeling of nucleon-nucleon final state interactions in neutrino-nucleus scattering.

Bogart, Benjamin [Michigan U.]↗
DOE OSTI2020

Incorporating FLEX Strategies in Multi-Unit Probabilistic Risk Assessment

The catastrophic Fukushima nuclear accident reminded nuclear community about the possibilities of extreme accident scenarios, including those involving multiple reactor units on the same site. As the responses to the Fukushima accident, the nuclear power industry developed and implemented a series of strategies, including the Diverse and Flexible Coping Strategies (FLEX), to enhance the coping capacities of nuclear power plants (NPPs) under extreme accidents. This study intends to examine the impact of FLEX strategies on the risk from all the reactor units on the same NPP site, including risks from accidents involving a single unit and from accidents involving multiple units. The fundamental, methodological element of this study is Multi-Unit Probabilistic Risk Assessment (MUPRA), which requires a shift in Probabilistic Risk Assessment (PRA) from a “one-reactor-at-a-time” mindset to a “considering all reactors sharing a site as a unity” one. An integrated modeling approach for multi-unit event sequence development will be leveraged to develop MUPRA model and address the intra-unit and inter-unit dependencies. Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE), a PRA software developed and maintained by Idaho National Laboratory (INL) for the U.S. Nuclear Regulatory Commission (NRC), will serve as the platform for MUPRA modeling. This study selects Loss Of Offsite Power (LOOP) as a representative initiating event, which may occur on a generic two-unit NPP site and impacts both reactor units on the site. First, an MUPRA model, including multi-unit event trees, will be developed to obtain single-unit and multi-unit accident scenarios. Next, different FLEX strategies will be assumed, including FLEX equipment for a unit cannot be used for another unit, FLEX equipment for multiple units can be used in a cross-connected manner, etc. Lastly, the effectiveness of each postulated FLEX strategy will be evaluated by incorporating the corresponding FLEX equipment and deployment logic in the MUPRA model.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Hydrogen Extremely Low Probability of Rupture Version 1

SAND2024-08511O The Hydrogen Extremely Low Probability of Rupture (HELPR) software toolkit provides probabilistic fracture assessments of natural gas infrastructure for transporting hydrogen. Using probabilistic sampling and sensitivity analysis—along with engineering fatigue and fracture mechanics— the software develops models that can predict structural integrity measures for natural gas pipelines under stress. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Schroeder, Benjamin↗
DOE OSTI2026

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗
DOE OSTI2023

Simulation-Based Recovery Action Analysis Using the EMRALD Dynamic Risk Assessment Tool

A recovery action is defined as the action that prevents deviant conditions from producing unwanted effects. It generally indicates a kind of countermeasure performed in response to a failure of human action. The recovery actions especially play an important role in complex systems like nuclear power plants (NPPs), which consist of highly sophisticated controllers to ensure that desired performance and safety must be achieved and maintained. This is because a combination of human error and its recovery failure may be able to cause a catastrophic effect on a system. Analyzing recovery actions has been a critical part of HRA, which is a technique to evaluate human errors and provide human error probabilities (HEPs) for application in probabilistic safety assessment (PSA). If recovery actions are not adequately analyzed and applied to PSA models, the PSA results may be under-estimated or be not able to reasonably account for the failure of human actions in the context of PSA. For this reason, some regulatory documents such as ASME/ANS RA-Sb-2013 by the American Society for Mechanical Engineers and the American Nuclear Society and NUREG-1792 by U.S. Nuclear Regulatory Commission have emphasized the importance of recovery analysis within the HRA. A couple of existing HRA methods, such as the Technique for Human Error-Rate Prediction (THERP), the Cause-Based Decision Tree (CBDT), and the Korean Standard HRA (K-HRA), have respectively suggested their own approaches to the HRA recovery analysis. However, there are a couple of limitations to treating recovery actions using only the current HRA methods available. The biggest limitation is that the existing recovery analysis does not explicitly consider a variety of recovery action types and recovery sequences as they occur in actual NPPs. To handle the limitations of existing recovery analysis, this study proposes a simulation-based recovery analysis method using the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) software. The EMRALD software is a dynamic simulation tool for PSA. It supports realistic and dynamic modeling of human actions as they would be performed at NPPs. It is also favorable to simultaneously model the specific moment at which an action is performed, the time it takes to perform the action, and the failure probability of that action. In this paper, a detailed methodology for modeling recovery actions in the simulation platform is proposed with a couple of examples. Then, outputs from the simulation are discussed as reviewing if this novel approach can complement the challenges of existing recovery analyses.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Generative learning of densities on manifolds

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent) spaces in the high-dimensional data (ambient) space. Two approaches for sampling from the latent data density are described. The first is a score-based diffusion model, which is trained to map a standard normal distribution to the latent data distribution using a neural network. The second one involves solving an Itô stochastic differential equation in the latent space. Additional realizations of the data are generated by lifting the samples back to the ambient space using Double Diffusion Maps , a recently introduced technique typically employed in studying dynamical system reduction; here the focus lies in sampling densities rather than system dynamics. The proposed approaches enable sampling high dimensional data densities restricted to low-dimensional, a priori unknown manifolds. The efficacy of the proposed framework is demonstrated through a benchmark problem and a material with multiscale structure.

Double diffusion maps↗
DOE OSTI2024

Emulator-Based Bayesian Calibration of the CISNET Colorectal Cancer Models

Purpose To calibrate Cancer Intervention and Surveillance Modeling Network (CISNET)'s SimCRC, MISCAN-Colon, and CRC-SPIN simulation models of the natural history colorectal cancer (CRC) with an emulator-based Bayesian algorithm and internally validate the model-predicted outcomes to calibration targets.Methods We used Latin hypercube sampling to sample up to 50,000 parameter sets for each CISNET-CRC model and generated the corresponding outputs. We trained multilayer perceptron artificial neural networks (ANNs) as emulators using the input and output samples for each CISNET-CRC model. We selected ANN structures with corresponding hyperparameters (i.e., number of hidden layers, nodes, activation functions, epochs, and optimizer) that minimize the predicted mean square error on the validation sample. We implemented the ANN emulators in a probabilistic programming language and calibrated the input parameters with Hamiltonian Monte Carlo-based algorithms to obtain the joint posterior distributions of the CISNET-CRC models' parameters. We internally validated each calibrated emulator by comparing the model-predicted posterior outputs against the calibration targets.Results The optimal ANN for SimCRC had 4 hidden layers and 360 hidden nodes, MISCAN-Colon had 4 hidden layers and 114 hidden nodes, and CRC-SPIN had 1 hidden layer and 140 hidden nodes. The total time for training and calibrating the emulators was 7.3, 4.0, and 0.66 h for SimCRC, MISCAN-Colon, and CRC-SPIN, respectively. The mean of the model-predicted outputs fell within the 95% confidence intervals of the calibration targets in 98 of 110 for SimCRC, 65 of 93 for MISCAN, and 31 of 41 targets for CRC-SPIN.Conclusions Using ANN emulators is a practical solution to reduce the computational burden and complexity for Bayesian calibration of individual-level simulation models used for policy analysis, such as the CISNET CRC models. In this work, we present a step-by-step guide to constructing emulators for calibrating 3 realistic CRC individual-level models using a Bayesian approach.

artificial neural networks↗