Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Probabilistic Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

Reliability-Based Design Optimization of a Composite Airframe Component

A stochastic design optimization methodology (SDO) has been developed to design components of an airframe structure that can be made of metallic and composite materials. The design is obtained as a function of the risk level, or reliability, p. The design method treats uncertainties in load, strength, and material properties as distribution functions, which are defined with mean values and standard deviations. A design constraint or a failure mode is specified as a function of reliability p. Solution to stochastic optimization yields the weight of a structure as a function of reliability p. Optimum weight versus reliability p traced out an inverted-S-shaped graph. The center of the inverted-S graph corresponded to 50 percent (p = 0.5) probability of success. A heavy design with weight approaching infinity could be produced for a near-zero rate of failure that corresponds to unity for reliability p (or p = 1). Weight can be reduced to a small value for the most failure-prone design with a reliability that approaches zero (p = 0). Reliability can be changed for different components of an airframe structure. For example, the landing gear can be designed for a very high reliability, whereas it can be reduced to a small extent for a raked wingtip. The SDO capability is obtained by combining three codes: (1) The MSC/Nastran code was the deterministic analysis tool, (2) The fast probabilistic integrator, or the FPI module of the NESSUS software, was the probabilistic calculator, and (3) NASA Glenn Research Center s optimization testbed CometBoards became the optimizer. The SDO capability requires a finite element structural model, a material model, a load model, and a design model. The stochastic optimization concept is illustrated considering an academic example and a real-life raked wingtip structure of the Boeing 767-400 extended range airliner made of metallic and composite materials.

Patnaik, Surya N.↗

A Probabilistic Asteroid Impact Risk Model

Asteroid threat assessment requires the quantification of both the impact likelihood and resulting consequence across the range of possible events. This paper presents a probabilistic asteroid impact risk (PAIR) assessment model developed for this purpose. The model incorporates published impact frequency rates with state-of-the-art consequence assessment tools, applied within a Monte Carlo framework that generates sets of impact scenarios from uncertain parameter distributions. Explicit treatment of atmospheric entry is included to produce energy deposition rates that account for the effects of thermal ablation and object fragmentation. These energy deposition rates are used to model the resulting ground damage, and affected populations are computed for the sampled impact locations. The results for each scenario are aggregated into a distribution of potential outcomes that reflect the range of uncertain impact parameters, population densities, and strike probabilities. As an illustration of the utility of the PAIR model, the results are used to address the question of what minimum size asteroid constitutes a threat to the population. To answer this question, complete distributions of results are combined with a hypothetical risk tolerance posture to provide the minimum size, given sets of initial assumptions. Model outputs demonstrate how such questions can be answered and provide a means for interpreting the effect that input assumptions and uncertainty can have on final risk-based decisions. Model results can be used to prioritize investments to gain knowledge in critical areas or, conversely, to identify areas where additional data has little effect on the metrics of interest.

Asteroid↗

Structural Reliability Using Probability Density Estimation Methods Within NESSUS

A reliability analysis studies a mathematical model of a physical system taking into account uncertainties of design variables and common results are estimations of a response density, which also implies estimations of its parameters. Some common density parameters include the mean value, the standard deviation, and specific percentile(s) of the response, which are measures of central tendency, variation, and probability regions, respectively. Reliability analyses are important since the results can lead to different designs by calculating the probability of observing safe responses in each of the proposed designs. All of this is done at the expense of added computational time as compared to a single deterministic analysis which will result in one value of the response out of many that make up the density of the response. Sampling methods, such as monte carlo (MC) and latin hypercube sampling (LHS), can be used to perform reliability analyses and can compute nonlinear response density parameters even if the response is dependent on many random variables. Hence, both methods are very robust; however, they are computationally expensive to use in the estimation of the response density parameters. Both methods are 2 of 13 stochastic methods that are contained within the Numerical Evaluation of Stochastic Structures Under Stress (NESSUS) program. NESSUS is a probabilistic finite element analysis (FEA) program that was developed through funding from NASA Glenn Research Center (GRC). It has the additional capability of being linked to other analysis programs; therefore, probabilistic fluid dynamics, fracture mechanics, and heat transfer are only a few of what is possible with this software. The LHS method is the newest addition to the stochastic methods within NESSUS. Part of this work was to enhance NESSUS with the LHS method. The new LHS module is complete, has been successfully integrated with NESSUS, and been used to study four different test cases that have been proposed by the Society of Automotive Engineers (SAE). The test cases compare different probabilistic methods within NESSUS because it is important that a user can have confidence that estimates of stochastic parameters of a response will be within an acceptable error limit. For each response, the mean, standard deviation, and 0.99 percentile, are repeatedly estimated which allows confidence statements to be made for each parameter estimated, and for each method. Thus, the ability of several stochastic methods to efficiently and accurately estimate density parameters is compared using four valid test cases. While all of the reliability methods used performed quite well, for the new LHS module within NESSUS it was found that it had a lower estimation error than MC when they were used to estimate the mean, standard deviation, and 0.99 percentile of the four different stochastic responses. Also, LHS required a smaller amount of calculations to obtain low error answers with a high amount of confidence than MC. It can therefore be stated that NESSUS is an important reliability tool that has a variety of sound probabilistic methods a user can employ and the newest LHS module is a valuable new enhancement of the program.

Chamis, Chrisos C.↗

The MCDB System for Management and Analysis of Petabyte-Scale Uncertain Data

Analysts working with very large data sets often use statistical models to “guess” at unknown, inaccurate, or missing information associated with the data. For example, a distant object viewed through an optical lens will have its position slightly shifted by imperfections in the lens. Thus, rather than considering the object’s observed position to be absolutely correct, it makes sense to take into account the lens’s imperfections to obtain a probabilistic guess as to the object’s true position. For another example, it might be important to associate some sort of error distribution with each of the individual sensors in an array of magnetometers. This error distribution may be complex and include spatially-driven covariances, because errors in nearby sensors are likely to be correlated (caused, for example, by the presence of some nearby, fixed metal object). This project is concerned with the design and implementation of a prototype data management system called the Monte Carlo Database System, or MCDB for short. MCDB allows an expert-level analyst or statistician to attach arbitrary stochastic models to very large data sets in order to “guess” the values for unknown or inaccurate data, such as the actual position of the observed object in the lens example above. When the resulting data set is analyzed, the underlying stochastic models are used to generate hundreds or thousands of possible data set instances, and each of those possible instances is analyzed separately by MCDB. Thus, MCDB does not just give a single answer to the analysis, but it actually gives an empirical distribution of query results that embody the underlying uncertainty, and can in turn be analyzed using standard statistical techniques. The stochastic models in MCDB are implemented as user-defined, external C++ libraries called Variable Generation functions (VG functions for short). Because the VG function interface is exceedingly general, it allows MCDB to be used in a very wide variety of application domains, in conjunction with virtually any stochastic model. Ultimately, we ended up calling the system that we developed over the course of the project SimSQL, to denote the fact that it allowed for stochastic simulation of data. The software developed during the lifetime of the project is available for download from the SimSQL project website: http://cmj4.web.rice.edu/SimSQL/SimSQL.html.

42 ENGINEERING↗

Dynamic Probabilistic Safety Assessment Studies for Advanced Reactor Using RAVEN

Probabilistic Safety Assessment (PSA) is used extensively to evaluate the risks associated with complex engineering systems like Nuclear Power Plants (NPPs). Current PSA models are based on the Event-Tree/Fault-Tree (ET/FT) methodology. ET and FT models are static and are based on Boolean logic approaches. In the past, concerns have been raised in the literature regarding the capability of the traditional static modelling approaches to adequately account for the impact of process, hardware, software, firmware and human interactions on the stochastic system behaviour. To overcome the limitations of the traditional approach to PSA, several dynamic PSA methodologies have been proposed. One of the dynamic PSA methodologies used for dynamic evaluations is Dynamic Event Tree (DET) framework which can be used to assess the impact of the parameter variability and scenario dynamics on the PSA model for the initiating event. The DET framework couples the stochastic model (number of component/trains that start on demand, operator action timing, etc.) with a Thermal-Hydraulic (TH) model of the plant. This paper explores the use of DET along with a case study on advanced reactor. The initiating event selected for the study was Class IV power supply failure event. The TH analysis considering uncertainty in various parameters was performed using RELAP5 and Reactor Analysis and Virtual control ENvironment (RAVEN) tool. Based on the uncertainty analysis, it is concluded that the peak clad temperatures (PCT) are within the limits in all the code runs implying a high-degree of safety margin. However, variation in time to reach the PCT was observed among the code runs and the mean time to reach the PCT was found to be around 8590sec (approximately 2.4 hours). Hence, sufficient time margin is available for human intervention and the operator might have a relatively stress-free state during such an accident scenario. Due to the static nature of the traditional PSA models, the safety margin available was lesser, whereas, with the help of dynamic PSA models, one can demonstrate that the actual available safety margin is more in the present case study and is valuable input from the design point of view.

99 GENERAL AND MISCELLANEOUS↗

Developing a Crew Time Model for Human Exploration Missions to Mars

Candidate human missions to Mars require mission lengths that could extend beyond those that have previously been demonstrated during crewed Lunar (Apollo) and International Space Station (ISS) missions. The nature of the architectures required for deep space human exploration will likely necessitate major changes in how crews operate and maintain the spacecraft. The uncertainties associated with these shifts in mission constructs - including changes to habitation systems, transit durations, and system operations - raise concerns as to the ability of the crew to complete required overhead activities while still having time to conduct a set of robust exploration activities. This paper will present an initial assessment of crew operational requirements for human missions to the Mars surface. The presented results integrate assessments of crew habitation, system maintenance, and utilization to present a comprehensive analysis of potential crew time usage. Destination operations were assessed for a short (approx. 50 day) and long duration (approx. 500 day) surface habitation case. Crew time allocations are broken out by mission segment, and the availability of utilization opportunities was evaluated throughout the entire mission progression. To support this assessment, the integrated crew operations model (ICOM) was developed. ICOM was used to parse overhead, maintenance and system repair, and destination operations requirements within each mission segment - outbound transit, Mars surface duration, and return transit - to develop a comprehensive estimation of exploration crew time allocations. Overhead operational requirements included daily crew operations, health maintenance activities, and down time. Maintenance and repair operational allocations are derived using the Exploration Maintainability and Analysis Tool (EMAT) to develop a probabilistic estimation of crew repair time necessary to maintain systems functionality throughout the mission.

Battfeld, Bryan↗

Upper bounds for 21st-century surface air temperatures in the Western United States

The last decade has seen a large number of severe heatwaves that were unprecedented in the observational record, highlighting challenges associated with observationally-based statistical quantification of the likelihood and magnitude of future extreme temperatures. An alternative to such probabilistic assessments is identification of upper bounds that quantify the hottest surface air temperatures that can possibly be achieved by the end of the 21st century. Theory, simulations, and observational analyses support the existence of a finite upper bound for surface air temperature; however, estimates for future upper-bound values that are realistic and usable for planning remain unavailable. Here, we combine atmospheric theory with large ensembles of dynamically downscaled projections to estimate historical and end-of-century upper bounds for surface air temperatures. A number of physical mechanisms can influence upper bounds, and at the end of the 21st century, estimates based on mechanisms that yield more moderate upper-bounds produce values around 60∘C for much of the Western United States and in excess of 80∘C for the hottest parts of the domain. Even cooler high-altitude locations have end-of-century upper bounds over 50∘C. Although these upper-bound estimates might seem implausibly large, increases in the upper bounds over the 21st century are similar to increases in dynamically downscaled peak surface temperatures after adjusting those downscaled temperatures to eliminate the possibly biased model trends in surface specific humidity. While upper bound estimates are high relative to historical observations, they nonetheless suggest that heatwave intensity risk is bounded, with uncertainty dominated by projections of surface and upper-level humidity.

Risser, Mark D↗

Towards a Robust Sampling Approach: A Computational Review and Design

As pointed out in several other works, the estimation of the reliability of the electrical grid can not be conducted without the estimation of the stochastic phenomena of electicity demand and electricity production by variable renewable sources. Therefore, sampling procedures have become integral in the design of engineering structures and analysis. Commonly referred to as Monte Carlo uncertainty analysis or integration, the general objective of these procedures is to establish specifics about the uncertainty of an output characteristic of such an engineering system, given uncertainty about its input characteristics. These sampling procedures are applied in a context in which establishing such specifics cannot be performed through other means. Variance-reduction techniques are designed to lessen the variability among estimators to estimate statistics of those output uncertainties. Importance-sampling techniques, on the other hand, are designed to reduce the number of samples needed to estimate a particular statistic—e.g., a tail probability. The combination of these approaches can reduce the computational burden considerably for a particular estimator and statistic. Importance sampling—geared and designed as it is toward improving a particular estimator—suffers, unfortunately, from the unintended consequence of reducing the performance of other estimators in terms of their variance. The objective of this paper is to offer an alternative sampling procedure where this variance does not grow unacceptably large for a suite of estimators. Moreover, it is anticipated that, with additional knowledge of how an engineering output characteristic responds to its input characteristics, tuning parameters of the input’s sampling procedure can be set to improve the output characteristic’s estimation. This work proves the effectiveness of the suggested alternative approach. Such positive outcome will lead to a decrease of the computational burden of performing stochastic optimization of integrated energy systems (e.g., components dispatch, and portfolio composition). In particular, capturing the contribution to the overall system cost of rare and unlikely events and patterns of the electricity demand and production will become less computationally expensive. This is due to the fact that the approach demonstrated here will allow the sampling of those rare occurrences more frequently without misrepresenting their probabilistic impacts.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Scalable optimal Bayesian classification of single-cell trajectories under regulatory model uncertainty

Single-cell gene expression measurements offer opportunities in deriving mechanistic understanding of complex diseases, including cancer. However, due to the complex regulatory machinery of the cell, gene regulatory network (GRN) model inference based on such data still manifests significant uncertainty. The goal of this paper is to develop optimal classification of single-cell trajectories accounting for potential model uncertainty. Partially-observed Boolean dynamical systems (POBDS) are used for modeling gene regulatory networks observed through noisy gene-expression data. We derive the exact optimal Bayesian classifier (OBC) for binary classification of single-cell trajectories. The application of the OBC becomes impractical for large GRNs, due to computational and memory requirements. To address this, we introduce a particle-based single-cell classification method that is highly scalable for large GRNs with much lower complexity than the optimal solution. The performance of the proposed particle-based method is demonstrated through numerical experiments using a POBDS model of the well-known T-cell large granular lymphocyte (T-LGL) leukemia network with noisy time-series gene-expression data.

59 BASIC BIOLOGICAL SCIENCES↗

Assessment of the Area of Review and Leakage Impact for Site 7 using the NRAP-IAM-CCS Tool, Northern Michigan Basin-CarbonSAFE Phase 1 Pre-Feasibility Study

U.S. Environmental Protection Agency’s (EPA’s) Class VI regulations require owners or operators of carbon storage projects to determine an Area of Review (AoR) representative of project risk to underground sources of drinking water (USDWs). The AoR is an estimate of the project footprint and is used to develop monitoring plans to ensure protection of USDWs. In this syudy, the NRAP-IAM-CS software tool was applied to estimate the AoR and the leakage potential of legacy wells located within the AoR to impact groundwater quality at a carbon storage screening site for the NMB-CS, Phase 1 project. The NRAP-IAM-CS is a science-based toolset developed by the U.S. Department of Energy for quantitative risk assessment of geologic sequestration of carbon dioxide (CO 2 ) (Pawar et al., 2016). The toolset adopts a stochastic approach in which predictions include site uncertainties using storage reservoir, leakage scenario, and shallow groundwater impact reduced order models (ROMs). Risk-based analysis done using the NRAP-IAM-CS yielded an AoR that was comparable to estimates defined by the critical pressure needed move fluid from the reservoir to the overlying USDW through an open wellbore. The risk-based AoR was slightly smaller than that based on the critical pressure (234 km 2 compared to 269 km 2 ), because small fluxes did not impact groundwater quality. Leakage from two legacy wells located within the AoR should not impact groundwater quality over the 30-year injection period. Legacy Well 1 penetrates the simulated CO 2 plume and would require a permeability of 5 x 10 -12 m 2 (~5 Darcy) to impact groundwater quality after about 20 years of injection. Legacy Well 2 falls outside of the CO 2 plume footprint, where reservoir pressures are too small to generate large enough leakage flux to change groundwater quality even with well permeabilities as high as 5 x 10 -11 m 2 (~50 Darcy). This work represents one of the first applications of the NRAP toolset for the screening of potential CO 2 storage sites. The toolset provides a risk-based method of evaluating the AoR and the impact of CO 2 or brine leakage through legacy wells. The following recommendations will strengthen the use of probabilistic assessments for site selection and permitting of Class VI CO 2 injection wells.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Assessing the Relative Risk of Aerocapture Using Probabalistic Risk Assessment

A recent study performed for the Aerocapture Technology Area in the In-Space Propulsion Technology Projects Office at the Marshall Space Flight Center investigated the relative risk of various capture techniques for Mars missions. Aerocapture has been proposed as a possible capture technique for future Mars missions but has been perceived by many in the community as a higher risk option as compared to aerobraking and propulsive capture. By performing a probabilistic risk assessment on aerocapture, aerobraking and propulsive capture, a comparison was made to uncover the projected relative risks of these three maneuvers. For mission planners, this knowledge will allow them to decide if the mass savings provided by aerocapture warrant any incremental risk exposure. The study focuses on a Mars Sample Return mission currently under investigation at the Jet Propulsion Laboratory (JPL). In each case (propulsive, aerobraking and aerocapture), the Earth return vehicle is inserted into Martian orbit by one of the three techniques being investigated. A baseline spacecraft was established through initial sizing exercises performed by JPL's Team X. While Team X design results provided the baseline and common thread between the spacecraft, in each case the Team X results were supplemented by historical data as needed. Propulsion, thermal protection, guidance, navigation and control, software, solar arrays, navigation and targeting and atmospheric prediction were investigated. A qualitative assessment of human reliability was also included. Results show that different risk drivers contribute significantly to each capture technique. For aerocapture, the significant drivers include propulsion system failures and atmospheric prediction errors. Software and guidance hardware contribute the most to aerobraking risk. Propulsive capture risk is mainly driven by anomalous solar array degradation and propulsion system failures. While each subsystem contributes differently to the risk of each technique, results show that there exists little relative difference in the reliability of these capture techniques although uncertainty for the aerocapture estimates remains high given the lack of in-space demonstration.

Percy, Thomas K.↗

Quantitative Risk Management - Risk Informed Decision Making on High-Risk Waste Remediation Projects - 19022

For every $1 billion invested in projects, $97 million is wasted due to poor project performance. That means 9.7% of money spent on projects is wasted due to poor risk and uncertainty management. High-risk projects, similar to those in waste remediation, have the most to lose. A solid quantitative risk management program is one of the keys to increasing the likelihood that a project will succeed. A quantitative risk program solves two major problems that challenge the effective management of risk and uncertainty: 1. Risks arise at all levels of an organization; however, not all organizational levels have an effective way to identify and resolve them. This can lead to risks that, even if identified, are not reported. 2. Decision-makers are often forced to operate solely on intuition when implementing mitigation strategies, not fully understanding the effects that certain decisions have on the program's cost and schedule. A quantitative risk program uses a risk register and builds it into the project/program integrated schedule to assess the impact of these risks, typically at the 80% confidence contingency level for specific milestones and/or project completion. Implementing a quantitative risk program drives a forward-thinking, proactive mentality to problem solving into all levels of the organization. A healthy risk program for regular reporting and communication ensures that all members of an organization are thinking about risks and using their communication channels to resolve them. It gives a method of communication and incentive for all levels in the organization and helps to ensure that risks will be reported and resolved. Pacific Northwest National Laboratory (PNNL) has developed tools and methods that provide a level of realism for analyzing different scenarios and estimating contingency that does not exist in the standard industry risk tool kit. These tools and methods provide decision-makers with actionable, quantitatively based information to guide their decision making. The first tool is a probabilistic branching risk model for mitigation strategies. Current quantitative risk analysis tools in the industry simulate two cases: fully mitigated and un-mitigated. In the fully mitigated case, the user assumes that every planned mitigation activity is successful. In the un-mitigated case, the user assumes that none are successful. The truth lies between these two extremes. The PNNL team has developed a probabilistic risk model for mitigation scenarios that includes a probability that a mitigation activity will succeed and a probability that a mitigation action will be funded. These probabilities are elicited from subject matter experts and ensure that the contingency calculations at the specified confidence are approaching reality. The second tool developed at PNNL is the Risk Box, which is a tool that integrates with different scenarios in the risk register. For example, say the user is faced with two different and mutually exclusive mitigation actions to reduce a risk. The Risk Box methodology performs the contingency calculations and then displays them on a time-phased graph that shows how each scenario reduces the risk contingency needed on the project/program. This graph then provides quantitative information to show decision-makers which mitigation action provides the greatest reduction (cost and schedule) in risk contingency for the program. Implementing these and other tools within a structured risk program increases the likelihood that a project will come in on schedule and budget, ensures that all personnel are proactively thinking about problems and resolutions, creates communication channels for all members to submit and resolve potential problems, produces a prioritized list of risk rankings to focus leadership on issues that may cause the biggest problems, and implements processes that drive updates to the risk program as the risk profile changes. PNNL has been developing these methods and using them on projects for over 20 years. They have been successfully applied on waste management projects, high-tech research and development projects, and construction projects, and they continue to be used on a number of U.S. Department of Energy projects today. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Concrete Structural Health Monitoring in Nuclear Power Plants

Assessment and management of aging concrete structures in nuclear power plants require a more systematic approach than simple reliance on existing code margins of safety. Health monitoring of concrete structures is performed in order to understand the current condition of a structure based on heterogeneous measurements and then produce high confidence actionable information regarding structural integrity; this information can then be used to support operational and maintenance decisions. The paper describes a framework of research activities for the health monitoring of nuclear power plant concrete structures. The proposed framework consists of four elements: health monitoring, data analytics, uncertainty quantification, and prognosis. The goal of this framework is to enable plant operators to make risk-informed decisions on structural integrity, remaining useful life, and performance of concrete structures across the nuclear fleet. Among several concrete degradations, the research focuses on the degradation caused by the Alkali-Silica Reaction (ASR). ASR is a chemical reaction that in presence of sufficient moisture forms a gel that increases in volume and exerts an expansive pressure inside the material causing micro- to macro-cracks. The paper also presents development of controlled concrete samples with reactive aggregates to cause ASR degradation and application of different non-destructive evaluation techniques to detect the damage caused by ASR. Initial results are presented in the paper along with potential path forward.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

How New Mexico Leveraged a COVID-19 Case Forecasting Model to Preemptively Address the Healthcare Needs of the State: Quantitative Analysis

Prior to the COVID-19 pandemic, US hospitals relied on static projections of future trends for long-term planning and were only beginning to consider forecasting methods for short-term planning of staffing and other resources. With the overwhelming burden imposed by COVID-19 on the health care system, an emergent need exists to accurately forecast hospitalization needs within an actionable timeframe. Our goal was to leverage an existing COVID-19 case and death forecasting tool to generate the expected number of concurrent hospitalizations, occupied intensive care unit (ICU) beds, and in-use ventilators 1 day to 4 weeks in the future for New Mexico and each of its five health regions. We developed a probabilistic model that took as input the number of new COVID-19 cases for New Mexico from Los Alamos National Laboratory’s COVID-19 Forecasts Using Fast Evaluations and Estimation tool, and we used the model to estimate the number of new daily hospital admissions 4 weeks into the future based on current statewide hospitalization rates. The model estimated the number of new admissions that would require an ICU bed or use of a ventilator and then projected the individual lengths of hospital stays based on the resource need. By tracking the lengths of stay through time, we captured the projected simultaneous need for inpatient beds, ICU beds, and ventilators. We used a postprocessing method to adjust the forecasts based on the differences between prior forecasts and the subsequent observed data. Thus, we ensured that our forecasts could reflect a dynamically changing situation on the ground. Forecasts made between September 1 and December 9, 2020, showed variable accuracy across time, health care resource needs, and forecast horizon. Forecasts made in October, when new COVID-19 cases were steadily increasing, had an average accuracy error of 20.0%, while the error in forecasts made in September, a month with low COVID-19 activity, was 39.7%. Across health care use categories, state-level forecasts were more accurate than those at the regional level. Although the accuracy declined as the forecast was projected further into the future, the stated uncertainty of the prediction improved. Forecasts were within 5% of their stated uncertainty at the 50% and 90% prediction intervals at the 3- to 4-week forecast horizon for state-level inpatient and ICU needs. However, uncertainty intervals were too narrow for forecasts of state-level ventilator need and all regional health care resource needs. Real-time forecasting of the burden imposed by a spreading infectious disease is a crucial component of decision support during a public health emergency. Our proposed methodology demonstrated utility in providing near-term forecasts, particularly at the state level. This tool can aid other stakeholders as they face COVID-19 population impacts now and in the future.

60 APPLIED LIFE SCIENCES↗

Validation Metrics for Fixed Effects and Mixed-Effects Calibration

The modern scientific process often involves the development of a predictive computational model. To improve its accuracy, a computational model can be calibrated to a set of experimental data. A variety of validation metrics can be used to quantify this process. Some of these metrics have direct physical interpretations and a history of use, while others, especially those for probabilistic data, are more difficult to interpret. In this work, a variety of validation metrics are used to quantify the accuracy of different calibration methods. Frequentist and Bayesian perspectives are used with both fixed effects and mixed-effects statistical models. Through a quantitative comparison of the resulting distributions, the most accurate calibration method can be selected. Two examples are included which compare the results of various validation metrics for different calibration methods. It is quantitatively shown that, in the presence of significant laboratory biases, a fixed effects calibration is significantly less accurate than a mixed-effects calibration. This is because the mixed-effects statistical model better characterizes the underlying parameter distributions than the fixed effects model. The results suggest that validation metrics can be used to select the most accurate calibration model for a particular empirical model with corresponding experimental data.

97 MATHEMATICS AND COMPUTING↗

Idaho National Laboratory Integrated Multisite SSHAC Level 3: Probabilistic Volcanic Hazards Assessment

The Idaho National Laboratory (INL) resides on the eastern Snake River Plain (ESRP), part of the Snake River Plain (SRP) with a complex origin and geologic history of volcanism. Much of the Quaternary (last 2.58 million years) volcanism within 400 km of INL is genetically associated with a major thermal anomaly referred to as the Yellowstone hotspot, which is currently located more than 180 km northeast of INL. Near INL, local volcanic sources include silicic domes near its southern border, and numerous dike-fed basaltic vents of the ESRP, some of which are near or within the INL boundaries. Quantitative probabilistic assessments of screened-in volcanic hazardous phenomena for nine different facility complexes at the INL are presented for a Senior Seismic Hazard Analysis Committee (SSHAC) Level 3 (SL3) study. The comprehensive, integrated multisite SSHAC study consists of a single regional Probabilistic Volcanic Hazards Assessment (PVHA) that pertains to all nine INL facility complexes, with site-specific information developed at each respective area of interest (AOI), referred to as the "INL facility AOI" (Figure ES-1). Hazard products are generated for specified INL facility AOIs for use by multiple stakeholders from different agencies in risk-informed decision-making regarding site selection, operations, and design of nuclear facilities at INL, consistent with U.S. Department of Energy (DOE) and U.S. Nuclear Regulatory Commission (NRC) regulatory guidance. The study also serves as the basis for future periodic safety assessments required for existing DOE facilities, such as 10-year evaluations of natural-phenomena hazards. Elements of the INL PVHA including initial characterization, screening, quantitative assessments of eruption and hazard potential, and consideration of facility needs are conducted using the three phases of the SSHAC process: evaluation, integration, and documentation. As per regulatory guidance, the SSHAC framework provided the necessary processes and procedures for the PVHA Technical Integration (TI) team, at three workshops, five formal working meetings and many TI team remote meetings, to conduct initial characterization, screen the volcanic hazards, create PVHA model inputs, exercise those models in the PVHA, consider facility-specific volcanic hazard needs, and perform final hazard calculations. The Participatory Peer Review Panel (PPRP) provided independent oversight and performed process and technical reviews of the PVHA throughout its duration. The study included an extensive New Data Collection and Analyses (NDCA) program developed by the PVHA TI team to reduce uncertainties in hazard-significant elements in the PVHA model. NDCA activities generated 20 reports providing important contributory datasets and results to the project database for characterizing the ESRP. For example, a report compiling the dimensions of ESRP shield volcanoes and lava fields was used to construct volcanic footprints (areas of impact), was compared with data from INL subsurface cores, and was used to validate the results of lava-flow inundation modeling on the contemporary terrain. Another example is the acquisition of aeromagnetic data over INL and its surrounding area, with maps of buried magmatic features (e.g., subsurface volcanoes and swarms of feeder dikes) that informed the PVHA conceptual model of volcanism. The SSHAC evaluation process was used to conduct all elements of the PVHA including initial characterization and screening. Existing data and NDCA activities provided the foundation to develop the tectonomagmatic conceptual model of volcanism for the region of geographical interest in the SRP and Yellowstone hotspot volcanic system, and for considering volcanoes in the western US. Considering Quaternary volcanic sources active during this period, the screening approach identified and evaluated magma compositions, types of eruptive and intrusive phenomena, types of hazardous phenomena, and proximity of sources to INL. The PVHA TI team evaluated 18 types of magmatic sources in terms of 20 potentially hazardous phenomena, resulting in 360 screening decisions. The screening process resulted in 140 screened-in hazardous volcanic phenomena for Quaternary volcanic sources 1) proximal to INL facility complexes in the ESRP (64 basaltic and 54 silicic), 2) regional sources associated with the Yellowstone caldera system and Blackfoot Reservoir volcanic field (7), and 3) more distal sources from thirteen Cascade volcanoes and two volcanoes at Long Valley caldera (CA).

58 GEOSCIENCES↗

Concrete structural health monitoring in nuclear power plants - 212

Assessment and management of aging concrete structures in nuclear power plants require a more systematic approach than simple reliance on existing code margins of safety. Health monitoring of concrete structures is performed in order to understand the current condition of a structure based on heterogeneous measurements and produce high-confidence actionable information regarding structural integrity. This information can be used to support operational and maintenance decisions. This paper describes a framework of research activities for health monitoring of nuclear power plant concrete structures. The proposed framework consists of four elements: (1) health monitoring, (2) data analytics, (3) uncertainty quantification, and (4) prognosis. The goal of this framework is to enable plant operators to make risk-informed decisions about structural integrity, remaining useful life, and performance of concrete structures across the nuclear fleet. Among several concrete degradations, research focuses on degradation caused by the alkali-silica reaction (ASR). ASR is a chemical reaction that, in the presence of sufficient moisture, forms a gel that increases in volume and exerts an expansive pressure inside the material, thus causing micro to macro-cracks. This paper also presents development of controlled concrete samples with reactive aggregates to cause ASR degradation and application of different non-destructive evaluation techniques to detect the damage caused by ASR. Initial results are presented in the paper along with a potential path forward. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗