Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “PROBABILISTIC ESTIMATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

1,241 records · Page 69

Evaluating the impact of anatomical and physiological variability on human equivalent doses using PBPK models

Abstract Addressing human anatomical and physiological variability is a crucial component of human health risk assessment of chemicals. Experts have recommended probabilistic chemical risk assessment paradigms in which distributional adjustment factors are used to account for various sources of uncertainty and variability, including variability in the pharmacokinetic behavior of a given substance in different humans. In practice, convenient assumptions about the distribution forms of adjustment factors and human equivalent doses (HEDs) are often used. Parameters such as tissue volumes and blood flows are likewise often assumed to be lognormally or normally distributed without evaluating empirical data for consistency with these forms. In this work, we performed dosimetric extrapolations using physiologically based pharmacokinetic (PBPK) models for dichloromethane (DCM) and chloroform that incorporate uncertainty and variability to determine if the HEDs associated with such extrapolations are approximately lognormal and how they depend on the underlying distribution shapes chosen to represent model parameters. We accounted for uncertainty and variability in PBPK model parameters by randomly drawing their values from a variety of distribution types. We then performed reverse dosimetry to calculate HEDs based on animal points of departure for each set of sampled parameters. Corresponding samples of HEDs were tested to determine the impact of input parameter distributions on their central tendencies, extreme percentiles, and degree of conformance to lognormality. This work demonstrates that the measurable attributes of human variability should be considered more carefully and that generalized assumptions about parameter distribution shapes may lead to inaccurate estimates of extreme percentiles of HEDs.

Toxicology↗

Host-region parameters for an adjustable model for crustal earthquakes to facilitate the implementation of the backbone approach to building ground-motion logic trees in probabilistic seismic hazard analysis

The backbone approach to constructing a ground-motion logic tree for probabilistic seismic hazard analysis (PSHA) can address shortcomings in the traditional approach of populating the branches with multiple existing, or potentially modified, ground-motion models (GMMs) by rendering more transparent the relationship between branch weights and the resulting distribution of predicted accelerations. To capture epistemic uncertainty in a tractable manner, there are benefits in building the logic tree through the application of successive adjustments for differences in source, path, and site characteristics between the host region of the selected backbone GMM and the target region for which the PSHA is being conducted. The implementation of this approach is facilitated by selecting a backbone GMM that is amenable to such host-to-target adjustments for individual source, path, and site characteristics. The NGA-West2 GMM of Chiou and Youngs (CY14) has been identified as a highly adaptable model for crustal seismicity that is well suited to such adjustments. Rather than using generic source, path, and site characteristics assumed appropriate for the host region, the final suite of adjusted GMMs for the target region will be better constrained if the host-region parameters are defined specifically on the basis of their compatibility with the CY14 backbone GMM. To this end, making use of a recently developed crustal shear-wave velocity profile consistent with CY14, we present an inversion of the model to estimate the key source and path parameters, namely the stress parameter and the anelastic attenuation. With these outputs, the effort in constructing a ground-motion logic tree for any PSHA dealing with crustal seismicity can be focused primarily on the estimation of the target-region characteristics and their associated uncertainties. The inversion procedure can also be adapted for any application in which different constraints might be relevant.

Stafford, Peter J.↗

Mass and Reliability System (MaRS)

The Safety and Mission Assurance (S&MA) Directorate is responsible for mitigating risk, providing system safety, and lowering risk for space programs from ground to space. The S&MA is divided into 4 divisions: The Space Exploration Division (NC), the International Space Station Division (NE), the Safety & Test Operations Division (NS), and the Quality and Flight Equipment Division (NT). The interns, myself and Arun Aruljothi, will be working with the Risk & Reliability Analysis Branch under the NC Division's. The mission of this division is to identify, characterize, diminish, and communicate risk by implementing an efficient and effective assurance model. The team utilizes Reliability and Maintainability (R&M) and Probabilistic Risk Assessment (PRA) to ensure decisions concerning risks are informed, vehicles are safe and reliable, and program/project requirements are realistic and realized. This project pertains to the Orion mission, so it is geared toward a long duration Human Space Flight Program(s). For space missions, payload is a critical concept; balancing what hardware can be replaced by components verse by Orbital Replacement Units (ORU) or subassemblies is key. For this effort a database was created that combines mass and reliability data, called Mass and Reliability System or MaRS. The U.S. International Space Station (ISS) components are used as reference parts in the MaRS database. Using ISS components as a platform is beneficial because of the historical context and the environment similarities to a space flight mission. MaRS uses a combination of systems: International Space Station PART for failure data, Vehicle Master Database (VMDB) for ORU & components, Maintenance & Analysis Data Set (MADS) for operation hours and other pertinent data, & Hardware History Retrieval System (HHRS) for unit weights. MaRS is populated using a Visual Basic Application. Once populated, the excel spreadsheet is comprised of information on ISS components including: operation hours, random/nonrandom failures, software/hardware failures, quantity, orbital replaceable units (ORU), date of placement, unit weight, frequency of part, etc. The motivation for creating such a database will be the development of a mass/reliability parametric model to estimate mass required for replacement parts. Once complete, engineers working on future space flight missions will have access a mean time to failures and on parts along with their mass, this will be used to make proper decisions for long duration space flight missions

Barnes, Sarah↗

Sensitivity Study of Impact Risk Model Results to Thermal Radiation Damage Model for Large Objects

NASA’s Probabilistic Asteroid Impact Risk (PAIR) assessment model assesses the likelihood of potential damage for asteroid impact scenarios. Fast-running models are used to capture the effects of different hazards. This paper looks specifically at local ground damage hazards, including blast overpressure and thermal radiation damage, for large object impact scenarios. A sensitivity study is conducted to determine which parameters, and over what ranges, cause impact risks to become sensitive to thermal damage. Two additional thermal models with different approaches are used for comparison. The study determined the current thermal model is most sensitive to the luminous efficiency parameter that reflects the model’s uncertainty in the amount of energy contributing to the thermal radiation damage. This sensitivity was most apparent for the highest severity damage levels. Comparisons of the three models showed that in addition to sensitivities within the models, the impact risks are also sensitive to the choice of thermal model. The study results were applied to the 2023 PDC hypothetical asteroid impact scenario and parameter ranges of interest determined. At the serious damage level, luminous efficiencies above 0.006 showed a small chance of thermal playing an important role, while luminous efficiencies above 0.0008 led to thermal playing a significant role at the unsurvivable damage severity level. Study results are used to identify key areas where additional model refinement and better knowledge of asteroid properties may be important for improving damage estimates.

SMD↗

Sensitivity Study of Impact Risk Model Results to Thermal Radiation Damage Model for Large Objects

NASA’s Probabilistic Asteroid Impact Risk (PAIR) assessment model assesses the likelihood of potential damage for asteroid impact scenarios. Fast-running models are used to capture the effects of different hazards. This paper looks specifically at local ground damage hazards, including blast overpressure and thermal radiation damage, for large object impact scenarios. A sensitivity study is conducted to determine which parameters, and over what ranges, cause impact risks to become sensitive to thermal damage. Two additional thermal models with different approaches are used for comparison. The study determined the current thermal model is most sensitive to the luminous efficiency parameter that reflects the model’s uncertainty in the amount of energy contributing to the thermal radiation damage. This sensitivity was most apparent for the highest severity damage levels. Comparisons of the three models showed that in addition to sensitivities within the models, the impact risks are also sensitive to the choice of thermal model. The study results were applied to the 2023 Planetary Defense Conference hypothetical asteroid impact scenario and parameter ranges of interest determined. At the serious damage level, luminous efficiencies above 0.006 showed a small chance of thermal playing an important role, while luminous efficiencies above 0.0008 led to thermal playing a significant role at the unsurvivable damage severity level. Study results are used to identify key areas where additional model refinement and better knowledge of asteroid properties may be important for improving damage estimates.

SMD↗

Assessing the Relative Risk of Aerocapture Using Probabalistic Risk Assessment

A recent study performed for the Aerocapture Technology Area in the In-Space Propulsion Technology Projects Office at the Marshall Space Flight Center investigated the relative risk of various capture techniques for Mars missions. Aerocapture has been proposed as a possible capture technique for future Mars missions but has been perceived by many in the community as a higher risk option as compared to aerobraking and propulsive capture. By performing a probabilistic risk assessment on aerocapture, aerobraking and propulsive capture, a comparison was made to uncover the projected relative risks of these three maneuvers. For mission planners, this knowledge will allow them to decide if the mass savings provided by aerocapture warrant any incremental risk exposure. The study focuses on a Mars Sample Return mission currently under investigation at the Jet Propulsion Laboratory (JPL). In each case (propulsive, aerobraking and aerocapture), the Earth return vehicle is inserted into Martian orbit by one of the three techniques being investigated. A baseline spacecraft was established through initial sizing exercises performed by JPL's Team X. While Team X design results provided the baseline and common thread between the spacecraft, in each case the Team X results were supplemented by historical data as needed. Propulsion, thermal protection, guidance, navigation and control, software, solar arrays, navigation and targeting and atmospheric prediction were investigated. A qualitative assessment of human reliability was also included. Results show that different risk drivers contribute significantly to each capture technique. For aerocapture, the significant drivers include propulsion system failures and atmospheric prediction errors. Software and guidance hardware contribute the most to aerobraking risk. Propulsive capture risk is mainly driven by anomalous solar array degradation and propulsion system failures. While each subsystem contributes differently to the risk of each technique, results show that there exists little relative difference in the reliability of these capture techniques although uncertainty for the aerocapture estimates remains high given the lack of in-space demonstration.

Percy, Thomas K.↗

Multidimensional Distributional Neural Network Output Demonstrated in Super‐Resolution of Surface Wind Speed

Accurate quantification of uncertainty in neural network predictions remains a central challenge for scientific applications involving high-dimensional, correlated data. While existing methods capture either aleatoric or epistemic uncertainty, few offer closed-form, multidimensional distributions that preserve spatial correlation while remaining computationally tractable. In this work, we present a framework for training neural networks with a multidimensional Gaussian loss, generating a closed-form predictive distribution over outputs informed by non-identically distributed training data. Our approach captures aleatoric uncertainty by iteratively estimating the means and covariance matrices, and is demonstrated on a super-resolution example out-of-training-sample. We leverage a Fourier representation of the covariance matrix to stabilize network training and preserve spatial correlation. We introduce a novel regularization strategy—referred to as information sharing—that interpolates between image-specific and global covariance estimates, enabling convergence of the super-resolution downscaling network trained on image-specific distributional loss functions. This framework allows for efficient sampling, explicit correlation modeling, and extensions to more complex distribution families all without disrupting prediction performance. We demonstrate the method on a surface wind speed downscaling task and discuss its broader applicability to uncertainty-aware prediction in scientific models.

17 WIND ENERGY↗

NASA Tech Briefs, March 2014

Topics include: Data Fusion for Global Estimation of Forest Characteristics From Sparse Lidar Data; Debris and Ice Mapping Analysis Tool - Database; Data Acquisition and Processing Software - DAPS; Metal-Assisted Fabrication of Biodegradable Porous Silicon Nanostructures; Post-Growth, In Situ Adhesion of Carbon Nanotubes to a Substrate for Robust CNT Cathodes; Integrated PEMFC Flow Field Design for Gravity-Independent Passive Water Removal; Thermal Mechanical Preparation of Glass Spheres; Mechanistic-Based Multiaxial-Stochastic-Strength Model for Transversely-Isotropic Brittle Materials; Methods for Mitigating Space Radiation Effects, Fault Detection and Correction, and Processing Sensor Data; Compact Ka-Band Antenna Feed with Double Circularly Polarized Capability; Dual-Leadframe Transient Liquid Phase Bonded Power Semiconductor Module Assembly and Bonding Process; Quad First Stage Processor: A Four-Channel Digitizer and Digital Beam-Forming Processor; Protective Sleeve for a Pyrotechnic Reefing Line Cutter; Metabolic Heat Regenerated Temperature Swing Adsorption; CubeSat Deployable Log Periodic Dipole Array; Re-entry Vehicle Shape for Enhanced Performance; NanoRacks-Scale MEMS Gas Chromatograph System; Variable Camber Aerodynamic Control Surfaces and Active Wing Shaping Control; Spacecraft Line-of-Sight Stabilization Using LWIR Earth Signature; Technique for Finding Retro-Reflectors in Flash LIDAR Imagery; Novel Hemispherical Dynamic Camera for EVAs; 360 deg Visual Detection and Object Tracking on an Autonomous Surface Vehicle; Simulation of Charge Carrier Mobility in Conducting Polymers; Observational Data Formatter Using CMOR for CMIP5; Propellant Loading Physics Model for Fault Detection Isolation and Recovery; Probabilistic Guidance for Swarms of Autonomous Agents; Reducing Drift in Stereo Visual Odometry; Future Air-Traffic Management Concepts Evaluation Tool; Examination and A Priori Analysis of a Direct Numerical Simulation Database for High-Pressure Turbulent Flows; and Resource-Constrained Application of Support Vector Machines to Imagery.

Source record↗

Validation Metrics for Fixed Effects and Mixed-Effects Calibration

The modern scientific process often involves the development of a predictive computational model. To improve its accuracy, a computational model can be calibrated to a set of experimental data. A variety of validation metrics can be used to quantify this process. Some of these metrics have direct physical interpretations and a history of use, while others, especially those for probabilistic data, are more difficult to interpret. In this work, a variety of validation metrics are used to quantify the accuracy of different calibration methods. Frequentist and Bayesian perspectives are used with both fixed effects and mixed-effects statistical models. Through a quantitative comparison of the resulting distributions, the most accurate calibration method can be selected. Two examples are included which compare the results of various validation metrics for different calibration methods. It is quantitatively shown that, in the presence of significant laboratory biases, a fixed effects calibration is significantly less accurate than a mixed-effects calibration. This is because the mixed-effects statistical model better characterizes the underlying parameter distributions than the fixed effects model. The results suggest that validation metrics can be used to select the most accurate calibration model for a particular empirical model with corresponding experimental data.

97 MATHEMATICS AND COMPUTING↗

Quantifying Medical Risk on a Long Duration Lunar Mission: A Demonstration of NASA’s IMPACT Tradespace Analysis Tool

Background NASA’s human exploration spaceflight missions to the Moon and Mars present unprecedented challenges for in-mission medical care. The distance from Earth will mean increased mission durations, communication delays, limited to no resupply opportunities, and constraints on the medical evacuation of astronauts. Mass, volume, power, and data will be limited while higher demands will be placed on the crew to manage medical care. NASA’s Moon to Mars exploration strategy lays out increasingly complex Artemis missions both in terms of duration and operations. In these more challenging deep space missions, it is important to quantitatively estimate the human medical risk to inform a traditional heuristic approach to medical risk. Prior tools have been developed for missions in low Earth orbit, but a new tool is required to plan for future exploration missions. Methods IMPACT (Informing Mission Planning via Analysis of Complex Tradespaces) is a risk assessment tool developed by NASA to advance exploration mission medical system design by quantitatively estimating mission medical risk. IMPACT v1.0 includes a novel evidence library baselined to exploration environments; an expanded list of 119 medical conditions; the addition of medical resources; and the ability for rapid and iterative analysis. Medical system risk estimates include loss of crew life, consideration of the need for return to definitive care (medical evacuation), and an estimate of crew time affected due to medical conditions. A notional long duration lunar orbit and lunar surface design reference mission (DRM) was chosen with a 4-astronaut crew to represent a sustained exploration Artemis mission. Results/Discussion Overall, IMPACT successfully quantified medical risk and derived an optimized medical system to support crew on a long duration lunar mission. In this DRM, the calculated loss of crew life from a medical event was 0.008 events per mission, risk of potential need for evacuation was 0.30 events per mission, and cumulative crew time affected by medical conditions was 103 days. The medical conditions that most contributed to overall medical risk were decompression sickness, trauma conditions, and respiratory failure. The conditions that had the largest effects on crew performance included musculoskeletal injuries and lunar dust exposure. The IMPACT-generated medical system included resources that target the most common and highest risk conditions. This systematic analysis demonstrates the value of the IMPACT tool in medical system design for human exploration spaceflight missions.

Missions to Mars↗

Quantifying Medical Risk on a Long Duration Lunar Mission: A Demonstration of NASA’s IMPACT Tradespace Analysis Tool

Background NASA’s human exploration spaceflight missions to the Moon and Mars present unprecedented challenges for in-mission medical care. The distance from Earth will mean increased mission durations, communication delays, limited to no resupply opportunities, and constraints on the medical evacuation of astronauts. Mass, volume, power, and data will be limited while higher demands will be placed on the crew to manage medical care. NASA’s Moon to Mars exploration strategy lays out increasingly complex Artemis missions both in terms of duration and operations. In these more challenging deep space missions, it is important to quantitatively estimate the human medical risk to inform a traditional heuristic approach to medical risk. Prior tools have been developed for missions in low Earth orbit, but a new tool is required to plan for future exploration missions. Methods IMPACT (Informing Mission Planning via Analysis of Complex Tradespaces) is a risk assessment tool developed by NASA to advance exploration mission medical system design by quantitatively estimating mission medical risk. IMPACT v1.0 includes a novel evidence library baselined to exploration environments; an expanded list of 119 medical conditions; the addition of medical resources; and the ability for rapid and iterative analysis. Medical system risk estimates include loss of crew life, consideration of the need for return to definitive care (medical evacuation), and an estimate of crew time affected due to medical conditions. A notional long duration lunar orbit and lunar surface design reference mission (DRM) was chosen with a 4-astronaut crew to represent a sustained exploration Artemis mission. Results/Discussion Overall, IMPACT successfully quantified medical risk and derived an optimized medical system to support crew on a long duration lunar mission. In this DRM, the calculated loss of crew life from a medical event was 0.008 events per mission, risk of potential need for evacuation was 0.30 events per mission, and cumulative crew time affected by medical conditions was 103 days. The medical conditions that most contributed to overall medical risk were decompression sickness, trauma conditions, and respiratory failure. The conditions that had the largest effects on crew performance included musculoskeletal injuries and lunar dust exposure. The IMPACT-generated medical system included resources that target the most common and highest risk conditions. This systematic analysis demonstrates the value of the IMPACT tool in medical system design for human exploration spaceflight missions.

Missions to Mars↗

Natural Language Processing-Enhanced Nuclear Industry Operating Experience Data Analysis: Aggregation and Interpretation of Multi-Report Analysis Results

Industry-wide operating experience is a critical source of raw data for reliability and risk model parameter estimations for nuclear power plants. A large portion of operating experience data are failure events stored as reports that contain unstructured data, such as narratives. In current practice, a failure report is usually reviewed and manually coded by analysts. The coding is based on extracting several event characteristics such as system name, component type, sub-part type, failure mode, and failure cause. Event narratives are mostly used to help understand events and extract their characteristics. In this line of research, we aim to maximize the usage of event narratives by leveraging natural language processing (NLP) methods to automatically convert an event narrative to a causal graph. This research has promise to improve physical understanding of failure initiation and propagation and to facilitate use of non-failure data (e.g., near-misses and degradations) to complement the limited data pool of failures. In our previous work, we developed an NLP tool and applied it to analyze a number of licensee event reports submitted by U.S. nuclear power plants to the Nuclear Regulatory Commission. In this paper, we will report our recent research progress in aggregating the results of multiple reports, developing network model(s), and drawing statistical insights.

99 GENERAL AND MISCELLANEOUS↗

Lunar Meteorites and Implications for Compositional Remote Sensing of the Lunar Surface

Lunar meteorites (LMs) are rocks found on Earth that were ejected from the Moon by impact of an asteroidal meteoroid. Three factors make the LMs important to remote-sensing studies: (1) Most are breccias composed of regolith or fragmental material; (2) all are rocks that resided (or breccias composed of material that resided) in the upper few meters of the Moon prior to launch and (3) most apparently come from areas distant from the Apollo sites. How Many Lunar Locations? At this writing (June 1999), there are 18 known lunar meteorite specimens. When unambiguous cases of terrestrial pairing are considered, the number of actual LMs reduces to 13. (Terrestrial pairing is when a single piece of lunar rock entered Earth's atmosphere, but multiple fragments were produced because the meteoroid broke apart on entry, upon hitting the ground or ice, or while being transported through the ice.) We have no reason to believe that LMs preferentially derive from any specific region(s) of the Moon; i.e., we believe that they are samples from random locations. However, we do not know how many different locations are represented by the LMs; mathematically, it could be as few as 1 or as many as 13. The actual maximum is < 13 because in some cases a single impact appears to have yielded more than one LM. Yamato 793169 and Asuka 881757 are considered "source-crater paired" or "launch paired" because they are compositionally and petrographically similar to each other and distinct from the others, and both have similar cosmic-ray exposure (CRE) histories. The same can be said of QUE 94281 and Y 793274. Thus the 13 meteorites probably represent a maximum of 11 locations on the Moon. The minimum number of likely source craters is debated and in flux as new data for different isotopic systems are obtained. Conservatively, considering CRE data only, a minimum of about 5 impacts is required. Compositional and petrographic data offer only probabilistic constraints. An extreme, but not unreasonable viewpoint, is that such data offer no constraint. For example, if one were to cut up the Apollo 17 landing site (which was selected for its diversity) into softball-sized pieces, some of those pieces (e.g., sample 70135) would be crystalline mare basalts like Y 793169 whereas others (e.g., sample 73131 would be feldspathic regolith breccias like MAC 88104/ 88105. However, nature is not so devious. Warren argues that LMs come from craters of only a few kilometers in diameter. If so, even though CRE data allow, for example, that ALHA 81005 and Y 791197) were launched simultaneously from the same crater, the probability is nevertheless low because the two meteorites are compositionally and mineralogically distinct. Thus, within the allowed range (5-11) for the number of locations represented by the LMs, values at the high end of the range are probably more likely. Mare Meteorites: Three LMs consist almost entirely of mare basalt. Two, Y 793169 and Asuka 881757, are unbrecciated, low-Ti, crystalline rocks that are compositionally and mineralogically similar (but not identical) to each other; they probably derive from a single lunar-mare location. The third, EET 87521/96008, is a fragmental breccia consisting predominantly of VLT mare basalt. Thus, these LMs probably represent only two lunar mare locations. The basaltic LMs have mineral and bulk compositions distinct from Apollo mare basalts. The petrography of Calcalong Creek has not been described in detail, but compositionally it is unique in that it corresponds to a mixture (breccia) of about one-half feldspathic material (i.e., the mean composition of the feldspathic lunar meteorites, below), one-fourth KREEP norite, one-fourth VLT mare basalt (like EET 87521), and 1% CI chondrite. With 4 micro g/g Th and correspondingly high concentrations of other incompatible elements, it is the only lunar meteorite that is likely to have come from within the Procellarum KREEP Terrane (PKT). Yamato 793274 and QUE 94281 are together distinct in being fragmental breccias containing subequal parts of feldspathic highland material and VLT mare basalt. Jolliff et al. estimate a mare to highland ratio of 54:46 for QUE 94281 and 62:38 for Y 793274; this difference is well within the range observed for soils collected only centimeters apart (in cores) at interface site like Apollo 15 and 17 [11]. Although the two meteorites were found on opposite sides of Antarctica, they are probably launch-paired. The strongest evidence is that the pyroclastic glass spherules that occur in both are of two compositional groups and the two groups are essentially the same in both meteorites. Yamato 791197 is nominally a feldspathic lunar meteorite (below), but among FLMs, it probably contains the highest abundance of clasts and glasses of mare derivation. As a consequence, its composition is at the high-Fe, low-Mg end of the range for FLMs and is not included in the FLM average of Table 1. Its composition is consistent with about 10% mare-derived material. Similarly, the two small (Y 82) pieces of Y 82192/82193186032 are more mafic than the large (Y 86) piece, probably as a result of about 7% mare-derived material. All Apollo missions went to areas in or near the PKT, and, consequently, all Apollo regolith samples are contaminated with Th-rich material from the PKT. At the nominally "typical" highland site, Apollo 16, about 30% of the regolith (<1-mm fines) is Th-rich ejecta from the Imbrium impact and about 6% is mare material probably derived from mare basins. Thus Apollo 16 regolith is not typical of the highlands. Among Apollo rocks, the compositions of the FLMs correspond most closely to the feldspathic granulitic breccias of Apollo 16 and 17. (Additional information is contained in original)

Korotev, R. L.↗

Summary of Technical Peer Review on the Risk Assessment Framework proposed in Report INL/RPT-22-68656 for Digital Instrumentation and Control Systems

This report summarizes the peer review activities initiated by Idaho National Laboratory (INL) during fiscal year (FY) 2023 for the evaluation and improvement of the methodology developed under the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, digital instrumentation and control (DI&C) risk assessment project. In FY 2019, the RISA Pathway initiated a project to develop a risk assessment strategy for delivering a technical basis to support effective and secure DI&C technologies for digital upgrades/designs. A framework was proposed for this strategy, which aims to (1) provide a best-estimate, risk-informed capability to quantitatively and accurately estimate the risk impact of plant modernization, considering the introduction of high safety-significant safety-related (HSSSR) DI&C systems, (2) support and supplement existing risk-informed DI&C design guides by providing quantitative risk information and evidence, (3) offer a capability of design architecture evaluation of various DI&C systems, (4) assure the long-term safety and reliability of HSSSR DI&C systems, and (5) reduce uncertainty in costs and support integration of DI&C systems in the plant. The R&D efforts of this project from FY 2019 through FY 2022 were focused on methodology improvement and demonstration of the proposed framework for the risk assessment and design optimization of safety-critical DI&C systems. Collaborations with the nuclear industry have been initiated to support the reliability and risk assessment of their DI&C systems by using the proposed framework. In FY 2023, the framework has reached to a point for a technical peer review and obtain stakeholder feedback. This peer review activity includes coordination of the reviews performed by a group of industry stakeholders, documentation of the peer review suggestions, providing resolutions and responses to the peer review comments. The objective of this technical peer review is to obtain representative feedback on the proposed framework to improve the technical qualities of its methodology and readiness for deployment to the industry. Feedback may identify potential areas for improvement and further development. The Subject Matter experts were invited to review the latest project report documenting the methodology developed in the project and provide evaluations of the technical qualities of the proposed framework and relevant methods. The reviewed project report is “An Integrated Framework for Risk Assessment of High Safety-significant Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants: Methodology and Demonstration” INL/RPT-22-68656 (short as “INL/RPT-22-68656” in this report). This peer review report documents the technical questions provided for technical peer review and introduces the technical peer reviewers from the stakeholders including nuclear utilities, regulators, and universities. Comments from technical peer reviewers and the resolutions and responses to these comments are outlined. Insights and lessons learned from the technical peer review are summarized in conclusions and future work. The primary audience of this report are DI&C designers, engineers, and probabilistic risk assessment (PRA) practitioners. This includes stakeholders, such as the nuclear utilities and regulators who consider the deployment and upgrade of DI&C systems, DI&C software developers and reviewers, and cybersecurity specialists.

99 GENERAL AND MISCELLANEOUS↗

Framework for Quantitative Evaluation of Resilience Solutions: An Approach to Determine the Value of Resilience for a Particular Site

The paper provides the approach to providing a benefit cost analysis of energy and water alternatives to provide resilience to extreme events. The approach estimates the costs and returns of providing greater resilience of water and energy infrastructure. Extreme events are defined as high impact, low-frequency events such as, but not limited to, hurricanes, floods, storm surges and earthquakes. The provides justification for hardening water and energy infrastructure. Resilience is defined as “the ability to prepare for and to withstand an extreme event with little or no damage, or to recover more quickly from an extreme event.” The approach can be summarized as follows. The approach requires the development of a baseline with which to compare alternatives. The baseline is used to evaluate the baseline’s resilience to hazards through the probability of the hazard(s), the likelihood of damage from that the hazard through a vulnerability analysis, and the consequence to calculate a cost of the damage. The approach then evaluates proposed mitigation alternatives that would improve the resilience of the system. Each alternative is evaluated based on probability of the hazard, probability of vulnerability and consequence to determine the reduced damage that each alternative presents. The approach includes any monetary and non-monetary benefits that can quantified for each of the alternatives. Non-quantifiable benefits are evaluated based on the relative importance of each alternative to the criteria used to determine how well the alternative meets the goals and objectives of the site/facility. Then, a life cycle cost analysis should be conducted for the baseline and alternatives. Finally, the results of the life cycle analysis should be presented in a decision matrix with cost, net present value, benefit/cost ratios, and any non-monetary criteria ranked to show how well the alternatives met the criteria, weighted with the decision maker’s weights and the results presented.

54 ENVIRONMENTAL SCIENCES↗

Climate-Related Trends of Within-Storm Intensities Using Dimensionless Temporal-Storm Distributions

Huff curves are probabilistic time distributions of rainfall expressed as dimensionless cumulative percentages of storm depth and duration. Previous studies have documented development factors, spatial robustness, and the utility of Huff curves in practical applications. However, the effects of trending rainfall on Huff curve intensity patterns have not yet been studied. As such, the goal of this paper is to fill this gap by studying Huff curve patterns in a watershed with demonstrated increasing trends of temperature and precipitation, with the intention that it can be generalized to other areas in the US and the world. To achieve this goal, the high temporal resolution precipitation data collected from a high spatial density, 72-year precipitation-gauge network on the 4.25-km 2 North Appalachian Experimental Watershed in east-central Ohio were used. Seasonal storm pattern trends from 1939 to 2010 were investigated using dimensionless depth (with the frequency of 50%, $d_{50}$) and the curve variability $(V = d_{80} - d_{20})$ at three dimensionless within-storms time periods (three verticals). The Spearman rank correlation procedure (correlation coefficient, ρ and significance probability, p) was used to statistically determine trends over time using 8 periods of 4-season sets of Huff curves over the 72 years. Two averages of ρ and p were computed: (1) by averaging the individual ρ and p obtained from 10 gauges (AvgI); and (2) by grouped averaging of all individual gauge values of $d_{50}$ and V and then computing ρ and p (AvgG). The test results of individual gauges showed that 4 cases for $d_{50}$ and 23 cases for V were significant for all seasons and verticals (total of 120 cases for each variable). The test results of AvgI for $d_{50}$ and V and AvgG for $d_{50}$ showed no significant trends in all seasons and verticals. Only the AvgG for V led to a significant trend for V in spring and fall at different times within storm patterns. The data do not provide sufficient evidence at the p=0.05 significance level to reject the null hypothesis of unchanging position of the dimensionless depth of the 50% Huff curves for individual or averages for all seasons and verticals. Also, there is insufficient evidence to reject the null hypothesis of unchanging variability, V, using the average ρ of individual gauges (AvgI for V) for all seasons and verticals. AvgG results showed a significant trend in V; however, this analysis may be affected by the nonindependence of storm data. The results suggest that it is likely that there is little if any effect of trending climate over approximately 70 years on Huff curve patterns. The results of this study add to the robustness characteristics of Huff curves and to their potential use in hydrological practice as design storms, as the foundation of stochastic storm generation, and for storm disaggregation, and they deserve further investigation. These different forms of inputs to watershed models have the potential to improve runoff estimation. The results suggest that, if verified in other studies, they have applicability to provide useful stationary precipitation patterns across the US and other areas of the world in areas of nonstationary climate. Also, individual rain gauge data may not be representative of trends even over small areas, and seasonal differences were noticeable as found in other studies. Recommendations are provided.

54 ENVIRONMENTAL SCIENCES↗

Framework for Modeling High-Impact, Low-Frequency Power Grid Events to Support Risk-Informed Decisions

Natural and man-made hazardous events resulting in loss of grid infrastructure assets challenge the electric power grid’s security and resilience. However, the planning and allocation of appropriate contingency resources for such events requires an understanding of their likelihood and the extent of their potential impact. Where these events are of low likelihood, a risk-informed perspective on planning can be problematic as there exists an insufficient statistical basis to directly estimate the probabilities and consequences of their occurrence. Since risk-informed decisions rely on such knowledge, a basis for modeling the risk associated with high-impact low frequency events (HILFs) is essential. Insights from such a model can inform where resources are most rationally and effectively expended. The present effort is focused on development of a HILF risk assessment framework. Such a framework is intended to provide the conceptual and overarching technical basis for the development of HILF risk models that can inform decision makers across numerous stakeholder sectors. The North American Electric Reliability Corporation (NERC) 2014 Standard TPL-001-4 considers severe events for transmission reliability planning, but does not address events of such severity that they have the potential to fail a substantial fraction of grid assets over a region, such as geomagnetic disturbances (GMD), extreme seismic events, and coordinated cyber-physical attacks. These are beyond current planning guidelines. As noted, the risks associated with such events cannot be statistically estimated based on historic experience; however, there does exist a stable of risk modeling techniques for rare events that have proven of value across a wide range of engineering application domains. There is an active and growing interest in evaluating the value of risk management techniques in the State transmission planning and emergency response communities, some of this interest in the context of grid modernization activities. The availability of a grid HILF risk model, integrated across multi-hazard domains which, when interrogated, can support transparent, defensible and effective decisions, is an attractive prospect among these communities. In this report, we document an integrated HILF risk framework intended to inform the development of risk models. These models would be based on the systematic and comprehensive (to within scope) characterization of hazards to the level of detail required for modeling risk, identification of the stressors associated with the hazards (i.e., the means of impacting grid and supporting infrastructure), characterization of the vulnerability of assets to these stressors and the probabilities of asset compromise, the grid’s dynamic response to the asset failures, and assessment of subsequent severities of consequence with respect to selected impact metrics, such as power outage duration and geographic reach. Specifically, the current framework is being developed to;1. Provide the conceptual and overarching technical paradigms for the development of risk models; 2. Identify the classes of models required to implement the framework - providing examples of existing models, and also identifying where modeling gaps exist; 3. Identify the types of data required, addressing circumstances under which data are sparse and the formal elicitation of informed judgment might be required; and 4. Identify means by which the resultant risk models might be interrogated to form the necessary basis for risk management.

97 MATHEMATICS AND COMPUTING↗