Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probabilistic reasoning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Accelerated Life Structural Benchmark Testing for a Stirling Convertor Heater Head

For proposed long-duration NASA Space Science missions, the Department of Energy, Lockheed Martin, Infinia Corporation, and NASA Glenn Research Center are developing a high-efficiency, 110 W Stirling Radioisotope Generator (SRG110). A structurally significant limit state for the SRG110 heater head component is creep deformation induced at high material temperature and low stress level. Conventional investigations of creep behavior adequately rely on experimental results from uniaxial creep specimens, and a wealth of creep data is available for the Inconel 718 material of construction. However, the specified atypical thin heater head material is fine-grained with a heat treatment that limits precipitate growth, and little creep property data for this microstructure is available in the literature. In addition, the geometry and loading conditions apply a multiaxial stress state on the component, far from the conditions of uniaxial testing. For these reasons, an extensive experimental investigation is ongoing to aid in accurately assessing the durability of the SRG110 heater head. This investigation supplements uniaxial creep testing with pneumatic testing of heater head-like pressure vessels at design temperature with stress levels ranging from approximately the design stress to several times that. This paper presents experimental results, post-test microstructural analyses, and conclusions for four higher-stress, accelerated life tests. Analysts are using these results to calibrate deterministic and probabilistic analytical creep models of the SRG110 heater head.

Krause, David L.↗

Real-time value-driven diagnosis

Diagnosis is often thought of as an isolated task in theoretical reasoning (reasoning with the goal of updating our beliefs about the world). We present a decision-theoretic interpretation of diagnosis as a task in practical reasoning (reasoning with the goal of acting in the world), and sketch components of our approach to this task. These components include an abstract problem description, a decision-theoretic model of the basic task, a set of inference methods suitable for evaluating the decision representation in real-time, and a control architecture to provide the needed continuing coordination between the agent and its environment. A principal contribution of this work is the representation and inference methods we have developed, which extend previously available probabilistic inference methods and narrow, somewhat, the gap between probabilistic and logical models of diagnosis.

Dambrosio, Bruce↗

RAVEN User Manual

RAVEN is a generic software framework to perform parametric and probabilistic analysis based on the response of complex system codes. The initial development was aimed to provide dynamic risk analysis capabilities to the Thermo-Hydraulic code RELAP-7, currently under development at the Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose probabilistic and uncertainty quantification platform, capable to agnostically communicate with any system code. This agnosticism includes providing Application Programming Interfaces (APIs). These APIs are used to allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by input files or via python interfaces. RAVEN is capable of investigating the system response, and investigating the input space using Monte Carlo, Grid, or Latin Hyper Cube sampling schemes, but its strength is focused toward system feature discovery, such as limit surfaces, separating regions of the input space leading to system failure, using dynamic supervised learning techniques. The development of RAVEN started in 2012, when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework became stronger. RAVEN principal assignment is to provide the necessary software and algorithms in order to employ the concept developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just the individuation of the frequency of an event potentially leading to a system failure, but the closeness (or not) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. for an important process such as peak pressure in a pipe) is exceeded under certain conditions. The initial development of RAVEN has been focused on providing dynamic risk assessment capability to RELAP-7, currently under development at the INL and, likely, future replacement of the RELAP5-3D code. Most the capabilities that have been implemented having RELAP-7 as principal focus are easily deployable for other system codes. For this reason, several side activates are currently ongoing for coupling RAVEN with software such as RELAP5-3D, etc. The aim of this document is the explanation of the input requirements, focusing on the input structure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

RAVEN User Manual

RAVEN is a generic software framework to perform parametric and probabilistic analysis based on the response of complex system codes. The initial development was aimed to provide dynamic risk analysis capabilities to the Thermo-Hydraulic code RELAP-7, currently under development at the Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose probabilistic and uncertainty quantification platform, capable to agnostically communicate with any system code. This agnosticism includes providing Application Programming Interfaces (APIs). These APIs are used to allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by inputs files or via python interfaces. RAVEN is capable of investigating the system response, and investigating the input space using Monte Carlo, Grid, or Latin Hyper Cube sampling schemes, but its strength is focused toward system feature discovery, such as limit surfaces, separating regions of the input space leading to system failure, using dynamic supervised learning techniques. The development of RAVEN has started in 2012, when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework became stronger. RAVEN principal assignment is to provide the necessary software and algorithms in order to employ the concept developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just the individuation of the frequency of an event potentially leading to a system failure, but the closeness (or not) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. for an important process such as peak pressure in a pipe) is exceeded under certain conditions. The initial development of RAVEN has been focused on providing dynamic risk assessment capability to RELAP-7, currently under development at the INL and, likely, future replacement of the RELAP5-3D code. Most the capabilities that have been implemented having RELAP-7 as principal focus are easily deployable for other system codes. For this reason, several side activaties are currently ongoing for coupling RAVEN with software such as RELAP5-3D, etc. The aim of this document is the explanation of the input requirements, focalizing on the input structure.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Mariner Venus-Mercury 1973 mission solar proton environment: fluence and dose

A derivation is presented for proton fluence over the duration of the Mariner Venus-Mercury 1973 (MVM73) mission in terms of a relatively constant, low energy component, the solar wind, and a probabilistic high energy component from discrete solar events. An updated correlation of yearly energetic proton fluence with yearly average sunspot number is presented. This correlation and sunspot cycle forecasts for the period of the MVM73 mission (late 1973 through early 1975) form the basis for the high energy proton fluence estimates with various confidence levels. Uncertainties in the probability estimates and in calculation of the scaling with distance from the Sun are discussed. Selection of a particular 95-percentile model as the design constraint is recommended, and reasons are presented for not using the worst-case model. Interior fluences were calculated and expressed in terms useful for spacecraft design.

Thomas, J. R.↗

Should’ve Could’ve: Progress in the Systems Engineering of the Mars2020 On-Board Planner

Mars rover operations has traditionally controlled behavior using meticulously compiled, so-called “Master” sequences that enforce deterministic timing and ordering of activities. While the approach is effective at managing risk and complexity, it can also be inefficient. Extended operations of the Mars2020 rover envisions a fundamentally different scheduling and execution approach. Atomic activities are constrained by mission operators in time, resource usage, and a structure of dependencies. The rover flight software will create and re-create schedules, responding to available energy, data volume, actual activity durations and execution status, observed temperatures, and other on-board state. Schedules are expected to change substantially in the course of execution. The solution space is prohibitively large and probabilistic in nature. A range of emergent behavior is accessible depending on the interaction between actual on-board state and a given formulation of constraints. For years, the specification and implementation of this capability have been considered and refined, as testing and analysis have mapped the contours of the system. Many concepts that could have been adopted were rejected, and in some cases, emergent properties have been exposed and beaten back with approaches to steer the behavior. This paper discusses some of the design history and underlying reasoning in the systems engineering of the first autonomous activity planner on Mars.

Kuhn, Stephen R↗

Probabilistic Analysis for Comparing Fatigue Data Based on Johnson-Weibull Parameters

Probabilistic failure analysis is essential when analysis of stress-life (S-N) curves is inconclusive in determining the relative ranking of two or more materials. In 1964, L. Johnson published a methodology for establishing the confidence that two populations of data are different. Simplified algebraic equations for confidence numbers were derived based on the original work of L. Johnson. Using the ratios of mean life, the resultant values of confidence numbers deviated less than one percent from those of Johnson. It is possible to rank the fatigue lives of different materials with a reasonable degree of statistical certainty based on combined confidence numbers. These equations were applied to rotating beam fatigue tests that were conducted on three aluminum alloys at three stress levels each. These alloys were AL 2024, AL 6061, and AL 7075. The results were analyzed and compared using ASTM Standard E739-91 and the Johnson-Weibull analysis. The ASTM method did not statistically distinguish between AL 6010 and AL 7075. Based on the Johnson-Weibull analysis confidence numbers greater than 99 percent, AL 2024 was found to have the longest fatigue life, followed by AL 7075, and then AL 6061. The ASTM Standard and the Johnson-Weibull analysis result in the same stress-life exponent p for each of the three aluminum alloys at the median or L(sub 50) lives.

Hendricks, Robert C.↗

Qualitative Event-Based Fault Isolation under Uncertain Observations

For many systems, automatic fault diagnosis is critical to ensuring safe and efficient operation. Fault isolation is performed by analyzing measured signals from the system, and reasoning over the system behavior to determine which faults have occurred, based on models of predicted faulty behavior. For dynamic systems, reasoning may be performed using qualitative analysis of the differences between measured signals and their predicted values, in which observations take the form of qualitative symbols. Such an approach is quick to isolate faults, but depends critically on correct generation of the qualitative symbols from the signals. In this paper, we develop an approach to qualitative event-based fault isolation for dynamic systems that is robust to incorrect qualitative observations. Observations are treated as uncertain, where multiple interpretations of an observation, each with its own probability, are considered. By interpreting observed symbols in a probabilistic manner, the approach degrades gracefully as the number of incorrectly-generated symbols increases. The approach is demonstrated on an electrical power system testbed, and experiments using real data obtained from the hardware demonstrate the improved fault isolation performance in the presence of incorrect symbol generation.

Daigle, Matthew↗

Probabilistic Analysis of Aircraft Gas Turbine Disk Life and Reliability

Two series of low cycle fatigue (LCF) test data for two groups of different aircraft gas turbine engine compressor disk geometries were reanalyzed and compared using Weibull statistics. Both groups of disks were manufactured from titanium (Ti-6Al-4V) alloy. A NASA Glenn Research Center developed probabilistic computer code Probable Cause was used to predict disk life and reliability. A material-life factor A was determined for titanium (Ti-6Al-4V) alloy based upon fatigue disk data and successfully applied to predict the life of the disks as a function of speed. A comparison was made with the currently used life prediction method based upon crack growth rate. Applying an endurance limit to the computer code did not significantly affect the predicted lives under engine operating conditions. Failure location prediction correlates with those experimentally observed in the LCF tests. A reasonable correlation was obtained between the predicted disk lives using the Probable Cause code and a modified crack growth method for life prediction. Both methods slightly overpredict life for one disk group and significantly under predict it for the other.

Melis, Matthew E.↗

Optimal maintenance center inventories for fault-tolerant repairable systems

A probabilistic approach is taken to determine the optimal repairable parts inventory for a maintenance center, servicing machines which contain several m-out-of-n systems of different parts, with a constraint on the total inventory investment. A model, based on the discrete Markov process, accounts for a typical ultrareliable avionics system, such as one presently being developed by NASA. The dynamic programming algorithm for minimizing the stockout and holding costs is applied to an exemplary maintenance center, and solutions for single-item and multi-item cases are given. The computational burden is noted to be reasonable and a computer program is used to generate optimal solutions.

Lawrence, S. H.↗

The Use of Collective Dose for Optimization of a Low-Level Waste Site Closure Cover

Low-level radioactive waste management regulations require that releases to the environment be as low as reasonably achievable. Collective dose’s use in quantitative cost benefit analysis is well accepted for optimization of operational radiation safety, but seldom applied to routine environmental releases. One concern is that collective dose for large areas and long time periods may obscure the spatial and temporal distribution of risk and the magnitude of individual doses. Use of collective dose for optimization also requires that the decision maker justify subjective inputs including truncation limits for the summation of collective dose in space and time, a monetary value for collective dose, and a discount rate for future health detriment. In this study, a probabilistic collective dose model is developed and used to optimize the closure of the Area 5 Radioactive Waste Management Site (RWMS) on the Nevada Test Site. Collective dose’s shortcomings are addressed by preparing a dose matrix that disaggregates the collective dose in space and time and by reporting individual doses for exposed subgroups. Important subjective inputs are assigned discrete values reflecting differing opinions, and the consequence of the differences on the final decision is described. The resulting optimization process remains subjective, but clearly identifies subjective inputs, the values selected, and their impact on the decision. For the Area 5 RWMS, the value of the collective dose is small compared to closure cover cost options over a broad range of subjective values for the spatial and temporal limits for truncation of collective dose, monetary value of collective dose, and discount rates for future dose. The collective dose matrix and individual doses indicate that the societal and individual risks are greatest for future residents within the disposal site boundary, suggesting that options deterring intrusion have the greatest potential for cost-effectiveness. The cost of various closure options far exceeds the value of the collective dose averted, indicating that there are few opportunities for cost-effective improvements when closures meet the low dose constraints in waste management regulations.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Cost-Effectiveness Analysis of Stereotactic Body Radiation Therapy Compared With Radiofrequency Ablation for Inoperable Colorectal Liver Metastases

Purpose: To conduct a cost-effectiveness analysis to determine whether stereotactic body radiation therapy (SBRT) is a cost-effective therapy compared with radiofrequency ablation (RFA) for patients with unresectable colorectal cancer (CRC) liver metastases. Methods and Materials: A cost-effectiveness analysis was conducted using a Markov model and 1-month cycle over a lifetime horizon. Transition probabilities, quality of life utilities, and costs associated with SBRT and RFA were captured in the model on the basis of a comprehensive literature review and Medicare reimbursements in 2014. Strategies were compared using the incremental cost-effectiveness ratio, with effectiveness measured in quality-adjusted life years (QALYs). To account for model uncertainty, 1-way and probabilistic sensitivity analyses were performed. Strategies were evaluated with a willingness-to-pay threshold of $100,000 per QALY gained. Results: In base case analysis, treatment costs for 3 fractions of SBRT and 1 RFA procedure were $13,000 and $4397, respectively. Median survival was assumed the same for both strategies (25 months). The SBRT costs $8202 more than RFA while gaining 0.05 QALYs, resulting in an incremental cost-effectiveness ratio of $164,660 per QALY gained. In 1-way sensitivity analyses, results were most sensitive to variation of median survival from both treatments. Stereotactic body radiation therapy was economically reasonable if better survival was presumed (>1 month gain) or if used for large tumors (>4 cm). Conclusions: If equal survival is assumed, SBRT is not cost-effective compared with RFA for inoperable colorectal liver metastases. However, if better local control leads to small survival gains with SBRT, this strategy becomes cost-effective. Ideally, these results should be confirmed with prospective comparative data.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Comparing Physics Scheme Performance for a Lake Effect Snowfall Event in Northern Lower Michigan

High resolution forecast models, such as those used to predict severe convective storms, can also be applied to predictions of lake effect snowfall. A high resolution WRF model forecast model is provided to support operations at NWS WFO Gaylord, Michigan, using a 12 ]km and 4 ]km nested configuration. This is comparable to the simulations performed by other NWS WFOs adjacent to the Great Lakes, including offices in the NWS Eastern Region who participate in regional ensemble efforts. Ensemble efforts require diversity in initial conditions and physics configurations to emulate the plausible range of events in order to ascertain the likelihood of different forecast scenarios. In addition to providing probabilistic guidance, individual members can be evaluated to determine whether they appear to be biased in some way, or to better understand how certain physics configurations may impact the resulting forecast. On January 20 ]21, 2011, a lake effect snow event occurred in Northern Lower Michigan, with cooperative observing and CoCoRaHS stations reporting new snow accumulations between 2 and 8 inches and liquid equivalents of 0.1 ]0.25 h. The event of January 21, 2011 was particularly well observed, with numerous surface reports available. It was also well represented by the WRF configuration operated at NWS Gaylord. Given that the default configuration produced a reasonable prediction, it is used here to evaluate the impacts of other physics configurations on the resulting prediction of the primary lake effect band and resulting QPF. Emphasis here is on differences in planetary boundary layer and cloud microphysics parameterizations, given their likely role in determining the evolution of shallow convection and precipitation processes. Results from an ensemble of seven microphysics schemes and three planetary boundary layer schemes are presented to demonstrate variability in forecast evolution, with results used in an attempt to improve the forecasts in the 2011 ]2012 lake effect season.

Molthan, Andrew↗

Integration of performance assessments and 3116 basis documents within the Savannah River Site liquid waste facilities - 15375

The end of the Cold War has left a legacy of over 136 million liters (36 million gallons) of radioactive waste in the aging waste tanks at the Department of Energy's Savannah River Site (SRS). A robust program is in place to remove waste from these tanks, treat the waste to separate it into a relatively small volume of high-level waste and a large volume of low-level waste, and to actively dispose of the low-level waste on-site. This process allows the US Department of Energy (DOE) to move forward with closure of the cleaned waste tanks and associated ancillary structures. To support performance-based, risk decision making for closure and disposal activities, three individual performance assessments (PAs) have been developed - salt-stone Disposal Facility, F-Tank Farm and H-Tank Farm. In addition, three Waste Determinations (WDs) have been made by the Secretary of Energy, in consultation with the Nuclear Regulatory Commission (NRC), under the authority of Section 3116 of the Ronald W. Reagan National Defense Authorization Act for Fiscal Year 2005 (NDAA Section 3116). To support these waste determination decisions, individual '3116 Basis Documents' were developed that describe the assumptions and conditions under which the criteria outlined in NDAA Section 3116 are met. The development of each of the PAs represented a long and arduous effort that involved the development of both deterministic and probabilistic conceptual models of the facilities, the development of assumptions and associated ranges, uncertainty and sensitivity analyses, model data collection and analyses, writing of the actual performance assessment, internal and external peer reviews, and ultimately approval by DOE. Similarly, the development of the 3116 Basis Documents represents similar time and financial commitments. At the end of these efforts, after years of preparation and millions of dollars in investment, we have thousands of pages of highly technical text, tables of data and hundreds of graphs and charts all contained in a series of thick binders that fit neatly on the shelf of a bookcase. We were done - right? Actually, we were just getting started. Performance Assessments and 3116 Basis Documents are living documents that shape day-to-day and long-term decision making in the operation of a low-level waste disposal facility (e.g., salt-stone Disposal Facility) or in area closure activities (e.g., F-Tank Farm or H-Tank Farm). Although these documents do not contain specifically described requirements per se, they do utilize specific assumptions that, if changed significantly, could result in no longer being able to demonstrate that there is reasonable assurance that the required performance objectives or the criteria from NDAA Section 3116 can be met. Savannah River Remediation LLC (SRR), the contractor responsible for Liquid Waste operations at SRS, has not only developed the PAs and 3116 Basis Documents to support this work and shepherded these documents through the DOE approval process, but has also developed the processes and procedures to ensure the successful implementation and integration of these documents into day-to-day decision making within the associated facilities. This paper describes these processes, including the Un-reviewed Waste Management Question process and the PA Maintenance process, and provides specific examples of their successful implementation. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Is Biological Subtype Prognostic of Locoregional Recurrence Risk in Women With pT1-2N0 Breast Cancer Treated With Mastectomy?

Purpose: To examine locoregional and distant recurrence (LRR and DR) in women with pT1-2N0 breast cancer according to approximated subtype and clinicopathologic characteristics. Methods and Materials: Two independent datasets were pooled and analyzed. The study participants were 1994 patients with pT1-2N0M0 breast cancer, treated with mastectomy without radiation therapy. The patients were classified into 1 of 5 subtypes: luminal A (ER+ or PR+/HER 2−/grade 1-2, n=1202); luminal B (ER+ or PR+/HER 2−/grade 3, n=294); luminal HER 2 (ER+ or PR+/HER 2+, n=221); HER 2 (ER−/PR−/HER 2+, n=105) and triple-negative breast cancer (TNBC) (ER−/PR−/HER 2−, n=172). Results: The median follow-up time was 4.3 years. The 5-year Kaplan-Meier (KM) LRR were 1.8% in luminal A, 3.1% in luminal B, 1.7% in luminal HER 2, 1.9% in HER 2, and 1.9% in TNBC cohorts (P=.81). The 5-year KM DR was highest among women with TNBC: 1.8% in luminal A, 5.0% in luminal B, 2.4% in luminal HER 2, 1.1% in HER 2, and 9.6% in TNBC cohorts (P<.001). Among 172 women with TNBC, the 5-year KM LRR were 1.3% with clear margins versus 12.5% with close or positive margins (P=.04). On multivariable analysis, factors that conferred higher LRR risk were tumors >2 cm, lobular histology, and close/positive surgical margins. Conclusions: The 5-year risk of LRR in our pT1-2N0 cohort treated with mastectomy was generally low, with no significant differences observed between approximated subtypes. Among the subtypes, TNBC conferred the highest risk of DR and an elevated risk of LRR in the presence of positive or close margins. Our data suggest that although subtype alone cannot be used as the sole criterion to offer postmastectomy radiation therapy, it may reasonably be considered in conjunction with other clinicopathologic factors including tumor size, histology, and margin status. Larger cohorts and longer follow-up times are needed to define which women with node-negative disease have high postmastectomy LRR risks in contemporary practice.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk, and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results, and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods, such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty, are rendered obsolete, since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods. This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper describes how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty are rendered obsolete since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods.This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper shows how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗

Predictability of phases and magnitudes of natural decadal climate variability phenomena in CMIP5 experiments with the UKMO HadCM3, GFDL-CM2.1, NCAR-CCSM4, and MIROC5 global earth system models

Data from decadal hindcast experiments conducted under CMIP5 were used to assess the ability of CM2.1, HadCM3, MIROC5, and CCSM4 Earth System Models (ESMs) to hindcast sea-surface temperature (SST) indices of the Pacific Decadal Oscillation (PDO), the tropical Atlantic SST gradient (TAG) variability, and the West Pacific Warm Pool (WPWP) SST variability from 1961 to 2010. The ESMs were initialized at specific times with observed data to make 10- and 30-year hindcasts/forecasts. Deterministic and probabilistic skill estimates show predictability of detrended WPWP index to 5 years’ lead time and of non-detrended WPWP index to 10 years’ lead time. These estimates also show atypical skill dependence of PDO and TAG indices on lead times, with increasing skill in the middle to end of 10-year hindcasts. The skill of ESMs to hindcast an observed DCV index (signal skill) is surprisingly greater than the skill to hindcast their own DCV index (noise skill) at some lead times. All ESMs hindcast occurrence frequencies of positive and negative phases of the indices, and probabilities of same-phase transitions from one year to the next reasonably well. Four, major, low-latitude volcanic eruptions are associated with phase transitions of all observed and some of the ensemble-average hindcast indices. All ESMs’ WPWP index hindcasts respond correctly to all eruptions as do three observed PDO phase transitions. No one of the ESMs’ hindcasts of the TAG index responds correctly to these eruptions. Some of the ESMs hindcast correct phase transitions in the absence of eruptions also, implying that initializations with observed data are beneficial in predicting phase transitions. The skills of DCV indices’ phase prediction up to at least two years in advance can be used to inform societal impacts adaptation decisions in water resources management and agriculture. The Atlantic region’s responses in these ESMs appear to be fundamentally incorrect.

54 ENVIRONMENTAL SCIENCES↗