Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “PROBABILISTIC ESTIMATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Online NASA Software Estimating Tools (ONSET): A Suite of Web-Based Cost Analysis Tools

This paper provides an overview of ONSET theOnline NASA Software Estimating Tools suite of web-basedcosts analysis tools. ONSET is comprised of the AnalogySoftware Cost Tool (ASCoT) [1], and the CubeSat Or MicrosatProbabilistic and Analogies Cost Tool (COMPACT) [2]. TheOnline NASA Space Estimation Tool (ONSET) has beendeveloped to provide a standardized platform for hosting webbasedNASA cost estimation tools on NASA ONCE (OneNASA Cost Engineering). It evolved from the BETA version ofASCoT (The NASA Analogy Software Cost Tool) which wasreleased in 2017 and was presented at the 2017 IEEEAerospace Conference. This first release of ONSET contains anew version of ASCoT as well as the first official release ofCOMPACT (CubeSat Or Microsat Probabilistic + AnalogiesCost Tool). In this paper we will provide an overview ofONSET, all its features and a high-level summary of bothASCoT and COMPACT. The heart of both tools arealgorithms for analogy-based estimation based on system levelinputs.

Johnson, James↗

Probability Distribution Estimated From the Minimum, Maximum, and Most Likely Values: Applied to Turbine Inlet Temperature Uncertainty

Modern engineering design practices are tending more toward the treatment of design parameters as random variables as opposed to fixed, or deterministic, values. The probabilistic design approach attempts to account for the uncertainty in design parameters by representing them as a distribution of values rather than as a single value. The motivations for this effort include preventing excessive overdesign as well as assessing and assuring reliability, both of which are important for aerospace applications. However, the determination of the probability distribution is a fundamental problem in reliability analysis. A random variable is often defined by the parameters of the theoretical distribution function that gives the best fit to experimental data. In many cases the distribution must be assumed from very limited information or data. Often the types of information that are available or reasonably estimated are the minimum, maximum, and most likely values of the design parameter. For these situations the beta distribution model is very convenient because the parameters that define the distribution can be easily determined from these three pieces of information. Widely used in the field of operations research, the beta model is very flexible and is also useful for estimating the mean and standard deviation of a random variable given only the aforementioned three values. However, an assumption is required to determine the four parameters of the beta distribution from only these three pieces of information (some of the more common distributions, like the normal, lognormal, gamma, and Weibull distributions, have two or three parameters). The conventional method assumes that the standard deviation is a certain fraction of the range. The beta parameters are then determined by solving a set of equations simultaneously. A new method developed in-house at the NASA Glenn Research Center assumes a value for one of the beta shape parameters based on an analogy with the normal distribution (ref.1). This new approach allows for a very simple and direct algebraic solution without restricting the standard deviation. The beta parameters obtained by the new method are comparable to the conventional method (and identical when the distribution is symmetrical). However, the proposed method generally produces a less peaked distribution with a slightly larger standard deviation (up to 7 percent) than the conventional method in cases where the distribution is asymmetric or skewed. The beta distribution model has now been implemented into the Fast Probability Integration (FPI) module used in the NESSUS computer code for probabilistic analyses of structures (ref. 2).

Holland, Frederic A., Jr.↗

Combining Radiography and Passive Measurements for Radiological Threat Localization in Cargo

Detecting shielded special nuclear material (SNM) in a cargo container is a difficult problem, since shielding reduces the amount of radiation escaping the container. Radiography provides information that is complementary to that provided by passive gamma-ray detection systems: while not directly sensitive to radiological materials, radiography can reveal highly shielded regions that may mask a passive radiological signal. Combining these measurements has the potential to improve SNM detection, either through improved sensitivity or by providing a solution to the inverse problem to estimate source properties (strength and location). We present a data-fusion method that uses a radiograph to provide an estimate of the radiation-transport environment for gamma rays from potential sources. This approach makes quantitative use of radiographic images without relying on image interpretation, and results in a probabilistic description of likely source locations and strengths. We present results for this method for a modeled test case of a cargo container passing through a plastic-scintillator-based radiation portal monitor and a transmission-radiography system. We find that a radiograph-based inversion scheme allows for localization of a low-noise source placed randomly within the test container to within 40 cm, compared to 70 cm for triangulation alone, while strength estimation accuracy is improved by a factor of six. Improvements are seen in regions of both high and low shielding, but are most pronounced in highly shielded regions. The approach proposed here combines transmission and emission data in a manner that has not been explored in the cargo-screening literature, advancing the ability to accurately describe a hidden source based on currently-available instrumentation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Probabilistic Risk Assessment of Flexible Power Operation of a Nuclear Power Plant

Nuclear power plants (NPPs) are becoming cost prohibitive to operate. This is due to historically low natural gas prices and wind and solar prices often being less than the marginal cost of operating baseload coal and NPPs, which sometimes forces NPPs to pay for the electricity they create. Thus, the feasibility of using part of the heat from an NPP to create other commodities such as hydrogen is being evaluated; operating in this way is called flexible power operation (FPO). To change the NPP design and operation, a license review must happen. Part of the review is the Probabilistic Risk Assessment (PRA) which proves the safety of the design and operation by identifying sequences of events that result in plant failure and estimating their likelihood of occurrence. A Level 1 PRA model that evaluates the risk of removing heat from the secondary side of NPP was created. The model was developed using Systems Analysis Program for Hands-On Integrated Reliability Evaluations (SAPHIRE 8) software to calculate core damage frequency (CDF). It is a fault tree that represents the possible pathways that could lead to a loss of steam inventory in the secondary loop. A loss of steam inventory can induce steam generator tube rupture or other events that activates response systems to avoid core damage. This is the main concern for the Nuclear Regulatory Commission (NRC), the group in the United States that licenses NPPs. This model will calculate a total CDF of any of these pathways occurring which will be compared to the baseline CDF in a generic NPP PRA for licensing support.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A framework for feasibility-level validation of high-resolution wave hindcast models

The value of long-term wave hindcasts for investigating wave climates, wave energy resources, and extreme wave conditions has motivated research developing, calibrating and validating wave hindcast models. Past hindcast model validation studies examined the accuracy in modeling bulk wave parameters of overall sea states without considering the dependency of the model's skill within different sea states. In the present study, a framework for wave hindcast model validation is developed by examining the model accuracy for the most frequently occurring sea states, sea states contributing the most energy to total wave power, sea states associated with hurricane events, and those with the largest model error. Here, validations using bulk wave parameters and frequency-directional spectra at these key sea states and extreme wave conditions based on univariate and bivariate-contour methods provide insights to improve model accuracy, identifying the model's strong and weak points, and pathways for improvement, e.g., modeling wave-current interactions and adjusting wind data. This study adds to a growing body of research demonstrating that a carefully calibrated and verified spectral wave hindcast model can be used to estimate key wave energy parameters over a wide range of wave energy climates, as well as their spatial, temporal, frequency, directional, and probabilistic distributions.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning Derived Dynamic Operating Reserve Requirements in High-Renewable Power Systems

Accurately forecasting wind and solar power output poses challenges for deeply decarbonized electricity systems. Grid operators must commit resources to provide reserves to ensure reliable operations in the face of forecast errors, a process which can increase fuel consumption and emissions. We apply neural network-based machine learning to expand the usefulness of median point forecast data by creating probabilistic distributions of short-term uncertainty in demand, wind, and solar forecasts that adapt to prevailing grid conditions. Machine learning derived estimates of forecast errors compare favorably to estimates based on incumbent methods. Reserves derived from machine learning are usually smaller than values derived using incumbent methods, which enables fuel savings during most hours. Machine learning reserves are generally larger than incumbent reserves during times of higher forecast error, potentially improving system reliability. Performance is tested using multi-stage production simulation modeling of the California Independent System Operator (CAISO) system. Machine learning reserves provide production cost and greenhouse gas (GHG) emission reductions of approximately 0.3% relative to historical 2019 requirements. Savings in the 2030 timeframe are highly dependent on battery storage capacity. At lower levels of battery capacity, savings of 0.4% from machine learning reserves are shown. Significant quantities of battery storage are expected to be added to meet California's resource adequacy needs and GHG reduction targets. Addition of these batteries saturate reserve needs and results in minimal within-hour balancing costs in 2030.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Data-Driven Optimization for the Design and Control of Large-Scale Systems (LDRD Final Report)

Engineering decisions are often formulated as optimization problems such as the optimal design or control of physical systems. In these applications, the resulting optimization problems are constrained by large-scale simulations involving systems of partial differential equations (PDEs), ordinary differential equations (ODEs), and differential algebraic equations (DAEs). In addition, critical components of these systems are fraught with uncertainty, including unverifiable modeling assumptions, unknown boundary and initial conditions, and uncertain coefficients. Typically, these components are estimated using noisy and incomplete data from a variety of sources (e.g., physical experiments). The lack of knowledge of the true underlying probabilistic characterization of model inputs motivates the need for optimal solutions that are robust to this uncertainty. In this report, we introduce a framework for handling "distributional" uncertainties in the context of simulation-based optimization. This includes a novel measure discretization technique that will lead to an adaptive optimization algorithm tailored to exploit the structures inherent to simulation- based optimization.

42 ENGINEERING↗

Space system operations and support cost analysis using Markov chains

This paper evaluates the use of Markov chain process in probabilistic life cycle cost analysis and suggests further uses of the process as a design aid tool. A methodology is developed for estimating operations and support cost and expected life for reusable space transportation systems. Application of the methodology is demonstrated for the case of a hypothetical space transportation vehicle. A sensitivity analysis is carried out to explore the effects of uncertainty in key model inputs.

Unal, Resit↗

Testing and Analysis of NEXT Ion Engine Discharge Cathode Assembly Wear

Experimental and analytical investigations were conducted to predict the wear of the discharge cathode keeper in the NASA Evolutionary Xenon Thruster. The ion current to the keeper was found to be highly dependent upon the beam current, and the average beam current density was nearly identical to that of the NSTAR thruster for comparable beam current density. The ion current distribution was highly peaked toward the keeper orifice. A deterministic wear assessment predicted keeper orifice erosion to the same diameter as the cathode tube after processing 375 kg of xenon. A rough estimate of discharge cathode assembly life limit due to sputtering indicated that the current design exceeds the qualification goal of 405 kg. Probabilistic wear analysis showed that the plasma potential and the sputter yield contributed most to the uncertainty in the wear assessment. It was recommended that fundamental experimental and modeling efforts focus on accurately describing the plasma potential and the sputtering yield.

Domonkos, Matthew T.↗

Thoughts Without Content are Empty, Intuitions Without Concepts are Blind - Determinism and Contingency Revisited

Was the emergence of life a predictable outcome of chemical evolution on earth? Could evolution produce life very different from ours? These are one of the oldest questions in the field of the origin of life that not only have broad philosophical implications but also impact how we approach the problem from the methodological standpoint. Framing the issue in terms of the dichotomy between contingency and determinism is not a fortunate because these two terms in their conventional meaning are neither mutually exclusive nor jointly exhaustive. Determinism, represented in natural sciences by Newtonian physics, relies on the assumption that every event is causally determined by a chain of previous events. In the context of the origin of life it means that once the initial conditions on the early earth have been specified further evolution follows inevitably. Considering uncertainties about conditions on the prebiotic earth, many plausible sets of initial conditions can be defined, each followed by a separate deterministic trajectory. This conventional understanding of determinism does not admit contingency. Further, it has no implications for evaluating how many sets of initial conditions lead to the emergence of life. It appears that a better framing of the problem is as follows: given plausible sets of initial conditions on the early earth how probable and broadly spread are evolutionary trajectories that lead to life? Instead of undertaking an impossible task of specifying microscopic initial conditions for all components of the system one uses a reduced representation of this system and specify only a small set of essential macroscopic parameters, values (or ranges of values) of which can be identified, inferred or estimated from experiment, theory or historical record. The following evolutionary trajectories are still governed by laws of physics and chemistry but become probabilistic and "contingency" is admitted as variations in other variables in the system. A similar reasoning is common in other fields of science, for example in statistical mechanics. Some trajectories lead to life, perhaps in different forms, whereas others do not. Of our true interest is the ratio of these two outcomes. The issue of determinism does not directly enter the picture. The debate about the likelihood of the emergence of life is quite old. One view holds that the origin of life is an event governed by chance, and the result of so many random events (contingencies) is unpredictable. This view was eloquently expressed by Monod. In his book "Chance or Necessity" he argued that life was a product of "nature's roulette." In an alternative view, expressed in particular by deDuve and Morowitz, the origin of life is considered a highly probable or even inevitable event (although its details need not be determined in every respect). Only in this sense the origin of life can be considered a "deterministic event".

Pohorille, Andrew↗

Quantifying uncertainty in stable isotope mixing models

Mixing models are powerful tools for identifying biogeochemical sources and determining mixing fractions in a sample. However, identification of actual source contributors is often not simple, and source compositions typically vary or even overlap, significantly increasing model uncertainty in calculated mixing fractions. This study compares three probabilistic methods, SIAR [ Parnell et al ., 2010] a pure Monte Carlo technique (PMC), and Stable Isotope Reference Source (SIRS) mixing model, a new technique that estimates mixing in systems with more than three sources and/or uncertain source compositions. In this paper, we use nitrate stable isotope examples (δ 15 N and δ 18 O) but all methods tested are applicable to other tracers. In Phase I of a three-phase blind test, we compared methods for a set of six-source nitrate problems. PMC was unable to find solutions for two of the target water samples. The Bayesian method, SIAR, experienced anchoring problems, and SIRS calculated mixing fractions that most closely approximated the known mixing fractions. For that reason, SIRS was the only approach used in the next phase of testing. In Phase II, the problem was broadened where any subset of the six sources could be a possible solution to the mixing problem. Results showed a high rate of Type I errors where solutions included sources that were not contributing to the sample. In Phase III some sources were eliminated based on assumed site knowledge and assumed nitrate concentrations, substantially reduced mixing fraction uncertainties and lowered the Type I error rate. These results demonstrate that valuable insights into stable isotope mixing problems result from probabilistic mixing model approaches like SIRS. The results also emphasize the importance of identifying a minimal set of potential sources and quantifying uncertainties in source isotopic composition as well as demonstrating the value of additional information in reducing the uncertainty in calculated mixing fractions.

54 ENVIRONMENTAL SCIENCES↗

Interpretation of Probabilistic Surface Ozone Forecasts: A Case Study for Philadelphia

The use of probabilistic forecasting has been growing in a variety of disciplines because of its potential to emphasize the degree of uncertainty inherent in a prediction. Interpretation of probabilistic forecasts, however, is oftentimes difficult, deterring users who may benefit from such forecasts. To encourage broader use of probabilistic forecasts in the field of air quality, a process for interpreting forecasts from a statistical probabilistic air quality surface ozone model [the Regression in Self Organizing Map (REGiS)] is demonstrated. Four procedures to convert probabilistic to deterministic forecasts are explored for the Philadelphia, Pennsylvania, metropolitan area. These procedures calibrate the predicted probability of daily maximum 8-h-average ozone exceeding a standard value by 1) estimating climatological relative frequency, 2) establishing a probability of an exceedance threshold as 50%, 3) maximizing the threat score, and 4) determining the unit bias ratio. REGiS is trained using 2000–11 ozone-season (1 May–30 September) data, calibrated using 2012–14 data, and evaluated using 2015–18 data. Assessment of the calibration data with the Pierce skill score suggests an exceedance threshold based on climatological relative frequency for the conversion from probabilistic to deterministic forecasts. Calibrated REGiS generally compares well to predictions from the U.S. national air quality model and operational “expert” forecasts over the evaluation period. For other probabilistic models and situations, different procedures of converting probabilistic to deterministic forecasts may be more beneficial. The methods presented in this paper represent an approach for operational air quality forecasters seeking to use probabilistic model output to support forecasts designed to protect public health.

Nikolay Balashov↗

Topographic Slant Range Modeling and Fault Detection for Precision Planetary Landing

This work presents a novel landing site relative topographic measurement model for aslant range sensor being utilized for precision planetary landing operations. The measurement model accounts for the local terrain the slant range sensor captures and leverages knowledge of the estimated landing site provided by the navigation filter. Notably, in contrast to previous works, the new model does not rely on surface normal approximation, reducing the model’s sensitivity to noisy digital elevation maps which represent the local topography. In addition to the measurement model, this work introduces a novel fault detection method, denoted the probabilistic inspection of topographic filter altitude likelihood (PITFAL) algorithm, that implements a statistical outlier rejection algorithm. PITFAL is designed for multi-beam slant range sensors, such as the Navigation Doppler LIDAR (NDL), and identifies statistically inconsistent range estimates through a consensus check on the set of apparent altitudes computed for each individual beam. These models are numerically validated by the Safe and Precise Landing Capability Evolution (SPLICE) project’s high-fidelity terrestrial and lunar lander simulations.

Davis W Adams↗

Topographic Slant Range Modeling and Fault Detection for Precision Planetary Landing

This work presents a novel landing site relative topographic measurement model for aslant range sensor being utilized for precision planetary landing operations. The measurement model accounts for the local terrain the slant range sensor captures and leverages knowledge of the estimated landing site provided by the navigation filter. Notably, in contrast to previous works, the new model does not rely on surface normal approximation, reducing the model’s sensitivity to noisy digital elevation maps which represent the local topography. In addition to the measurement model, this work introduces a novel fault detection method, denoted the probabilistic inspection of topographic filter altitude likelihood (PITFAL) algorithm, that implements a statistical outlier rejection algorithm. PITFAL is designed for multi-beam slant range sensors, such as the Navigation Doppler LIDAR (NDL), and identifies statistically inconsistent range estimates through a consensus check on the set of apparent altitudes computed for each individual beam. These models are numerically validated by the Safe and Precise Landing Capability Evolution (SPLICE) project’s high-fidelity terrestrial and lunar lander simulations.

Davis W Adams↗

Using probabilistic analysis to assess the reliability of predicted SRB aft-skirt stresses

Probabilistic failure analysis is a tool to predict the reliability of a part or system. Probabalistic techniques were used to predict critical stresses which occur in the solid rocket booster aft-skirt during main engine buildup, immediately prior to lift-off. More than any other hold down post (HDP) load component, the Z loads are sensitive to variations in strains and calibration constants. Also, predicted aft-skirt stresses are strongly affected by HDP load variations. Therefore, the instrumented HDP are not effective load transducers for Z loads, and, when used with aft skirt stress indicator equations, yield estimates with large uncertainty. Monte Carlo simulation proved to be a straight forward way of studying the overlapping effects of multiple parameters on predicted equipment performance. An advantage of probabilistic analysis is the degree of uncertainty of each parameter as stated explicitly by its probability distribution. It was noted, however, that the choice of parameter distribution had a large effect on the simulation results. Many times these distributions must be assumed. The engineer who is designing the part should be responsible for the choice of parameter distribution.

Richardson, James A.↗

Impact Real World System Validation

Introduction NASA has developed a new evidence-based data-driven probabilistic risk assessment and tradespace analysis tool as a successor to the Integrated Medical Model. This updated decision support tool is known as IMPACT (Informing Mission Planning via Analysis of Complex Tradespaces). IMPACT estimates the frequency and consequences of medical conditions that might arise during exploration missions. A validation analysis of IMPACT was performed with respect to a set of International Space Station (ISS) and Shuttle Transportation System (STS) real world system (RWS) referent data due to the limited referent data available from exploration missions. Methods Observed mission and crew characteristics from STS and ISS missions were used as model inputs within MEDPRAT (Medical Extensible Dynamic Probabilistic Risk Assessment Tool). For each mission, two hundred thousand simulations were generated. For each mission, model outputs included occurrence counts for each condition, total medical events (TME), and the probability of loss of crew life (LOCL). These simulated model outputs were compared to the RWS referent data. Results The predicted number of total medical events exceeded the total RWS medical events for ISS missions and combined ISS and STS missions and fell within the 90% confidence interval for STS missions. For the 32 ISS missions simulated by IMPACT, the number of total medical events was overpredicted for 19 missions and fell within the 90% confidence interval for 13 missions. For the 21 STS missions, the total number of medical events was overpredicted for 3 missions, fell within the 90% confidence interval for 16 missions, and was underpredicted for 2 missions. Combined, 29 missions were in range, 22 were overpredicted, and 2 were underpredicted. The predicted LOCL probability for the 32 ISS missions, the 21 STS missions, and the combined ISS and STS missions was consistent with the zero LOCL events observed in the RWS referent data. The validation analysis included a comparison of the number of medical events predicted by IMPACT and the number of medical events observed in the RWS data on a condition-by-condition basis. For ISS missions, 50 conditions were in range, 52 conditions were statistically underpowered (not enough observed sample to draw any conclusions on precision), 8 conditions were overpredicted, and 9 conditions were underpredicted. Overall, only 14% (17/119) of conditions were out of range for STS missions, 40 conditions were in range, 59 conditions were statistically underpowered, 10 conditions were overpredicted, and 10 conditions were underpredicted. Overall, only 17% (20/119) of conditions were out of range. For combined ISS and STS missions, 11 conditions were overpredicted, and 11 conditions were underpredicted. Overall, only 18% (22/119) of conditions were out of range. For combined ISS and STS missions, 49 conditions were in range, 46 conditions were statistically underpowered, 18 conditions were overpredicted, and 8 conditions were underpredicted. Overall, 21% (26/121) of conditions were out of range. Conclusion The results of this validation analysis should not be interpreted as a pass/fail test of the validity of IMPACT. Instead, this validation analysis should be used to assess some of the IMPACT outcomes in terms of consistencies and inconsistencies with the ISS and STS RWS referent data.

L. Boley↗

An extended polynomial chaos expansion for PDF characterization and variation with aleatory and epistemic uncertainties

This paper presents an extended polynomial chaos formalism for epistemic uncertainties and a new framework for evaluating sensitivities and variations of output probability density functions (PDF) to uncertainty in probabilistic models of input variables. An ”extended” polynomial chaos expansion (PCE) approach is developed that accounts for both aleatory and epistemic uncertainties, modeled as random variables, thus allowing a unified treatment of both types of uncertainty. We explore in particular epistemic uncertainty associated with the choice of prior probabilistic models for input parameters. A PCE-based Kernel Density (KDE) construction provides a composite map from the PCE coefficients and germ to the PDF of quantities of interest (QoI). Here, the sensitivities of these PDF with respect to the input parameters are then evaluated. Input parameters of the probabilistic models are considered. By sampling over the epistemic random variable, a family of PDFs is generated and the failure probability is itself estimated as a random variable with its own PCE. Integrating epistemic uncertainties within the PCE framework results in a computationally efficient paradigm for propagation and sensitivity evaluation. Two typical illustrative examples are used to demonstrate the proposed approach.

Aleatory uncertainty↗