Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “PROBABILISTIC ESTIMATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Comparison of Health and Performance Risk for Accelerated Mars Mission Scenarios

This document details the results for a quantitative estimate of the difference in human health and performance risk that crews would face for two hypothetical variations on Mars mission scenarios: an Accelerated Mars Mission (AMM) and a Standard Mars Mission(SMM).NASA goals for Mars mission concepts, duration, and tasks have varied over the years. While neither of the cases considered here are likely to accurately represent the initial mission to Mars, the exercise of evaluating significant differences in mission duration from an astronaut health perspective can provide bounding insight to the level of risk that is likely to be encountered in an eventual Mars mission. Medical Probabilistic Risk Assessment using the Integrated Medical Model (IMM)(1–3)and the NASA Space Radiation Cancer Risk Model (NSCR)(4,5) are used here to help mission planners gain the best insight currently available into the expected magnitude of impacts to astronaut health when undertaking a Mars mission. These impacts occur both in-mission as well as in the long-term health of the astronauts post-mission. These evaluations are currently the best available modeling estimates to characterize and bound the health risks in a proposed mission domain where humans have no experience.

Erik Antonsen↗

Upper bounds for 21st-century surface air temperatures in the Western United States

The last decade has seen a large number of severe heatwaves that were unprecedented in the observational record, highlighting challenges associated with observationally-based statistical quantification of the likelihood and magnitude of future extreme temperatures. An alternative to such probabilistic assessments is identification of upper bounds that quantify the hottest surface air temperatures that can possibly be achieved by the end of the 21st century. Theory, simulations, and observational analyses support the existence of a finite upper bound for surface air temperature; however, estimates for future upper-bound values that are realistic and usable for planning remain unavailable. Here, we combine atmospheric theory with large ensembles of dynamically downscaled projections to estimate historical and end-of-century upper bounds for surface air temperatures. A number of physical mechanisms can influence upper bounds, and at the end of the 21st century, estimates based on mechanisms that yield more moderate upper-bounds produce values around 60∘C for much of the Western United States and in excess of 80∘C for the hottest parts of the domain. Even cooler high-altitude locations have end-of-century upper bounds over 50∘C. Although these upper-bound estimates might seem implausibly large, increases in the upper bounds over the 21st century are similar to increases in dynamically downscaled peak surface temperatures after adjusting those downscaled temperatures to eliminate the possibly biased model trends in surface specific humidity. While upper bound estimates are high relative to historical observations, they nonetheless suggest that heatwave intensity risk is bounded, with uncertainty dominated by projections of surface and upper-level humidity.

Risser, Mark D↗

Setting the threshold for high throughput detectors: A mathematical approach for ensembles of dynamic, heterogeneous, probabilistic anomaly detectors

Cyber operations now manage a high volume of heterogeneous log data. Anomaly Detection (AD) in such operations involves multiple (e.g., per IP, per data type) ensembles of detectors modeling heterogeneous characteristics (e.g., rate, size, type) often with adaptive online models producing alerts in near real time. Because of the high data volume, setting the threshold for each detector in such a system is an essential yet underdeveloped configuration issue that, if slightly mistuned, can leave the system useless, either producing a myriad of alerts (and flooding downstream systems) or giving none. In this work, we build on the foundations of Ferragut et al. to provide a set of rigorous results for understanding the relationship between threshold values and alert quantities for probabilistic detectors. This informs an algorithm for setting the threshold of multiple, heterogeneous, possibly dynamic detectors completely a priori, in principle. Indeed, if the underlying distribution of the incoming data is known, the algorithm provides provably manageable thresholds. If the distribution is unknown (poorly estimated), our analysis gives insight into how the model distribution differs from the actual distribution, indicating refitting is necessary. We provide empirical experiments, regulating the alert rate of a system with ≈2,500 adaptive detectors scoring over 1.5M events in 5 hours of timestamps. Further, we demonstrate on real network data and detection framework of Harshaw et al. the alternative case, demonstrating that the inability to regulate alerts indicates how the detection model is not a good fit to the data.

Bridges, Robert↗

Model-Based Method for Sensor Validation

Fault detection, diagnosis, and prognosis are essential tasks in the operation of autonomous spacecraft, instruments, and in situ platforms. One of NASA s key mission requirements is robust state estimation. Sensing, using a wide range of sensors and sensor fusion approaches, plays a central role in robust state estimation, and there is a need to diagnose sensor failure as well as component failure. Sensor validation can be considered to be part of the larger effort of improving reliability and safety. The standard methods for solving the sensor validation problem are based on probabilistic analysis of the system, from which the method based on Bayesian networks is most popular. Therefore, these methods can only predict the most probable faulty sensors, which are subject to the initial probabilities defined for the failures. The method developed in this work is based on a model-based approach and provides the faulty sensors (if any), which can be logically inferred from the model of the system and the sensor readings (observations). The method is also more suitable for the systems when it is hard, or even impossible, to find the probability functions of the system. The method starts by a new mathematical description of the problem and develops a very efficient and systematic algorithm for its solution. The method builds on the concepts of analytical redundant relations (ARRs).

Vatan, Farrokh↗

Synthesizing a New Launch Vehicle Failure Probability Based on Historical Flight Data

New launch vehicles have historically had significantly higher failure rates in early flights than what has been predicted using Probabilistic Risk Assessment - PRA. This is because PRAs typically model a mature vehicle where a significant portion of the early failure probability contributors have been eliminated due to testing and improvements after actual field operation. To capture a more accurate early flight failure probability estimate, this paper develops a method that estimates ascent failure probability starting with the first flight based on historical launch vehicle records. With new launch vehicles being developed, such as the Space Launch System - SLS, a PRA model must be extended to cover early flight failure probability contributions that are either not covered in the mature-vehicle PRA or are underestimated. These failure probability contributions include design errors, quality control deficiencies, installation errors, and environmental impacts. There are also failure dependencies due to systemic errors that still exist due to limited entire-system testing.

Cross, Robert B.↗

Estimating Orion Heat Shield Failure Due To Ablator Cracking During The EFT-1 Mission

The Orion EFT-1 heatshield suffered from two major certification challenges: First, the mechanical properties used in design were not evident in the flight hardware and second, the flight article itself cracked during fabrication. The combination of these events motivated the Orion Program to pursue an engineering-level Probabilistic Risk Assessment (PRA) as part of heatshield certification rationale. The PRA provided loss of Mission (LOM) likelihoods considering the probability of a crack occurring during the mission and the likelihood of subsequent structure over-temperature. The methods and input data for the PRA are presented along with a discussion of the test data used to anchor the results. The Orion program accepted an EFT-1 Loss of Vehicle (LOV) risk of 1-in-160,000 due to in-mission Avcoat cracking based on the results of this analysis. Conservatisms in the result, along with future considerations for Exploration Missions (EM) are also addressed.

Avcoat↗

Applying AI/ML Techniques to U.S. Nuclear Operating Experience Program

Idaho National Laboratory (INL) has provided technical assistance to the U.S. Nuclear Regulatory Commission (NRC) in reliability and risk analysis including the operating experience (OpE) program since the 1980s. The U.S. nuclear OpE program provides input parameters to the NRC Standardized Plant Analysis Risk models and the industry probabilistic risk assessment (PRA) models. While earlier PRA focuses were on at-power, internal event analysis, the risks from external hazards and during low power shutdown (LPSD) operation could be significant and the needs to develop LPSD PRA and external hazards PRA are on the rise. One issue in developing LPSD PRA is the reasonable estimation of shutdown initiative event (SDIE) frequencies. INL has developed and is maintaining an SDIE database for the NRC. However, this database is based on the reviewing of Licensee Event Reports (LERs), which is believed to be only a subset of “actual” shutdown initiating events occurred in the industry. This paper investigates a new approach to identify and characterize shutdown initiating events from the Institute of Nuclear Power Operations (INPO) industry database using machine learning techniques. The main process in this approach is to find out the relationship between key words in event descriptions and the SDIE categories as in the NRC SDIE database. The relationship can then be applied to the INPO database and search for SDIEs.

99 GENERAL AND MISCELLANEOUS↗

Compositional Solution Space Quantification for Probabilistic Software Analysis

Probabilistic software analysis aims at quantifying how likely a target event is to occur during program execution. Current approaches rely on symbolic execution to identify the conditions to reach the target event and try to quantify the fraction of the input domain satisfying these conditions. Precise quantification is usually limited to linear constraints, while only approximate solutions can be provided in general through statistical approaches. However, statistical approaches may fail to converge to an acceptable accuracy within a reasonable time. We present a compositional statistical approach for the efficient quantification of solution spaces for arbitrarily complex constraints over bounded floating-point domains. The approach leverages interval constraint propagation to improve the accuracy of the estimation by focusing the sampling on the regions of the input domain containing the sought solutions. Preliminary experiments show significant improvement on previous approaches both in results accuracy and analysis time.

Monte Carlo Methods↗

A Probabilistic Method of Assessing Carbon Accumulation Rate at Imnavait Creek Peatland, Arctic Long Term Ecological Research Station, Alaska

Arctic peatlands are an important part of the global carbon cycle, accumulating atmospheric carbon as organic matter since the Late glacial. Current methods for understanding the changing efficiency of the peatland carbon sink rely on peatlands with an undisturbed stratigraphy. Here we present a method of estimating primary carbon accumulation rate from a site where permafrost processes have either vertically or horizontally translocated nearby carbon-rich sediment out of stratigraphic order. Briefly, our new algorithm estimates the probability of the age of deposition of a random increment of sediment in the core. The method assumes that if sediment age is measured at even depth increments, dates are more likely to occur during intervals of higher accumulation rate and vice versa. Multiplying estimated sedimentation rate by measured carbon density yields carbon accumulation rate. We perform this analysis at the Imnavait Creek Peatland, near the Arctic Long Term Ecological Research network site at Toolik Lake, Alaska. Using classical radiocarbon age modeling, we find unreasonably high rates of carbon accumulation at various Holocene intervals. With our new method, we find accumulation rate changes that are in improved agreement within the context of other sites throughout Alaska and the rest of the Circum-Arctic region.

carbon accumulation;Imnavait;peatlands;permafrost;↗

SAXS Assistant: Automated SAXS analysis for structural discovery in biologics and polymeric nanoparticles

Small-angle x-ray scattering (SAXS) is a powerful technique for assessing macromolecular structure. High-throughput SAXS is limited by the time-consuming and, at times, subjective nature of SAXS data interpretation. Here, we present SAXS Assistant, a Python-based script that streamlines SAXS data analysis to extract features for machine learning (ML) and key structural parameters, including the Guinier radius of gyration (R g ), pair distance distribution function (PDDF)-derived R g , maximum particle dimension (D max ), and Kratky plots. The script builds upon BioXTAS RAW and validates reliability via Guinier/PDDF R g agreement, an important indicator of well-measured data sets. For assistance in D max estimation, a multilayer perceptron regressor was trained with 1940 data files from the Small Angle Scattering Biological Data Bank. The model achieved a test set performance R 2 = 0.90 and mean absolute error = 11.7 Å. Training exclusively with experimental data translates analyses from researchers, including experts in the field, to the ML model, which helps assess D max estimations from PDDF. Gaussian mixture model clustering was implemented to classify profiles into structural classes based on entries in the Small Angle Scattering Biological Data Bank. Users may therefore assess the similarity between experimental samples and known biomolecular shapes within the mapped repository entries. This probabilistic clustering aids in quantifying information from Kratky and generating shape-descriptive features. SAXS Assistant accelerates SAXS data analysis through enforced quality control, ML-ready outputs, and flags for low-confidence results. In addition to providing the ability to analyze large data sets at high throughput, this tool is versatile and may serve researchers in both biological and synthetic polymer research fields.

36 MATERIALS SCIENCE↗

The COMBS Survey - II. Distinguishing the metal-poor bulge from the halo interlopers

The metal-poor stars in the bulge are important relics of the Milky Way’s formation history, as simulations predict that they are some of the oldest stars in the Galaxy. In order to determine if they are truly ancient stars, we must understand their origins. Currently, it is unclear if the metal-poor stars in the bulge ([Fe/H] < -1 dex) are merely halo interlopers, a unique accreted population, part of the boxy/peanut-shaped bulge, or a classical bulge population. In this work, we use spectra from the VLT/FLAMES spectrograph to obtain metallicity estimates using the Ca-II triplet of 473 bulge stars (187 of which have [Fe/H] < -1 dex), targeted using SkyMapper photometry. We also use Gaia DR2 data to infer the Galactic positions and velocities along with orbital properties for 523 stars. We employ a probabilistic orbit analysis and find that about half of our sample has a >50 percent probability of being bound to the bulge, and half are halo interlopers. We also see that the occurrence rate of halo interlopers increases steadily with decreasing metallicity across the full range of our sample (-3 < [Fe/H] < 0.5). Our examination of the kinematics of the confined compared to the unbound stars indicates the metal-poor bulge comprises at least two populations; those confined to the boxy/peanut bulge and halo stars passing through the inner galaxy. We conclude that an orbital analysis approach, as we have employed, is important to understand the composite nature of the metal-poor stars in the inner region.

79 ASTRONOMY AND ASTROPHYSICS↗

Risk-Informed MultiPphysics BestEestimate Plus Uncertainties (BEPU) Application Development of RELAP5-3D Perturbation Model

The United States nuclear industry is facing a strong challenge to ensure maximum safety while enhancing economic benefit. Safety is a key parameter to all aspects related to light water reactor (LWR) nuclear power plants (NPPs), especially cost savings. Since the goal is to extend the lifetimes of these NPPs, the traditional deterministic safety concept may not guarantee a current economic asset. The Light Water Reactor Sustainability (LWRS) Program has been promoting a wide range of research and development (R&D) in this field to maximize the safety, economics, and performance of these NPPs through improved scientific understanding. One of the best practices to achieve this goal is to identify and optimize safety margins, which can lead to cost reduction. To do this, under the LWRS framework, the Risk-Informed Systems Analysis (RISA) Pathway will focus on the optimization of safety margin and minimization of uncertainties to ensure both safety and economics at the highest level. The RISA Pathway will provide enhanced capabilities for analyzing and characterizing LWR systems performance by developing and demonstrating methods, tools, and data to enable risk-informed margins management (RIMM). The goals of the RISA Pathway are twofold: (1) deploy the risk-informed tools and methods that enable better representation of safety margins and factors that contribute to cost and safety; and (2) conduct advanced risk assessment applications with industry to support margin management strategies that enable more cost-effective plant operation. The tools and methods provided by the RISA Pathway will support effective margin management for both active and passive safety systems, structures, and components (SSC) of an NPP. The tools and methods used in the RISA Pathway should have high confidence and highest technical maturity for and implementation to industry at its current setting. They should also have a capability to support risk-informed decision making for both probabilistic and deterministic elements of safety. The RISA Pathway will, therefore, perform a comprehensive assessment of verification and validation (V&V) status of RISA Toolkit to enhance credibility RISA Toolkit which be used by industry. This report summarizes RELAP5-3D development activities for best estimated and uncertainty (BEPU) capability to support ongoing RISA Pathway pilot projects for risk informed uncertainty quantification applications. Work scope includes (1) development of initial perturbation model for selected closure laws and (2) testing of suitable probability distribution functions (PDF) for the selected correlations. Developed BEPU modules are tested with selected separate effect cases and compared with conventional thermal-hydraulics model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A PROPOSED METHOD FOR ESTIMATING FAILURE RATES OF DEGRADED PASSIVE COMPONENTS IN THE NRC SIGNIFICANCE DETERMINATION PROCESS

This paper outlines a methodology for estimation of the incremental core damage frequency associated with the degradation of passive components with a view to its application in the US Nuclear Regulatory Commission's significance determination process. The method involves use of simplified physics-based models of materials degradation and the probabilistic comparison of transient loads with deteriorating system capacities.

passives↗

Continued Discussion of Failure Mode Modeling and Overall Component Reliability: Is the Data Missing or Censored?

This paper is a continuation of a paper presented at the 13th Probabilistic Safety Assessment and Management Conference, in which a discussion of modeling failure modes of complex components was presented; see Paulos and Smith (2016). The paper demonstrated how the typical method of treating failure modes as being exponential in nature may yield optimistic predictions when estimating how improvements to components will perform in the real world. Instead of relying on textbook methods, it is more accurate to model the failure modes as a race in time; unfortunately, this does not give a closed-form solution. This work uses a simulation to solve for the model of the world, and is compared to the standard methodology of treating the failure modes as exponential random failures. The standard method is shown to have optimistic predictions, which will lead to prediction errors when failure modes were removed or “fixed.” The failure mode methodology presented in the first paper treated the data as being censored when the test stopped. In this paper, we will compare the results from treating the data as both censored and missing, and comparisons will be shown showing which method is more accurate and under what conditions.

97 MATHEMATICS AND COMPUTING↗

Application of Fault Management Theory to the Quantitative Selection of a Launch Vehicle Abort Trigger Suite

The theory of System Health Management (SHM) and of its operational subset Fault Management (FM) states that FM is implemented as a "meta" control loop, known as an FM Control Loop (FMCL). The FMCL detects that all or part of a system is now failed, or in the future will fail (that is, cannot be controlled within acceptable limits to achieve its objectives), and takes a control action (a response) to return the system to a controllable state. In terms of control theory, the effectiveness of each FMCL is estimated based on its ability to correctly estimate the system state, and on the speed of its response to the current or impending failure effects. This paper describes how this theory has been successfully applied on the National Aeronautics and Space Administration's (NASA) Space Launch System (SLS) Program to quantitatively estimate the effectiveness of proposed abort triggers so as to select the most effective suite to protect the astronauts from catastrophic failure of the SLS. The premise behind this process is to be able to quantitatively provide the value versus risk trade‐off for any given abort trigger, allowing decision makers to make more informed decisions. All current and planned crewed launch vehicles have some form of vehicle health management system integrated with an emergency launch abort system to ensure crew safety. While the design can vary, the underlying principle is the same: detect imminent catastrophic vehicle failure, initiate launch abort, and extract the crew to safety. Abort triggers are the detection mechanisms that identify that a catastrophic launch vehicle failure is occurring or is imminent and cause the initiation of a notification to the crew vehicle that the escape system must be activated. While ensuring that the abort triggers provide this function, designers must also ensure that the abort triggers do not signal that a catastrophic failure is imminent when in fact the launch vehicle can successfully achieve orbit. That is, the abort triggers must have low false negative rates to be sure that real crew‐threatening failures are detected, and also low false positive rates to ensure that the crew does not abort from non‐crew‐threatening launch vehicle behaviors. The analysis process described in this paper is a compilation of over six years of lessons learned and refinements from experiences developing abort triggers for NASA's Constellation Program (Ares I Project) and the SLS Program, as well as the simultaneous development of SHM/FM theory. The paper will describe the abort analysis concepts and process, developed in conjunction with SLS Safety and Mission Assurance (S&MA) to define a common set of mission phase, failure scenario, and Loss of Mission Environment (LOME) combinations upon which the SLS Loss of Mission (LOM) Probabilistic Risk Assessment (PRA) models are built. This abort analysis also requires strong coordination with the Multi‐Purpose Crew Vehicle (MPCV) and SLS Structures and Environments (STE) to formulate a series of abortability tables that encapsulate explosion dynamics over the ascent mission phase. The design and assessment of abort conditions and triggers to estimate their Loss of Crew (LOC) Benefits also requires in‐depth integration with other groups, including Avionics, Guidance, Navigation and Control(GN&C), the Crew Office, Mission Operations, and Ground Systems. The outputs of this analysis are a critical input to SLS S&MA's LOC PRA models. The process described here may well be the first full quantitative application of SHM/FM theory to the selection of a sensor suite for any aerospace system.

Lo, Yunnhon↗

Machine Learning Emulation of Spatial Deposition from a Multi-Physics Ensemble of Weather and Atmospheric Transport Models

In the event of an accidental or intentional hazardous material release in the atmosphere, researchers often run physics-based atmospheric transport and dispersion models to predict the extent and variation of the contaminant spread. These predictions are imperfect due to propagated uncertainty from atmospheric model physics (or parameterizations) and weather data initial conditions. Ensembles of simulations can be used to estimate uncertainty, but running large ensembles is often very time consuming and resource intensive, even using large supercomputers. In this paper, we present a machine-learning-based method which can be used to quickly emulate spatial deposition patterns from a multi-physics ensemble of dispersion simulations. We use a hybrid linear and logistic regression method that can predict deposition in more than 100,000 grid cells with as few as fifty training examples. Logistic regression provides probabilistic predictions of the presence or absence of hazardous materials, while linear regression predicts the quantity of hazardous materials. The coefficients of the linear regressions also open avenues of exploration regarding interpretability—the presented model can be used to find which physics schemes are most important over different spatial areas. A single regression prediction is on the order of 10,000 times faster than running a weather and dispersion simulation. However, considering the number of weather and dispersion simulations needed to train the regressions, the speed-up achieved when considering the whole ensemble is about 24 times. Ultimately, this work will allow atmospheric researchers to produce potential contamination scenarios with uncertainty estimates faster than previously possible, aiding public servants and first responders.

97 MATHEMATICS AND COMPUTING↗

Deep Direct-Use Geothermal Feasibility Study for Hawthorne NV

The Hawthorne Nevada, deep direct-use geothermal study is a two-year effort funded by the U.S. Department of Energy to determine the techno-economic feasibility of implementing a large-scale, direct-use facility for the Hawthorne Army Depot (HAD) and the public facilities of the city of Hawthorne and Mineral County. The approach links a production side analysis (PSA) and a demand side analysis (DSA) into a whole-system analysis (WSA) to provide an integrated assessment of the resource and the probability of delivering economically viable direct-use energy to Hawthorne. Hawthorne, Nevada is in the western part of the Basin and Range province and has been the focus of geothermal investigations for over 40 years. Over the last 15 years, several studies completed by the U.S. Navy Geothermal Program Office (GPO) in conjunction with industry professionals quantified the existence of several low temperature geothermal prospects, the most promising of which is called Prospect A. The promise of Prospect A is based on drilling and flow testing that produced ~100 °C water at flow rates of up to 31 l/s (500 gallons per minute). Measured productivity indexes range from 40-85 l/s/MPa, suggesting a warm and productive heat source. Despite the promise of the resource, uncertainties in its spatial extent and long-term sustainability mean that techno-economic analyses must include probabilities of the sustainability of the resource under different operating scenarios. Here, the PSA is conducted by integrating a wide range of disparate data to estimate lognormal P90, P50, and P10 resource capacities. These capacities are used as input to a thermal-hydrologic (T-H) model to estimate thermal drawdown for each capacity estimate for several different DSA scenarios. Using a systems-based approach, the WSA links the dynamic T-H simulations of the PSA/DSA combinations with the techno-economic model GEOPHIRES to account for both the temporal dynamics and uncertainties in the system to produce probabilistic distributions of several performance metrics including the levelized cost of heat (LCOH) and the return on investment (ROI). This report is the final delivery for the project and documents the study's activities and results.

15 GEOTHERMAL ENERGY↗

Selected reliability studies for the NERVA program

An investigation was made into certain methods of reliability analysis that are particularly suitable for complex mechanisms or systems in which there are many interactions. The methods developed were intended to assist in the design of such mechanisms, especially for analysis of failure sensitivity to parameter variations and for estimating reliability where extensive and meaningful life testing is not feasible. The system is modeled by a network of interconnected nodes. Each node is a state or mode of operation, or is an input or output node, and the branches are interactions. The network, with its probabilistic and time-dependent paths is also analyzed for reliability and failure modes by a Monte Carlo, computerized simulation of system performance.

Hoover, S. V.↗