Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Environmental Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Atmospheric Structure Prediction for Infrasound Propagation Modeling Using Deep Learning

Abstract Infrasound is generated by a variety of natural and anthropogenic sources. Infrasonic waves travel through the dynamic atmosphere, which can change on the order of minutes to hours. Infrasound propagation largely depends on the wind and temperature structure of the atmosphere. Numerical weather prediction models are available to provide atmospheric specifications, but uncertainties in these models exist and they are computationally expensive to run. Machine learning has proven useful in predicting tropospheric weather using Long Short‐Term Memory (LSTM) networks. An LSTM network is utilized to make atmospheric specification predictions up to ∼30 km for three different training and testing scenarios: (a) the model is trained and tested using only radiosonde data from the Albuquerque, NM, USA station, (b) the model is trained on radiosonde stations across the contiguous US, excluding the Albuquerque, NM, USA station, which was reserved for testing, and (c) the model is trained and tested on radiosonde stations across the contiguous US. Long Short‐Term Memory predictions are compared to a state‐of‐the‐art reanalysis model and show cases where the LSTM outperforms, performs equally as well, or underperforms in comparison to the state‐of‐the‐art. Regional and temporal trends in model performance across the US are also discussed. Results suggest that the LSTM model is a viable tool for predicting atmospheric specifications for infrasound propagation modeling.

54 ENVIRONMENTAL SCIENCES↗

Frozen Hydrometeor Terminal Fall Velocity Dependence on Particle Habit and Riming as Observed by Vertically Pointing Radars

Vertically pointing Ka-band radar measurements are used to derive fall velocity–reflectivity factor ($V$ t = $aZ$$^{b}_{e}$) relations for frozen hydrometeor populations of different habits during snowfall events observed at Oliktok Point, Alaska, and at the Multidisciplinary Drifting Observatory for the Study of Arctic Climate (MOSAiC). Case study events range from snowfall with highly rimed particles observed during periods with large amounts of supercooled liquid water path (LWP > 320 g m –2 ) to unrimed snowflakes including instances when pristine planar crystals were the dominant frozen hydrometeor habit. The prefactor a and the exponent b in the observed $V$ t –$Z$ e relations scaled to the sea level vary in the approximate ranges 0.5–1.4 and 0.03–0.13, respectively (reflectivities are in mm 6 m –3 and velocities are in m s –1 ). The coefficient a values are the smallest for planar crystals (a ~ 0.5) and the largest (a > 1.2) for particles under severe riming conditions with high LWP. There is no clear distinction between b values for high and low LWP conditions. The range of the observed $V$ t –$Z$ e relation coefficients is in general agreement with results of modeling using fall velocity–size (υ t = αD β ) relations for individual particles found in literature for hydrometeors of different habits, though there is significant variability in α and β coefficients from different studies even for a same particle habit. Correspondences among coefficients in the $V$ t –$Z$ e relations for particle populations and in the individual particle υ t –$D$ relations are analyzed. Furthermore, these correspondences and the observed $V$ t –$Z$ e relations can be used for evaluating different frozen hydrometeor fall velocity parameterizations in models.

54 ENVIRONMENTAL SCIENCES↗

How Snow Aggregate Ellipsoid Shape and Orientation Variability Affects Fall Speed and Self-Aggregation Rates

Snow aggregate shapes and orientations have long been known to exhibit substantial variability. Despite this observed variability, most weather and climate prediction models use fixed power-law functions that deterministically map particle size to mass and fall speed. As such, integrated quantities like precipitation and self-aggregation rates currently ignore nonlinear effects resulting from variation in shape and orientation for aggregates of the same size. This study therefore develops an analytic framework that couples an empirically based bivariate distribution of ellipsoid shapes to classical hydrodynamic theory so as to capture an appropriate dispersion of masses, projected areas, and fall speeds for an assumed size distribution. For a fixed aggregate size, shape variations produce approximately ±0.13 m s -1 standard deviation of fall speed which increases the mass flux fall speed dispersion by more than 100% over traditional microphysics models. This increased fall speed dispersion results predominantly from shape-induced mass dispersion whereas orientation and drag dispersion play a lesser role. Shape variations can increase mass- and reflectivity-weighted fall speeds by up to 60% of traditional models whereas self-aggregation rates can increase by a factor of 100 for very small slope parameters. This implies that aggregate shape variations effectively forestall the theorized onset of fall speed distribution narrowing and subsequent quenching of the aggregation process. As a result, it is likely that secondary ice formation is necessary to prevent an ever decreasing slope parameter. The mathematical theory presented in this study is used to develop simple correction factors for snow forecast and climate models.

54 ENVIRONMENTAL SCIENCES↗

Boundary Layer Controls on the Shallow-to-Deep Cumulus Transition (Final Technical Report)

This project advanced our understanding of the processes governing cumulus cloud formation and provides an improved observational basis for validating earth system models. To be specific, the project used laser- and radar-remote sensors to examine the physical properties of updrafts that rise from earth’s surface and initiate clouds deeper in the atmosphere. These updrafts comprise “thermals” and “plumes” and occur at small spatial and temporal scales (e.g., 10s of minutes, 100s of meters). These small scales preclude explicit representation in most earth system and climate models, and thus necessitate “sub-grid-scale” parameterization of updraft processes. The innovation of this project was to directly measure the size, shape, strength and water vapor content of these updrafts with Doppler and Raman lidars, respectively, and to link these updraft properties to cloud processes using vertically pointed weather radars. The resulting data sets comprise 100s of thousands of updrafts and thousands of clouds, which far exceeds previous efforts, and thereby provides a robust statistical and physical representation of these processes. From these large datasets the project produced a sequence of scientific analyses that: (1) Elucidate how variations in the turbulent structure of the convective boundary layer control shallow cumulus convection, (2) Quantify the upward transport of water vapor to cloud base via thermals and plumes, (3) Validate large-eddy simulations of updrafts and shallow convective clouds, (4) Demonstrate a size-to-strength relationship between updraft width and updraft speed, and (5) Demonstrate how updrafts interact with the stability at the top of the convective boundary layer to modulate the depth and vigor of convective clouds. These results have been disseminated via several published journal articles, academic theses, and conference presentations. Collectively these results contribute to the Atmospheric System Research (ASR) program’s goal to “improve understanding of the key cloud, aerosol, precipitation, and radiation processes that affect the Earth’s radiative balance and hydrological cycle, particularly processes that limit the predictive ability of regional and global earth system models”.

54 ENVIRONMENTAL SCIENCES↗

Small field campaign: aerosol – ice formation closure pilot study. Final Report

Prediction of atmospheric ice formation from aerosol particles by heterogeneous nucleation represents one of the grand challenges in atmospheric science. Our insufficient predictive understanding of primary ice formation is the reason that climate models typically do not include heterogeneous ice nucleation with subsequent effects on climate uncertainty. Mixed-phase clouds, where supercooled water droplets and ice crystals coexist play globally an important role regulating climate. This is especially the case for the Arctic region that experiences the greatest warming due to climate change compared to other regions in the world. Immersion freezing initiated by ice-nucleating particles (INPs) in supercooled water droplets is recognized as the dominant primary ice formation pathway in mixed-phase cloud regimes. For this reason, it is crucial to evaluate our capability to predict immersion freezing for a given ambient aerosol population. The goal of this project is conducting a field-based pilot study at the U.S. DOE Atmospheric Radiation Measurement (ARM) user facility at Southern Great Plains (SGP) to evaluate our capability to predict the number concentration of aerosol particles that serve as INPs in the immersion freezing mode. Successful prediction of INP number concentrations is also termed “closure”. This field-observational approach represents a first-of-its kind attempt of an aerosol–ice formation closure study (AEROICESTUDY). Very few closure studies related to INPs have been conducted, and to our knowledge, none using robust size-resolved ambient aerosol composition measurements as a starting point. Achievement of aerosol–ice formation closure relies on our ability to characterize the ambient aerosol population with respect to particles size and composition and to determine INP number concentrations for specified freezing temperatures. This requires numerous online and offline instrumentation resulting in this pilot field campaign being a multi-institutional and community-collaborative effort. We chose the ARM SGP megasite for this first aerosol-ice formation closure pilot study due to its significant measurement capabilities available to obtain detailed physical characterization of the local aerosol population including size distribution, mass loading, and chemical composition of non-refractory aerosol particles. The overall objective of this project is to identify ice nucleation parameterizations that produce the most robust predictions of INP numbers and thus are best suited to be included in cloud and climate models. This objective includes the following goals for this field and laboratory-based project: i) What are the crucial aerosol physicochemical property measurements needed to accurately guide ice nucleation representations in models and long-term INP measurements? ii) What level of parameter details needs to be known to achieve aerosol–ice formation closure? iii) What are the leading causes for climate model bias in INP predictions? We found that the advances in our understanding of immersion freezing garnered over the last 20 years allowed us to yield partial and full closures of atmospheric immersion freezing from ambient aerosol particles. When the aerosol population is physicochemically complex and parameterizations for representative INP types are not yet available, we still struggle to accurately predict INP number concentrations. This project clearly demonstrates that with more laboratory and field measurements that are accompanied by particle composition analysis, the necessary datasets to achieve aerosol–ice formation closure for various locations will emerge, thus providing a robust foundation for guiding the representation of INPs in cloud and climate models.

54 ENVIRONMENTAL SCIENCES↗

Effects of Intrusive Confining Units on Groundwater Flow at Pahute Mesa, Nevada National Security Site

Geological, geophysical, hydrogeological, and hydrological evidence indicates that feeder dikes to rhyolitic lava flows may play a role as confining units in the groundwater flow system underlying the Pahute Mesa (PM) area of underground nuclear testing at the Nevada National Security Site (NNSS) (Figure 1). Of geological significance, the PM testing area is largely situated within the Silent Canyon caldera complex (SCCC), which includes both tuffs and lavas that were fed by (and are connected to) intrusive rock units such as feeder dikes prior to and during volcanic eruptions (Orkild et al., 1968; Byers et al., 1976a). Groundwater modeling results presented in this report support extension of “pool-dam” and “breach scenario” concepts presented in Jackson and Fenelon (2018) and Jackson et al. (2021) to low-permeability intrusive confining units (ICUs) such as feeder dikes that are expected to dissect and ring silicic calderas. As laterally extensive, steeply-dipping, and sub-parallel planar structures, ICUs may further compartmentalize groundwater flow in some areas of the volcanic aquifer system at PM. ICUs may explain unusually high horizontal hydraulic gradient southwest of Cheshire. Breaching of an ICU within which the Cheshire test was emplaced may explain changes in water levels before and after the Cheshire test was detonated in the U-20n emplacement hole on 2/14/76 (USDOE, 2015b). This analysis of the effects of ICUs on groundwater flow at PM addresses a need to evaluate uncertainty in the conceptual model or structural aspects of hydrologic source term (HST) or corrective action unit (CAU) models for groundwater flow and contaminant transport (FFACO, 1996, as amended). At Cheshire and possibly other test locations at PM, downgradient extent of radionuclide contamination may be overpredicted by not including the confining effects of ICUs. On the other hand, contaminant extent may be underpredicted by not considering transient flow effects and/or the re-equilibrated flow field caused by breaching of an ICU by an underground nuclear test. Near Cheshire, the effects of ICUs may be most apparent and impactful to the groundwater flow system at PM because of an unusual combination of thickness, extent, and frequency of dikes transecting the saturated CHLFA4 aquifer and feeding into the overlying unsaturated rhyolite lava of Windy Wash. Chapters 2, 3, and 4 present geological, geophysical, hydrogeological, and hydrological evidence for ICUs at PM. Chapters 5 and 6 examine effects of ICUs on groundwater flow including analysis by groundwater modeling.

54 ENVIRONMENTAL SCIENCES↗

Coastal Wetland Carbon Processes in a Warmer Climate (Final Report)

Coastal wetlands are global hotspots of carbon storage. Marshes, mangroves, and seagrass meadows account for about half of the total marine soil carbon budget and bury carbon at rates roughly equivalent to terrestrial forests despite occupying just 2.5% of Earth’s land area. Coastal wetlands have recently been recognized as important for storing carbon, but the future sink strength and carbon stock stability of these systems is uncertain because global change drivers such as temperature and elevated CO 2 disturb the complex ecology that drives high rates of soil carbon sequestration. The dynamics of coastal wetland carbon pools are not presently represented in earth system models. Our goals are to understand the influence of warming and elevated CO 2 on C cycling and to forecast the stability of tidal wetland soil carbon pools at the terrestrial-aquatic interface. We designed and implemented a novel field manipulation of elevated CO 2 and temperature and operated it from 2016 to 2020. We learned that plant communities and microbial communities respond differently to rising temperature, and that the net effects of these responses means that a modest amount of warming will increase tidal marsh carbon sequestration, while warming above that level will diminish the potential for additional carbon sequestration. In mathematical terms the system showed non-linear responses which are important for building forecast models.

54 ENVIRONMENTAL SCIENCES↗

The Early Career Research Program Annual Progress Report: Using ARM Data and Multiscale Models to Advance the Understanding of Liquid-Phase Cloud Response to Aerosol Perturbation over Ocean and Land

This project aims to study the response of liquid-phase clouds to aerosol perturbation and reduce the related uncertainty in the DOE Earth system model. Specific objectives include: Objective 1: Quantify the aerosol indirect effect on liquid-phase clouds using ARM observations and satellite retrievals while constraining the confounding large-scale conditions; Objective 2: Harness LES case studies, untangle the confounding meteorological impacts on the observed aerosol indirect effect, and identify key cloud processes controlling the net radiative forcing of aerosol-cloud interactions at different spatiotemporal scales; Objective 3: Evaluate the aerosol indirect effect on liquid-phase clouds with process-level understanding in E3SM multiscale model configurations.

54 ENVIRONMENTAL SCIENCES↗

Simulated wildfire burned area over the CONUS during 2001-2020

Wildfires have shown increasing trends in both frequency and severity across the Contiguous United States (CONUS). However, process-based fire models have difficulties in accurately simulating the burned area over the CONUS due to a simplification of the physical process and cannot capture the interplay among fire, ignition, climate, and human activities. The deficiency of burned area simulation deteriorates the description of fire impact on energy balance, water budget, and carbon fluxes in the Earth System Models (ESMs). Alternatively, machine learning (ML) based fire models, which capture statistical relationships between the burned area and environmental factors, have shown promising burned area predictions and corresponding fire impact simulation. We develop a hybrid framework (ML4Fire-XGB) that integrates a pretrained eXtreme Gradient Boosting (XGBoost) wildfire model with the Energy Exascale Earth System Model (E3SM) land model (ELM). A Fortran-C-Python deep learning bridge is adapted to support online communication between ELM and the ML fire model. Specifically, the burned area predicted by the ML-based wildfire model is directly passed to ELM to adjust the carbon pool and vegetation dynamics after disturbance, which are then used as predictors in the ML-based fire model in the next time step. Evaluated against the historical burned area from Global Fire Emissions Database 5 from 2001-2020, the ML4Fire-XGB model outperforms process-based fire models in terms of spatial distribution and seasonal variations. Sensitivity analysis confirms that the ML4Fire-XGB well captures the responses of the burned area to rising temperatures. The ML4Fire-XGB model has proved to be a new tool for studying vegetation-fire interactions, and more importantly, enables seamless exploration of climate-fire feedback, working as an active component in E3SM.

Liu, Ye↗

Develop a Model Component

During my internship at NASA, I was a model developer for Ground Support Equipment (GSE). The purpose of a model developer is to develop and unit test model component libraries (fluid, electrical, gas, etc.). The models are designed to simulate software for GSE (Ground Special Power, Crew Access Arm, Cryo, Fire and Leak Detection System, Environmental Control System (ECS), etc. ~.) before they are implemented into hardware. These models support verifying local control and remote software for End-Item Software Under Test (SUT). The model simulates the physical behavior (function, state, limits and 110) of each end-item and it's dependencies as defined in the Subsystem Interface Table, Software Requirements & Design Specification (SRDS), Ground Integrated Schematic (GIS), and System Mechanical Schematic.(SMS). The software of each specific model component is simulated through MATLAB's Simulink program. The intensiv~ model development life cycle is a.s follows: Identify source documents; identify model scope; update schedule; preliminary design review; develop model requirements; update model.. scope; update schedule; detailed design review; create/modify library component; implement library components reference; implement subsystem components; develop a test script; run the test script; develop users guide; send model out for peer review; the model is sent out for verific~tionlvalidation; if there is empirical data, a validation data package is generated; if there is not empirical data, a verification package is generated; the test results are then reviewed; and finally, the user. requests accreditation, and a statement of accreditation is prepared. Once each component model is reviewed and approved, they are intertwined together into one integrated model. This integrated model is then tested itself, through a test script and autotest, so that it can be concluded that all models work conjointly, for a single purpose. The component I was assigned, specifically, was a fluid component, a discrete pressure switch. The switch takes a fluid pressure input, and if the pressure is greater than a designated cutoff pressure, the switch would stop fluid flow.

Ensey, Tyler S.↗

Data, Modeling, & Analysis

The project goal includes developing model pathways to improve sustainability of feedstock supply chains to reduce access costs and the environmental footprint. The project aims to harness synergies of production and collection practices and current systems to improve economic and environmental outcomes.

09 BIOMASS FUELS↗

The development of a model for predicting passenger acceptance of short-haul air transportation systems

Meaningful criteria and methodology for assessing, particularly in the area of ride quality, the potential acceptability to the traveling public of present and future transportation systems were investigated. Ride quality was found to be one of the important variables affecting the decision of users of air transportation, and to be influenced by several environmental factors, especially motion, noise, pressure, temperature, and seating. Models were developed to quantify the relationship of subjective comfort to all of these parameters and then were exercised for a variety of situations. Passenger satisfaction was found to be strongly related to ride quality and was so modeled. A computer program was developed to assess the comfort and satisfaction levels of passengers on aircraft subjected to arbitrary flight profiles over arbitrary terrain. A model was deduced of the manner in which passengers integrate isolated segments of a flight to obtain an overall trip comfort rating. A method was established for assessing the influence of other links (e.g., access, terminal conditions) in the overall passenger trip.

Kuhlthau, A. R.↗

Orthomosaic Images and Digital Elevation Models for the 2019 SALVO Campaign

The springtime, surface-albedo transition in the Alaskan Arctic and the forcings that determine the duration and nature of that transition are the focus of our Snow ALbedo eVOlution (SALVO I & II) campaign. The SALVO team are assessing the “whys” and “how longs” of the stages of the spring melt during which albedo values drop from 0.8 to 0.1, the largest and most significant change of the year. The near-shore location of the ARM NSA observatory makes this an ideal place to investigate these melt stages.

54 ENVIRONMENTAL SCIENCES↗

Subseasonal Tropical Convection Characteristics in the Energy Exascale Earth System Model Version 2

Accurate simulation of subseasonal tropical moist convection remains a key challenge for Earth system models. The difficulties stem from the reliance of cumulus cloud processes on model parameterizations and the need to represent the multiscale nature of interactions among clouds, radiation, moisture, circulation, and surface energy fluxes. Equatorial convection drives circulation anomalies that can affect weather patterns and extremes globally, motivating efforts to better understand and simulate these tropical disturbances. Here, a detailed review of subseasonal tropical convective behavior as simulated in the Energy Exascale Earth System Model version 2 (E3SMv2) is presented, with comparison to its predecessor version 1 (E3SMv1) and reference data sets. Model structural changes to the deep convective trigger function and surface fluxes, along with parametric tuning of the cloud and microphysics schemes, together result in an improved depiction of organized tropical convection across scales. In particular, E3SMv2 exhibits a more realistic Madden‐Julian oscillation (MJO) and low‐frequency Kelvin waves—owing to a sharper time mean equatorial meridional moisture gradient and improved convection‐circulation coupling —as well as a better depiction of MJO Northern Hemisphere teleconnections. Despite these improvements, subseasonal precipitation variance continues to be strongly underestimated in E3SMv2. Use of a cloud plume model also reveals that the coupling between daily averaged tropical precipitation and lower tropospheric instability in E3SM is inconsistent with observations, a bias that could potentially impact the simulation of intraseasonal disturbances.

54 ENVIRONMENTAL SCIENCES↗

Development of the ECLSS Sizing Analysis Tool and ARS Mass Balance Model Using Microsoft Excel

The development of a Microsoft Excel-compatible Environmental Control and Life Support System (ECLSS) sizing analysis "tool" for conceptual design of Mars human exploration missions makes it possible for a user to choose a certain technology in the corresponding subsystem. This tool estimates the mass, volume, and power requirements of every technology in a subsystem and the system as a whole. Furthermore, to verify that a design sized by the ECLSS Sizing Tool meets the mission requirements and integrates properly, mass balance models that solve for component throughputs of such ECLSS systems as the Water Recovery System (WRS) and Air Revitalization System (ARS) must be developed. The ARS Mass Balance Model will be discussed in this paper.

McGlothlin, E. P.↗

Hot gas ingestion characteristics and flow visualization of a vectored thrust STOVL concept

A 9.2 percent scale short takeoff and vertical landing (STOVL) hot gas ingestion model was designed and built by McDonnell Douglas Corporation (MCAIR) and tested in the NASA Lewis Research Center 9- by 15-Foot Low Speed Wind Tunnel (LSWT). Hot gas ingestion, the entrainment of heated engine exhaust into the inlet flow field, is a key development issue for advanced short takeoff and vertical landing aircraft. The Phase 1 test program, conducted by NASA Lewis and McDonnell Douglas Corporation, evaluated the hot ingestion phenomena and control techniques and Phase 2 test program which was conducted by NASA Lewis are both reported. The Phase 2 program was conducted at exhaust nozzles temperatures up to 1460 R and utilized a sheet laser system for flow visualization of the model flow field in and out of ground effects. Hot gas ingestion levels were measured for the several forward nozzle splay configurations and with flow control/lift improvement devices which reduced the hot gas ingestion. The model support system had four degrees of freedom, heated high pressure air for nozzle flow, and a suction system exhaust for inlet flow. The headwind (freestream) velocity for Phase 1 was varied from 8 to 90 kn, with primary data taken in the 8 to 23 kn headwind velocity range. Phase 2 headwind velocity varied from 10 to 23 kn. Results of both Phase 1 and 2 are presented. A description of the model, facility, a new model support system, and a sheet laser illumination system are also provided. Results are presented over a range of main landing gear height (model height) above the ground plane at a 10 kn headwind velocity. The results contain the compressor face pressure and temperature distortions, total pressure recovery, compressor face temperature rise, and the environmental effects of the hot gas. The environmental effects include the ground plane temperature and pressure distributions, model airframe heating, and the location of the ground flow separation. Results from the sheet laser flow visualization test are also shown.

Johns, Albert L.↗

Changes in soil water content and lateral flow exert large effects on soil thermal dynamics across Alaskan landscapes

Both lateral surface and subsurface water flow affect soil moisture dynamics, yet most land surface models only solve subsurface water movement vertically. Here, we use a 3D ecosystem model that considers both land surface and subsurface hydrologic processes to simulate soil moisture, which is then used to drive a 1-D vertical soil thermal model to simulate the soil moisture effects on soil thermal dynamics in central Alaska. Our coupled model improves soil temperature (ST) estimates by 43.5% in comparison with observational data. Soil moisture has little effect on ST during the wet season (-1.5%) and a substantial influence during the dry season (60%). Spatially, water lateral flow has significant impacts on both soil moisture and ST, causing model estimates for thawed areas in the transition season to increase by ~10% in the study area. Our results highlight the importance of considering dynamical soil moisture, as well as lateral flow effects, on soil thermal dynamics in permafrost regions.

54 ENVIRONMENTAL SCIENCES↗

Stratified processes to analyze SSME parts and subsystems using Weibull methodology

Due to the various parts found in a Space Shuttle Main Engine (SSME), analyzation of every part is not feasible or needed. Based on previous mathematical modeling experience of high velocity cryogenic equipment, the environmental traits of location of the part, temperature range, fluid velocity, pressure range, and elevation variation of fluid flow as being significant factors were determined. Six parts categories were developed. The part categories are: (1) fuel turbomachinery, (2) oxidizer, (3) combustion devices, (4) valves, (5) ducts, and (6) lines. Due to a suspicion that superficial failure modes exist, six status codes were developed. The codes are: (1) part is in service presently, (2) part is out-of-service due to its own failure, (3) part is out-of-service due to engine (or some other part failure), (4) part is out-of-service because it's retired/obsolete (time related), (5) never fired-scrapped due to own problem or part is store, and (6) part is out-of-service for repair. It was suggested that to properly model failure behavior of SSME parts that: (1) significant factors contributing to failure must be examined, (2) relatively precision based on real life data must be examined, and (3) alternative definitions of failure must be initialized by the engineers.

Gray, Lou Allen Bell↗