Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reliability metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Anisotropic Goal-Based Mesh Adaptation Metric Clarification and Development

Adaptive unstructured mesh techniques have a limited, but growing impact on production analysis workflows to control discretization error for reliable simulation results. Multiple independent implementations of flow solvers, anisotropic metric construction methods, and anisotropic mesh adaptation mechanics have matured. Goal-based metrics target estimated error in output functions, such as lift and drag, through the guidance of an adjoint solution. A unification of goal-based anisotropic metrics is presented for steady viscous flows, which is an active area of research. These goal-based metrics drive robust and efficient anisotropic mesh adaptation for the calculation of output functions. The super-convergent functional output error behavior of stabilized finite-element methods is exploited without a formal proof, and evidence of super-convergence is shown in numerical experiments. Mesh adapted drag and lift outputs for two simple bodies in compressible viscous flow show convergence of error to less than a single drag count. Asymptotic behavior established for relatively coarse meshes shows the efficiency of this goal-based metric when compared to solution interpolation error control and expert-guided meshing. Anisotropic mesh adaptation techniques are applied to a transport aircraft in a high-lift configuration where variation between approaches decreases with mesh refinement, but asymptotic behavior is not observed with available resources.

goal-based↗

Integrating Formal Methods and Testing 2002

Traditionally, qualitative program verification methodologies and program testing are studied in separate research communities. None of them alone is powerful and practical enough to provide sufficient confidence in ultra-high reliability assessment when used exclusively. Significant advances can be made by accounting not only tho formal verification and program testing. but also the impact of many other standard V&V techniques, in a unified software reliability assessment framework. The first year of this research resulted in the statistical framework that, given the assumptions on the success of the qualitative V&V and QA procedures, significantly reduces the amount of testing needed to confidently assess reliability at so-called high and ultra-high levels (10-4 or higher). The coming years shall address the methodologies to realistically estimate the impacts of various V&V techniques to system reliability and include the impact of operational risk to reliability assessment. Combine formal correctness verification, process and product metrics, and other standard qualitative software assurance methods with statistical testing with the aim of gaining higher confidence in software reliability assessment for high-assurance applications. B) Quantify the impact of these methods on software reliability. C) Demonstrate that accounting for the effectiveness of these methods reduces the number of tests needed to attain certain confidence level. D) Quantify and justify the reliability estimate for systems developed using various methods.

Cukic, Bojan↗

Improving Quantification of Medical Evacuation Risk for Human Spaceflight in the IMPACT Model

Traditionally, mission planners have used a heuristic and qualitative approach to design medical systems based on prior experience however this approach may result in high variability and implicit bias to design and could put missions and crewmembers at risk. The Informing Mission Planning through Analysis of Complex Tradespaces (IMPACT) tool is a probabilistic risk assessment tool designed by NASA to model medical risk in long duration missions outside of low earth orbit (LEO). This tool can quantify risk metrics such as risk of crewmember death, loss of crew task time, and the need for medical evacuation to better inform and augment the more traditional approach to medical system design. The risk metric of Return to Definitive Care (RTDC) represents the likelihood of requiring medical evacuation and has been difficult to quantify in a reliable and standardized manner. Initial development of the RTDC metric was constrained due to the complexity of a medical evacuation decision and the lack of prior spaceflight data and this presentation will discuss the review and improvement process used to increase model accuracy and fidelity.

Prashant Parmar↗

Artemis Missions Probabilistic Risk Assessment (PRA) & Reliability Assessment Overview

To show how NASA’s Moon-to-Mars (M2M) program can use hardware reliability assessments and comprehensive Probabilistic Risk Assessments (PRAs) to estimate risk of future missions and manage risk via safety and mission success requirements from the top down, so that this risk can be balanced with other program metrics like cost and schedule. These PRAs and reliability assessments can be used during the concept, design, and operational phases of development. This presentation also provides some thoughts on how the NASA process can be utilized for a lunar surface power grid development.

PRA↗

A Planar Approximation for the Least Reliable Bit Log-likelihood Ratio of 8-PSK Modulation

The optimum decoding of component codes in block coded modulation (BCM) schemes requires the use of the log-likelihood ratio (LLR) as the signal metric. An approximation to the LLR for the least reliable bit (LRB) in an 8-PSK modulation based on planar equations with fixed point arithmetic is developed that is both accurate and easily realizable for practical BCM schemes. Through an error power analysis and an example simulation it is shown that the approximation results in 0.06 dB in degradation over the exact expression at an E(sub s)/N(sub o) of 10 dB. It is also shown that the approximation can be realized in combinatorial logic using roughly 7300 transistors. This compares favorably to a look up table approach in typical systems.

Thesling, William H.↗

Rapid Response Risk Assessment in New Project Development

A capability for rapidly performing quantitative risk assessments has been developed by JSC Safety and Mission Assurance for use on project design trade studies early in the project life cycle, i.e., concept development through preliminary design phases. A risk assessment tool set has been developed consisting of interactive and integrated software modules that allow a user/project designer to assess the impact of alternative design or programmatic options on the probability of mission success or other risk metrics. The risk and design trade space includes interactive options for selecting parameters and/or metrics for numerous design characteristics including component reliability characteristics, functional redundancy levels, item or system technology readiness levels, and mission event characteristics. This capability is intended for use on any project or system development with a defined mission, and an example project will used for demonstration and descriptive purposes, e.g., landing a robot on the moon. The effects of various alternative design considerations and their impact of these decisions on mission success (or failure) can be measured in real time on a personal computer. This capability provides a high degree of efficiency for quickly providing information in NASA s evolving risk-based decision environment

Graber, Robert R.↗

An Assessment of the Differences Between Spatial Resolution and Grid Size for the SMAP Enhanced Soil Moisture Product over Homogeneous Sites

Satellite-based passive microwave remote sensing typically involves a scanning antenna that makes measurements at irregularly spaced locations. These locations can change on a day to day basis. Soil moisture products derived from satellite-based passive microwave remote sensing are usually resampled to a fixed Earth grid that facilitates their use in applications. In many cases the grid size is finer than the actual spatial resolution of the observation, and often this difference is not well understood by the user. Here, this issue was examined for the Soil Moisture Active Passive (SMAP) enhanced version of the passive-based soil moisture product, which has a grid size of 9-km and a nominal spatial resolution of 33-km. In situ observations from core validation sites were used to compute comparison metrics. For sites that satisfied the established reliability and scaling criteria, the impact of validating the 9-km grid product with in situ data collected over a 9-km versus a 33-km domain was very small for the sites studied (0.039 cu. m/cu. m unbiased root mean square difference for the 9-km case versus 0.037 cu. m/cu. m for the 33-km case). This result does not mean that the resolution of the product is 9-km but that for the conditions studied here the soil moisture estimated from in situ observations over 9-km is a close approximation of the soil moisture estimated from in situ observations over the 33-km resolution. The implication is that using the enhanced SMAP product at its grid resolution of 9-km should not introduce large errors in most applications.

Soil moisture↗

Advances in dual algorithms and convex approximation methods

A new algorithm for solving the duals of separable convex optimization problems is presented. The algorithm is based on an active set strategy in conjunction with a variable metric method. This first order algorithm is more reliable than Newton's method used in DUAL-2 because it does not break down when the Hessian matrix becomes singular or nearly singular. A perturbation technique is introduced in order to remove the nondifferentiability of the dual function which arises when linear constraints are present in the approximate problem.

Smaoui, H.↗

Understanding the nature of software evolution

In this paper, we analyze the measurements of structural evolution and fault counts obtained from the JPL flight software technology development effort.

software evolution software measurement software m↗

Extreme Environment Hot Fire Durability of Post-Processed Additively Manufactured GRCop-Alloy Combustion Chambers in LOX/Hydrogen and LOX/Methane

Extreme environment survivability of metal additive manufactured (AM) GRCop-alloy thrust chambers has been demonstrated in different bi-propellants at near stoichiometric and even oxygen rich combustion. GRCop-alloy chambers tested at NASA Marshall Space Flight Center (MSFC) have accumulated over 26,000 seconds of hot fire duration and over 500 starts. These chambers are produced using an AM process called laser powder bed fusion (L-PBF). A major feature of this process is high wall surface roughness which can be customized in post processing to leverage various performance advantages. Post-processing can include heat treatment, final machining, polishing, and welding and is key to hardware survivability in extreme environments. Surface finish enhancement techniques were applied to the hot wall and coolant channels to reduce the overall total heat load to the chamber walls. Performance optimization of various thrust class TCA’s is a strategic technology goal of NASA MSFC. Three different chamber geometries using cryogenic methane and de-ionized water as coolants were hot fire tested to obtain their life cycle, pressure drop, and heat load performances. Several 1.2K lbf LOX/H2 chambers, 1K lbf LOX/CH4 chambers, and 7K lbf LOX/CH4 chambers were tested. All post-processed configurations performed remarkably well when subjected to extreme hot fire test conditions. Streaking and blanching due to localized oxygen rich conditions were observed on some test articles in their as-built surface finish state. However, this is actually a function of the injector mixing and only serves to further establish the durability of L-PBF GRCop-alloy thrust chambers. Several different polishing techniques were applied to the hot wall and integrated coolant channels prior to hot fire testing and their performances assessed. Overall, AM produced GRCop chambers are extremely reliable, durable, and customizable to the desired performance metrics.

grcop↗

Spur, helical, and spiral bevel transmission life modeling

A computer program, TLIFE, which estimates the life, dynamic capacity, and reliability of aircraft transmissions, is presented. The program enables comparisons of transmission service life at the design stage for optimization. A variety of transmissions may be analyzed including: spur, helical, and spiral bevel reductions as well as series combinations of these reductions. The basic spur and helical reductions include: single mesh, compound, and parallel path plus revert star and planetary gear trains. A variety of straddle and overhung bearing configurations on the gear shafts are possible as is the use of a ring gear for the output. The spiral bevel reductions include single and dual input drives with arbitrary shaft angles. The program is written in FORTRAN 77 and has been executed both in the personal computer DOS environment and on UNIX workstations. The analysis may be performed in either the SI metric or the English inch system of units. The reliability and life analysis is based on the two-parameter Weibull distribution lives of the component gears and bearings. The program output file describes the overall transmission and each constituent transmission, its components, and their locations, capacities, and loads. Primary output is the dynamic capacity and 90-percent reliability and mean lives of the unit transmissions and the overall system which can be used to estimate service overhaul frequency requirements. Two examples are presented to illustrate the information available for single element and series transmissions.

Savage, Michael↗

A Computational Framework to Control Verification and Robustness Analysis

This paper presents a methodology for evaluating the robustness of a controller based on its ability to satisfy the design requirements. The framework proposed is generic since it allows for high-fidelity models, arbitrary control structures and arbitrary functional dependencies between the requirements and the uncertain parameters. The cornerstone of this contribution is the ability to bound the region of the uncertain parameter space where the degradation in closed-loop performance remains acceptable. The size of this bounding set, whose geometry can be prescribed according to deterministic or probabilistic uncertainty models, is a measure of robustness. The robustness metrics proposed herein are the parametric safety margin, the reliability index, the failure probability and upper bounds to this probability. The performance observed at the control verification setting, where the assumptions and approximations used for control design may no longer hold, will fully determine the proposed control assessment.

Crespo, Luis G.↗

An Analysis of the Environments of Intense Convective Systems in West Africa in 2003

We investigated the local- and regional-scale thermodynamical and dynamical environments associated with intense convective systems in West Africa during 2003. We identified convective system cases from TRMM microwave imagery, classifying each case by the system minimum 85-GHz brightness temperature and by the estimated elapsed time of propagation from high terrain. The speed of the mid-level jet, the magnitude of the low-level shear, and the surface equivalent potential temperature (theta(sub e)) were greater for the intense cases compared to the non-intense cases, although the differences between the means tended to be small, less than 3K for surface theta(sub e). Hypothesis testing of a series of commonly used intensity prediction metrics resulted in significant results only for low-level metrics such as convective available potential energy and not for any of the mid- or upper-level metrics such as 700-hPa theta(sub e). None of the environmental variables or intensity metrics by themselves or in combination appeared to be reliable direct predictors of intensity. In the regional scale analysis, the majority of intense convective systems occurred in the surface baroclinic zone where surface theta(sub e) exceeded 344 K and the 700-hPa zonal wind speeds were less than -6/ms. Fewer intense cases compared to non-intense cases were associated with African easterly wave troughs. Fewer than 25% of our cases occurred in environments with detectable Saharan dust loads, and the results for intense and non-intense cases were similar. Our results for the regional analysis were consistent with the seasonal movement of the WAM and the intertropical front, regional differences in topography, and AEW energetics.

Nicholls, Stephen D.↗

Impact of Conflict Avoidance Responsibility Allocation on Pilot Workload in a Distributed Air Traffic Management System

Pilot workload was examined during simulated flights requiring flight deck-based merging and spacing while avoiding weather. Pilots used flight deck tools to avoid convective weather and space behind a lead aircraft during an arrival into Louisville International airport. Three conflict avoidance management concepts were studied: pilot, controller or automation primarily responsible. A modified Air Traffic Workload Input Technique (ATWIT) metric showed highest workload during the approach phase of flight and lowest during the en-route phase of flight (before deviating for weather). In general, the modified ATWIT was shown to be a valid and reliable workload measure, providing more detailed information than post-run subjective workload metrics. The trend across multiple workload metrics revealed lowest workload when pilots had both conflict alerting and responsibility of the three concepts, while all objective and subjective measures showed highest workload when pilots had no conflict alerting or responsibility. This suggests that pilot workload was not tied primarily to responsibility for resolving conflicts, but to gaining and/or maintaining situation awareness when conflict alerting is unavailable.

Ligda, Sarah V.↗

A menu of self-administered microcomputer-based neurotoxicology tests

This study examined the feasibility of repeated self-administration of a newly developed battery of mental acuity tests. Researchers developed this battery to be used to screen the fitness for duty of persons in at-risk occupations (astronauts, race car drivers), or those who may be exposed to environmental stress, toxic agents, or disease. The menu under study contained cognitive and motor tests implemented on a portable microcomputer including: a five-test core battery, lasting six minutes, which had demonstrable reliabilities and stability from several previous repeated-measures studies, and also 13 new tests, lasting 42 minutes, which had appeared in other batteries but had not yet been evaluated for repeated-measures implementation in this medium. Sixteen subjects self-administered the battery over 10 repeated sessions. The hardware performed well throughout the study and the tests appeared to be easily self-administered. Stabilities and reliabilities of the test from the core battery were comparable to those obtained previously under more controlled experimental conditions. Analyses of metric properties of the remaining 13 tests produced eight additional tests with satisfactory properties. Although the average retest reliability was high, cross-correlations between tests were low, indicating factorial richness. The menu can be used to form batteries of flexible total testing time which are likely to tap different mental processes and functions.

Kennedy, Robert S.↗