Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reliability metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Coupled Solid Rocket Motor Ballistics and Trajectory Modeling for Higher Fidelity Launch Vehicle Design

Multi-stage launch vehicles with solid rocket motors (SRMs) face design optimization challenges, especially when the mission scope changes frequently. Significant performance benefits can be realized if the solid rocket motors are optimized to the changing requirements. While SRMs represent a fixed performance at launch, rapid design iterations enable flexibility at design time, yielding significant performance gains. The streamlining and integration of SRM design and analysis can be achieved with improved analysis tools. While powerful and versatile, the Solid Performance Program (SPP) is not conducive to rapid design iteration. Performing a design iteration with SPP and a trajectory solver is a labor intensive process. To enable a better workflow, SPP, the Program to Optimize Simulated Trajectories (POST), and the interfaces between them have been improved and automated, and a graphical user interface (GUI) has been developed. The GUI enables real-time visual feedback of grain and nozzle design inputs, enforces parameter dependencies, removes redundancies, and simplifies manipulation of SPP and POST's numerous options. Automating the analysis also simplifies batch analyses and trade studies. Finally, the GUI provides post-processing, visualization, and comparison of results. Wrapping legacy high-fidelity analysis codes with modern software provides the improved interface necessary to enable rapid coupled SRM ballistics and vehicle trajectory analysis. Low cost trade studies demonstrate the sensitivities of flight performance metrics to propulsion characteristics. Incorporating high fidelity analysis from SPP into vehicle design reduces performance margins and improves reliability. By flying an SRM designed with the same assumptions as the rest of the vehicle, accurate comparisons can be made between competing architectures. In summary, this flexible workflow is a critical component to designing a versatile launch vehicle model that can accommodate a volatile mission scope.

Ables, Brett↗
NASA NTRS1989

Multi-version software reliability through fault-avoidance and fault-tolerance

A number of experimental and theoretical issues associated with the practical use of multi-version software to provide run-time tolerance to software faults were investigated. A specialized tool was developed and evaluated for measuring testing coverage for a variety of metrics. The tool was used to collect information on the relationships between software faults and coverage provided by the testing process as measured by different metrics (including data flow metrics). Considerable correlation was found between coverage provided by some higher metrics and the elimination of faults in the code. Back-to-back testing was continued as an efficient mechanism for removal of un-correlated faults, and common-cause faults of variable span. Software reliability estimation methods was also continued based on non-random sampling, and the relationship between software reliability and code coverage provided through testing. New fault tolerance models were formulated. Simulation studies of the Acceptance Voting and Multi-stage Voting algorithms were finished and it was found that these two schemes for software fault tolerance are superior in many respects to some commonly used schemes. Particularly encouraging are the safety properties of the Acceptance testing scheme.

Vouk, Mladen A.↗
NASA NTRS1993

Software reliability through fault-avoidance and fault-tolerance

Strategies and tools for the testing, risk assessment and risk control of dependable software-based systems were developed. Part of this project consists of studies to enable the transfer of technology to industry, for example the risk management techniques for safety-concious systems. Theoretical investigations of Boolean and Relational Operator (BRO) testing strategy were conducted for condition-based testing. The Basic Graph Generation and Analysis tool (BGG) was extended to fully incorporate several variants of the BRO metric. Single- and multi-phase risk, coverage and time-based models are being developed to provide additional theoretical and empirical basis for estimation of the reliability and availability of large, highly dependable software. A model for software process and risk management was developed. The use of cause-effect graphing for software specification and validation was investigated. Lastly, advanced software fault-tolerance models were studied to provide alternatives and improvements in situations where simple software fault-tolerance strategies break down.

Vouk, Mladen A.↗
NASA NTRS1992

Robustness of solutions to a benchmark control problem

The robustness of 10 solutions to a benchmark control design problem presented at the 1990 American Control Conference has been evaluated. The 10 controllers have second-to-eighth-order transfer functions and have been designed using several different methods, including H-infinity optimization, loop-transfer recovery, imaginary-axis shifting, constrained optimization, structured covariance, game theory, and the internal model principle. Stochastic robustness analysis quantifies the controllers' stability and performance robustness with structured uncertainties in up to six system parameters. The analysis provides insights into system response that are not readily derived from other robustness criteria and provides a common ground for judging controllers produced by alternative methods. One important conclusion is that gain and phase margins are not reliable indicators of the probability of instability. Furthermore, parameter variations actually may improve the likelihood of achieving selected performance metrics, as demonstrated by results for the probability of settling-time exceedance.

Stengel, Robert F.↗
NASA NTRS2003

An On-Line Technology Information System (OTIS) for Advanced Life Support

An On-line Technology Information System (OTIS) is currently being developed for the Advanced Life Support (ALS) Program. This paper describes the preliminary development of OTIS, which is a system designed to provide centralized collection and organization of technology information. The lack of thorough, reliable and easily understood technology information is a major obstacle in effective assessment of technology development progress, trade studies, metric calculations, and technology selection for integrated testing. OTIS will provide a formalized, well-organized protocol to communicate thorough, accurate, current and relevant technology information between the hands-on technology developer and the ALS Community. The need for this type of information transfer system within the Solid Waste Management (SWM) element was recently identified and addressed. A SWM Technology Information Form (TIF) was developed specifically for collecting detailed technology information in the area of SWM. In the TIF, information is requested from SWM technology developers, based upon the Technology Readiness Level (TRL). Basic information is requested for low-TRL technologies, and more detailed information is requested as the TRL of the technology increases. A comparable form is also being developed for the wastewater processing element. In the future, similar forms will also be developed for the ALS elements of air revitalization, food processing, biomass production and thermal control. These ALS element-specific forms will be implemented in OTIS via a web-accessible interface,with the data stored in an object-oriented relational database (created in MySQLTM) located on a secure server at NASA Ames Research Center. With OTIS, ALS element leads and managers will be able to carry out informed research and development investment, thereby promoting technology through the TRL scale. OTIS will also allow analysts to make accurate evaluations of technology options. Additionally, the range and specificity of information solicited will help educate technology developers of programmatic needs.

Levri, Julie A.↗
NASA NTRS2003

Intelligent Work Process Engineering System

Optimizing performance on work activities and processes requires metrics of performance for management to monitor and analyze in order to support further improvements in efficiency, effectiveness, safety, reliability and cost. Information systems are therefore required to assist management in making timely, informed decisions regarding these work processes and activities. Currently information systems regarding Space Shuttle maintenance and servicing do not exist to make such timely decisions. The work to be presented details a system which incorporates various automated and intelligent processes and analysis tools to capture organize and analyze work process related data, to make the necessary decisions to meet KSC organizational goals. The advantages and disadvantages of design alternatives to the development of such a system will be discussed including technologies, which would need to bedesigned, prototyped and evaluated.

Williams, Kent E.↗
NASA NTRS2008

Benchmarking Gas Path Diagnostic Methods: A Public Approach

Recent technology reviews have identified the need for objective assessments of engine health management (EHM) technology. The need is two-fold: technology developers require relevant data and problems to design and validate new algorithms and techniques while engine system integrators and operators need practical tools to direct development and then evaluate the effectiveness of proposed solutions. This paper presents a publicly available gas path diagnostic benchmark problem that has been developed by the Propulsion and Power Systems Panel of The Technical Cooperation Program (TTCP) to help address these needs. The problem is coded in MATLAB (The MathWorks, Inc.) and coupled with a non-linear turbofan engine simulation to produce "snap-shot" measurements, with relevant noise levels, as if collected from a fleet of engines over their lifetime of use. Each engine within the fleet will experience unique operating and deterioration profiles, and may encounter randomly occurring relevant gas path faults including sensor, actuator and component faults. The challenge to the EHM community is to develop gas path diagnostic algorithms to reliably perform fault detection and isolation. An example solution to the benchmark problem is provided along with associated evaluation metrics. A plan is presented to disseminate this benchmark problem to the engine health management technical community and invite technology solutions.

Simon, Donald L.↗
NASA NTRS2012

Space Launch System Accelerated Booster Development Cycle

With the retirement of the Space Shuttle, NASA is seeking to reinvigorate the national space program and recapture the public s interest in human space exploration by developing missions to the Moon, near-earth asteroids, Lagrange points, Mars, and beyond. The would-be successor to the Space Shuttle, NASA s Constellation Program, planned to take humans back to the Moon by 2020, but due to budgetary constraints was cancelled in 2010 in search of a more "affordable, sustainable, and realistic" concept2. Following a number of studies, the much anticipated Space Launch System (SLS) was unveiled in September of 2011. The SLS core architecture consists of a cryogenic first stage with five Space Shuttle Main Engines (SSMEs), and a cryogenic second stage using a new J-2X engine3. The baseline configuration employs two 5-segment solid rocket boosters to achieve a 70 metric ton payload capability, but a new, more capable booster system will be required to attain the goal of 130 metric tons to orbit. To this end, NASA s Marshall Space Flight Center recently released a NASA Research Announcement (NRA) entitled "Space Launch System (SLS) Advanced Booster Engineering Demonstration and/or Risk Reduction." The increased emphasis on affordability is evident in the language used in the NRA, which is focused on risk reduction "leading to an affordable Advanced Booster that meets the evolved capabilities of SLS" and "enabling competition" to "enhance SLS affordability. The purpose of the work presented in this paper is to perform an independent assessment of the elements that make up an affordable and realistic path forward for the SLS booster system, utilizing advanced design methods and technology evaluation techniques. The goal is to identify elements that will enable a more sustainable development program by exploring the trade space of heavy lift booster systems and focusing on affordability, operability, and reliability at the system and subsystem levels5. For this study, affordability is defined as lifecycle cost, which includes design, development, test, and engineering (DDT&E), production and operational costs (P&O). For this study, the system objectives include reducing DDT&E schedule by a factor of three, showing 99.9% reliability, flying up to four times per year, serving both crew and cargo missions, and evolving to a lift capability of 130 metric tons.3 After identifying gaps in the current system s capabilities, this study seeks to identify non-traditional and innovative technologies and processes that may improve performance in these areas and assess their impacts on booster system development. The DDT&E phase may be improved by incorporating incremental development testing and integrated demonstrations to mitigate risk. To further reduce DDT&E, this study will also consider how aspects of the booster system may have commonality with other users, such as the Department of Defense, commercial applications, or international partners; by sharing some of the risk and investment, the overall development cost may be reduced. Consideration is not limited to solid and liquid rocket boosters. A set of functional performance characteristics, such as engine thrust, specific impulse (Isp), mixture ratio, and throttle range are identified and their impacts on the system are evaluated. This study also identifies how such characteristics affect overall life cycle cost, including DDT&E and fixed and variable P&O.

Arockiam, Nicole↗
NASA NTRSDate not supplied

NASA’s Moon to Mars (M2M) Transit Habitat Refinement Point of Departure Design

As NASA prepares for the next human footsteps on the lunar surface, the Agency is already looking ahead to systems that will enable a sustained human presence on the lunar surface and mission to Mars, including a lunar Surface Habitat (SH) and Mars Transit Habitat (TH). This paper describes the latest NASA government reference design for the TH and how it will support NASA's Moon to Mars human exploration architecture. First, it will serve as a test and demonstration platform in lunar orbit, demonstrating capabilities required for long-duration microgravity human spaceflight as part of the lunar-Mars analog missions. Then, the TH will serve as a major Mars exploration element to support crew habitation during their transit from the Earth’s orbit to Mars and returning safely before TH’s return to a lunar orbit. This paper will cover several considerations contributing to the latest habitat design refinement, including the TH's concept of operations, system functional definition, subsystem assumptions, notional interior layouts, a detailed mass and volume breakdown, and identify future trade studies and analyses required to close identified technology/ development/architecture gaps. In addition to a technical description of the TH, this paper describes how the current TH government reference design will achieve many of the current lunar and Mars mission goals. Additionally, there are many assumed technological advances needed to support the prescribed mission phases leading up to the crewed mission to Mars in the late 2030s. The paper will describe many of the TH systems requiring further technology development and identify architectural solutions to achieve these mass, reliability, autonomy, and crew health targets. As a whole, the data shows the government reference TH design meeting the 26.4 metric ton launch /trans-Mars injection burn control mass limit outlined within NASA’s Moon to Mars Campaign. This is achievable near the desired timeframe with moderate strategic investments including maintainable life support systems, innovative structures configuration and materials, and system/ logistics packaging. The resulting design detail and data contained in this paper are intended to help teams across NASA and potential commercial, academic, or international partners understand the current performance targets of the Transit Habitat and vehicle interface considerations imposed by the latest Moon to Mars mission scope.

Habitation Systems↗
NASA NTRSDate not supplied

NASA’s Moon to Mars (M2M) Transit Habitat (TH) Refinement Point of Departure (PoD) Design

As NASA prepares for the next human footsteps on the lunar surface, the Agency is already looking ahead to systems that will enable a sustained human presence on the lunar surface and mission to Mars, including a lunar Surface Habitat and Mars Transit Habitat (TH). This paper describes the latest NASA government reference design for the TH and how it will support NASA's Moon to Mars human exploration architecture. First, it will serve as a test and demonstration platform in lunar orbit, demonstrating capabilities required for long-duration microgravity human spaceflight as part of the lunar-Mars analog missions. Then, the TH will also serve as a major Mars habitation exploration element to support the crew during their transit from the lunar orbit to Mars and returning them safely to lunar orbit. This paper will cover several considerations contributing to the latest habitat design refinement, including data on the TH's concept of operations, system functional definition, subsystem assumptions, notional interior layouts, a detailed mass and volume breakdown, and trade studies and analyses required to close identified technology/ development/architecture gaps. In addition to a technical description of the TH, this paper describes how the current TH government reference design will achieve many of the current lunar and Mars mission goals. Additionally, there are many assumed technological advances needed to support the prescribed mission phases leading up to the crewed mission to Mars in the late 2030s. The paper will describe many of the TH systems requiring further technology development and identify architectural solutions to achieve these mass, reliability, autonomy, and crew health targets. As a whole, the data in the paper shows that a TH meeting the 43 metric tons launch mass/trans-Mars injection burn limits specified by the Evolvable Mars Campaign is achievable near the desired timeframe with moderate strategic investments including maintainable life support systems, re-purposable structures and packaging, and lightweight exercise modalities. It also identifies operational and technological options to reduce this mass to less than 41 metric tons, including staging of launch structure/packaging and alternate structural materials. The resulting design detail and data contained in this paper are intended to help teams across NASA and potential commercial, academic, or international partners understand the current performance targets of the Transit Habitat and vehicle interface considerations imposed by the latest Moon to Mars mission scope.

Habitation Systems↗
NASA NTRS1983

A Bayesian modification to the Jelinski-Moranda software reliability growth model

The Jelinski-Moranda (JM) model for software reliability was examined. It is suggested that a major reason for the poor results given by this model is the poor performance of the maximum likelihood method (ML) of parameter estimation. A reparameterization and Bayesian analysis, involving a slight modelling change, are proposed. It is shown that this new Bayesian-Jelinski-Moranda model (BJM) is mathematically quite tractable, and several metrics of interest to practitioners are obtained. The BJM and JM models are compared by using several sets of real software failure data collected and in all cases the BJM model gives superior reliability predictions. A change in the assumption which underlay both models to present the debugging process more accurately is discussed.

Littlewood, B.↗
NASA NTRS2005

Robust Control Design for Systems With Probabilistic Uncertainty

This paper presents a reliability- and robustness-based formulation for robust control synthesis for systems with probabilistic uncertainty. In a reliability-based formulation, the probability of violating design requirements prescribed by inequality constraints is minimized. In a robustness-based formulation, a metric which measures the tendency of a random variable/process to cluster close to a target scalar/function is minimized. A multi-objective optimization procedure, which combines stability and performance requirements in time and frequency domains, is used to search for robustly optimal compensators. Some of the fundamental differences between the proposed strategy and conventional robust control methods are: (i) unnecessary conservatism is eliminated since there is not need for convex supports, (ii) the most likely plants are favored during synthesis allowing for probabilistic robust optimality, (iii) the tradeoff between robust stability and robust performance can be explored numerically, (iv) the uncertainty set is closely related to parameters with clear physical meaning, and (v) compensators with improved robust characteristics for a given control structure can be synthesized.

Crespo, Luis G.↗
NASA NTRS2006

Converging Indicators for Assessing Individual Differences in Adaptation to Extreme Environments: Preliminary Report

This paper describes the development and validation of a new methodology for assessing the deleterious effects of spaceflight on crew health and performance. It is well known that microgravity results in various physiological alterations, e.g., headward fluid shifts which can impede physiological adaptation. Other factors that may affect crew operational efficiency include disruption of sleep-wake cycles, high workload, isolation, confinement, stress and fatigue. From an operational perspective, it is difficult to predict which individuals will be most or least affected in this unique environment given that most astronauts are first-time flyers. During future lunar and Mars missions space crews will include both men and women of multi-national origins, different professional backgrounds, and various states of physical condition. Therefore, new methods or technologies are needed to monitor and predict astronaut performance and health, and to evaluate the effects of various countermeasures on crew during long duration missions. This paper reviews several studies conducted in both laboratory and operational environments with men and women ranging in age between 18 to 50 years. The studies included the following: soldiers performing command and control functions during mobile operations in enclosed armored vehicles; subjects participating in laboratory tests of an anti-motion sickness medication; subjects exposed to chronic hypergravity aboard a centrifuge, and subject responses to 36-hours of sleep deprivation. Physiological measurements, performance metrics, and subjective self-reports were collected in each study. The results demonstrate that multivariate converging indicators provide a significantly more reliable method for assessing environmental effects on performance and health than any single indicator.

Cowings, Patricia S.↗
NASA NTRS2018

Generic Control Allocation Toolbox for Preliminary Vehicle Design

This paper describes the development and application of a Generic Control Allocation Toolbox developed at NASA Langley Research Center (LGCAT) intended to aid engineers during the preliminary design phase of an aerospace vehicle. The static controllability space in the forms of a Theoretical Attainable Moment Set, Φ, or Theoretical Attainable Force Set, φ is difficult to visualize for modern vehicles with multiple types of redundant control effectors. The objective of LGCAT is to provide system engineers and designers early in the vehicle design phase with quick insights on how control effector parameters such as quantity, sizing, location, orientation, redundancy, etc., affect the overall controllability and other performance metrics. Having such information in hand allows system engineers to make more informed decisions on overall mission objectives such as performance vs. reliability vs. cost, etc. early in a vehicle design phase and reduce the number of iterations necessary in the design and analysis cycles. LGCAT can accept a variety of control effector types including aerodynamic surfaces, rotors, thrust vector control (TVC) engines, and reaction control systems (RCS). LGCAT is MATLAB based, user friendly, and is capable of performing the analysis in the Graphical User Interface (GUI) or script mode. Current add-on features include interfacing with engineering level codes such as Vehicle Sketch Pad (VSP) and generating the corresponding Φ and φ for an arbitrary vehicle design. These capabilities potentially make LGCAT an integral part of the preliminary design phase for any vehicle.

Pei, Jing↗
NASA NTRS2007

Evaluation of Radiation Belt Space Weather Forecasts for Internal Charging Analyses

A variety of static electron radiation belt models, space weather prediction tools, and energetic electron datasets are used by spacecraft designers and operations support personnel as internal charging code inputs to evaluate electrostatic discharge risks in space systems due to exposure to relativistic electron environments. Evaluating the environment inputs is often accomplished by comparing whether the data set or forecast tool reliability predicts measured electron flux (or fluence over a given period) for some chosen period. While this technique is useful as a model metric, it does not provide the information necessary to evaluate whether short term deviances of the predicted flux is important in the charging evaluations. In this paper, we use a 1-D internal charging model to compute electric fields generated in insulating materials as a function of time when exposed to relativistic electrons in the Earth's magnetosphere. The resulting fields are assumed to represent the "true" electric fields and are compared with electric field values computed from relativistic electron environments derived from a variety of space environment and forecast tools. Deviances in predicted fields compared to the "true" fields which depend on insulator charging time constants will be evaluated as a potential metric for determining the importance of predicted and measured relativistic electron flux deviations over a range of time scales.

Minow, Joseph I.↗
NASA NTRS2019

Electromagnetic Efficiency and Mass of Magnetic Gears for Electrified Aircraft

Magnetic gears are currently being explored to replace mechanical gears in various industries such as wind and automotive due to their higher reliability and lower maintenance requirements. In these applications volume minimization has been the goal of magnetic gear development. In contrast, the primary performance metrics for electrified aircraft drives are mass and efficiency. This paper presents the first ever study of design tradeoffs between electromagnetic mass and efficiency of concentric magnetic gears and the feasibility of achieving the low mass and high efficiency required for electrified aircraft applications. Higher level design variables are considered, including gear ratio, number of magnetic pole pairs, and number of magnets per pole pair.

Tallerico, Thomas↗
NASA NTRSDate not supplied

Verification of Viscous Goal-Based Anisotropic Mesh Adaptation

Adaptive unstructured mesh techniques have a limited, but growing impact on production analysis workflows where the control of discretization error is critical to obtaining reliable simulation results. Recent progress has matured a number of independent implementations of flow solvers, error estimation methods, and anisotropic mesh adaptation mechanics. Anisotropic metric construction methods are evaluated with analytically defined primal and adjoint fields. This allows the comparison of different metric formulations and different implementations of the same formulation without the complications of a flow and adjoint solution method. Unstructured mesh adaptation tools are verified by comparison on analytic primal and dual field before verification on benchmark aerodynamics cases. The documentation of these verification exercises helps to prepare these goal-based methods for routine use in production simulation workflows.

Mesh adaptation↗
NASA NTRSDate not supplied

EVM and Schedule Management

The objective of EVMS surveillance is to ensure that the management control processes that support the performance measurement baseline (PMB) are in place, compliant with the EVMS guidelines, are routinely being used, and provide timely and reliable data. The PMB is a triple constraint where the constraints are schedule, budget and scope. For Surveillance, NASA uses the DCMA EVM Compliance Metrics (DECM) Tests that are aligned with the EIA-748 EVM Standard. Guidelines 6 is Scheduling Work, and DECM has 23 Tests for evaluating if the IMS supports project goals in its planning, statusing and forecasting. This session will focus on the Test Metric that analyzes forecast start/finish dates riding the status date of the IMS for two or more consecutive months as an example of how surveillance works in concert with IMS health checks. It will cover how to run the test to recognize trends and how this test helps ensure that the forecast is credible in support of critical path analysis.

EVM↗