Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software failure model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Random Test Run Length and Effectiveness

A poorly understood but important factor in many applications of random testing is the selection of a maximum length for test runs. Given a limited time for testing, it is seldom clear whether executing a small number of long runs or a large number of short runs maximizes utility. It is generally expected that longer runs are more likely to expose failures -- which is certainly true with respect to runs shorter than the shortest failing trace. However, longer runs produce longer failing traces, requiring more effort from humans in debugging or more resources for automated minimization. In testing with feedback, increasing ranges for parameters may also cause the probability of failure to decrease in longer runs. We show that the choice of test length dramatically impacts the effectiveness of random testing, and that the patterns observed in simple models and predicted by analysis are useful in understanding effects observed.

software testing↗

Predicting Time Series Outputs and Time-to-Failure for an Aircraft Controller Using Bayesian Modeling

Safety of unmanned aerial systems (UAS) is paramount, but the large number of dynamically changing controller parameters makes it hard to determine if the system is currently stable, and the time before loss of control if not. We propose a hierarchical statistical model using Treed Gaussian Processes to predict (i) whether a flight will be stable (success) or become unstable (failure), (ii) the time-to-failure if unstable, and (iii) time series outputs for flight variables. We first classify the current flight input into success or failure types, and then use separate models for each class to predict the time-to-failure and time series outputs. As different inputs may cause failures at different times, we have to model variable length output curves. We use a basis representation for curves and learn the mappings from input to basis coefficients. We demonstrate the effectiveness of our prediction methods on a NASA neuro-adaptive flight control system.

Statistics↗

New risk metrics and mathematical tools for risk analysis: Current and future challenges

The current status of the food safety supply world wide, has led Food and Agriculture Organization (FAO) and World Health Organization (WHO) to establishing Risk Analysis as the single framework for building food safety control programs. A series of guidelines and reports that detail out the various steps in Risk Analysis, namely Risk Management, Risk Assessment and Risk Communication is available. The Risk Analysis approach enables integration between operational food management systems, such as Hazard Analysis Critical Control Points, public health and governmental decisions. To do that, a series of new Risk Metrics has been established as follows: i) the Appropriate Level of Protection (ALOP), which indicates the maximum numbers of illnesses in a population per annum, defined by quantitative risk assessments, and used to establish; ii) Food Safety Objective (FSO), which sets the maximum frequency and/or concentration of a hazard in a food at the time of consumption that provides or contributes to the ALOP. Given that ALOP is rather a metric of the public health tolerable burden (it addresses the total ‘failure’ that may be handled at a national level), it is difficult to be interpreted into control measures applied at the manufacturing level. Thus, a series of specific objectives and criteria for performance of individual processes and products have been established, all of them assisting in the achievement of FSO and hence, ALOP. In order to achieve FSO, tools quantifying the effect of processes and intrinsic properties of foods on survival and growth of pathogens are essential. In this context, predictive microbiology and risk assessment have offered an important assistance to Food Safety Management. Predictive modelling is the basis of exposure assessment and the development of stochastic and kinetic models, which are also available in the form of Web-based applications, e.g., COMBASE and Microbial Responses Viewer), or introduced into user-friendly softwares, (e.g., Seafood Spoilage Predictor) have evolved the use of information systems in the food safety management. Such tools are updateable with new food-pathogen specific models containing cardinal parameters and multiple dependent variables, including plate counts, concentration of metabolic products, or even expression levels of certain genes. Then, these tools may further serve as decision-support tools which may assist in product logistics, based on their scientifically-based and “momentary” expressed spoilage and safety level.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Prefabricated High-Strength Rebar Systems with High-Performance Concrete for Accelerated Construction of Nuclear Concrete Structures

This project aimed to reduce the field construction times and fabrication costs of reinforced concrete (RC) nuclear structures through the use of: 1) high-strength steel deformed reinforcing bar (rebar); 2) prefabricated high-strength rebar (HSR) assemblies with headed anchorages; and 3) high-strength concrete (HSC). The focus of the project was not to develop new innovations on materials, but rather to fill a major knowledge gap on the effectiveness, code conformity, and viability (i.e., practicality, commercial availability) of existing high-strength materials in nuclear structures, especially in shear walls, their connections/joints, and around penetrations. These advances promote the Nuclear Energy Enabling Technologies Advanced Methods for Manufacturing (NEET-1) goals of accelerating deployment schedules by at least 6 months and reducing component fabrication costs by 20% or more. Toward this vision, the following objectives were identified and completed: Develop limit-benefit and cost-benefit analysis frameworks: The structural and economic limits and benefits of HSR and HSC in nuclear walls were evaluated. Importantly, it was found that modest increases in concrete strength up to 10.0 ksi and rebar yield strength up to 100 ksi result in the most economic designs and improved structural performance (Barbachyn et al., 2017a and Barbachyn et al., 2017b). Also, an industry survey was distributed to determine the cost benefits associated with prefabrication. Importantly, on-site worker-hours are significantly reduced, allowing for significantly accelerated construction schedules (Devine et al. 2018b). Develop an optimization methodology for structural design: An optimization study was deemed not necessary since the trivial solution with maximized use of high-strength materials and prefabrication always resulted in the largest cost and time savings. Instead, the benefits (and limits) of high-strength materials and prefabrication on construction costs and on-site construction time were investigated through a parametric study. Cost-reductions through the use of HSR and HSC were found to be greater than 40%. Also, on-site construction time of nuclear shear walls can be reduced by up to 83% through the use of prefabricated rebar assemblies. Conduct experimental evaluations of nuclear shear walls and wall-foundation joints: A large scale experimental program was completed on shear-critical RC cantilever deep beams. From these experiments, it was demonstrated that increasing rebar yield strength had a greater effect on increasing lateral strength than increasing the concrete compressive strength. Further, using HSR together with HSC resulted in the highest lateral strength and displacement ductility (Devine et al. 2018a). Additionally, large-scale reversed-cyclic lateral load tests were conducted on RC shear walls. It was demonstrated that through the utilization of HSR and HSC, a wall with 55% reduced vertical and horizontal rebar area was able to achieve 91% of the peak lateral strength of a conventional wall using state-of-practice materials with the same geometry. Further, trim reinforcement with headed anchorages around the penetrations proved to be effective. Develop validated numerical simulation models: Numerical modeling was completed in two phases during this project using 3 different finite element software packages. The first phase used existing measured data from previous experimental studies on stocky RC walls to validate simplified predictive models. Models using two different programs were validated based on a database of 38 stocky walls (Barbachyn et al., 2017a). The second phase occurred after experimental testing using a third and more detailed finite element package. Prediction improvements for the initial stiffness, lateral deformations, damage propagation, and failure mechanisms were targeted. The resulting detailed models more accurately predicted the peak lateral strength, initial and secant stiffnesses, lateral deformations, and cracking patterns of the wall test specimens subjected to reversed-cyclic lateral loading as compared to the simplified pretest models. Develop validated design procedures, tools, and criteria: This project evaluated the accuracy of existing closed-form design equations from U.S. building design standards and previous research (Barbachyn et al. 2017a and Devine et al. 2018a). It was shown that the current predictive equations for shear strength capacity need to be revisited as they provide significant scatter and gross overestimates, indicating the potential for unconservative designs. Further, for both the deep beam and shear wall specimens, the numerical models and flexural capacity predictions provided the most accurate strength predictions. Develop cost-effective field construction procedures: To promote the use of prefabricated rebar assemblies, the following construction conditions where prefabrication would be used instead of in-place rebar tying were identified from an industry survey: 1) to save on construction schedule; 2) to improve safety and/or quality control; 3) for areas with heavy rebar congestion; and 4) for structures with significant repetition in rebar layout. All of these conditions directly apply and benefit nuclear construction where construction costs and schedules are extensive, safety and quality are of utmost importance, the reinforcement is extremely dense, and the reinforcement layout is repetitive in many regions of the shear walls. Additionally, an experimental study was conducted to investigate the changes in bar spacing (with respect to code-required rebar spacing and placement tolerances) when a horizontally assembled prefabricated two-dimensional (2D) rebar mat or three-dimensional (3D) rebar cage is lifted (or tripped) to a vertical position. It was found that the bars involved in both the lateral translation of the rebar assemblies (i.e., movement of the assembly in its horizontal position) and the tripping process were most susceptible to large spacing changes, and thus, their positions within the assembly would need to be checked after the placement of the assembly in place within the formwork. Importantly, the spacings of all of the other bars in the assembly were not affected significantly by the lateral translation and tripping process, thereby eliminating the need to recheck their positions within the assembly (Devine et al. 2018b).

36 MATERIALS SCIENCE↗

A Model-Based Expert System for Space Power Distribution Diagnostics

When engineers diagnose system failures, they often use models to confirm system operation. This concept has produced a class of advanced expert systems that perform model-based diagnosis. A model-based diagnostic expert system for the Space Station Freedom electrical power distribution test bed is currently being developed at the NASA Lewis Research Center. The objective of this expert system is to autonomously detect and isolate electrical fault conditions. Marple, a software package developed at TRW, provides a model-based environment utilizing constraint suspension. Originally, constraint suspension techniques were developed for digital systems. However, Marple provides the mechanisms for applying this approach to analog systems such as the test bed, as well. The expert system was developed using Marple and Lucid Common Lisp running on a Sun Sparc-2 workstation. The Marple modeling environment has proved to be a useful tool for investigating the various aspects of model-based diagnostics. This report describes work completed to date and lessons learned while employing model-based diagnostics using constraint suspension within an analog system.

Quinn, Todd M.↗

Modeling and Diagnostic Software for Liquefying-Fuel Rockets

A report presents a study of five modeling and diagnostic computer programs considered for use in an integrated vehicle health management (IVHM) system during testing of liquefying-fuel hybrid rocket engines in the Hybrid Combustion Facility (HCF) at NASA Ames Research Center. Three of the programs -- TEAMS, L2, and RODON -- are model-based reasoning (or diagnostic) programs. The other two programs -- ICS and IMS -- do not attempt to isolate the causes of failures but can be used for detecting faults. In the study, qualitative models (in TEAMS and L2) and quantitative models (in RODON) having varying scope and completeness were created. Each of the models captured the structure and behavior of the HCF as a physical system. It was noted that in the cases of the qualitative models, the temporal aspects of the behavior of the HCF and the abstraction of sensor data are handled outside of the models, and it is necessary to develop additional code for this purpose. A need for additional code was also noted in the case of the quantitative model, though the amount of development effort needed was found to be less than that for the qualitative models.

Poll, Scott↗

SU-F-R-07: Radiomics of CT Features and Associations and Correlation with Outcomes Following Lung SBRT

Objective: To investigate the prognostic significance of image gradients and in predicting clinical outcomes in a patients with non-small cell lung cancer treated with stereotactic body radiotherapy (SBRT) on 71 patients with 83 treated lesions. Methods: The records of patients treated with lung SBRT were retrospectively reviewed. When applicable, SBRT target volumes were modified to exclude any overlap with pleura, chestwall, or mediastinum. The ITK software package was utilized to generate quantitative measures of image intensity, inhomogeneity, shape morphology and first and second-order CT textures. Multivariate and univariate models containing CT features were generated to assess associations with clinicopathologic factors. Results: On univariate analysis, tumor size (HR 0.54, p=0.045) sumHU (HR 0.31, p=0.044) and short run grey level emphasis STD (HR 0.22, p=0.019) were associated with regional failure-free survival; meanHU (HR 0.30, p=0.035), long run emphasis (HR 0.21, p=0.011) and long run low grey level emphasis (HR 0.14, p=0.005) was associated with distant failure-free survival (DFFS). No features were significant on multivariate modeling however long run low grey level emphasis had a hazard ratio of 0.12 (p=0.061) for DFFS. Adenocarcinoma and squamous cell carcinoma differed with respect to long run emphasis STD (p=0.024), short run low grey level emphasis STD (p<0.001), and long run low grey level emphasis STD (p=0.024). Multivariate modeling of texture features associated with tumor histology was used to estimate histologies of 18 lesions treated without histologic confirmation. Of these, MVA suggested the same histology as a prior metachronous lung malignancy in 3/7 patients. Conclusion: Extracting radiomics features on clinical datasets was feasible with the ITK package with minimal effort to identify pre-treatment quantitative CT features with prognostic factors for distant control after lung SBRT.

60 APPLIED LIFE SCIENCES↗

Seismic Contingency Auto Generator

This code takes in premade earthquake scenario XML files from USGS, power grid data, and converts them into a contingency file (.con file) that can be used by power grid solvers. Within the .con file are a number (Specified by the user) of contingencies that have randomly failed power transformers based on their likelihood of failure and peak ground acceleration (PGA) value around the transformer. The transformers' likelihood of failure was calculated based on a variety of finite element modeling on various transformer designed for specific transformer voltage classes. Parameters from these FEM were used to create generic fragility curves for transformers within a specific voltage class, which correspond with earthquake PGA values to produced a probability of failure for a given earthquake scenario. More refined versions of this process, such as specifying specific transformer design categories within a voltage class, could also be applied in future iterations of the software.

Vaagensmith, Bjorn [Idaho National Laboratory (INL↗

Engineering Risk Assessment of Space Thruster Challenge Problem

The Engineering Risk Assessment (ERA) team at NASA Ames Research Center utilizes dynamic models with linked physics-of-failure analyses to produce quantitative risk assessments of space exploration missions. This paper applies the ERA approach to the baseline and extended versions of the PSAM Space Thruster Challenge Problem, which investigates mission risk for a deep space ion propulsion system with time-varying thruster requirements and operations schedules. The dynamic mission is modeled using a combination of discrete and continuous-time reliability elements within the commercially available GoldSim software. Loss-of-mission (LOM) probability results are generated via Monte Carlo sampling performed by the integrated model. Model convergence studies are presented to illustrate the sensitivity of integrated LOM results to the number of Monte Carlo trials. A deterministic risk model was also built for the three baseline and extended missions using the Ames Reliability Tool (ART), and results are compared to the simulation results to evaluate the relative importance of mission dynamics. The ART model did a reasonable job of matching the simulation models for the baseline case, while a hybrid approach using offline dynamic models was required for the extended missions. This study highlighted that state-of-the-art techniques can adequately adapt to a range of dynamic problems.

Assessment↗

GHOST (Grid Hardware Open Source Testbed) [SWR-18-32]

The software was developed for the purpose of Microgrid Controller Procurement where multiple Microgrid Controller vendors were competing to prove the best performance. Each microgrid controller was connected to Real-Time Simulator (Opal-RT) where the Real-Time model of microgrid was simulated. Microgrid controllers were able to control most of the assets in the model. To be able to fairly compare controller's performance each controller was evaluated using exactly the same model, with the same initial conditions and exactly the same test sequence. The microgrid evaluation test sequence lasted 100 minutes and consist of various grid disturbances to which a microgrid controller must respond. The microgrid and power system will experience multiple types of disturbances while performing dispatch functions. Many functions are tested in grid-connected and islanded modes such as unexpended failures of generators, energy storage trip events, and large load fluctuations. The test sequence focuses on fault scenarios that cause the highest short-circuit fault current contribution; force a swing bus or generator capable of being a swing bus offline; cause the most reconfigurations; and cause conflicting objectives for the microgrid controller. During the test sequence execution multiple datapoints are being recorded and stored. During data postprocessing key performance parameters are extracted allowing quantitative comparison of performance on multiple aspects including: resiliency, fuel utilization, grid interconnection, ancillary services and power quality and eventually after summing all key performance parameters by comparing the overall result. To be able to perform such testing multiple tools had to be developed included in this repository including: - Real time model of microgrid (Urban-Banshee, Remote-smaller model) - Test sequence configuration tools - Test execution real-time scripts - Post processing scripts - Human Machine Interface software

Koralewicz, Przemyslaw↗

V and V of ISHM Software for Space Exploration

NASA has established a far-reaching and long-term program for robotic and manned exploration of the solar system, beginning with missions to the moon and Mars. The Crew Transportation System (CTS), a key system for space exploration, imposes four requirements' that ISHM addresses. These requirements have a wide range of implications for V&V and certification of ISHM. There is a range of time-criticality for ISHM actions, from prognostication, which is often (but not always) non-time-critical, to time-critical state estimation and system management under off-nominal emergency conditions. These are externally imposed requirements on ISHM that are subject to V&V. - In addition, a range of techniques are needed to implement an ISHM. The approaches to ISHM are described elsewhere. These approaches range from well-understood algorithms for low-level data analysis, validation and reporting, to AI techniques for state estimation and planning. The range of techniques, and specifically the use of AI techniques such as reasoning under uncertainty and mission planning (and re-planning), implies that several V&V approaches may be required. Depending on the ISHM architecture, traditional testing approaches may be adequate for some ISHM functionality. The AI-based approaches to reasoning under uncertainty, model-based reasoning, and planning share characteristics typical of other complex software systems, but they also have characteristics that set them apart and challenge standard V&V techniques. The range of possible solutions to the overall ISHM problem impose internal challenges to V&V. The V&V challenges increase when hard real-time constraints are imposed for time-critical functionality. For example, there is an external requirement that impending catastrophic failure of the Launch Vehicle (LV) at launch time be detected and life-saving action be taken within two seconds. In this paper we outline the challenges for ISHM V&V, existing approaches and analogs in other software application areas, and possible new approaches to the V&V challenges for space exploration ISHM.

Markosian, Lawrence↗

NASA Tech Briefs, June 2010

Topics covered include: Situational Awareness from a Low-Cost Camera System; Data Acquisition System for Multi-Frequency Radar Flight Operations Preparation; Mercury Toolset for Spatiotemporal Metadata; Social Tagging of Mission Data; Integrating Radar Image Data with Google Maps; Demonstration of a Submillimeter-Wave HEMT Oscillator Module at 330 GHz; Flexible Peripheral Component Interconnect Input/Output Card; Interface Supports Lightweight Subsystem Routing for Flight Applications; MMIC Amplifiers and Wafer Probes for 350 to 500 GHz; Public Risk Assessment Program; Particle Swarm Optimization Toolbox; Telescience Support Center Data System Software; Update on PISCES; Ground and Space Radar Volume Matching and Comparison Software; Web-Based Interface for Command and Control of Network Sensors; Orbit Determination Toolbox; Distributed Observer Network; Computer-Automated Evolution of Spacecraft X-Band Antennas; Practical Loop-Shaping Design of Feedback Control Systems; Fully Printed High-Frequency Phased-Array Antenna on Flexible Substrate; Formula for the Removal and Remediation of Polychlorinated Biphenyls in Painted Structures; Integrated Solar Concentrator and Shielded Radiator; Water Membrane Evaporator; Modeling of Failure for Analysis of Triaxial Braided Carbon Fiber Composites; Catalyst for Carbon Monoxide Oxidation; Titanium Hydroxide - a Volatile Species at High Temperature; Selective Functionalization of Carbon Nanotubes: Part II; Steerable Hopping Six-Legged Robot; Launchable and Retrievable Tetherobot; Hybrid Heat Exchangers; Orbital Winch for High-Strength, Space-Survivable Tethers; Parameterized Linear Longitudinal Airship Model; and Physics of Life: A Model for Non-Newtonian Properties of Living Systems.

Source record↗

UQTools: The Uncertainty Quantification Toolbox - Introduction and Tutorial

UQTools is the short name for the Uncertainty Quantification Toolbox, a software package designed to efficiently quantify the impact of parametric uncertainty on engineering systems. UQTools is a MATLAB-based software package and was designed to be discipline independent, employing very generic representations of the system models and uncertainty. Specifically, UQTools accepts linear and nonlinear system models and permits arbitrary functional dependencies between the system s measures of interest and the probabilistic or non-probabilistic parametric uncertainty. One of the most significant features incorporated into UQTools is the theoretical development centered on homothetic deformations and their application to set bounding and approximating failure probabilities. Beyond the set bounding technique, UQTools provides a wide range of probabilistic and uncertainty-based tools to solve key problems in science and engineering.

Kenny, Sean P.↗

Methods, software and datasets to verify DVH calculations against analytical values: Twenty years late(r)

Purpose: The authors designed data, methods, and metrics that can serve as a standard, independent of any software package, to evaluate dose-volume histogram (DVH) calculation accuracy and detect limitations. The authors use simple geometrical objects at different orientations combined with dose grids of varying spatial resolution with linear 1D dose gradients; when combined, ground truth DVH curves can be calculated analytically in closed form to serve as the absolute standards. Methods: DICOM RT structure sets containing a small sphere, cylinder, and cone were created programmatically with axial plane spacing varying from 0.2 to 3 mm. Cylinders and cones were modeled in two different orientations with respect to the IEC 1217 Y axis. The contours were designed to stringently but methodically test voxelation methods required for DVH. Synthetic RT dose files were generated with 1D linear dose gradient and with grid resolution varying from 0.4 to 3 mm. Two commercial DVH algorithms—PINNACLE (Philips Radiation Oncology Systems) and PlanIQ (Sun Nuclear Corp.)—were tested against analytical values using custom, noncommercial analysis software. In Test 1, axial contour spacing was constant at 0.2 mm while dose grid resolution varied. In Tests 2 and 3, the dose grid resolution was matched to varying subsampled axial contours with spacing of 1, 2, and 3 mm, and difference analysis and metrics were employed: (1) histograms of the accuracy of various DVH parameters (total volume, D{sub max}, D{sub min}, and doses to % volume: D99, D95, D5, D1, D0.03 cm{sup 3}) and (2) volume errors extracted along the DVH curves were generated and summarized in tabular and graphical forms. Results: In Test 1, PINNACLE produced 52 deviations (15%) while PlanIQ produced 5 (1.5%). In Test 2, PINNACLE and PlanIQ differed from analytical by >3% in 93 (36%) and 18 (7%) times, respectively. Excluding D{sub min} and D{sub max} as least clinically relevant would result in 32 (15%) vs 5 (2%) scored deviations for PINNACLE vs PlanIQ in Test 1, while Test 2 would yield 53 (25%) vs 17 (8%). In Test 3, statistical analyses of volume errors extracted continuously along the curves show PINNACLE to have more errors and higher variability (relative to PlanIQ), primarily due to PINNACLE’s lack of sufficient 3D grid supersampling. Another major driver for PINNACLE errors is an inconsistency in implementation of the “end-capping”; the additional volume resulting from expanding superior and inferior contours halfway to the next slice is included in the total volume calculation, but dose voxels in this expanded volume are excluded from the DVH. PlanIQ had fewer deviations, and most were associated with a rotated cylinder modeled by rectangular axial contours; for coarser axial spacing, the limited number of cross-sectional rectangles hinders the ability to render the true structure volume. Conclusions: The method is applicable to any DVH-calculating software capable of importing DICOM RT structure set and dose objects (the authors’ examples are available for download). It includes a collection of tests that probe the design of the DVH algorithm, measure its accuracy, and identify failure modes. Merits and applicability of each test are discussed.

60 APPLIED LIFE SCIENCES↗

Computational Fluid Dynamics Modeling to Simulate a Combined Reforming Process for Syngas and Hydrogen Production

An Oxygen Transport Membrane (OTM) combined reforming technology for producing syngas and hydrogen integrates the advantages of multiple processes—steam methane reforming (SMR), autothermal reforming (ATR), an air separation unit (ASU)—into a single integrated technology. The OTM consists of a primary reforming tube, in which desulfurized natural gas is partially reformed by steam at high pressure in the presence of a metal catalyst. This process is followed in series by a ceramic OTM with a secondary reformer, in which residual methane reforms and O 2 - ions react with a portion of the CO and H 2 fuel to provide the heat to support both primary and secondary reforming. Although the OTM combined reformer technology for syngas and H 2 production has been substantially developed in the last decade, several challenges that affect the overall production efficiency and reliability are yet to be fully understood, addressed, and resolved. Therefore, developing Computational Fluid Dynamics (CFD) models that incorporate fluid dynamics, mass transport, kinetics, heat transport, and structural mechanics is critical to understanding and minimizing the probability of tube failures during the startup and operation. In this report, an exhaustive literature review was performed to survey the current state of technology for producing syngas and H 2 using either conventional or renewable energy sources. The feedstocks reviewed include natural gas and coal for the conventional technologies, whereas biomass, solar, wind, and nuclear energy for the renewable technologies. The existing industry-grade COMSOL multiphysics models of OTM were upgraded for the latest software release. In addition, they were improved to help achieve grid and solver independence and were successfully ported on the ORNL high-performance computing clusters to speed up their run times. A 42% reduction in the simulation run time was achieved. A new higher-fidelity CFD model of an OTM tube was developed in the StarCCM+ simulation platform. This new model was designed to simulate various physics using first principles, e.g., turbulent flow, heat transfer, and chemical reactions while avoiding unnecessary simplifications. The resulting predictions were qualitatively assessed and provided useful insights into the multiphysics complexity of an OTM tube.

08 HYDROGEN↗

Software reliability - Measures and effects in flight critical digital avionics systems

The paper discusses software reliability as it applies particularly to design and evaluation of flight-critical digital avionics systems. Measures of software reliability, measurement methods and reliability (macro-) models are discussed. Recent work assessing their accuracy in predicting software errors in 'fly-by-wire' Newtonian applications is presented. Additional, detailed topics are discussed including software error distributions (e.g. catastrophic vs. noncatastrophic) and the effects of system growth/maturity on reliability improvement. In practical flight-critical digital applications, software reliability improvement is sought through use of parallel, redundant software (i.e. N-version programming) or backup software that can be invoked in the event of (primary) software failure. Achievable reliability levels are however highly sensitive to common-mode specification and programming errors. Recent data correlating these errors with net software reliability are discussed.

Dunn, William R.↗

Ground Operations Autonomous Control and Integrated Health Management

An intelligent autonomous control capability has been developed and is currently being validated in ground cryogenic fluid management operations. The capability embodies a physical architecture consistent with typical launch infrastructure and control systems, augmented by a higher level autonomous control (AC) system enabled to make knowledge-based decisions. The AC system is supported by an integrated system health management (ISHM) capability that detects anomalies, diagnoses causes, determines effects, and could predict future anomalies. AC is implemented using the concept of programmed sequences that could be considered to be building blocks of more generic mission plans. A sequence is a series of steps, and each executes actions once conditions for the step are met (e.g. desired temperatures or fluid state are achieved). For autonomous capability, conditions must consider also health management outcomes, as they will determine whether or not an action is executed, or how an action may be executed, or if an alternative action is executed instead. Aside from health, higher level objectives can also drive how a mission is carried out. The capability was developed using the G2 software environment (www.gensym.com) augmented by a NASA Toolkit that significantly shortens time to deployment. G2 is a commercial product to develop intelligent applications. It is fully object oriented. The core of the capability is a Domain Model of the system where all elements of the system are represented as objects (sensors, instruments, components, pipes, etc.). Reasoning and decision making can be done with all elements in the domain model. The toolkit also enables implementation of failure modes and effects analysis (FMEA), which are represented as root cause trees. FMEA's are programmed graphically, they are reusable, as they address generic FMEA referring to classes of subsystems or objects and their functional relationships. User interfaces for integrated awareness by operators have been created.

Figueroa, Fernando↗

Resilience Design Patterns - A Structured Approach to Resilience at Extreme Scale (version 1.2)

We developed a new structured approach to the management of HPC resilience using the concept of resilience-based design patterns. In general, a design pattern is a repeatable solution to a commonly occurring problem. We identified the well-known solutions that are commonly used to deal with faults, errors and failures in HPC systems. In the initial design patterns specification (version 1.0), we described the various solutions, which address specific problems in the design of resilient HPC environments, in the form of patterns. Each pattern describes a problem caused by a fault, error or failure event in an HPC environment, and then describes the core of the solution of the problem in such a way that this solution may be adapted to different systems and implemented at different layers of the system stack. The catalog of these resilience design patterns provides designers with a collection of design elements. To construct complete resilience solutions using combinations of various patterns, we defined a framework that enhances HPC designers’ understanding of the important constraints and the opportunities for the design patterns to be implemented and deployed at various layers of the system stack. The design framework is also useful for establishing interfaces and mechanisms to coordinate flexible fault management across hardware and software components, as well as to consider the trade-off between performance, resilience, and power consumption when constructing a solution. The resilience design patterns specification version 1.1 included more detailed explanations of the pattern solutions, the context in which the patterns are applicable, and the implications for hardware or software design. It also provided several additional examples and detailed case studies to demonstrate the use of patterns to build realistic solutions. In this version 1.2 of the specification document, we have improved the pattern descriptions, including graphical representations of the pattern components. These improvements are largely based on critical comments, feedback and suggestions received from pattern experts and readers of the previous versions of the specification. The pattern classification has been modified to further clarify the relationships between pattern categories. This version of the specification also introduces a pattern language for resilience design patterns. The pattern language presents the patterns in the catalog as a network, revealing the relations among the resilience patterns. The language provides designers with the means to explore alternative techniques for handling a specific fault model that may have different effciency and complexity characteristics. Using the pattern language also enables the design and implementation of comprehensive resilience solutions as a set of interconnected resilience patterns that can be instantiated across layers of the system stack. The overall goal of this work is to provide hardware and software designers, as well as the users and operators of HPC systems, a systematic methodology for the design and evaluation of resilience technologies in HPC systems that keep scientific applications running to a correct solution in a timely and cost-effcient manner despite frequent faults, errors, and failures of various types.

97 MATHEMATICS AND COMPUTING↗