Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software and System Safety”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

The Legacy of Space Shuttle Flight Software

The initial goals of the Space Shuttle Program required that the avionics and software systems blaze new trails in advancing avionics system technology. Many of the requirements placed on avionics and software were accomplished for the first time on this program. Examples include comprehensive digital fly-by-wire technology, use of a digital databus for flight critical functions, fail operational/fail safe requirements, complex automated redundancy management, and the use of a high-order software language for flight software development. In order to meet the operational and safety goals of the program, the Space Shuttle software had to be extremely high quality, reliable, robust, reconfigurable and maintainable. To achieve this, the software development team evolved a software process focused on continuous process improvement and defect elimination that consistently produced highly predictable and top quality results, providing software managers the confidence needed to sign each Certificate of Flight Readiness (COFR). This process, which has been appraised at Capability Maturity Model (CMM)/Capability Maturity Model Integration (CMMI) Level 5, has resulted in one of the lowest software defect rates in the industry. This paper will present an overview of the evolution of the Primary Avionics Software System (PASS) project and processes over thirty years, an argument for strong statistical control of software processes with examples, an overview of the success story for identifying and driving out errors before flight, a case study of the few significant software issues and how they were either identified before flight or slipped through the process onto a flight vehicle, and identification of the valuable lessons learned over the life of the project.

Hickey, Christopher J.↗

Autonomy Verification & Validation Roadmap and Vision 2045

Advanced capabilities planned for the next generation of autonomous and increasingly autonomous air vehicles will include non-traditional components based on artificial intelligence, machine learning, and complex optimization and planning algorithms. These complex components will be used to provide enhanced safety and high-level decision-making functions. However, there are serious barriers to the deployment of autonomous aircraft in the National Airspace System (NAS). Current civil aviation certification processes are based on the concept that the correct behavior of a system or a component must be completely specified and verified prior to operation. This report from the Autonomy Verification and Validation (V&V) Roadmap and Vision 2045 project presents the most recent effort to build a comprehensive list of verification challenges and needs for autonomous aircraft, a roadmap to meet those autonomy V&V needs, the services they can enable, and point to the certification gaps they fill. To accomplish these goals, we assembled a team of world-class researchers from the aerospace industry (Boeing, Collins Aerospace, and GeneralElectric) and academia (University of Michigan, University of Texas, and Massachusetts Institute of Technology) with deep expertise in autonomy, aerospace systems, and assurance of Artificial Intelligence/machine learning systems.

Software Assurance↗

Automatic Generation of Chemical Mechanisms for Electrochemical Systems: Solid Electrolyte Interphase Formation in Lithium Batteries

Electrolytes in many lithium ion batteries decompose at the low potentials near the anode. The decomposition products form a layer termed the solid electrolyte interphase (SEI). The composition and growth of the SEI layer significantly affect both the capacity fade and safety of lithium ion batteries. However, SEI formation and growth kinetics are not well understood. In this work, we present an extension of the Reaction Mechanism Generator (RMG) software to automatically generate mechanisms for SEI formation. We extend RMG’s solvation correction framework to account for kinetic solvent effects and demonstrate the accuracy of our technique. We calculate thermochemical parameters for 252 species and rate coefficients for 69 reactions, most with associated solvation corrections. This and additional quantum chemistry data are used to extend RMG’s thermodynamic group additivity and solute parameter estimation schemes to handle lithiated species and add 14 new reaction families to RMG. RMG is additionally extended to simulate electrocatalytic systems. Lastly, we demonstrate RMG on the decomposition of acetonitrile and ethylene carbonate near a battery anode. Furthermore, while this framework does not yet resolve individual ions, as appropriate thermochemistry estimators are not available, and thus, cannot yet resolve more complex electrochemical pathways, RMG is able to generate reasonable pathways for SEI formation that match literature pathways and products. In particular, RMG identifies a new important reaction pathway that is not present in literature.

Chemical reactions↗

Nuclear Safety [Vol. 35, No. 1, January-June 1994]

Nuclear Safety is a review journal that covers significant developments in the field of nuclear safety. Its scope includes the analysis and control of hazards associated with nuclear energy, operations involving fissionable materials, and the products of nuclear fission and their effects on the environment. Primary emphasis is on safety in reactor design, construction, and operation; however, the safety aspects of the entire fuel cycle, including fuel fabrication, spent-fuel processing, nuclear waste disposal, handling of radioisotopes, and environmental effects of these operations, are also treated. Table of Contents for this issue follows. THE CHERNOBYL ACCIDENT: 1 Chernobyl Accident Management Actions, A. R Sich; GENERAL SAFETY CONSIDERATIONS: 25 The IAEA-ASSET Approach to Avoiding Accidents is to Recognize the Precursors to Prevent Incidents, F. Reisch; ACCIDENT ANALYSIS: 36 A Review of the Available Information on the Triggering Stage of a Steam Explosion, D. F. Fletcher; 58 Analysis and Modeling of Flow-Blockage-Induced Steam Explosion Events in the High-Flux Isotope Reactor, R. P. Taleyarkhan, V. Georgevich, C. W. Nestor, U. Gat, B. L. Lepard, D. H. Cook, J. Freels, S. J. Chang, C. Luttrell, R. C. Gwaltney, and J. Kirkpatrick; 74 An Analysis of Disassembling the Radial Reflector of a Thermionic Space Nuclear Reactor Power System, M. S. El-Genk and D. V. Paramonov; CONTROL AND INSTRUMENTATION: 86 Standards for High-Integrity Software, D. R. Wallace, D. R. Kuhn, L M. Ippolito, and L. Beltracchi; DESIGN FEATURES: 98 Adoption of New Design Features for the Next Generation Nuclear Power Reactors, L. S. Tong; 114 Review of Nuclear Piping Seismic Design Requirements, G. C. Slagis and S. E. Moore; ENVIRONMENTAL EFFECTS: 128 PC-Based Probabilistic Safety Assessment Study for a Geological Waste Repository Placed in a Bedded Salt Formation, S. A. Khan; OPERATING EXPERIENCES: 142 Managing Aging in Nuclear Power Plants: Insights from NRC’s Maintenance Team Inspection Reports, A. Fresco and M. Subudhi; 150 Reactor Shutdown Experience, Compiled by J. W. Cletcher; 153 Selected Safety-Related Events, Compiled by G. A. Murphy; RECENT DEVELOPMENTS: 158 Reports, Standards, and Safety Guides, D. S. Queener; 168 Proposed Rule Changes as of Dec. 31, 1993; ANNOUNCEMENTS: 177 Symposium on Radioactive and Mixed Waste—Risk as a Basis for Waste Classification; 177 1995 Incineration Conference 178 Ninth Power Plant Dynamics Control and Testing Symposium; 174 The Authors

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Hierarchical specification of the SIFT fault tolerant flight control system

The specification and mechanical verification of the Software Implemented Fault Tolerance (SIFT) flight control system is described. The methodology employed in the verification effort is discussed, and a description of the hierarchical models of the SIFT system is given. To meet the objective of NASA for the reliability of safety critical flight control systems, the SIFT computer must achieve a reliability well beyond the levels at which reliability can be actually measured. The methodology employed to demonstrate rigorously that the SIFT computer meets as reliability requirements is described. The hierarchy of design specifications from very abstract descriptions of system function down to the actual implementation is explained. The most abstract design specifications can be used to verify that the system functions correctly and with the desired reliability since almost all details of the realization were abstracted out. A succession of lower level models refine these specifications to the level of the actual implementation, and can be used to demonstrate that the implementation has the properties claimed of the abstract design specifications.

Melliar-Smith, P. M.↗

Mission and Safety Critical (MASC) plans for the MASC Kernel simulation

This report discusses a prototype for Mission and Safety Critical (MASC) kernel simulation which explains the intended approach and how the simulation will be used. Smalltalk is chosen for the simulation because of usefulness in quickly building working models of the systems and its object-oriented approach to software. A scenario is also introduced to give details about how the simulation works. The eventual system will be a fully object-oriented one implemented in Ada via Dragoon. To implement the simulation, a scenario using elements typical of those in the Space Station, was created.

Source record↗

The Soil Moisture Acttive Passive Mission: Fault Protection Performance and Lessons Learned

Fault protection as a discipline involves a collection of flight software logic and operational processes for detecting unacceptable anomalous behavior, responding prior to reaching criticality, restricting the propagation of a failure beyond a fault containment region, and recovering the vehicle back to full or degraded functionality if possible. The System Fault Protection (SFP) design for the SMAP Earth orbiter was put to the test during its 90-day vehicle commissioning activities. During this time, the SFP software autonomously protected the vehicle from multiple faults to critical hardware, and the operations team successfully returned the observatory to its science state. The SFP also performed well in the presence of anomalous behavior below true safety limits by not taking unnecessary response actions, instead allowing the operations team time to monitor the behavior. Certain aspects of the SFP design were modified during operations via both parameter updates and a full flight software update in order to better match the vehicle behavior in the flight environment. An evaluation of the SMAP SFP performance during vehicle Commissioning will be provided in this paper, as well as a set of lessons learned largely focused on visibility, SFP mutability in operations, responses to peripheral device faults, and Safe Mode recovery and design. By capturing some of the knowledge gained during SMAP Commissioning, it is intended that this paper provide guidance for making future System Fault Protection designs more robust and supportive of operations.

Clark, Jessica↗

Dynamic Positioning System (DPS) Risk Analysis Using Probabilistic Risk Assessment (PRA)

The National Aeronautics and Space Administration (NASA) Safety & Mission Assurance (S&MA) directorate at the Johnson Space Center (JSC) has applied its knowledge and experience with Probabilistic Risk Assessment (PRA) to projects in industries ranging from spacecraft to nuclear power plants. PRA is a comprehensive and structured process for analyzing risk in complex engineered systems and/or processes. The PRA process enables the user to identify potential risk contributors such as, hardware and software failure, human error, and external events. Recent developments in the oil and gas industry have presented opportunities for NASA to lend their PRA expertise to both ongoing and developmental projects within the industry. This paper provides an overview of the PRA process and demonstrates how this process was applied in estimating the probability that a Mobile Offshore Drilling Unit (MODU) operating in the Gulf of Mexico and equipped with a generically configured Dynamic Positioning System (DPS) loses location and needs to initiate an emergency disconnect. The PRA described in this paper is intended to be generic such that the vessel meets the general requirements of an International Maritime Organization (IMO) Maritime Safety Committee (MSC)/Circ. 645 Class 3 dynamically positioned vessel. The results of this analysis are not intended to be applied to any specific drilling vessel, although provisions were made to allow the analysis to be configured to a specific vessel if required.

Thigpen, Eric B.↗

Dynamic Positioning System (DPS) Risk Analysis Using Probabilistic Risk Assessment (PRA)

The National Aeronautics and Space Administration (NASA) Safety & Mission Assurance (S&MA) directorate at the Johnson Space Center (JSC) has applied its knowledge and experience with Probabilistic Risk Assessment (PRA) to projects in industries ranging from spacecraft to nuclear power plants. PRA is a comprehensive and structured process for analyzing risk in complex engineered systems and/or processes. The PRA process enables the user to identify potential risk contributors such as, hardware and software failure, human error, and external events. Recent developments in the oil and gas industry have presented opportunities for NASA to lend their PRA expertise to both ongoing and developmental projects within the industry. This paper provides an overview of the PRA process and demonstrates how this process was applied in estimating the probability that a Mobile Offshore Drilling Unit (MODU) operating in the Gulf of Mexico and equipped with a generically configured Dynamic Positioning System (DPS) loses location and needs to initiate an emergency disconnect. The PRA described in this paper is intended to be generic such that the vessel meets the general requirements of an International Maritime Organization (IMO) Maritime Safety Committee (MSC)/Circ. 645 Class 3 dynamically positioned vessel. The results of this analysis are not intended to be applied to any specific drilling vessel, although provisions were made to allow the analysis to be configured to a specific vessel if required.

Thigpen, Eric B.↗

Nuclear Safety [Vol. 35, No. 1, January-June 1994]

Nuclear Safety is a review journal that covers significant developments in the field of nuclear safety. Its scope includes the analysis and control of hazards associated with nuclear energy, operations involving fissionable materials, and the products of nuclear fission and their effects on the environment. Primary emphasis is on safety in reactor design, construction, and operation; however, the safety aspects of the entire fuel cycle, including fuel fabrication, spent-fuel processing, nuclear waste disposal, handling of radioisotopes, and environmental effects of these operations, are also treated. Table of Contents for this issue follows. GENERAL SAFETY CONSIDERATIONS: THE CHERNOBYL ACCIDENT: 1 Chernobyl Accident Management Actions, A. R Sich 25 The IAEA-ASSET Approach to Avoiding Accidents is to Recognize the Precursors to Prevent Incidents, F. Reisch; ACCIDENT ANALYSIS: 36 A Review of the Available Information on the Triggering Stage of a Steam Explosion, D. F. Fletcher; 58 Analysis and Modeling of Flow-Blockage-Induced Steam Explosion Events in the High-Flux Isotope Reactor, R. P. Taleyarkhan, V. Georgevich, C. W. Nestor, U. Gat, B. L. Lepard, D. H. Cook, J. Freels, S. J. Chang, C. Luttrell, R. C. Gwaltney, and J. Kirkpatrick; 74 An Analysis of Disassembling the Radial Reflector of a Thermionic Space Nuclear Reactor Power System, M. S. El-Genk and D. V. Paramonov; CONTROL AND INSTRUMENTATION: 86 Standards for High-Integrity Software, D. R. Wallace, D. R. Kuhn, L M. Ippolito, and L. Beltracchi; DESIGN FEATURES: 98 Adoption of New Design Features for the Next Generation Nuclear Power Reactors, L. S. Tong; 114 Review of Nuclear Piping Seismic Design Requirements, G. C. Slagis and S. E. Moore; ENVIRONMENTAL EFFECTS: 128 PC-Based Probabilistic Safety Assessment Study for a Geological Waste Repository Placed in a Bedded Salt Formation, S. A. Khan; OPERATING EXPERIENCES: 142 Managing Aging in Nuclear Power Plants: Insights from NRC’s Maintenance Team Inspection Reports, A. Fresco and M. Subudhi; 150 Reactor Shutdown Experience, Compiled by J. W. Cletcher; 153 Selected Safety-Related Events, Compiled by G. A. Murphy; RECENT DEVELOPMENTS: 158 Reports, Standards, and Safety Guides, D. S. Queener; 168 Proposed Rule Changes as of Dec. 31, 1993; ANNOUNCEMENTS: 177 Symposium on Radioactive and Mixed Waste—Risk as a Basis for Waste Classification; 177 1995 Incineration Conference 178 Ninth Power Plant Dynamics Control and Testing Symposium; 174 The Authors

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Analyzing and Predicting Effort Associated with Finding and Fixing Software Faults

Context: Software developers spend a significant amount of time fixing faults. However, not many papers have addressed the actual effort needed to fix software faults. Objective: The objective of this paper is twofold: (1) analysis of the effort needed to fix software faults and how it was affected by several factors and (2) prediction of the level of fix implementation effort based on the information provided in software change requests. Method: The work is based on data related to 1200 failures, extracted from the change tracking system of a large NASA mission. The analysis includes descriptive and inferential statistics. Predictions are made using three supervised machine learning algorithms and three sampling techniques aimed at addressing the imbalanced data problem. Results: Our results show that (1) 83% of the total fix implementation effort was associated with only 20% of failures. (2) Both safety critical failures and post-release failures required three times more effort to fix compared to non-critical and pre-release counterparts, respectively. (3) Failures with fixes spread across multiple components or across multiple types of software artifacts required more effort. The spread across artifacts was more costly than spread across components. (4) Surprisingly, some types of faults associated with later life-cycle activities did not require significant effort. (5) The level of fix implementation effort was predicted with 73% overall accuracy using the original, imbalanced data. Using oversampling techniques improved the overall accuracy up to 77%. More importantly, oversampling significantly improved the prediction of the high level effort, from 31% to around 85%. Conclusions: This paper shows the importance of tying software failures to changes made to fix all associated faults, in one or more software components and/or in one or more software artifacts, and the benefit of studying how the spread of faults and other factors affect the fix implementation effort.

software fix implementation effort↗

Large-scale Hydrogen Storage Risk Assessment

This project investigated risks involved in deploying a large-scale hydrogen storage system at the Port of Seattle (hereafter, the Port) for its on-terminal and maritime applications in an urban industrial setting. Alongside, the project attempted to address some of the barriers to risk assessment such as need for an exact system design for a systematic investigation, direct access to surrounding communities to gauge their perceptions, and an integrated software required to undertake a full-fledged risk assessment. These barriers were overcome using illustrative reference station designs, engaging with community-facing agencies through Port support, and pooling national laboratory capabilities available for risk assessments. The project identified relevant public safety risk metrics, compared various hydrogen carriers, engaged with community-facing agencies, and explored potential gaps in existing safety codes and standards. The primary impacts of this project include the development of risk assessment guidance for ports and utilities, informing them of the trade-offs in the choice of hydrogen carriers, and the ability to increase public capacity for dialog and engagement. This paves the way toward decarbonization of the Port activities, bringing about awareness around jobs in the market for risk assessments, and the need to ramp up community engagement long before any hydrogen system deployment is undertaken.

08 HYDROGEN↗

Safety Assessment of a Machine Learning-Based Aircraft Emergency Braking System: A Case Study

Machine Learning (ML) is revolutionizing many technological fields, but its use in aviation remains restricted due to stringent certification requirements. Efforts by the aviation community to establish standards for certifying ML-based systems are progressing, yet challenges persist, particularly with safety assessment methods for ML-based systems. This research addresses these challenges through a case study of an autonomous emergency braking system utilizing a computer vision deep neural network (DNN). We demonstrate a safety assessment process tailored to ML-specific concerns, such as low integrity and performance variability in quantitative safety analysis. This study can serve as an illustrative example to facilitate the discussion and convergence on certification aspects for ML-based systems within the aviation community.

Safety certification↗

Proceedings of the Twenty-Third Annual Software Engineering Workshop

The Twenty-third Annual Software Engineering Workshop (SEW) provided 20 presentations designed to further the goals of the Software Engineering Laboratory (SEL) of the NASA-GSFC. The presentations were selected on their creativity. The sessions which were held on 2-3 of December 1998, centered on the SEL, Experimentation, Inspections, Fault Prediction, Verification and Validation, and Embedded Systems and Safety-Critical Systems.

Source record↗

Runway Safety Monitor Algorithm for Single and Crossing Runway Incursion Detection and Alerting

The Runway Safety Monitor (RSM) is an aircraft based algorithm for runway incursion detection and alerting that was developed in support of NASA's Runway Incursion Prevention System (RIPS) research conducted under the NASA Aviation Safety and Security Program's Synthetic Vision System project. The RSM algorithm provides warnings of runway incursions in sufficient time for pilots to take evasive action and avoid accidents during landings, takeoffs or when taxiing on the runway. The report documents the RSM software and describes in detail how RSM performs runway incursion detection and alerting functions for NASA RIPS. The report also describes the RIPS flight tests conducted at the Reno/Tahoe International Airport (RNO) and the Wallops Flight Facility (WAL) during July and August of 2004, and the RSM performance results and lessons learned from those flight tests.

Green, David F., Jr.↗

Development and Overview of CPAS Sasquatch Airdrop Landing Location Predictor Software

The Capsule Parachute Assembly System (CPAS) is the parachute system for NASA's Orion spacecraft. CPAS is currently in the Engineering Development Unit (EDU) phase of testing. The test program consists of numerous drop tests, wherein a test article rigged with parachutes is extracted from an aircraft. During such tests, range safety is paramount, as is the recoverability of the parachutes and test article. It is crucial to establish a release point from the aircraft that will ensure that the article and all items released from it during flight will land in a designated safe area. The Sasquatch footprint tool was developed to determine this safe release point and to predict the probable landing locations (footprints) of the payload and all released objects. In 2012, a new version of Sasquatch, called Sasquatch Polygons, was developed that significantly upgraded the capabilities of the footprint tool. Key improvements were an increase in the accuracy of the predictions, and the addition of an interface with the Debris Tool (DT), an in-flight debris avoidance tool for use on the test observation helicopter. Additional enhancements include improved data presentation for communication with test personnel and a streamlined code structure. This paper discusses the development, validation, and performance of Sasquatch Polygons, as well as its differences from the original Sasquatch footprint tool.

Bledsoe, Kristin J.↗

Perseverance Rover Collision Model for a range of Autonomous Behaviors

The NASA Mars 2020 Perseverance rover landed in Jezero crater on Mars on 18 February 2021. It is a science mission to collect and cache sample cores for possible return to Earth in the future. Robot collision modeling is traditionally used in robotics for hardware safety for manipulation and sampling. The Mars 2020 Rover Collision Model (RCM) optimizes and extends collision checking in innovative ways to provide a range of onboard autonomous capability on a computationally constrained system. It provides an example of the benefit of systems and operations cognizant software design and development of autonomous systems.

Klein, Douglas↗

Detection of Anomalous Events in Electronic Health Records

Over the past decade, Health Information Technology (Health IT) has enabled an explosion in the amount of digital information stored in electronic health records (EHRs). According to recent studies, safety-related issues in healthcare can present themselves as anomalies in EHR data. Motivating examples of anomalous events in EHRs include clinical events related to invalid order cancellations or rejections, which may be initiated by clinical staff or automatic software routines in Health IT systems. Such events may be detected using anomaly detection or change point detection methods. In this paper, we explore the use of a forecasting approach to detect anomalies in EHR data using an online Support Vector Regression technique. Specifically, the proposed approach uses temporal frequency of activities in EHRs, coupled with dynamic robust confidence intervals, to characterize events as normal or anomalous. Once an event is characterized as an anomaly, our approach suppresses its effects in subsequent time intervals. The proposed approach shows encouraging results using real-world EHR data from the Veterans Affairs' corporate data warehouse

Pellett, Jordan J.↗