Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “System safety”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Assuring Safety-Critical Machine Learning Enabled Systems: Challenges and Promise

Machine learning is increasingly being used in safety-critical systems, where the public safety requires a rigorous assurance process. We shall outline how assurance processes work for conventional systems and identify the primary difficulty in applying them to machine learning enabled systems. We will then outline a path forward including identifying where considerable basic research remains.

machine learning↗

Separation Assurance and Collision Avoidance

Objective SACA-1: Determine the level of safety provided by tactical separation assurance safety monitoring systems for UAS missions. a) Rationale: Continuous mission-risk monitoring can provide equivalent levels of safety for UAS operations possibly reducing the burden on other safety systems. b) Approach: Utilize and adapt algorithms and approaches developed for the NextGen Airspace Systems Program for UAS applications.

Lauderdale, Todd↗

Software Safety Analysis of a Flight Guidance System

This document summarizes the safety analysis performed on a Flight Guidance System (FGS) requirements model. In particular, the safety properties desired of the FGS model are identified and the presence of the safety properties in the model is formally verified. Chapter 1 provides an introduction to the entire project, while Chapter 2 gives a brief overview of the problem domain, the nature of accidents, model based development, and the four-variable model. Chapter 3 outlines the approach. Chapter 4 presents the results of the traditional safety analysis techniques and illustrates how the hazardous conditions associated with the system trace into specific safety properties. Chapter 5 presents the results of the formal methods analysis technique model checking that was used to verify the presence of the safety properties in the requirements model. Finally, Chapter 6 summarizes the main conclusions of the study, first and foremost that model checking is a very effective verification technique to use on discrete models with reasonable state spaces. Additional supporting details are provided in the appendices.

Butler, Ricky W.↗

Identification of Vehicle Health Assurance Related Trends

Trend analysis in aviation as related to vehicle health management (VHM) was performed by reviewing the most current statistical and prognostics data available from the National Transportation Safety Board (NTSB) accident, the Federal Aviation Administration (FAA) incident, and the NASA Aviation Safety Reporting System (ASRS) incident datasets. In addition, future directions in aviation technology related to VHM research areas were assessed through the Commercial Aviation Safety Team (CAST) Safety Enhancements Reserved for Future Implementations (SERFIs), the National Transportation Safety Board (NTSB) Most-Wanted List and recent open safety recommendations, the National Research Council (NRC) Decadal Survey of Civil Aeronautics, and the Future Aviation Safety Team (FAST) areas of change. Future research direction in the VHM research areas is evidently strong as seen from recent research solicitations from the Naval Air Systems Command (NAVAIR), and VHM-related technologies actively being developed by aviation industry leaders, including GE, Boeing, Airbus, and UTC Aerospace Systems. Given the highly complex VHM systems, modifications can be made in the future so that the Vehicle Systems Safety Technology Project (VSST) technical challenges address inadequate maintenance crew's trainings and skills, and the certification methods of such systems as recommended by the NTSB, NRC, and FAST areas of change.

Phojanamongkolkij, Nipa↗

Mass and Reliability System (MaRS)

The Safety and Mission Assurance (S&MA) Directorate is responsible for mitigating risk, providing system safety, and lowering risk for space programs from ground to space. The S&MA is divided into 4 divisions: The Space Exploration Division (NC), the International Space Station Division (NE), the Safety & Test Operations Division (NS), and the Quality and Flight Equipment Division (NT). The interns, myself and Arun Aruljothi, will be working with the Risk & Reliability Analysis Branch under the NC Division's. The mission of this division is to identify, characterize, diminish, and communicate risk by implementing an efficient and effective assurance model. The team utilizes Reliability and Maintainability (R&M) and Probabilistic Risk Assessment (PRA) to ensure decisions concerning risks are informed, vehicles are safe and reliable, and program/project requirements are realistic and realized. This project pertains to the Orion mission, so it is geared toward a long duration Human Space Flight Program(s). For space missions, payload is a critical concept; balancing what hardware can be replaced by components verse by Orbital Replacement Units (ORU) or subassemblies is key. For this effort a database was created that combines mass and reliability data, called Mass and Reliability System or MaRS. The U.S. International Space Station (ISS) components are used as reference parts in the MaRS database. Using ISS components as a platform is beneficial because of the historical context and the environment similarities to a space flight mission. MaRS uses a combination of systems: International Space Station PART for failure data, Vehicle Master Database (VMDB) for ORU & components, Maintenance & Analysis Data Set (MADS) for operation hours and other pertinent data, & Hardware History Retrieval System (HHRS) for unit weights. MaRS is populated using a Visual Basic Application. Once populated, the excel spreadsheet is comprised of information on ISS components including: operation hours, random/nonrandom failures, software/hardware failures, quantity, orbital replaceable units (ORU), date of placement, unit weight, frequency of part, etc. The motivation for creating such a database will be the development of a mass/reliability parametric model to estimate mass required for replacement parts. Once complete, engineers working on future space flight missions will have access a mean time to failures and on parts along with their mass, this will be used to make proper decisions for long duration space flight missions

Barnes, Sarah↗

From Lift-Off to Light-Off

Shuttle's propellant measurement system is produced by Simmonds Precision. Company has extensive experience in fuel management systems and other equipment for military and commercial aircraft. A separate corporate entity, Industrial Controls Division was formed due to a number of non-aerospace spinoffs. One example is a "custody transfer" system for measuring and monitoring liquefied natural gas (LNG). LNG is transported aboard large tankers at minus 260 degrees Fahrenheit. Value of a single shipload may reach $15 million. Precision's LNG measurement and monitoring system aids accurate financial accounting and enhances crew safety. Custody transfer systems have been provided for 10 LNG tankers, built by Owing Shipbuilding. Simmonds also provided measurement systems for several liquefied petroleum gas (LPG) production and storage installations. Another spinoff developed by Simmonds Precision is an advanced ignition system for industrial boilers that offers savings of millions of gallons of fuel, and a computer based monitoring and control system for improving safety and reliability in electrical utility applications. Simmonds produces a line of safety systems for nuclear and non-nuclear electrical power plants.

Source record↗

Development of a methodology for assessing the safety of embedded software systems

A Dynamic Flowgraph Methodology (DFM) based on an integrated approach to modeling and analyzing the behavior of software-driven embedded systems for assessing and verifying reliability and safety is discussed. DFM is based on an extension of the Logic Flowgraph Methodology to incorporate state transition models. System models which express the logic of the system in terms of causal relationships between physical variables and temporal characteristics of software modules are analyzed to determine how a certain state can be reached. This is done by developing timed fault trees which take the form of logical combinations of static trees relating the system parameters at different point in time. The resulting information concerning the hardware and software states can be used to eliminate unsafe execution paths and identify testing criteria for safety critical software functions.

Garrett, C. J.↗

Expanding Our Understanding of What Constitutes a Safety-Relevant Occurrence

Focusing on undesired operator behaviors is pervasive in system design and safety management cultures. This focus limits the data that are collected, the questions that are asked during data analysis, and therefore our understanding of what operators do in everyday work. Human performance represents a significant source of safety data that includes both desired and undesired actions. When safety is characterized only in terms of errors and failures, the vast majority of human impacts on system safety and performance are ignored. The outcomes of safety data analyses dictate what is learned from those data, which in turn informs safety policies and safety-related decision making. When learning opportunities are systematically restricted by focusing only on rare failure events, not only do we learn less (and less often), but we can draw misleading conclusions by relying on a non-representative sample of human performance data. The study of human contributions to safety represents a vast and largely unexplored opportunity to learn. Changes in how we define and think about safety can highlight new opportunities for collection and analysis of safety-relevant data. Developing an integrated safety picture to better inform system design, safety-related decision making and policies depends upon identifying, collecting, and interpreting safety producing behaviors in addition to safety reducing behaviors.

Jon B Holbrook↗

Adaptive Stress Testing: Finding Likely Failure Events with Reinforcement Learning

Finding the most likely path to a set of failure states is important to the analysis of safety-critical systems that operate over a sequence of time steps, such as aircraft collision avoidance systems and autonomous cars. In many applications such as autonomous driving, failures cannot be completely eliminated due to the complex stochastic environment in which the system operates.As a result, safety validation is not only concerned about whether a failure can occur, but also discovering which failures are most likely to occur. This article presents adaptive stress testing (AST), a framework for finding the most likely path to a failure event in simulation. We consider a general black box setting for partially observable and continuous-valued systems operating in an environment with stochastic disturbances. We formulate the problem as a Markov decision process and use reinforcement learning to optimize it. The approach is simulation-based and does not require internal knowledge of the system, making it suitable for black-box testing of large systems. We present different formulations depending on whether the state is fully observable or partially observable. In the latter case, we present a modified Monte Carlo tree search algorithm that only requires access to the pseudorandom number generator of the simulator to overcome partial observability. We also present an extension of the framework, called differential adaptive stress testing (DAST), that can find failures that occur in one system but not in another. This type of differential analysis is useful in applications such as regression testing, where we are concerned with finding areas of relative weakness compared to a baseline. We demonstrate the effectiveness of the approach on an aircraft collision avoidance application, where a prototype aircraft collision avoidance system is stress tested to find the most likely scenarios of near mid-air collision.

Verification and Validation↗

Safety management of a complex R&D ground operating system

Report discusses safety program implementation for large R&D operating system. Analytical techniques are defined and suggested as tools for identifying potential hazards and determining means to effectively control or eliminate hazards.

Connors, J.↗

Toxic substances registry system: Index of material safety data sheets

The Jul. 1992 Revision of the KSC Toxic Substances Registry System (TSRS) Index of Material Safety Data Sheets (MSDS's) is presented. The listed MSDS's reflect product inventories and associated MSDS's which were submitted to the Toxic Substance Registry Data Base maintained by the Base Operations Contractors of the Biomedical Operations and Research Office of KSC. The purpose of the index is to provide a means of accessing information on the hazards associated with the toxic and otherwise hazardous chemicals stored and used at KSC. Indices are provided for manufacturers, trademarks, and stock numbers.

Source record↗

Toxic substances registry system: Index of material safety data sheets

The Oct. 1992 Revision of the KSC Toxic Substances Registry System (TSRS) Index of Material Safety Data Sheets (MSDS's) is presented. The listed MSDS's reflect product inventories and associated MSDS's which were submitted to the Toxic Substance Registry Data Base maintained by the Base Operations Contractors of the Biomedical Operations and Research Office of KSC. The purpose of the index is to provide a means of accessing information on the hazards associated with the toxic and otherwise hazardous chemicals stored and used at KSC. Indices are provided for manufacturers, trademarks, and stock numbers.

Source record↗

Toxic substances registry system: Index of material safety data sheets

The Jan. 1993 Revision of the KSC Toxic Substances Registry System (TSRS) Index of Material Safety Data Sheets (MSDS's) is presented. The listed MSDS's reflect product inventories and associated MSDS's which were submitted to the Toxic Substance Registry Data Base maintained by the Base Operations Contractors of the Biomedical Operations and Research Office of KSC. The purpose of the index is to provide a means of accessing information on the hazards associated with the toxic and otherwise hazardous chemicals stored and used at KSC. Indices are provided for manufacturers, trademarks, and stock numbers.

Source record↗

A safety-based decision making architecture for autonomous systems

Engineering systems designed specifically for space applications often exhibit a high level of autonomy in the control and decision-making architecture. As the level of autonomy increases, more emphasis must be placed on assimilating the safety functions normally executed at the hardware level or by human supervisors into the control architecture of the system. The development of a decision-making structure which utilizes information on system safety is detailed. A quantitative measure of system safety, called the safety self-information, is defined. This measure is analogous to the reliability self-information defined by McInroy and Saridis, but includes weighting of task constraints to provide a measure of both reliability and cost. An example is presented in which the safety self-information is used as a decision criterion in a mobile robot controller. The safety self-information is shown to be consistent with the entropy-based Theory of Intelligent Machines defined by Saridis.

Musto, Joseph C.↗

Assessing the use of UAS-related terms in ASRS using Seed Topic Modeling

Context: The NASA Aviation Safety Reporting System (ASRS) is a voluntary confidential aviation safety reporting system. The ASRS receives reports from pilots, air traffic controllers, flight attendants and other involved in aviation operations. The reports are de-identified and coded by ASRS expert safety analysts. The de-identified reports are then disseminated to the aviation community in a number of ways including entry into an online database. Augmenting the discovery of topics of user interest in this online database would therefore be beneficial to the community it serves. Aim: We propose and execute an experiment to assess the use of seed term topic modeling using the database narratives to identify UAS reports. The use of seed term topic modeling would enable users to identify groups of related narratives associated to a topic of their interest. Method: We use a newly curated field in ASRS reports which identify UAS from non-UAS reports in combination of different set of UAS related terms to assess if seed topic modeling can be used in ASRS.

LDA↗