Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “safety evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Bond Line Thickness Estimation in Composite Structures Using Multiple Inspection Techniques

Imaging and other nondestructive evaluation techniques are commonly used for material characterization and defect recognition in safety critical aerospace applications, with data fusion providing the framework for uncertainty quantification in these contexts. Most commonly, forward physics-based modeling predicts the response conditioned on material properties and defect assumptions, and probabilistic methods are used to infer the hidden state of subject of the inspection from a combination of prior information, likelihoods, and inspection data. In this paper Bayesian methods are used to estimate bond thickness in lap joints comprised of aluminum adherends using a combination of infrared thermography, digital radiography, and ultrasound. The accuracy of the fused estimates are validated against data generated from synthetic specimens, and by comparison against high resolution X-ray computed tomography inspections of built specimens.

thermal nondestructive evaluation↗

Identifying Emerging Safety Threats Through Topic Modeling in the Aviation Safety Reporting System: A Covid-19 Study

The NASA Aviation Safety Reporting System (ASRS) is a voluntary, confidential aviation safety reporting system. The ASRS receives reports from pilots, air traffic controllers, flight attendants, and others involved in aviation operations. The reports are de-identified and coded by ASRS expert safety analysts, and a short descriptive synopsis is written to describe the safety issue. The de-identified reports are then disseminated to the aviation community in many ways, including via an online database, Safety Alert Bulletins, For Your Information Notices, and the CALLBACK newsletter. In this work, we consider whether we can improve the grouping, linking, and understanding of safety concerns through topic modeling. Specifically, we use topic modeling as a building block to identify emerging safety threats over time. This unsupervised approach, we argue, offers the flexibility to identify new emerging themes in this large dataset by constructing different timelines based on the content similarity of ASRS report narratives. This method's unsupervised nature improves upon related research, which is limited to pre-defined labels and therefore can not fully capture emerging safety threats. We apply our method to all ASRS reports in 2020 to assess if the generated timelines can highlight COVID-19 as it is emerging as a safety threat in incoming ASRS reports. We perform both a quantitative and qualitative evaluation of the automatically constructed timelines. The qualitative evaluation is performed by describing the evolution of top terms in the timelines, generated by our method, which we found explicitly convey the themes of COVID-19. Separately, we use a set of 1,213 COVID-19 reports from 2020 that were manually identified by ASRS analysts to quantitatively evaluate the COVID-19 reports distribution across the timelines. Our results have shown that COVID-19 emergence can be identified using the top terms that were generated by topic modeling. The top terms in topic modeling therefore can serve as a summary alternative to manually inspecting reports. Moreover, leveraging the manually identified COVID-19 reports, we found the manually identified timelines accounted for over 70% of the COVID-19 reports curated by the ASRS analysts, which demonstrates the potential of this approach for facilitating the understanding of safety concerns as they emerge and evolve. This method shows great potential to understand aerospace safety threats and other narrative- driven incident report databases.

ASRS↗

Identifying Emerging Safety Threats Through Topic Modeling in the Aviation Safety Reporting System: A COVID-19 Study

The NASA Aviation Safety Reporting System (ASRS) is a voluntary, confidential aviation safety reporting system. The ASRS receives reports from pilots, air traffic controllers, flight attendants, and others involved in aviation operations. The reports are de-identified and coded by ASRS expert safety analysts, and a short descriptive synopsis is written to describe the safety issue. The de-identified reports are then disseminated to the aviation community in many ways, including via an online database, Safety Alert Bulletins, For Your Information Notices, and the CALLBACK newsletter. In this work, we consider whether we can improve the grouping, linking, and understanding of safety concerns through topic modeling. Specifically, we use topic modeling as a building block to identify emerging safety threats over time. This unsupervised approach, we argue, offers the flexibility to identify new emerging themes in this large dataset by constructing different timelines based on the content similarity of ASRS report narratives. This method's unsupervised nature improves upon related research, which is limited to pre-defined labels and therefore can not fully capture emerging safety threats. We apply our method to all ASRS reports in 2020 to assess if the generated timelines can highlight COVID-19 as it is emerging as a safety threat in incoming ASRS reports. We perform both a quantitative and qualitative evaluation of the automatically constructed timelines. The qualitative evaluation is performed by describing the evolution of top terms in the timelines, generated by our method, which we found explicitly convey the themes of COVID-19. Separately, we use a set of 1,213 COVID-19 reports from 2020 that were manually identified by ASRS analysts to quantitatively evaluate the COVID-19 reports distribution across the timelines. Our results have shown that COVID-19 emergence can be identified using the top terms that were generated by topic modeling. The top terms in topic modeling therefore can serve as a summary alternative to manually inspecting reports. Moreover, leveraging the manually identified COVID-19 reports, we found the manually identified timelines accounted for over 70% of the COVID-19 reports curated by the ASRS analysts, which demonstrates the potential of this approach for facilitating the understanding of safety concerns as they emerge and evolve. This method shows great potential to understand aerospace safety threats and other narrative- driven incident report databases.

ASRS↗

Bond Line Thickness Estimation in Composite Structures Using Multiple Inspection Techniques

Imaging and other nondestructive evaluation techniques are commonly used for material characterization and defect recognition in safety critical aerospace applications, with data fusion providing the framework for uncertainty quantification in these contexts. Most commonly, forward physics-based modeling predicts the response conditioned on material properties and defect assumptions, and probabilistic methods are used to infer the hidden state of the subject of the inspection from a combination of prior information, likelihoods, and inspection data. In this paper Bayesian methods are used to estimate bond thickness in lap joints comprised of aluminum adherends using a combination of infrared thermography and ultrasound. The concept of the conflation of probability distributions is applied to combine the posterior distributions derived from thermography and ultrasound and the quality of the fused estimates are compared against the individual estimates against synthetic data that was created to mimic the inspection of a lap joint comprised of aluminum adherends.

thermal nondestructive evaluation↗

A safety margin and flight reference system and display for powered-lift aircraft

A study was conducted to explore the feasibility of a safety margin and flight reference system for those powered-lift aircraft which require a backside piloting technique. The main objective was to display multiple safety margin criteria as a single variable which could be tracked both manually and automatically and which could be monitored in order to derive safety margin status. The study involved a pilot-in-the-loop analysis of several system concepts and a simulator experiment to evaluate those concepts showing promise. A system was ultimately configured which yielded reasonable compromises in controllability, status information content, and the ability to regulate safety margins at some expense of the allowable low speed flight path envelope.

Heffley, R. K.↗

High Performance COPVs for In-Space Storage of High Pressure Cryogenic Fuels

Polymeric composite overwrapped pressure vessels (COPVs) provide an attractive material system to support developing commercial launch business and alternate fuel ventures. However to be able to design with these materials, the mechanical behavior of the materials must be understood with regards to processing, performance, damage tolerance, and environment. For the storage of cryogenic propellants, it is important to evaluate the materials performance and impact damage resistance at cryogenic temperatures in order to minimize weight and to ensure safety and reliability. As part of this study, material tests of candidate fiber and resin systems were used as the basis for the selection of the material combinations for evaluation in a COPV at cryogenic conditions. This comprehensive approach has also been expanded to address issues with impact damage tolerance and material degradation due to environmental factors. KEY WORDS: Cryogenic testing, evaluation and applications for pressure vessels, COPVs, tanks, or storage vessels.

Schneider, Judy↗

Supporting Hazard Analysis for Wildfire Response Using fmdtools and MIKA

The System Wide Safety (SWS) Safety Demonstrator (SD) Series drives development of an increasingly capable In-Time Aviation Safety Management System (IASMS) focusing on humanitarian applications, starting with wildfire response (SD-1). The goals of this report are to (1) provide an early hazard analysis and mitigation evaluation of wildfire response to support these efforts and (2) provide a demonstration of capabilities of the Fault Model Design Tools (fmdtools) and Manager for Intelligent Knowledge Access (MIKA) tools. fmdtools provides a modeling, simulation, and resiliency analysis framework in which a wildfire response model, the System Modeling and Analysis of Resiliency in Scalable Traffic Management for Emergency Response Operations (SMARt-STEReO), is built. MIKA is an intelligent knowledge manager with several capabilities, including assisting in hazard analysis by extracting and analyzing hazards from historical incident reports. The following topics are covered in the report: Understanding Wildfire Hazard Dynamics. We provide a description and simulated examples of how hazards occur in the SMARt-STEReO model of wildfire response and their effect on its outcome. This provides a common mental model and focuses the analysis presented in the remainder of the report. Wildfire Hazard Identification. MIKA identifies wildfire hazards from three relevant datasets: the ICS-209-PLUS, SAFECOM, and SAFENET. Hazards are manually organized into a taxonomy and MIKA analyzes each hazard’s effects, likelihood, severity, and risk. Evaluating Mitigation Strategies. The SMARt-STEReO wildfire response model built in fmdtools evaluates a subset of identified hazards. Specifically, we simulate the effect of communications faults and equipment faults on operator safety, the effect of changing winds and flammability, and a scenario with multiple ignition points and heavy smoke. Tool Limitations and Usage Considerations. We provide a discussion of appropriate tool use cases as well as limitations and considerations for usage. The tool findings are used to synthesize recommendations for wildfire response operations, which can be captured as part of an IASMS. Key recommendations are as follows: Hazards are identified from a broad spectrum of sources including aircraft subsystems, operational sources, and ground crew operations. Highest risk operational environment hazards identified are Evacuations. The highest risk manned aerial operations hazard categorized is Jumper Operations Mishap. Ground crew hazards that are highest risk are Burns, Cargo Operations Overhead, Dehydration, Entrapment, Falling Objects, Heart Attacks, Heat Exhaustion, Inadequate Training or Certification, Vehicle Breakdown, and Vehicle Collision. Modelled containment failures arise from a mismatch between the difficulty of the firefighting scenario and the capacity (e.g., speed, effectiveness, awareness) of the response. In firefighting scenarios where containment is possible (e.g., because the fire does not spread too quickly), these mismatches can occur because of a change in environmental conditions (e.g., wind, flammability, etc) or because of planning, equipment, or communications faults. Improvements to communications increase the capacity of the firefighting response by reducing the time needed to respond to the fire. While surveillance does not increase this capacity by itself, it increases operator safety by increasing state awareness, enabling firefighters to evade approaching fires. Increasing both has a synergistic effect. In general, these performance and resilience increases generalize over fault scenarios as well as unforeseen changes to circumstances (i.e., wind, aridity, etc.). However, these improvements need to be designed so as not to make the system prone to persistent large-scale communications outages, which can reduce performance.

Hazard analysis↗

Influence of Design Variations on Systems Performance

High-risk aerospace components have to meet very stringent quality, performance, and safety requirements. Any source of variation is a concern, as it may result in scrap or rework. poor performance, and potentially unsafe flying conditions. The sources of variation during product development, including design, manufacturing, and assembly, and during operation are shown. Sources of static and dynamic variation during development need to be detected accurately in order to prevent failure when the components are placed in operation. The Systems' Health and Safety (SHAS) research at the NASA Ames Research Center addresses the problem of detecting and evaluating the statistical variation in helicopter transmissions. In this work, we focus on the variations caused by design, manufacturing, and assembly of these components, prior to being placed in operation (DMV). In particular, we aim to understand and represent the failure and variation information, and their correlation to performance and safety and feed this information back into the development cycle at an early stage. The feedback of such critical information will assure the development of more reliable components with less rework and scrap. Variations during design and manufacturing are a common source of concern in the development and production of such components. Accounting for these variations, especially those that have the potential to affect performance, is accomplished in a variety ways, including Taguchi methods, FMEA, quality control, statistical process control, and variation risk management. In this work, we start with the assumption that any of these variations can be represented mathematically, and accounted for by using analytical tools incorporating these mathematical representations. In this paper, we concentrate on variations that are introduced during design. Variations introduced during manufacturing are investigated in parallel work.

Tumer, Irem Y.↗

Bibliography on contaminants and solubility of organic compounds in oxygen

A compilation of a number of document citations is presented which contains information on contaminants in oxygen. Topics covered include contaminants and solubility of organic compounds in oxygen, reaction characteristics of organic compounds with oxygen, and sampling and detection limits of impurities. Each citation in the data bank contains many items of information about the document. Some of the items are title, author, abstract, corporate source, description of figures pertinent to hazards or safety, key references, and descriptors (keywords) by which the document can be retrieved. Each citation includes an evaluation of the technical contents as to being good/excellent, acceptable, or poor. The descriptors used to define the contents of the documents and subsequently used in the computerized search operations were developed for the cryogenic fluid safety by experts in the cryogenics field.

Ordin, P. M.↗

Evaluation of Brazed Joints Using Failure Assessment Diagram

Fitness-for service approach was used to perform structural analysis of the brazed joints consisting of several base metal / filler metal combinations. Failure Assessment Diagrams (FADs) based on tensile and shear stress ratios were constructed and experimentally validated. It was shown that such FADs can provide a conservative estimate of safe combinations of stresses in the brazed joints. Based on this approach, Margins of Safety (MS) of the brazed joints subjected to multi-axial loading conditions can be evaluated..

Flom, Yury↗

A Dynamic Risk Model for Evaluation of Space Shuttle Abort Scenarios

The Space Shuttle is an advanced manned launch system with a respectable history of service and a demonstrated level of safety. Recent studies have shown that the Space Shuttle has a relatively low probability of having a failure that is instantaneously catastrophic during nominal flight as compared with many US and international launch systems. However, since the Space Shuttle is a manned. system, a number of mission abort contingencies exist to primarily ensure the safety of the crew during off-nominal situations and to attempt to maintain the integrity of the Orbiter. As the Space Shuttle ascends to orbit it transverses various intact abort regions evaluated and planned before the flight to ensure that the Space Shuttle Orbiter, along with its crew, may be returned intact either to the original launch site, a transoceanic landing site, or returned from a substandard orbit. An intact abort may be initiated due to a number of system failures but the highest likelihood and most challenging abort scenarios are initiated by a premature shutdown of a Space Shuttle Main Engine (SSME). The potential consequences of such a shutdown vary as a function of a number of mission parameters but all of them may be related to mission time for a specific mission profile. This paper focuses on the Dynamic Abort Risk Evaluation (DARE) model process, applications, and its capability to evaluate the risk of Loss Of Vehicle (LOV) due to the complex systems interactions that occur during Space Shuttle intact abort scenarios. In addition, the paper will examine which of the Space Shuttle subsystems are critical to ensuring a successful return of the Space Shuttle Orbiter and crew from such a situation.

Henderson, Edward M.↗

Evaluation of Synthetic Vision Display Concepts for Improved Awareness in Unusual Attitude Recovery Scenarios

A recent study conducted by the Commercial Aviation Safety Team (CAST) determined 40 percent of all fixed-wing fatal accidents, between 2001 and 2011, were caused by Loss-of-Control (LOC) in flight (National Transportation Safety Board, 2015). Based on their findings, CAST recommended manufacturers develop and implement virtual day-visual meteorological conditions (VMC) display systems, such as synthetic vision or equivalent systems (CAST, 2016). In a 2015 simulation study conducted at NASA Langley Research Center (LaRC), researchers gathered to test and evaluate virtual day-VMC displays under realistic flight operation scenarios capable of inducing reduced attention states in pilots. Each display concept was evaluated to determine its efficacy to improve attitude awareness. During the experiment, Evaluation Pilots (EPs) were shown the following three display concepts on the Primary Flight Display (PFD): Baseline, Synthetic Vision (SV) with color gradient, and SV with texture. The baseline configuration was a standard, conventional 'blue over brown' display. Experiment scenarios were simulated over water to evaluate Unusual Attitude (UA) recovery over 'featureless terrain' environments. Thus, the SV with color gradient configuration presented a 'blue over blue' display with a linear blue color progression, to differentiate attitude changes between sky and ocean. The SV with texture configuration presented a 'blue over blue' display with a black checkerboard texture atop a synthetic ocean. These displays were paired with a Background Attitude Indicator (BAI) concept. The BAI was presented across all four Head-Down Displays (HDDs), displaying a wide field-of-view blue-over-blue attitude indicator. The BAI aligned with the PFD and showed through the background of the navigation displays with opaque transparency. Each EP participated in a two-part experiment series with a total seventy-five trial runs: Part I included a set of twenty-five Unusual Attitude Recovery (UAR) scenarios; Part II included a set of fifty Attitude Memory Recall Tasks (AMRT). At the conclusion of each trial, EPs were asked to complete a set post-run questionnaires. Quantitative results showed that there were no significant statistical effects on UA recovery times when utilizing SV with or without the presence of a BAI. Qualitative results show the SV displays (color, texture) with BAI On are most preferred for both UA recognition and recovery when compared with the baseline display. When only comparing SV display concepts, EPs performed better when using the SV with texture, BAI On, than any other display configuration. This is an interesting find considering most EPs noted their preference towards the SV with color gradient when the BAI was on.

Nicholas, Stephanie↗

Tactical Separation and Safety Alerting System for Terminal Airspace

Provision of tactical alerts to aid air traffic controllers in providing separation assurance in terminal airspace is hindered by the complexity of the airspace, its operations, and flight procedures. A prototype automation system is studied that provides controllers with both separation and safety alerts based on or derived from the separation standard for terminal airspace. The system models flight trajectories heuristically, with use of merged intent information from readily available sources: area navigation departure procedures, flight-plan routes, and arrival nominal interior routes used in terminal automation systems. Flight vertical intent is modeled according to standard procedural restrictions except when superseded by controller-issued altitude clearances. Importantly, flight trajectories are modeled for all aircraft, including those conducting visual approaches. New safety-alert thresholds for aircraft conducting visual approaches are studied. Performance of the system is evaluated through fast-time playback of recorded air traffic data from high-fidelity Human-In-The-Loop simulations and real-world operations in two Terminal Radar Approach Control facilities. The prototype system is found to produce a false-alert rate of 8% for separation alerts. The number and validity of safety alerts are studied by comparing with the current Conflict Alert system, showing that the false alerts of Conflict Alert are at 85% and they are avoided in the prototype system.

Air Traffic Management↗

An Empirical Evaluation of Automated Theorem Provers in Software Certification

We describe a system for the automated certification of safety properties of NASA software. The system uses Hoare-style program verification technology to generate proof obligations which are then processed by an automated first-order theorem prover (ATP). We discuss the unique requirements this application places on the ATPs, focusing on automation, proof checking, and usability. For full automation, however, the obligations must be aggressively preprocessed and simplified, and we demonstrate how the individual simplification stages, which are implemented by rewriting, influence the ability of the ATPs to solve the proof tasks. Our results are based on 13 certification experiments that lead to more than 25,000 proof tasks which have each been attempted by Vampire, Spass, e-setheo, and Otter. The proofs found by Otter have been proof-checked by IVY.

Denney, Ewen↗

An Enhanced Model for Evaluating Failure Propagation in Launch Vehicle Engine Sections

An important component in the assessment of launch vehicle safety is the estimation of the likelihood of large-scale explosions given the existence of failures that manifest as a localized energy release. A failure propagation model is presented for simulating cascading failures of energetic components in proximity where the primary modes of energy transfer are fragments/shrapnel and blast overpressure. The model is an extension of the model developed by Mathias and Motiwala (2015) [1] with enhancements to include the effects of fragment ricochet, fragment drag, fragment ballistic limit equation thresholds, and blast impulse thresholds. A series of sensitivity studies were conducted for a generic launch vehicle engine section and results are presented that illustrate the effects of the model modifications.

Susie Go↗

An Enhanced Model for Evaluating Failure Propagation in Launch Vehicle Engine Sections

An important component in the assessment of launch vehicle safety is the estimation of the likelihood of large-scale explosions given the existence of failures that manifest as a localized energy release. A failure propagation model is presented for simulating cascading failures of energetic components in proximity where the primary modes of energy transfer are fragments/shrapnel and blast overpressure. The model is an extension of the model developed by Mathias and Motiwala (2015) [1] with enhancements to include the effects of fragment ricochet, fragment drag, fragment ballistic limit equation thresholds, and blast impulse thresholds. A series of sensitivity studies were conducted for a generic launch vehicle engine section and results are presented that illustrate the effects of the model modifications.

Susie Go↗

NASA Engineering and Safety Center Technical Bulletin No. 24-01: Material Compatibility of Common Aerospace Metals in MMH/MON-3

The NESC evaluated material compatibility of some common aerospace metals in monomethylhydrazine (MMH) and nitrogen tetroxide (MON-3). Previous work had identified a lack of quantitative compatibility data for nickel alloy 718, 300 series stainless steel, and titanium Ti-6Al-4V in MMH and MON-3 to support the use of zero-failure-tolerant, thin-walled pressure barriers in these propellants. Static (i.e., not flowing) general corrosion and electrochemistry testing was conducted, evaluating varied processing forms and heat treatment of the metals, water content of propellant, and exposure duration. Corrosion-rate data for all tested product forms, fluids, and durations were on the order of 1 x 10 –6 inch per year rather than the previously documented “less than 1 x 10 –3 inch per year”. The majority of the corrosion products were seen in the first 20 days of exposure, with an overall corrosion rate decreasing with time due to the increased divisor (time). It is therefore recommended that corrosion testing be performed at multiple short-term durations to inform the need for longer-duration testing.

Heather K Hickman↗