Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “safety testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

Experimental Study of Supercooled Large Droplet Impingement Effects

Typically, ice accretion results from small supercooled droplets (droplets cooled below freezing), usually 5 to 50 microns in diameter, which can freeze upon impact with an aircraft surface. Recently, ice accretions resulting from supercooled large droplet (SLD) conditions have become a safety concern. Current ice accretion codes have been extensively tested for Title 14 Code of Federal Regulations Part 25, Appendix C icing conditions but have not been validated for SLD icing conditions. This report presents experimental methods for investigating large droplet impingement dynamics and for obtaining small and large water droplet impingement data.

ICE ACCRETION CODE↗
NASA NTRSDate not supplied

Novel Microgreen Crop Testing for Space

Long-duration missions beyond low-Earth orbit will encounter challenges in maintaining adequate nutrition and crew acceptability in the food system. In situ production of fresh produce can supplement nutrient deficiencies in the prepackaged diet. Currently, there are a relatively small number of crops that can be reliably grown in space for space crop production efforts. An intriguing area of new investigation involves novel types of microgreens that have the potential to be sources of calories, fat, carbohydrates, and protein. These sources of nutrition are not obtainable in significant quantities with current pick and eat crops. Many microgreen cultivars are also sources of nutrients of interest, such as Vitamins B1, C, and K, and elements such as potassium. Microgreens should be selected to address specific nutritional deficits, as identified by NASA’s Human Research Program, with an emphasis on having a diversity of crops to meet nutritional requirements and crew acceptability. To achieve this, the concept of Crop Readiness Level (CRL) has been developed to gauge readiness of crops for spaceflight applications. CRL includes assessing environmental compatibility, food safety considerations, relevant nutritional analysis, and sensory analysis. Recent testing at Kennedy Space Center has focused on advancing the CRL of a variety of novel microgreens. These varieties were grown under 150 µmol m -2 s -1 PPFD from LED lights, 3000 ppm CO 2 , and 23°C to simulate an ISS environment. Crops were harvested and yield was assessed. Then, baseline microbiological and nutritional analysis (Vitamins B1, C, K; mineral analysis; proximate analysis) and sensory evaluation were performed. These baseline data are essential to selecting candidate crops for future missions and assessing crop production hardware and changes in environmental conditions on future crop performance and nutritional quality.

nutrition↗
NASA NTRS1999

System Identification for Integrated Aircraft Development and Flight Testing [l'Identification Des Systemes Pour le Developpement Integre des Aeronefs et les Essais en Vol]

Over the last decades flight vehicles such as aircraft and helicopters entering service and requiring increased operational effectiveness have with few exceptions experienced prolonged flight test development to achieve full certification. In many cases the original requirements had later to be reduced to enable release to service. The impact on the customer, and manufacturer has been considerable leading to increased costs and or reduced operational capabilities. These costly experiences are largely a result of the flight vehicle not behaving as modelled and designed. The evaluation of flight test data can be used as a tool for validating windtunnel results and mathematical models describing the flight dynamical behaviour. In this sense the uncertainty of important aerodynamic stability and control parameters can be reduced and the confidence of aircraft mathematical models improved. An additional important factor comes from the implementation of active control systems offering the promise of significantly increased flight vehicle performance and operational capability. This approach extends the traditional trade-offs between aerodynamics, structures and propulsion systems to include full- time, full-authority fly-by-wire/light systems. It is imperative that the aerodynamic stability and control parameters of such integrated flight and propulsion control systems have to turn out inflight as predicted, since inherent stability margins will be lower and the flight control system must correct these deficiencies to provide flight critical redundancy and safety. With the methodology of system identification from flight tests it is possible to sense the control inputs and the flight vehicle reactions Such as accelerations, rates and attitudes. The mathematical model, e.g. the model structure and parameters, has to be determined from the relationship of the measured control inputs and the system's responses. The aim of this symposium was to review the present state of the art of flight vehicle system and parameter identification techniques, and to provide a critical appraisal of current methods developed and applied to flight test data in a number of NATO nations. Particular emphasis was placed on practical aspects and lessons learned in order to generate information useful to the flight test community in industry and government agencies. The technical papers share invaluable experience and emphasize the advances of flight vehicle system identification over the last years to the point where confidence and robustness level is now reasonably high. The symposium covered overviews of identification methodologies, flight test techniques, recent aircraft and helicopter application programs, and a session of short papers covering up-to-the-minute flight test results. A final discussion included prepared comments from experts and concluded with key issues learned in the application of system identification and future research needs. The essential benefits to NATO nations can be condensed as follows: More accurate mathematical models for high bandwidth flight control systems, Improved assessment and evaluation of flying qualities, High fidelity mathematical models for flight vehicle development and mission training simulators, and generally, Reduced flight test time and costs.

Advisory Group for Aerospace Research and Developm↗
NASA NTRS1993

Software reliability through fault-avoidance and fault-tolerance

Strategies and tools for the testing, risk assessment and risk control of dependable software-based systems were developed. Part of this project consists of studies to enable the transfer of technology to industry, for example the risk management techniques for safety-concious systems. Theoretical investigations of Boolean and Relational Operator (BRO) testing strategy were conducted for condition-based testing. The Basic Graph Generation and Analysis tool (BGG) was extended to fully incorporate several variants of the BRO metric. Single- and multi-phase risk, coverage and time-based models are being developed to provide additional theoretical and empirical basis for estimation of the reliability and availability of large, highly dependable software. A model for software process and risk management was developed. The use of cause-effect graphing for software specification and validation was investigated. Lastly, advanced software fault-tolerance models were studied to provide alternatives and improvements in situations where simple software fault-tolerance strategies break down.

Vouk, Mladen A.↗
NASA NTRS2012

Subscale Flight Testing for Aircraft Loss of Control: Accomplishments and Future Directions

Subscale flight-testing provides a means to validate both dynamic models and mitigation technologies in the high-risk flight conditions associated with aircraft loss of control. The Airborne Subscale Transport Aircraft Research (AirSTAR) facility was designed to be a flexible and efficient research facility to address this type of flight-testing. Over the last several years (2009-2011) it has been used to perform 58 research flights with an unmanned, remotely-piloted, dynamically-scaled airplane. This paper will present an overview of the facility and its architecture and summarize the experimental data collected. All flights to date have been conducted within visual range of a safety observer. Current plans for the facility include expanding the test volume to altitudes and distances well beyond visual range. The architecture and instrumentation changes associated with this upgrade will also be presented.

Cox, David E.↗
NASA NTRS2000

Physiological response of rats to delivery of helium and xenon: implications for hyperpolarized noble gas imaging

The physiological effects of various hyperpolarized helium and xenon MRI-compatible breathing protocols were investigated in 17 Sprague-Dawley rats, by continuous monitoring of blood oxygen saturation, heart rate, EKG, temperature and endotracheal pressure. The protocols included alternating breaths of pure noble gas and oxygen, continuous breaths of pure noble gas, breath-holds of pure noble gas for varying durations, and helium breath-holds preceded by two helium rinses. Alternate-breath protocols up to 128 breaths caused a decrease in oxygen saturation level of less than 5% for either helium or xenon, whereas 16 continuous-breaths caused a 31.5% +/- 2.3% decrease in oxygen saturation for helium and a 30.7% +/- 1. 3% decrease for xenon. Breath-hold protocols up to 25 s did not cause the oxygen saturation to fall below 90% for either of the noble gases. Oxygen saturation values below 90% are considered pathological. At 30 s of breath-hold, the blood oxygen saturation dropped precipitously to 82% +/- 0.6% for helium, and to 76.5% +/- 7. 4% for xenon. Breath-holds longer than 10 s preceded by pre-rinses caused oxygen saturation to drop below 90%. These findings demonstrate the need for standardized noble gas inhalation procedures that have been carefully tested, and for continuous physiological monitoring to ensure the safety of the subject. We find short breath-hold and alternate-breath protocols to be safe procedures for use in hyperpolarized noble gas MRI experiments. Copyright 2000 John Wiley & Sons, Ltd.

NASA Discipline Life Sciences Technologies↗
NASA NTRS2000

Manufacturing and NDE of Large Composite Structures for Space Transportation at MSFC

This paper presents the Marshall Space Flight Center's (MSFC's) vision to manufacture, increase safety and reduce the cost of launch vehicles. Nondestructive evaluations of large composite structures are tested for space transportation at MSFC. The topics include: 1) 6 1/2 Generations of Airplanes in a Century; 2) Shuttle Safety Upgrades; 3) Generations of Reusable Launch Vehicles; 4) RLV Technology Demonstration Path; 5) Second Generation; 6) Key NASA Requirements; 7) X-33 Elements; 8) Future-X Pathfinder Projects and Experiments; 9) Focus Area Technical Goals; 10) X-34 Expanded View; 11) X-38 Spacecraft with De-Orbit Propulsion Stage (DPS); 12) Deorbit Module (DM) Critical Design Review (CDR) Design; 13) Forward Structural Adapter (FSA) CDR Design; 14) X-38 DPS CDR Design; 15) RLV Focused Propulsion Technologies; and 16) Challenges in Technology. This paper is presented in viewgraph form.

McGill, Preston↗
NASA NTRS2015

Formal Foundations for Hierarchical Safety Cases

Safety cases are increasingly being required in many safety-critical domains to assure, using structured argumentation and evidence, that a system is acceptably safe. However, comprehensive system-wide safety arguments present appreciable challenges to develop, understand, evaluate, and manage, partly due to the volume of information that they aggregate, such as the results of hazard analysis, requirements analysis, testing, formal verification, and other engineering activities. Previously, we have proposed hierarchical safety cases, hicases, to aid the comprehension of safety case argument structures. In this paper, we build on a formal notion of safety case to formalise the use of hierarchy as a structuring technique, and show that hicases satisfy several desirable properties. Our aim is to provide a formal, theoretical foundation for safety cases. In particular, we believe that tools for high assurance systems should be granted similar assurance to the systems to which they are applied. To this end, we formally specify and prove the correctness of key operations for constructing and managing hicases, which gives the specification for implementing hicases in AdvoCATE, our toolset for safety case automation. We motivate and explain the theory with the help of a simple running example, extracted from a real safety case and developed using AdvoCATE.

Hierarchy↗
NASA NTRS2016

S&MA Internship to Support Orion and the European Service Module

As a University Space Research Association (USRA) intern for NASA Johnson Space Center (JSC) during the summer 2016 work term, I worked on three main projects for the Space Exploration Division (NC) of the Safety and Mission Assurance (S&MA) Directorate. I worked on all three projects concurrently. One of the projects involved facilitating the status and closure of technical actions that were created during European Service Module (ESM) safety reviews by the MPCV Safety & Engineering Review Panel (MSERP). The two main duties included accurately collecting and summarizing qualitative data, and communicating that information to the European Space Agency (ESA) and Airbus (ESA's prime contractor) in a clear, succinct and precise manner. This project also required that I create a report on the challenges and opportunities of international S&MA. With its heavy emphasis on soft skills, this project taught me how to communicate better, by showing me how to present and share information in an easy-to-read and understandable format, and by showing me how to cooperate with and culturally respect international partners on a technical project. The second project involved working with the Orion Thermal Protection System (TPS) Process Failure Modes and Effects Analysis (PFMEA) Working Group to create the first full version of the Orion TPS PFMEA. The Orion TPS PFMEA Working Group met twice a week to analyze the Avcoat block installation process for failure modes, the failure modes effects, and how such failure modes could be controlled. I was in charge of implementing changes that were discussed in meeting, but were not implemented real time. Another major task included creating a significant portion of the content alongside another team member outside the two weekly meetings. This project caused me to become knowledgeable about TPS, heatshields, space-rated manufacturing, and non-destructive evaluation (NDE). The project also helped me to become better at working with a small team and helped improved my technical communication skills. My main duty for the third project was creating a Safety Verification Tracking Log (SVTL) for the Orbital Maneuvering System Engine (OMS-E), and contacting subject matter experts to close Hazard Report (HR) control verifications. This project also required me to support other OMS-E safety process tasks, like monitoring OMS-E vibration testing for Quality Assurance (QA) purposes. This project helped me become even more proficient in Excel. Throughout the project, I gained knowledge about the OMS-E system and improved my understanding of pressure systems and propellant systems. In terms of education goals, this work term has affirmed my desire to take a few more space-related courses, like orbital mechanics, so that I can have a better understanding of human spaceflight and the industry surrounding it. However, the work term did not persuade me to pursue a master's degree. In terms of career goals, this work term has helped me clarify the direction I would like to head in the future. The perspective of three summer terms working for NASA in S&MA has allowed me to observe that most S&MA employees joined S&MA after working in other NASA directorates, such as Engineering or Flight Operations. It is my belief that it would be advantageous for both NASA and I for me to broaden my knowledge base and technical skill set by completing hands-on technical work on human spaceflight projects, and for me to integrate my safety experience directly into technical work in other directorates. The other significant advantage to this proposed situation is that if I were to eventually return to S&MA, I would be returning with a substantial set of hands-on technical experience and knowledge, which would be a significant resource for S&MA tasks and projects.

Hutcheson, Connor↗
NASA NTRSDate not supplied

The NASA JSC Hypervelocity Impact Technology (HVIT) Office

The Hypervelocity Impact Technology (HVIT) office at the National Aeronautical and Space Administration (NASA) Johnson Space Center (JSC) is dedicated to support NASA flight programs in meeting their meteoroid and orbital debris (MMOD) protection requirements both efficiently and effectively, with a minimum of shielding mass, volume, and cost. This paper provides an overview of HVIT capabilities in providing hypervelocity tests, analyses, MMOD risk assessments and shielding expertise. HVIT personnel work closely with NASA program and safety/mission assurance personnel to develop program-specific MMOD protection requirements which are both achievable based on initial risk assessments and will meet overall safety and mission success requirements. HVIT then proceeds with hypervelocity impact testing and hydrocode assessments to update and verify ballistic limit equations used in the MMOD risk assessment. Hypervelocity impact tests are primarily performed at the NASA WSTF Remote Hypervelocity Test Laboratory (RHTL). Other hypervelocity facilities that provide complementary test capabilities are called on when necessary to fill data gaps. The goal of the final pre-flight MMOD risk assessment is to show compliance with MMOD requirements prior to flight. This final assessment will also incorporate changes in the MMOD environment from meteoroid showers and orbital debris breakups. After the mission is flown, post-flight inspections are performed by HVIT to document and trend MMOD damage to returned spacecraft surfaces and hardware. HVIT accomplishments in NASA mission support are described. In addition, current HVIT activities to aid on-going NASA crewed missions and science missions are presented.

Meteoroid↗
NASA NTRS2006

Large-Scale Hybrid Motor Testing

Hybrid rocket motors can be successfully demonstrated at a small scale virtually anywhere. There have been many suitcase sized portable test stands assembled for demonstration of hybrids. They show the safety of hybrid rockets to the audiences. These small show motors and small laboratory scale motors can give comparative burn rate data for development of different fuel/oxidizer combinations, however questions that are always asked when hybrids are mentioned for large scale applications are - how do they scale and has it been shown in a large motor? To answer those questions, large scale motor testing is required to verify the hybrid motor at its true size. The necessity to conduct large-scale hybrid rocket motor tests to validate the burn rate from the small motors to application size has been documented in several place^'^^.^. Comparison of small scale hybrid data to that of larger scale data indicates that the fuel burn rate goes down with increasing port size, even with the same oxidizer flux. This trend holds for conventional hybrid motors with forward oxidizer injection and HTPB based fuels. While the reason this is occurring would make a great paper or study or thesis, it is not thoroughly understood at this time. Potential causes include the fact that since hybrid combustion is boundary layer driven, the larger port sizes reduce the interaction (radiation, mixing and heat transfer) from the core region of the port. This chapter focuses on some of the large, prototype sized testing of hybrid motors. The largest motors tested have been AMROC s 250K-lbf thrust motor at Edwards Air Force Base and the Hybrid Propulsion Demonstration Program s 250K-lbf thrust motor at Stennis Space Center. Numerous smaller tests were performed to support the burn rate, stability and scaling concepts that went into the development of those large motors.

Story, George↗
NASA NTRS1976

Zero-G flight test of a gauging system. Volume 1: Summary

The capability of a nucleonic gauging system to gauge the content of a reduced-scale storable liquid tank in a zero-g environment as provided by a KC-135 Zero-G Aircraft was demonstrated. Although the propellant-ullage interface never achieved the stable, zero-g equilibrium configuration, the gauging system gauged liquid quantity over all tank loadings to a total system accuracy the order of two percent. It was also determined that the gauging system presented no undue safety hazard to operating personnel in either ground and/or flight testing.

Source record↗
NASA NTRSDate not supplied

Icing Physics Studies Using the 3D SIDRM Test Article: Aerodynamic and Supercooled Liquid Icing Analysis

In-flight icing is an important safety issue and is a factor that affects aircraft design and performance. Newer regulations are driving a need for improvements in airframe and engine icing simulation capability. Experimental data is required for development of icing physics models and simulation validation. To that end, this paper discusses analyzed data from icing tests conducted with a 3D test article in 2022 at the NASA Icing Research Tunnel. The test article, whose geometry is representative of an inter-compressor duct and strut region of a turbofan engine, has been designed and constructed to study the physics of supercooled water icing and ice crystal icing. The surfaces of the Simulated Inter-compressor Duct Research Model (SIDRM) can be heated to simulate the warm surfaces of the turbofan inter-compressor duct. The test article is instrumented with pressure taps, heaters, heat flux gauges, and thermocouples, while a 3D laser scanner, cameras, and a scale to measure ice mass were utilized to characterize the icing behavior. The aim of these tests was to generate ice accretions on the SIDRM test article under well-characterized supercooled liquid icing and ice crystal icing conditions. This paper discusses measurements related to aerodynamic tests and supercooled liquid icing tests that were conducted. Aerodynamic measurements were analyzed and compared to computational simulations and were found to be in good agreement for the range of airspeeds (50 to 230 knots) and angles of attack (0 to 4°) tested. Various parametric sweeps were conducted during the supercooled liquid icing portion of the test entry (cloud median volumetric diameter ranged from 15 to 90 µm, total air temperature from -3 to -17 °C, angle of attack from 0 to 4°, and accretion time from 5 to 20 min). These sweeps were performed to measure that parameter’s impact on ice accretion size, location, characteristics (such as glaze/rime ice and shedding behavior), and test article surface temperature. Analysis of the test data showed that clouds composed of larger drops, colder air temperatures, smaller angles of attack, and longer spray times were the primary parameters that resulted in accretions with greater ice mass. Test article angle of attack and cloud droplet size influenced the location of ice accretion as these two parameters directly impact collection efficiency. With respect to icing characteristics, total air temperature dictated icing type, and smaller cloud drop size along with warmer air temperatures resulted in greater amounts of ice shedding. Surface temperature increased during ice accretion from the release of latent (fusion) heat, where total air temperature and cloud drop size impacted the amount of surface temperature change. The icing measurements collected during the SIDRM tests will be used to develop and validate 3D computational engine icing tools, such as GlennICE, that predictively assesses the onset and growth of ice. One of the goals of the sponsoring NASA project is to develop simulation models and tools that can assist in the design and certification of engines for flight in icing conditions in a cost‑effective way.

supercooled liquid icing↗
NASA NTRS2015

AdvoCATE - User Guide

The basic vision of AdvoCATE is to automate the creation, manipulation, and management of large-scale assurance cases based on a formal theory of argument structures. Its main purposes are for creating and manipulating argument structures for safety assurance cases using the Goal Structuring Notation (GSN), and as a test bed and proof-of-concept for the formal theory of argument structures. AdvoCATE is available for Windows 7, Macintosh OSX, and Linux. Eventually, AdvoCATE will serve as a dashboard for safety related information and provide an infrastructure for safety decisions and management.

Safety Case↗
NASA NTRS2013

Unmanned Vehicle Material Flammability Test

Microgravity combustion phenomena have been an active area of research for the past 3 decades however, there have been very few experiments directly studying spacecraft fire safety under low-gravity conditions. Furthermore, none of these experiments have studied sample and environment sizes typical of those expected in a spacecraft fire. All previous experiments have been limited to samples of the order of 10 cm in length and width or smaller. Terrestrial fire safety standards for all other habitable volumes on earth, e.g. mines, buildings, airplanes, ships, etc., are based upon testing conducted with full-scale fires. Given the large differences between fire behavior in normal and reduced gravity, this lack of an experimental data base at relevant length scales forces spacecraft designers to base their designs using 1-g understanding. To address this question a large scale spacecraft fire experiment has been proposed by an international team of investigators. This poster presents the objectives, status and concept of this collaborative international project to examine spacecraft material flammability at realistic scales. The concept behind this project is to utilize an unmanned spacecraft such as Orbital Cygnus vehicle after it has completed its delivery of cargo to the ISS and it has begun its return journey to earth. This experiment will consist of a flame spread test involving a meter scale sample ignited in the pressurized volume of the spacecraft and allowed to burn to completion while measurements are made. A computer modeling effort will complement the experimental effort. Although the experiment will need to meet rigorous safety requirements to ensure the carrier vehicle does not sustain damage, the absence of a crew removes the need for strict containment of combustion products. This will facilitate the examination of fire behavior on a scale that is relevant to spacecraft fire safety and will provide unique data for fire model validation. This will be the first opportunity to examine microgravity flame behavior at scales approximating a spacecraft fire.

Combustion↗
NASA NTRS2024

Spacecraft Priming Analysis and Research Test Apparatus: Number 1 (SPARTAN 1), Test and Analysis Results

Spacecraft with Earth-storable propellants are required by range safety to launch with propellant isolated from the thrusters for ground operations, which is often accomplished by placing a pyrotechnic, or a latching isolation valve between the tank and the thrusters. Once on-orbit, downstream lines are vented out to space through the thrusters and are left evacuated and at vacuum pressure. Propellant isolation valve then opens and floods the lines with high velocity propellant which can lead to a significant pressure surge upon filling. Replicating this event during ground testing using water as a propellant simulant has always been difficult and costly to accurately perform due to the low vacuum pressure targeted on the downstream side of the system. This report describes the Spacecraft Priming Analysis and Research Test Apparatus (SPARTA) at Marshall Space Flight Center’s (MSFC) Component Development Area (CDA) and the initial test series meant to be a pathfinder for construction methods and test procedures to reduce the cost of future testing. The test data collected are critical to analytical models as the details to replicate prior ground tests are often lacking in enough detail to adequately model the test that was conducted. This report also describes the Thermal Desktop/FloCAD analysis that was performed alongside the test series. The test methods defined for this campaign showed a dramatic improvement on heritage test procedures. Test pace increased due to faster drying and pulling vacuum more effectively. Results generated in this test matched analytical predictions very well and provide a releasable set of test data to be leveraged on future NASA and commercial partner spacecraft development programs.

spacecraft↗
NASA NTRS2015

A Battery Certification Testbed for Small Satellite Missions

A battery pack consisting of standard cylindrical 18650 lithium-ion cells has been chosen for small satellite missions based on previous flight heritage and compliance with NASA battery safety requirements. However, for batteries that transit through the International Space Station (ISS), additional certification tests are required for individual cells as well as the battery packs. In this manuscript, we discuss the development of generalized testbeds for testing and certifying different types of batteries critical to small satellite missions. Test procedures developed and executed for this certification effort include: a detailed physical inspection before and after experiments; electrical cycling characterization at the cell and pack levels; battery-pack overcharge, over-discharge, external short testing; battery-pack vacuum leak and vibration testing. The overall goals of these certification procedures are to conform to requirements set forth by the agency and identify unique safety hazards. The testbeds, procedures, and experimental results are discussed for batteries chosen for small satellite missions to be launched from the ISS.

Certification↗
NASA NTRS2020

Adaptive Stress Testing: Finding Likely Failure Events with Reinforcement Learning

Finding the most likely path to a set of failure states is important to the analysis of safety-critical systems that operate over a sequence of time steps, such as aircraft collision avoidance systems and autonomous cars. In many applications such as autonomous driving, failures cannot be completely eliminated due to the complex stochastic environment in which the system operates.As a result, safety validation is not only concerned about whether a failure can occur, but also discovering which failures are most likely to occur. This article presents adaptive stress testing (AST), a framework for finding the most likely path to a failure event in simulation. We consider a general black box setting for partially observable and continuous-valued systems operating in an environment with stochastic disturbances. We formulate the problem as a Markov decision process and use reinforcement learning to optimize it. The approach is simulation-based and does not require internal knowledge of the system, making it suitable for black-box testing of large systems. We present different formulations depending on whether the state is fully observable or partially observable. In the latter case, we present a modified Monte Carlo tree search algorithm that only requires access to the pseudorandom number generator of the simulator to overcome partial observability. We also present an extension of the framework, called differential adaptive stress testing (DAST), that can find failures that occur in one system but not in another. This type of differential analysis is useful in applications such as regression testing, where we are concerned with finding areas of relative weakness compared to a baseline. We demonstrate the effectiveness of the approach on an aircraft collision avoidance application, where a prototype aircraft collision avoidance system is stress tested to find the most likely scenarios of near mid-air collision.

Verification and Validation↗