Unmanned Aircraft System Flight Test Approach Supporting the Development of Regulatory Recommendations for Integration with the National Airspace System
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Results of a fault-tolerant software (FTS) experiment are used to show deficiencies of the simple random testing approach. Testing was performed using randomly generated test cases supplemented with extremal and special value (ESV) cases. Error detection efficiency of the random testing approach, with emphasis on correlated errors, was compared to the error detecting capabilities of the ESV data and found deficient. The use of carefully designed test cases as a supplement to random testing, as well as the use of structure based testing are recommended.
Any cluster of parachute systems is subject to effects on performance due to interactions between the parachutes. One such interaction is the twisting of a riser from one parachute around that of another. Due to friction and relative motion between the risers, it is possible for the tension in the riser near the attach point to be different from the tension in the riser towards the suspension lines or canopy. This could result in system failure due to larger than expected loading. The Orion Capsule Parachute Assembly System (CPAS) designed and executed a test to quantify the amplification of the load in a parachute riser due to twist, rocking rate and angle, cluster size, and canopy load. The design of the testing approach, test matrix, and hardware are discussed along with results and findings.
The Low Earth Orbit Flight Test of an Inflatable Decelerator (LOFTID) involves the first orbital test of an inflatable decelerator. This test involves the LOFTID re-entry vehicle using an inflatable decelerator to re-enter the atmosphere after flying to orbit as a secondary payload. Due to system constraints, including spin stabilization, unknown time of day, a limited space available for antennas, and a heat shield which blocks magnetic fields, the navigation system includes only an inertial measurement unit and a single GPS receiver. As the vehicle is turned off for the first part of the mission and will not receive commands or data from the ground, the navigation system will not have accurate initialization, and will in-stead rely on pre-flight estimates or first measurement estimation. This could result in significant unknown error in the initial state, resulting in needing to initialize the state on-orbit and requires using the single GPS antenna for attitude updates. These design considerations led to using an Extended Kalman filter, modified to perform with these design constraints. A streamlined testing approach, including tests with flight-like rotations, is being used to limit the time and resources needed to test the navigation system while still fully testing the performance and robustness of the navigation system. This testing approach follows the NASA test-as-you-fly principle and allows for early detection of errors and changes that are needed in the software. This results in a navigation system that, even within the design constraints of the mission architecture, will provide the performance and robustness needed of the mission.
The goal of this work is, through computational simulations, to provide statistically-based evidence to convince the testing community that a distributed testing approach is superior to a clustered testing approach for most situations. For clustered testing, numerous, repeated test points are acquired at a limited number of test conditions. For distributed testing, only one or a few test points are requested at many different conditions. The statistical techniques of Analysis of Variance (ANOVA), Design of Experiments (DOE) and Response Surface Methods (RSM) are applied to enable distributed test planning, data analysis and test augmentation. The D-Optimal class of DOE is used to plan an optimally efficient single- and multi-factor test. The resulting simulated test data are analyzed via ANOVA and a parametric model is constructed using RSM. Finally, ANOVA can be used to plan a second round of testing to augment the existing data set with new data points. The use of these techniques is demonstrated through several illustrative examples. To date, many thousands of comparisons have been performed and the results strongly support the conclusion that the distributed testing approach outperforms the clustered testing approach.
This presentation presents the testing approach and initial laboratory test results of the Adaptive Optics (AO) Subassembly (AOS) for the Low-Cost Optical Terminal (LCOT), a low-cost and flexible optical communications ground terminal. Leveraging commercial components and subassemblies wherever possible, LCOT is being developed by the NASA Goddard Space Flight Center (GSFC) Advanced Communications Capabilities for Exploration and Science Systems (ACCESS) project. An economical ground terminal allows NASA to create a global optical terminal network and enables the expansion of direct-to-Earth (DTE) optical communications. Located at the Goddard Geophysical and Astronomical Observatory (GGAO), LCOT is in the development phase and will receive first light during initial testing beginning in 2023. This new optical terminal includes a 700 mm Ritchey-Chretien commercial telescope, able to track Low Earth Orbit (LEO) spacecraft, receive instruments specified from 1500 - 1600 nm, and an uplink transmit optical system. Demodulation of optical coherent modulation formats requires downlink signal coupling into single-mode fiber. Due to atmospheric turbulence, signals experience wavefront distortions creating speckle patterns larger than the fiber core and high jitter requiring precise beam steering. AO is necessary to correct atmospheric turbulence effects and allow efficient coupling of received signals. In 2020, GSFC contracted with General Atomics to provide the LCOT AO system. This system has been delivered to GSFC in September 2021 and has been tested in laboratory to evaluate performance. This paper describes the laboratory testing approach, turbulence phase plate design, test results, and the AO field testing plan when installed on the LCOT telescope.
•Combinatorial approaches to testing and characterization of materials is a very powerful tool to help explore some fundamentals of materials science.? •Three topics will be explored to help illustrate this:? •A fitness-for-service assessment of a CANDU component (this is work from my past)? •The use of small-scale mechanical testing of Cr-coated ATF cladding in support of qualification (this is work developed upon joining INL)? •A multi-scale characterization approach of TRISO fuel to investigate fission gas migration and microstructural features (this is work I now get to participate in on joining MFC)? •?
The response of truss-type structures for future space applications, such as Large Deployable Reflector (LDR), will be directly affected by joint performance. Some of the objectives of research at BAC were to characterize structural joints, establish analytical approaches that incorporate joint characteristics, and experimentally establish the validity of the analytical approaches. The test approach to characterize joints for both erectable and deployable-type structures was based upon a Force State Mapping Technique. The approach pictorially shows how the nonlinear joint results can be used for equivalent linear analysis. Testing of the Space Station joints developed at LaRC (a hinged joint at 2 Hz and a clevis joint at 2 Hz) successfully revealed the nonlinear characteristics of the joints. The Space Station joints were effectively linear when loaded to plus or minus 500 pounds with a corresponding displacement of about plus or minus 0.0015 inch. It was indicated that good linear joints exist which are compatible with errected structures, but that difficulty may be encountered if nonlinear-type joints are incorporated in the structure.
The main objective of software testing in the software development life cycle is to verify conformance of the implemented software with its intended requirements. Such requirements include system requirements, and programming requirements. Non-conformance with such requirements causes what are known as software errors. Specifying an appropriate testing strategy to expose software errors is still an art. Traditional approaches do succeed in revealing many errrors but none is powerful enough to expose all errors. The best that is hoped for is to use a specific test strategy to expose a specific error type in specific program locations. This limitation is exploited to develop a new approach to software testing which is called an error-specific testing (EST) strategy. Error specific testing is in fact a dual to the traditional testing approaches.
To find failure events and their likelihoods in flight-critical systems, we investigate the use of an advanced black-box stress testing approach called adaptive stress testing. We analyze a trajectory predictor from a developmental commercial flight management system which takes as input a collection of lateral waypoints and en-route environmental conditions. Our aim is to search for failure events relating to inconsistencies in the predicted lateral trajectories. The intention of this work is to find likely failures and report them back to the developers so they can address and potentially resolve shortcomings of the system before deployment. To improve search performance, this work extends the adaptive stress testing formulation to be applied more generally to sequential decision-making problems with episodic reward by collecting the state transitions during the search and evaluating at the end of the simulated rollout. We use a modified Monte Carlo tree search algorithm with progressive widening as our adversarial reinforcement learner. The performance is compared to direct Monte Carlo simulations and to the cross-entropy method as an alternative importance sampling baseline. The goal is to find potential problems otherwise not found by traditional requirements-based testing. Results indicate that our adaptive stress testing approach finds more failures and finds failures with higher likelihood relative to the baseline approaches.
The force-limited vibration test approaches discussed in NASA-7004C were developed to reduce overtesting associated with base shake vibration tests of aerospace hardware where the interface responses are excited coherently. This handbook outlines several different methods of specifying the force limits. The rationale for force limiting is based on the disparity between the impedances of typical aerospace mounting structures and the large impedances of vibration test shakers when the interfaces in general are coherently excited. Among these approaches, the semi-empirical method is presently the most widely used method to derive the force limits. The inclusion of the incoherent excitation of the aerospace structures at mounting interfaces has not been accounted for in the past and provides the basis for more realistic force limits for qualifying the hardware using shaker testing. In this paper current methods for defining the force limiting specifications discussed in the NASA handbook are reviewed using data from a series of acoustic and vibration tests. A new approach based on considering the incoherent excitation of the structural mounting interfaces using acoustic test data is also discussed. It is believed that the new approach provides much more realistic force limits that may further remove conservatism inherent in shaker vibration testing not accounted for by methods discussed in the NASA handbook. A discussion on using FEM/BEM analysis to obtain realistic force limits for flight hardware is provided.
Thermal barrier and environmental barrier coatings (TBCs and EBCs) will play a crucial role in future advanced gas turbine engines because of their ability to significantly extend the temperature capability of the ceramic matrix composite (CMC) engine components in harsh combustion environments. In order to develop high performance, robust coating systems for effective thermal and environmental protection of the engine components, appropriate test approaches for evaluating the critical coating properties must be established. In this paper, a laser high-heat-flux, thermal gradient approach for testing the coatings will be described. Thermal cyclic behavior of plasma-sprayed coating systems, consisting of ZrO2-8wt%Y2O3 thermal barrier and NASA Enabling Propulsion Materials (EPM) Program developed mullite+BSAS/Si type environmental barrier coatings on SiC/SiC ceramic matrix composites, was investigated under thermal gradients using the laser heat-flux rig in conjunction with the furnace thermal cyclic tests in water-vapor environments. The coating sintering and interface damage were assessed by monitoring the real-time thermal conductivity changes during the laser heat-flux tests and by examining the microstructural changes after the tests. The coating failure mechanisms are discussed based on the cyclic test results and are correlated to the sintering, creep, and thermal stress behavior under simulated engine temperature and heat flux conditions.
The Mars 2020 Perseverance rover is the most advanced robotic exploration system ever sent to another planet. To support the complex scientific and mobility needs of the mission, the rover utilizes 33 actuators, three multi-degree-of-freedom force-torque sensors, fifteen single or dual-speed resolvers, two solenoid valves, and twelve contact switches. The control for these actuators and sensors is achieved by several levels of flight software, coordinated between two computers with varying bandwidth control loops. Furthermore, the actuators and sensors were integrated into multiple larger robotic mechanisms that were delivered by different organizations at various points in the Integration and Test (I&T) timeline. All of this created a very complex Verification and Validation (V&V) scenario involving multiple subsystems and teams, several hardware and software testbeds with varying levels of fidelity, and significant systems engineering to ensure the overall I&T schedule could be maintained while ensuring system hardware safety.This paper details the integrated V&V effort across multiple teams and venues to provide full coverage of all necessary functionality, performance, and fault protection. First, it provides an overview of how the V&V campaign was subdivided among teams and venues and provides descriptions of the various hardware configurations used to support the testing. The Mars 2020 implementation of the plan incorporates many of the lessons learned from Mars Science Laboratory’s test campaign, and these value-added modifications are discussed here. Also included in this section is the system-level environmental testing approach used for mechanisms. Second, the paper describes the phased approach used by the teams to support new hardware and software deliveries to testbed and Systems I&T. In this approach the test campaign was built upon higher-level mechanism needs for performance, functionality, and safety at specific times in the campaign. Finally, the paper discusses lessons learned from the V&V campaign that should be applied to future large-scale motion control testing efforts.
Tests were made with a C-54 airplane in which airline pilots made several blind approaches to determine whether any special flying techniques were used in blind landings and whether any special handling-qualities requirements would have to be formulated because of such special techniques. It was found that the airplane was flown at all times in the normal manner; that is, all turns were banked turns that were nearly coordinated by use of the rudder so that the sideslip was held close to zero. The pilot expended considerable physical work in continually moving the controls but this wake was due in part to the large friction in the three control systems. The actual control deflections used were small compared to the maximum deflections available.
The navigation and flight director guidance systems implemented in the NASA/FAA helicopter microwave landing system (MLS) curved approach flight test program is described. Flight test were conducted at the U.S. Navy's Crows Landing facility, using the NASA Ames UH-lH helicopter equipped with the V/STOLAND avionics system. The purpose of these tests was to investigate the feasibility of flying complex, curved and descending approaches to a landing using MLS flight director guidance. A description of the navigation aids used, the avionics system, cockpit instrumentation and on-board navigation equipment used for the flight test is provided. Three generic reference flight paths were developed and flown during the test. They were as follows: U-Turn, S-turn and Straight-In flight profiles. These profiles and their geometries are described in detail. A 3-cue flight director was implemented on the helicopter. A description of the formulation and implementation of the flight director laws is also presented. Performance data and analysis is presented for one pilot conducting the flight director approaches.
This book of knowledge (BoK) provides a critical review of the benefits and difficulties associated with using proton irradiation as a means of exploring the radiation hardness of commercial-off-the-shelf (COTS) systems. This work was developed for the NASA Electronic Parts and Packaging (NEPP) Board Level Testing for the COTS task. The fundamental findings of this BoK are the following. The board-level test method can reduce the worst case estimate for a board's single-event effect (SEE) sensitivity compared to the case of no test data, but only by a factor of ten. The estimated worst case rate of failure for untested boards is about 0.1 SEE/board-day. By employing the use of protons with energies near or above 200 MeV, this rate can be safely reduced to 0.01 SEE/board-day, with only those SEEs with deep charge collection mechanisms rising this high. For general SEEs, such as static random-access memory (SRAM) upsets, single-event transients (SETs), single-event gate ruptures (SEGRs), and similar cases where the relevant charge collection depth is less than 10 μm, the worst case rate for SEE is below 0.001 SEE/board-day. Note that these bounds assume that no SEEs are observed during testing. When SEEs are observed during testing, the board-level test method can establish a reliable event rate in some orbits, though all established rates will be at or above 0.001 SEE/board-day. The board-level test approach we explore has picked up support as a radiation hardness assurance technique over the last twenty years. The approach originally was used to provide a very limited verification of the suitability of low cost assemblies to be used in the very benign environment of the International Space Station (ISS), in limited reliability applications. Recently the method has been gaining popularity as a way to establish a minimum level of SEE performance of systems that require somewhat higher reliability performance than previous applications. This sort of application of the method suggests a critical analysis of the method is in order. This is also of current consideration because the primary facility used for this type of work, the Indiana University Cyclotron Facility (IUCF) (also known as the Integrated Science and Technology (ISAT) hall), has closed permanently, and the future selection of alternate test facilities is critically important. This document reviews the main theoretical work on proton testing of assemblies over the last twenty years. It augments this with review of reported data generated from the method and other data that applies to the limitations of the proton board-level test approach. When protons are incident on a system for test they can produce spallation reactions. From these reactions, secondary particles with linear energy transfers (LETs) significantly higher than the incident protons can be produced. These secondary particles, together with the protons, can simulate a subset of the space environment for particles capable of inducing single event effects (SEEs). The proton board-level test approach has been used to bound SEE rates, establishing a maximum possible SEE rate that a test article may exhibit in space. This bound is not particularly useful in many cases because the bound is quite loose. We discuss the established limit that the proton board-level test approach leaves us with. The remaining possible SEE rates may be as high as one per ten years for most devices. The situation is actually more problematic for many SEE types with deep charge collection. In cases with these SEEs, the limits set by the proton board-level test can be on the order of one per 100 days. Because of the limited nature of the bounds established by proton testing alone, it is possible that tested devices will have actual SEE sensitivity that is very low (e.g., fewer than one event in 1 × 10(exp 4) years), but the test method will only be able to establish the limits indicated above. This BoK further examines other benefits of proton board-level testing besides hardness assurance. The primary alternate use is the injection of errors. Error injection, or fault injection, is something that is often done in a simulation environment. But the proton beam has the benefit of injecting the majority of actual SEEs without risk of something being missed, and without the risk of simulation artifacts misleading the SEE investigation.