Automatic Generation of Test Oracles - From Pilot Studies to Application
Cost, performance and functionality concerns are driving a trend towards use of self-sufficient autonomous systems in place of human-controlled mechanisms.
Test↗
SEARCH · Engineering Papers
Results for “Test Pilots”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Automatic Generation of Test Oracles - From Pilot Studies of Application
There is a trend towards increased use of automation in V&V. Automation can yield savings in time and effort. For critical systems, where thorough V&V is required, these savings can be substantial.
testing↗
Extraterrestrial resources: Implications from terrestrial experience
Terrestrial mining experience indicates that the overwhelming criterion of a potentially economic deposit is its recoverable concentration of the desired mineral or element. Recovery can be based on contrast in physical and/or chemical properties, but processes based on physical properties are typically less expensive. As several processes generally are used in sequence, they have a profound effect on extraction costs. These criteria will also apply to extraterrestrial resources. Although the extreme cost of access to space makes even ordinary materials extremely valuable, this inaccessibility also makes capital and maintenance costs extremely high. The following four development stages will apply, especially with the additional unknowns of an extraterrestrial environment: (1) Exploration for the highest grade of the mineral or element desired (because the extraction plant must be simple, cheap, and rugged to minimize capital and maintenance costs, high grade is extremely important); (2) Laboratory testing of various physical and/or chemical separation techniques on the possible ore to determine if the material can indeed be recovered economically; (3) a pilot plant test, in which a large sample is dug from the deposit to determine excavation rates, power requirements, and equipment wear. (This sample is then run through a pilot mill designed on the basis of the laboratory testing. Pilot plant testing must be carried out at increasing scales, but several trials are generally necessary at each scale before the size of operations can be increased. Moreover, pilot testing is necessary for each new mineral deposit); and (4) Last is the full-scale mine and plant start-up. (New problems invariably occur at this point, but they can be kept to a minimum if the pilot plant tests were realistic). If such a development plan is followed rigorously, major cost overruns, with their potentially disastrous effects on resource developments, can be avoided.
Kuck, David L.↗
Space shuttle pilot-induced-oscillation research testing
The simulation requirements for investigation of pilot-induced-oscillation (PIO) characteristics during the landing phase are discussed. Orbiters simulations and F-8 digital fly-by-wire aircraft tests are addressed.
Powers, B. G.↗
Integrated System Health Management (ISHM) Implementation in Rocket Engine Testing
A pilot operational ISHM capability has been implemented for the E-2 Rocket Engine Test Stand (RETS) and a Chemical Steam Generator (CSG) test article at NASA Stennis Space Center. The implementation currently includes an ISHM computer and a large display in the control room. The paper will address the overall approach, tools, and requirements. It will also address the infrastructure and architecture. Specific anomaly detection algorithms will be discussed regarding leak detection and diagnostics, valve validation, and sensor validation. It will also describe development and use of a Health Assessment Database System (HADS) as a repository for measurements, health, configuration, and knowledge related to a system with ISHM capability. It will conclude with a discussion of user interfaces, and a description of the operation of the ISHM system prior, during, and after testing.
Figueroa, Fernando↗
Pilot Escape from Spinning Airplanes as Determined from Free-spinning-tunnel Tests
Procedure for pilot escape from spinning airplanes has been determined by means of tests in which pilot escape was simulated from 21 airplane models spinning in the Langley 20-foot free-spinning tunnel. The results in general indicated that the pilot should bail out of the outboard side. Calculated centripetal accelerations acting on the pilot during a spin are presented.
SAFETY - PILOT ESCAPE TECHNIQUES↗
FT-01: Autonomous Helicopter Flight Testing Over Long Island Sound Special Session - Hazard Perception and Avoidance Tech Area
This presentation is included as part of a panel reporting on the Integration of Automated Systems (IAS) flight test series. The IAS series concluded in October 2023 and was conducted under NASA’s Advanced Air Mobility project and in partnership with Sikorsky and the Defense Advanced Research Projects Agency (DARPA). The flight test effort included two crewed rotorcraft platforms. The first, a modified S-76B helicopter, served as the “ownship” for the duration of the flight test. The second vehicle, a modified S-70, served as the intruder aircraft. One Sikorsky pilot and one NASA test pilot was onboard each aircraft for every test point, with the NASA test pilot responsible for interacting with the research systems under test. This portion of the panel presentation focuses on the results of the flight test that assessed the Federal Aviation Administration’s (FAA) next-generation collision avoidance system, the Airborne Collision Avoidance System X for Rotorcraft (ACAS Xr). The two configurations available within ACAS Xr – the Collision Avoidance System (CAS) configuration and the Detect and Avoid (DAA) configuration – were flown with an onboard pilot under Visual Flight Rules in controlled airspace over the Long Island Sound (Connecticut, USA). A total of 33 flight test cards were flown with ACAS Xr active. Results showed that the ACAS Xr alerting and guidance was largely effective and rated positively by the NASA test pilots, exemplified by zero instances of the pilots overriding an ACAS Xr Resolution Advisory (RA). Key areas of improvement, however, were noted, particularly with regards to the lack of an aural alert indicating a need to accelerate when receiving an RA at low speed and the occurrence of multiple RAs that the pilots found to be unacceptable.
detect and avoid↗
Detect and Avoid and Collision Avoidance Flight Test Results with ACAS Xr
In October 2023, the National Aeronautics and Space Administration (NASA) completed its Integration of Automated Systems flight test series, conducted under NASA’s Advanced Air Mobility project and in partnership with Sikorsky and the Defense Advanced Research Projects Agency (DARPA). The flight test effort included two crewed rotorcraft platforms. The first, a modified S-76B helicopter, served as the “ownship” for the duration of the flight test. The second vehicle, a modified S-70, served as the intruder aircraft. One Sikorsky pilot and one NASA test pilot was onboard each aircraft for every test point, with the NASA test pilot responsible for interacting with the research systems under test. Approximately half of the flight test was devoted to assessing the Federal Aviation Administration’s (FAA) next-generation collision avoidance system, the Airborne Collision Avoidance System X for Rotorcraft (ACAS Xr). The two configurations available within ACAS Xr – the Collision Avoidance System (CAS) configuration and the Detect and Avoid (DAA) configuration – were flown with an onboard pilot under Visual Flight Rules in controlled airspace over the Long Island Sound (Connecticut, USA). A total of 33 flight test cards were flown with ACAS Xr active. The ownship was equipped with ACAS Xr and the intruder was equipped with Automatic Dependent Surveillance-Broadcast (ADS-B). The test points were blocked by ACAS Xr configuration, with individual encounters varying the ownship speed (90 knots or 20 knots), the intruder designation (en-route, terminal area, or structured airspace), and method of RA execution (automated or manually executed). Results showed that the ACAS Xr alerting and guidance was largely effective and rated positively by the NASA test pilots, exemplified by zero instances of the pilots overriding an ACAS Xr Resolution Advisory (RA). Key areas of improvement, however, were noted, particularly with regards to the lack of an aural alert indicating a need to accelerate when receiving an RA at low speed and the occurrence of multiple RAs that the pilots found to be unacceptable.
detect and avoid↗
Detect and Avoid and Collision Avoidance Flight Test Results with ACAS Xr
In October 2023, the National Aeronautics and Space Administration (NASA) completed its Integration of Automated Systems flight test series, conducted under NASA’s Advanced Air Mobility project and in partnership with Sikorsky and the Defense Advanced Research Projects Agency (DARPA). The flight test effort included two crewed rotorcraft platforms. The first, a modified S-76B helicopter, served as the “ownship” for the duration of the flight test. The second vehicle, a modified S-70, served as the intruder aircraft. One Sikorsky pilot and one NASA test pilot was onboard each aircraft for every test point, with the NASA test pilot responsible for interacting with the research systems under test. Approximately half of the flight test was devoted to assessing the Federal Aviation Administration’s (FAA) next-generation collision avoidance system, the Airborne Collision Avoidance System X for Rotorcraft (ACAS Xr). The two configurations available within ACAS Xr – the Collision Avoidance System (CAS) configuration and the Detect and Avoid (DAA) configuration – were flown with an onboard pilot under Visual Flight Rules in controlled airspace over the Long Island Sound (Connecticut, USA). A total of 33 flight test cards were flown with ACAS Xr active. The ownship was equipped with ACAS Xr and the intruder was equipped with Automatic Dependent Surveillance-Broadcast (ADS-B). The test points were blocked by ACAS Xr configuration, with individual encounters varying the ownship speed (90 knots or 20 knots), the intruder designation (en-route, terminal area, or structured airspace), and method of RA execution (automated or manually executed). Results showed that the ACAS Xr alerting and guidance was largely effective and rated positively by the NASA test pilots, exemplified by zero instances of the pilots overriding an ACAS Xr Resolution Advisory (RA). Key areas of improvement, however, were noted, particularly with regards to the lack of an aural alert indicating a need to accelerate when receiving an RA at low speed and the occurrence of multiple RAs that the pilots found to be unacceptable.
detect and avoid↗
Flight tests with a data link used for air traffic control information exchange
Previous studies showed that air traffic control (ATC) message exchange with a data link offers the potential benefits of increased airspace system safety and efficiency. To accomplish these benefits, data link can be used to reduce communication errors and relieve overloaded ATC voice radio frequencies, which hamper efficient message exchange during peak traffic periods. Flight tests with commercial airline pilots as test subjects were conducted in the NASA Transport Systems Research Vehicle Boeing 737 airplane to contrast flight operations that used current voice communications with flight operations that used data link to transmit both strategic and tactical ATC clearances during a typical commercial airflight from takeoff to landing. The results of these tests that used data link as the primary communication source with ATC showed flight crew acceptance, a perceived reduction in crew work load, and a reduction in crew communication errors.
Knox, Charles E.↗
Crash Test of Three Cessna 172 Aircraft at NASA Langley Research Center's Landing and Impact Research Facility
During the summer of 2015, three Cessna 172 aircraft were crash tested at the Landing and Impact Research Facility (LandIR) at NASA Langley Research Center (LaRC). The three tests simulated three different crash scenarios. The first simulated a flare-to-stall emergency or hard landing onto a rigid surface such as a road or runway, the second simulated a controlled flight into terrain with a nose down pitch on the aircraft, and the third simulated a controlled flight into terrain with an attempt to unsuccessfully recover the aircraft immediately prior to impact, resulting in a tail strike condition. An on-board data acquisition system captured 64 channels of airframe acceleration, along with acceleration and load in two onboard Hybrid II 50th percentile Anthropomorphic Test Devices, representing the pilot and co-pilot. Each test contained different airframe loading conditions and results show large differences in airframe performance. This paper presents test methods used to conduct the crash tests and will summarize the airframe results from the test series.
Littell, Justin D.↗
Ride qualities criteria validation/pilot performance study: Flight test results
Pilot performance during a terrain following flight was studied for ride quality criteria validation. Data from manual and automatic terrain following operations conducted during low level penetrations were analyzed to determine the effect of ride qualities on crew performance. The conditions analyzed included varying levels of turbulence, terrain roughness, and mission duration with a ride smoothing system on and off. Limited validation of the B-1 ride quality criteria and some of the first order interactions between ride qualities and pilot/vehicle performance are highlighted. An earlier B-1 flight simulation program correlated well with the flight test results.
Nardi, L. U.↗
Simulation Test Of Descent Advisor
Report describes piloted-simulation test of Descent Advisor (DA), subsystem of larger automation system being developed to assist human air-traffic controllers and pilots. Focuses on results of piloted simulation, in which airline crews executed controller-issued descent advisories along standard curved-path arrival routes. Crews able to achieve arrival-time precision of plus or minus 20 seconds at metering fix. Analysis of errors generated in turns resulted in further enhancements of algorithm to increase accuracies of its predicted trajectories. Evaluations by pilots indicate general support for DA concept and provide specific recommendations for improvement.
Davis, Thomas J.↗
Analysis of validation tests of the Langley pilot transonic cryogenic tunnel
A pilot transonic cryogenic pressure tunnel has recently been developed and proof tested at the NASA Langley Research Center. In addition to providing an attractive method for obtaining high Reynolds number results at moderate aerodynamic loadings and tunnel power, this unique tunnel allows the independent determination of the effects of Reynolds number, Mach number, and dynamic pressure (aeroelasticity) on the aerodynamic characteristics of the model under test. The proof of concept experimental and theoretical studies are briefly reviewed. Experimental results obtained on both two- and three-dimensional models have substantiated that cryogenic test conditions can be set accurately and that cryogenic gaseous nitrogen is a valid test medium.
Ray, E. J.↗
Evaluation of an envelope-limiting device using simulation and flight test of a remotely piloted research vehicle
The operating characteristics of a nonlinear envelope-limiting device were investigated at extreme flight conditions by using a real time digital aircraft spin simulation and flight tests of a scale model remotely piloted research vehicle. A digital mechanization of the F-15 control system, including the stall inhibiter, was used in the simulation and in the control system of the scale model. The operational characteristics of the stall inhibiter and the effects of the stall inhibiter on the spin susceptibility of the airplane were investigated.
Petersen, K. L.↗
Measurement of pilot describing functions from flight test data with an example from Gemini 10
Pilot describing functions measurement and error reduction in flight test data with example from Gemini 10
Edwards, F. G.↗
Measurement of pilot describing functions from flight test data with an example from Gemini X.
Error reduction in identifying pilot describing function from flight test data by shifting input signal by pilot delay time in simulated computer model
Edwards, F. G.↗
A flight test evaluation of the pilot interface with a digital advanced avionics system
A flight study was conducted to study pilot workload and the pilot interface with high levels of avionics capability and automation. The study was done in the context of general aviation, single-pilot IFR operations and utilized an experimental, digital, integrated avionics system. Results indicate that such advanced systems can provide improved information to the pilot and increased functional capability. The results also indicate that additional research is needed to increase the knowledge base required to design the pilot interfaces with highly capable systems. A CRT-based moving map display format tested provided excellent navigational situational awareness but was inferior to an HSI for manual path tracking. The complexity of navigation data management, autopilot management, and maintaining awareness of system status contributed to pilot workload and errors. Suggested guidelines for the design of the pilot/avionics interface for advanced avionics systems are given.
Hinton, D. A.↗