Automatic Generation of Test Oracles - From Pilot Studies to Application
Cost, performance and functionality concerns are driving a trend towards use of self-sufficient autonomous systems in place of human-controlled mechanisms.
Test↗
SEARCH · Engineering Papers
Results for “Test Pilots”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
High Performance Solvent for NGCC Flue Gas CO 2 Capture (Final Technical Report)
Amine-based solvent absorption is the most mature and reliable technology for large scale CO 2 capture, dating back to the 1930s when monoethanolamine (MEA) was used to treat acid gases from oil refineries. However, while strategic advancements have optimized the CO2 capture process, the cost of capture remains high, where current estimates suggest that CO 2 capture costs are around $\$$72/tonne of CO 2 . To address this, solvent development and optimization have become a focus of current research. This project sought to develop a high-performance solvent to reduce the overall cost of CO 2 capture from NGCC flue gas. Here, solvent optimization focused on: (1) reducing the energy required for CO 2 desorption in a reboiler, (2) improving CO 2 absorption and desorption reaction kinetics, (3) improving solvent stability, and (4) reducing environmental impacts. Susteon has developed and evaluated a promoted solvent, Sustenol™, for NGCC flue gas CO 2 capture. The optimized Sustenol™ also shows a higher dynamic CO 2 absorption capacity of ~0.5 mol CO2 /mol amine compared to 0.25 mol CO2 /mol amine for 30 wt% MEA. Additionally, the solvent is oxidatively, thermally and hydrothermally stable, which leads to lower solvent loss and emissions. These advancements have resulted in a solvent regeneration energy of 2.16 GJ/tonne of CO 2 which is >30% lower than current state-of-the-art commercial and emerging solvents. Combined with empirical data from the bench and pilot scale testing, this preliminary TEA study indicated the cost of CO 2 capture by Sustenol™ for 97% CO 2 removal at $\$$54/tonne and for 90% removal at $\$$49/tonne, with a pathway to achieve $\$$45/tonne of CO 2 with continued process and solvent advancements. Susteon has developed a technology roadmap to reduce the cost of CO 2 capture to <$\$$45/tonne for NGCC flue gas. Susteon plans to derisk this technology for commercial deployment through comprehensive solvent degradation testing, long-term testing in a pilot plant at 5 tonne CO2 /day and demonstration scale testing at 100 tonne CO2 /day with NGCC flue gas and engineering design studies to qualify Sustenol™ as a drop-in replacement solvent.
03 NATURAL GAS↗
Automatic Generation of Test Oracles - From Pilot Studies of Application
There is a trend towards increased use of automation in V&V. Automation can yield savings in time and effort. For critical systems, where thorough V&V is required, these savings can be substantial.
testing↗
Overview of Advanced Plasma-Facing Materials Testing for Fusion Pilot Plants at DIII-D
Explore the source record for details and available documents.
Coburn, Jonathan D. [Sandia National Laboratories ↗
Pilot Deployment and Testing of Exoskeleton Devices at the Hanford Site .
Abstract not provided.
Wheeler, Jason↗
Extraterrestrial resources: Implications from terrestrial experience
Terrestrial mining experience indicates that the overwhelming criterion of a potentially economic deposit is its recoverable concentration of the desired mineral or element. Recovery can be based on contrast in physical and/or chemical properties, but processes based on physical properties are typically less expensive. As several processes generally are used in sequence, they have a profound effect on extraction costs. These criteria will also apply to extraterrestrial resources. Although the extreme cost of access to space makes even ordinary materials extremely valuable, this inaccessibility also makes capital and maintenance costs extremely high. The following four development stages will apply, especially with the additional unknowns of an extraterrestrial environment: (1) Exploration for the highest grade of the mineral or element desired (because the extraction plant must be simple, cheap, and rugged to minimize capital and maintenance costs, high grade is extremely important); (2) Laboratory testing of various physical and/or chemical separation techniques on the possible ore to determine if the material can indeed be recovered economically; (3) a pilot plant test, in which a large sample is dug from the deposit to determine excavation rates, power requirements, and equipment wear. (This sample is then run through a pilot mill designed on the basis of the laboratory testing. Pilot plant testing must be carried out at increasing scales, but several trials are generally necessary at each scale before the size of operations can be increased. Moreover, pilot testing is necessary for each new mineral deposit); and (4) Last is the full-scale mine and plant start-up. (New problems invariably occur at this point, but they can be kept to a minimum if the pilot plant tests were realistic). If such a development plan is followed rigorously, major cost overruns, with their potentially disastrous effects on resource developments, can be avoided.
Kuck, David L.↗
Application of Sequential Design of Experiments (SDoE) to Large Pilot-Scale Solvent-Based CO2 Capture Process at Technology Centre Mongstad (TCM)
The United States Department of Energy’s Carbon Capture Simulation for Industry Impact (CCSI2) program has developed a framework for sequential design of experiments (SDoE) that aims to maximize knowledge gained from budget- and schedule-limited pilot scale testing. SDoE was applied to the planning and execution of campaigns for testing CO2 capture systems at pilot-scale in order to optimally allocate resources available for the testing. In this methodology, a stochastic process model is developed by quantifying the parametric uncertainty in submodels of interest; for a solvent-based CO2 capture system, these may include physical properties and equipment performance submodels (e.g., mass transfer, interfacial area). This uncertainty is propagated through the full process model, over variable operating conditions, for estimating the resulting uncertainty in key model outputs (e.g., percentage of CO2 capture, solvent regeneration energy requirement). In developing a data collection plan, the predicted output uncertainty is incorporated into an algorithm that seeks simultaneously to select process operating conditions for which the predicted uncertainty is relatively high and to ensure that the entire space of operation is well represented. This test plan is then used to guide operation of the pilot plant at varying steady-state conditions, with resulting process data incorporated into the existing model using Bayesian inference to refine parameter distributions. The updated stochastic model, with reduced parametric uncertainty from data collected, is then used to guide additional data collection, thus the sequential nature of the experimental design. The SDoE process was implemented at the pilot test unit (12 MWe in scale) at Norway’s Technology Centre Mongstad (TCM) in a summer 2018 test campaign with aqueous monoethanolamine (MEA). During the test campaign, the varied operating conditions included the flowrates of circulated solvent, flue gas, and reboiler steam and the CO2 concentration in the flue gas. The process data were used to update probability distributions of mass transfer and interfacial area parameters of a stochastic process model developed by the CCSI2 team. Two iterations of the SDoE process were executed, resulting in the uncertainty in model predicted CO2 capture percentage decreasing by an average of 58.0 ± 4.7% over the full input space of interest. This work demonstrates the potential of the SDoE process for model refinement through reduction in process model parametric uncertainty, and ultimately risk in scale-up, in CO2 capture technology performance.
carbon capture↗
Space shuttle pilot-induced-oscillation research testing
The simulation requirements for investigation of pilot-induced-oscillation (PIO) characteristics during the landing phase are discussed. Orbiters simulations and F-8 digital fly-by-wire aircraft tests are addressed.
Powers, B. G.↗
Integrated System Health Management (ISHM) Implementation in Rocket Engine Testing
A pilot operational ISHM capability has been implemented for the E-2 Rocket Engine Test Stand (RETS) and a Chemical Steam Generator (CSG) test article at NASA Stennis Space Center. The implementation currently includes an ISHM computer and a large display in the control room. The paper will address the overall approach, tools, and requirements. It will also address the infrastructure and architecture. Specific anomaly detection algorithms will be discussed regarding leak detection and diagnostics, valve validation, and sensor validation. It will also describe development and use of a Health Assessment Database System (HADS) as a repository for measurements, health, configuration, and knowledge related to a system with ISHM capability. It will conclude with a discussion of user interfaces, and a description of the operation of the ISHM system prior, during, and after testing.
Figueroa, Fernando↗
Pilot Escape from Spinning Airplanes as Determined from Free-spinning-tunnel Tests
Procedure for pilot escape from spinning airplanes has been determined by means of tests in which pilot escape was simulated from 21 airplane models spinning in the Langley 20-foot free-spinning tunnel. The results in general indicated that the pilot should bail out of the outboard side. Calculated centripetal accelerations acting on the pilot during a spin are presented.
SAFETY - PILOT ESCAPE TECHNIQUES↗
FT-01: Autonomous Helicopter Flight Testing Over Long Island Sound Special Session - Hazard Perception and Avoidance Tech Area
This presentation is included as part of a panel reporting on the Integration of Automated Systems (IAS) flight test series. The IAS series concluded in October 2023 and was conducted under NASA’s Advanced Air Mobility project and in partnership with Sikorsky and the Defense Advanced Research Projects Agency (DARPA). The flight test effort included two crewed rotorcraft platforms. The first, a modified S-76B helicopter, served as the “ownship” for the duration of the flight test. The second vehicle, a modified S-70, served as the intruder aircraft. One Sikorsky pilot and one NASA test pilot was onboard each aircraft for every test point, with the NASA test pilot responsible for interacting with the research systems under test. This portion of the panel presentation focuses on the results of the flight test that assessed the Federal Aviation Administration’s (FAA) next-generation collision avoidance system, the Airborne Collision Avoidance System X for Rotorcraft (ACAS Xr). The two configurations available within ACAS Xr – the Collision Avoidance System (CAS) configuration and the Detect and Avoid (DAA) configuration – were flown with an onboard pilot under Visual Flight Rules in controlled airspace over the Long Island Sound (Connecticut, USA). A total of 33 flight test cards were flown with ACAS Xr active. Results showed that the ACAS Xr alerting and guidance was largely effective and rated positively by the NASA test pilots, exemplified by zero instances of the pilots overriding an ACAS Xr Resolution Advisory (RA). Key areas of improvement, however, were noted, particularly with regards to the lack of an aural alert indicating a need to accelerate when receiving an RA at low speed and the occurrence of multiple RAs that the pilots found to be unacceptable.
detect and avoid↗
Detect and Avoid and Collision Avoidance Flight Test Results with ACAS Xr
In October 2023, the National Aeronautics and Space Administration (NASA) completed its Integration of Automated Systems flight test series, conducted under NASA’s Advanced Air Mobility project and in partnership with Sikorsky and the Defense Advanced Research Projects Agency (DARPA). The flight test effort included two crewed rotorcraft platforms. The first, a modified S-76B helicopter, served as the “ownship” for the duration of the flight test. The second vehicle, a modified S-70, served as the intruder aircraft. One Sikorsky pilot and one NASA test pilot was onboard each aircraft for every test point, with the NASA test pilot responsible for interacting with the research systems under test. Approximately half of the flight test was devoted to assessing the Federal Aviation Administration’s (FAA) next-generation collision avoidance system, the Airborne Collision Avoidance System X for Rotorcraft (ACAS Xr). The two configurations available within ACAS Xr – the Collision Avoidance System (CAS) configuration and the Detect and Avoid (DAA) configuration – were flown with an onboard pilot under Visual Flight Rules in controlled airspace over the Long Island Sound (Connecticut, USA). A total of 33 flight test cards were flown with ACAS Xr active. The ownship was equipped with ACAS Xr and the intruder was equipped with Automatic Dependent Surveillance-Broadcast (ADS-B). The test points were blocked by ACAS Xr configuration, with individual encounters varying the ownship speed (90 knots or 20 knots), the intruder designation (en-route, terminal area, or structured airspace), and method of RA execution (automated or manually executed). Results showed that the ACAS Xr alerting and guidance was largely effective and rated positively by the NASA test pilots, exemplified by zero instances of the pilots overriding an ACAS Xr Resolution Advisory (RA). Key areas of improvement, however, were noted, particularly with regards to the lack of an aural alert indicating a need to accelerate when receiving an RA at low speed and the occurrence of multiple RAs that the pilots found to be unacceptable.
detect and avoid↗
Detect and Avoid and Collision Avoidance Flight Test Results with ACAS Xr
In October 2023, the National Aeronautics and Space Administration (NASA) completed its Integration of Automated Systems flight test series, conducted under NASA’s Advanced Air Mobility project and in partnership with Sikorsky and the Defense Advanced Research Projects Agency (DARPA). The flight test effort included two crewed rotorcraft platforms. The first, a modified S-76B helicopter, served as the “ownship” for the duration of the flight test. The second vehicle, a modified S-70, served as the intruder aircraft. One Sikorsky pilot and one NASA test pilot was onboard each aircraft for every test point, with the NASA test pilot responsible for interacting with the research systems under test. Approximately half of the flight test was devoted to assessing the Federal Aviation Administration’s (FAA) next-generation collision avoidance system, the Airborne Collision Avoidance System X for Rotorcraft (ACAS Xr). The two configurations available within ACAS Xr – the Collision Avoidance System (CAS) configuration and the Detect and Avoid (DAA) configuration – were flown with an onboard pilot under Visual Flight Rules in controlled airspace over the Long Island Sound (Connecticut, USA). A total of 33 flight test cards were flown with ACAS Xr active. The ownship was equipped with ACAS Xr and the intruder was equipped with Automatic Dependent Surveillance-Broadcast (ADS-B). The test points were blocked by ACAS Xr configuration, with individual encounters varying the ownship speed (90 knots or 20 knots), the intruder designation (en-route, terminal area, or structured airspace), and method of RA execution (automated or manually executed). Results showed that the ACAS Xr alerting and guidance was largely effective and rated positively by the NASA test pilots, exemplified by zero instances of the pilots overriding an ACAS Xr Resolution Advisory (RA). Key areas of improvement, however, were noted, particularly with regards to the lack of an aural alert indicating a need to accelerate when receiving an RA at low speed and the occurrence of multiple RAs that the pilots found to be unacceptable.
detect and avoid↗
Transforming Aeration Energy in Water Resource Recovery Facilities (WRRFs) through Suboxic Nitrogen Removal (Final Report)
The objective of this project was to advance two key technological components—aeration control strategies and process design methodologies—to support the development and broader adoption of suboxic biological nitrogen removal (SBNR). The project focused on achieving the following three goals: • Enhance Model Predictive Control (MPC) Technology: Advance the DO/Nmaster MPC platform from its initial 2018 pilot deployment at the Chico Water Resource Recovery Facility in California to full-scale integration. This included partnering with a blower technology commercialization partner and incorporating machine learning (ML) capabilities to enable nationwide deployment. • Bridge Knowledge Gaps in SBNR Process Design: Address fundamental gaps in SBNR process understanding through controlled pilot-scale testing at a dedicated pilot facility. These efforts supported the development of robust kinetic models to inform reliable SBNR control, operational strategies, and design frameworks. • Demonstrate Full-Scale Implementation of Low DO/SBNR with ML: Transition low dissolved oxygen (DO)/SBNR coupled with ML from pilot-scale trials to full-scale demonstration in flow-through biological nutrient removal (BNR) systems, with the goal of enabling scalable, nationwide adoption in activated sludge treatment processes. The project included demonstration of SBNR at the pilot scale as performed by Hampton Roads Sanitation District (HRSD) and at the full-scale as performed by the Los Angeles County Sanitation Districts' (LACSD) Pomona Water Reclamation Plant (POWRP).
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Flight tests with a data link used for air traffic control information exchange
Previous studies showed that air traffic control (ATC) message exchange with a data link offers the potential benefits of increased airspace system safety and efficiency. To accomplish these benefits, data link can be used to reduce communication errors and relieve overloaded ATC voice radio frequencies, which hamper efficient message exchange during peak traffic periods. Flight tests with commercial airline pilots as test subjects were conducted in the NASA Transport Systems Research Vehicle Boeing 737 airplane to contrast flight operations that used current voice communications with flight operations that used data link to transmit both strategic and tactical ATC clearances during a typical commercial airflight from takeoff to landing. The results of these tests that used data link as the primary communication source with ATC showed flight crew acceptance, a perceived reduction in crew work load, and a reduction in crew communication errors.
Knox, Charles E.↗
Crash Test of Three Cessna 172 Aircraft at NASA Langley Research Center's Landing and Impact Research Facility
During the summer of 2015, three Cessna 172 aircraft were crash tested at the Landing and Impact Research Facility (LandIR) at NASA Langley Research Center (LaRC). The three tests simulated three different crash scenarios. The first simulated a flare-to-stall emergency or hard landing onto a rigid surface such as a road or runway, the second simulated a controlled flight into terrain with a nose down pitch on the aircraft, and the third simulated a controlled flight into terrain with an attempt to unsuccessfully recover the aircraft immediately prior to impact, resulting in a tail strike condition. An on-board data acquisition system captured 64 channels of airframe acceleration, along with acceleration and load in two onboard Hybrid II 50th percentile Anthropomorphic Test Devices, representing the pilot and co-pilot. Each test contained different airframe loading conditions and results show large differences in airframe performance. This paper presents test methods used to conduct the crash tests and will summarize the airframe results from the test series.
Littell, Justin D.↗
Noble Metals Testing on the DM1200 Pilot Melter System with AZ-101 HLW Simulants, VSL-03R3740-2, Rev. 0
This report documents the results obtained with respect to the behavior of noble metals in tests on the DM1200 HLW Pilot Melter during processing of simulated HLW AZ-101 feed. The principal objective of these tests was to collect data to determine the extent of retention of noble metals in the melter since that is an important uncertainty in determining the expected life of the WTP HLW melter. The present results constitute one part of an integrated testing strategy that has been developed to address this risk.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Ride qualities criteria validation/pilot performance study: Flight test results
Pilot performance during a terrain following flight was studied for ride quality criteria validation. Data from manual and automatic terrain following operations conducted during low level penetrations were analyzed to determine the effect of ride qualities on crew performance. The conditions analyzed included varying levels of turbulence, terrain roughness, and mission duration with a ride smoothing system on and off. Limited validation of the B-1 ride quality criteria and some of the first order interactions between ride qualities and pilot/vehicle performance are highlighted. An earlier B-1 flight simulation program correlated well with the flight test results.
Nardi, L. U.↗