Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,585 records · Page 88

Objectives and first results of the NASA SETI Sky Survey field tests at Goldstone, California

The objectives and preliminary results of the initial field tests of the prototype hardware and software for the NASA SETI program are reviewed with emphasis on the Sky Survey component of the NASA search strategy. In particular, attention is given to field test instrumentation, sky pixelation, sky survey field tests, baseline tests, antenna control tests, and radio frequency interference survey. The test results and observational experience will be used to finalize the design of the SETI Sky Survey processing system and to optimize the observational strategy and procedures in time to begin a full-scale Microwave Observing Program in 1990.

Gulkis, S.↗

Quadrocopter Control Design and Flight Operation

A limiting factor in control system design and analysis for spacecraft is the inability to physically test new algorithms quickly and cheaply. Test flights of space vehicles are costly and take much preparation. As such, EV41 recently acquired a small research quadrocopter that has the ability to be a test bed for new control systems. This project focused on learning how to operate, fly, and maintain the quadrocopter, as well as developing and testing protocols for its use. In parallel to this effort, developing a model in Simulink facilitated the design and analysis of simple control systems for the quadrocopter. Software provided by the manufacturer enabled testing of the Simulink control system on the vehicle.

Karwoski, Katherine↗

NASA Tech Briefs, July 2003

Topics covered include: Real-Time, High-Frequency QRS Electrocardiograph; Software for Improved Extraction of Data From Tape Storage; Radio System for Locating Emergency Workers; Software for Displaying High-Frequency Test Data; Capacitor-Chain Successive-Approximation ADC; Simpler Alternative to an Optimum FQPSK-B Viterbi Receiver; Multilayer Patch Antenna Surrounded by a Metallic Wall; Software To Secure Distributed Propulsion Simulations; Explicit Pore Pressure Material Model in Carbon-Cloth Phenolic; Meshed-Pumpkin Super-Pressure Balloon Design; Corrosion Inhibitors as Penetrant Dyes for Radiography; Transparent Metal-Salt-Filled Polymeric Radiation Shields; Lightweight Energy Absorbers for Blast Containers; Brush-Wheel Samplers for Planetary Exploration; Dry Process for Making Polyimide/ Carbon-and-Boron-Fiber Tape; Relatively Inexpensive Rapid Prototyping of Small Parts; Magnetic Field Would Reduce Electron Backstreaming in Ion Thrusters; Alternative Electrochemical Systems for Ozonation of Water; Interferometer for Measuring Displacement to Within 20 pm; UV-Enhanced IR Raman System for Identifying Biohazards; Prognostics Methodology for Complex Systems; Algorithms for Haptic Rendering of 3D Objects; Modeling and Control of Aerothermoelastic Effects; Processing Digital Imagery to Enhance Perceptions of Realism; Analysis of Designs of Space Laboratories; Shields for Enhanced Protection Against High-Speed Debris; Study of Dislocation-Ordered In(x)Ga(1-x)As/GaAs Quantum Dots; and Tilt-Sensitivity Analysis for Space Telescopes.

Source record↗

ON THE EFFECTIVENESS OF LLMS IN UNIT TEST GENERATION FOR STRUCTURED TEXT PROGRAMS

The reliability of industrial automation systems heavily depends on the correctness of Programmable Logic Controller (PLC) programs, which are often written in Structured Text (ST). While Large Language Models (LLMs) have shown promise in automating test generation for mainstream programming languages, their effectiveness for the syntactically strict ST language remains underexplored. This thesis presents a systematic empirical evaluation of three state-of-the-art LLMs—GPT-4o, Gemini 2.5 Pro, and Claude Sonnet 4.5—for generating ST unit tests. We examine three prompting strategies: Natural Language (NL), Code Language (CL), and Chain-of-Thought (CoT), across a curated set of 11 ST function blocks. The quality of the generated tests is assessed using Compilation Success Rate (CSR), Statement Coverage (SC), and Branch Coverage (BC). In the zero-shot setting, Claude Sonnet 4.5 achieves the highest CSR, while Gemini 2.5 Pro consistently delivers the best statement and branch coverage, particularly under CL prompts. By incorporating a one-shot CL prompt, all models exhibit substantial improvements—most notably GPT-4o, whose CSR increases from 45.45% to 90.91%, with substantial gains in both SC and BC. To further contextualize these findings, we compare GPT-4o’s one-shot results with PLCAutoTester, a state-ofthe- art ST unit test generation tool, on an additional benchmark dataset. While LLMgenerated tests approach competitive coverage levels, PLCAutoTester maintains significantly higher and more stable coverage across programs. This study provides the first comprehensive benchmark of modern LLMs for ST unit testing, highlighting their strengths, limitations, and improvements through one-shot prompting, and positioning their performance relative to specialized automated testing tools in industrial automation.

42 ENGINEERING↗

TASK ALLOCATION IN GEO-DISTRIBUTED CYBER-PHYSICAL SYSTEMS

This paper studies the task allocation algorithm for a distributed test facility (DTF), which aims to assemble geo-distributed cyber (software) and physical (hardware in the loop components into a prototype cyber-physical system (CPS). This allows low cost testing on an early conceptual prototype (ECP) of the ultimate CPS (UCPS) to be developed. The DTF provides an instrumentation interface for carrying out reliability experiments remotely such as fault propagation analysis and in-situ testing of hardware and software components in a simulated environment. Unfortunately, the geo-distribution introduces an overhead that is not inherent to the UCPS, i.e. a significant time delay in communication that threatens the stability of the ECP and is not an appropriate representation of the behavior of the UCPS. This can be mitigated by implementing a task allocation algorithm to find a suitable configuration and assign the software components to appropriate computational locations, dynamically. This would allow the ECP to operate more efficiently with less probability of being unstable due to the delays introduced by geo-distribution. The task allocation algorithm proposed in this work uses a Monte Carlo approach along with Dynamic Programming to identify the optimal network configuration to keep the time delays to a minimum.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Model-Based GN and C Simulation and Flight Software Development for Orion Missions beyond LEO

For Orion missions beyond low Earth orbit (LEO), the Guidance, Navigation, and Control (GN&C) system is being developed using a model-based approach for simulation and flight software. Lessons learned from the development of GN&C algorithms and flight software for the Orion Exploration Flight Test One (EFT-1) vehicle have been applied to the development of further capabilities for Orion GN&C beyond EFT-1. Continuing the use of a Model-Based Development (MBD) approach with the Matlab®/Simulink® tool suite, the process for GN&C development and analysis has been largely improved. Furthermore, a model-based simulation environment in Simulink, rather than an external C-based simulation, greatly eases the process for development of flight algorithms. The benefits seen by employing lessons learned from EFT-1 are described, as well as the approach for implementing additional MBD techniques. Also detailed are the key enablers for improvements to the MBD process, including enhanced configuration management techniques for model-based software systems, automated code and artifact generation, and automated testing and integration.

Odegard, Ryan↗

Automatic Navaids Checkout System

An automatic Navaids Checkout System for use in Space Shuttle development is discussed. The groundwork leading to the development is presented, followed by a description of the hardware. Finally, system utilization including operator interface and system software is discussed. The Navaids Checkout System is extremely flexible with capability to handle different test articles with a minimum of hardware reconfiguration. Application software is written in a high level user-oriented test language. The checkout system has been in operation for approximately one year with capability to handle VOR, ILS, TACAN, ATC Radar Beacon, and UHF/VHF communications equipment.

Belver, T. L.↗

Flight test of a propulsion controlled aircraft system on the NASA F-15 airplane

Flight tests of the propulsion controlled aircraft (PCA) system on the NASA F-15 airplane evolved as a result of a long series of simulation and flight tests. Initially, the simulation results were very optimistic. Early flight tests showed that manual throttles-only control was much more difficult than the simulation, and a flight investigation was flown to acquire data to resolve this discrepancy. The PCA system designed and developed by MDA evolved as these discrepancies were found and resolved, requiring redesign of the PCA software and modification of the flight test plan. Small throttle step inputs were flown to provide data for analysis, simulation update, and control logic modification. The PCA flight tests quickly revealed less than desired performance, but the extensive flexibility built into the flight PCA software allowed rapid evaluation of alternate gains, filters, and control logic, and within 2 weeks, the PCA system was functioning well. The initial objective of achieving adequate control for up-and-away flying and approaches was satisfied, and the option to continue to actual landings was achieved. After the PCA landings were accomplished, other PCA features were added, and additional maneuvers beyond those originally planned were flown. The PCA system was used to recover from extreme upset conditions, descend, and make approaches to landing. A heading mode was added, and a single engine plus rudder PCA mode was also added and flown. The PCA flight envelope was expanded far beyond that originally designed for. Guest pilots from the USAF, USN, NASA, and the contractor also flew the PCA system and were favorably impressed.

Burcham, Frank W., Jr.↗

Initial Field Evaluation of Pilot Procedures for Flying CTAS Descent Clearances

The Center TRACON Automation System (CTAS) is a new support system that is designed to assist air traffic controllers in the management of arrival traffic. CTAS will provide controllers with more information about current air traffic, enabling them to provide clearances for efficient, conflict-free descents that help achieve an orderly stream of aircraft at the final approach fix. CTAS is a computer-based system that functions as a "ground-based FMS" that can predict flight trajectories and arrival times for all incoming aircraft. CTAS uses an aircraft's cruise airspeed; current air traffic, winds and temperature; performance characteristics of the aircraft type; and individual airline preferences to create a flight profile from cruise altitude to the final approach fix. Controllers can use this flight profile to provide a descent clearance that will allow an aircraft to fly an efficient descent and merge more smoothly with other arriving aircraft. A field test of the CTAS Descent Advisor software was conducted at the Denver Center for aircraft arriving at the Stapleton International Airport from September 12-29. CTAS Descent clearances were given to a NASA flight test aircraft and to 77 airline flights that arrived during low traffic periods. For the airline portion of the field test, cockpit procedures and pilot briefing packages for both FMS equipped and unequipped aircraft were developed in cooperation with an airline. The procedures developed for the FMS equipped aircraft were to fly a VNAV descent at a controller specified speed to cross a metering fix at a specified altitude and speed. For nonFMS aircraft, the clearance also specified a CTAS calculated top-of-descent point. Some CTAS related flight deck issues included how much time was available to the pilots' for compliance, the amount of information that needed to be interpreted in the clearance and possible repercussions of misunderstandings. Data collected during the study ranged from subjective data (including the airline pilots' opinions and comments about the new descent clearances and procedures) to objective data (including observations of aircraft performance from the flight deck). This paper will present data and the resulting changes in the design of the procedures and clearance phraseology.

Palmer, Everett↗

Field-Scale Geothermal Tracer Tests [Final CRADA Report]

The potential use of reactive tracers for estimating migration of a cold front between an injection well and a production well in a geothermal reservoir is studied to investigate application of reactive tracers to monitoring the thermal evolution of a geothermal reservoir. Aspects considered in this study include (1) mathematical investigation of the sensitivity of known and hypothetical reactive tracers, (2) laboratory testing of novel tracers that would improve method sensitivity, (3) a software tool for design and interpretation of reactive tracer tests and (4) field testing of the reactive tracer temperature monitoring concept at the Raft River geothermal field.

Source record↗

Exploring the Nature of Neutrinos with the Deep Underground Neutrino Experiment (DUNE)

The Deep Underground Neutrino Experiment (DUNE) is a next-generation experimental program designed to study the behaviour of neutrino oscillation. DUNE will utilize a neutrino beam originating at Fermilab, near Chicago, and will leverage a detector at Fermilab (Near Detector) and a detector 1300 km away in South Dakota (Far Detector), south of Saskatchewan. In the first phase of DUNE, its Far Detector will comprise of two 10,000 ton (fiducial) liquid argon (LAr) time-projection chamber (TPC) modules – powerful tracking calorimeter detectors – placed nearly a mile underground. With this large, sensitive, underground detector, DUNE aims to collect a high statistics and pure sample of neutrinos at the Far Detector. This setup also offers the potential to study non-beam physical processes via e.g. neutrinos produced in the atmosphere, supernova neutrino bursts, and/or solar neutrinos, etc. A second phase will aim to add more detector mass and expand the program. The Near Detector will consist of a LAr TPC module as well: critical to constraining systematic uncertainties in the oscillation analysis. However, this LAr TPC will have a novel design using a pixel-based readout instead of the traditional wire-based readout. This and the segmentation of the LAr TPC into multiple units are crucial in mitigating the high multiplicity of neutrino interactions expected in any readout window given its proximity to the beam. The Near Detector will feature additional components and capability beyond the LAr TPC, allowing one to deeply characterize the neutrino flux. Due to the complexity of this experimental program, several smaller-scale prototype detectors have been operating to test, validate, and improve both the technical designs and software for processing and analyzing events. By operating in charged particle test beams or neutrino beams, several of the prototypes are also capable of producing valuable results. Canadian institutions are involved in the realization of the DUNE through efforts with both the Near and Far Detectors and prototypes. DUNE is anticipated to begin operating near the end of this decade/the beginning of the next. This talk will focus on the overall DUNE program, for example its ultimate plans, status, and the efforts with prototypes.

Howard, Bruce [York U., Canada; Fermilab]↗

Development of Lidar Sensor Systems for Autonomous Safe Landing on Planetary Bodies

Lidar has been identified by NASA as a key technology for enabling autonomous safe landing of future robotic and crewed lunar landing vehicles. NASA LaRC has been developing three laser/lidar sensor systems under the ALHAT project. The capabilities of these Lidar sensor systems were evaluated through a series of static tests using a calibrated target and through dynamic tests aboard helicopters and a fixed wing aircraft. The airborne tests were performed over Moon-like terrain in the California and Nevada deserts. These tests provided the necessary data for the development of signal processing software, and algorithms for hazard detection and navigation. The tests helped identify technology areas needing improvement and will also help guide future technology advancement activities.

Amzajerdian, Farzin↗

Progress on Gust Load Alleviation Wind Tunnel Experiment and Aeroservoelastic Model Validation for a Flexible Wing with Variable Camber Continuous Trailing Edge Flap System

This paper discusses a wind tunnel experiment of active gust load alleviation of a flexible wing which took place at University of Washington (UW) in 2019. The experiment performed under a NASA SBIR contract with Scientific Systems Company, Inc (SSCI). The objective of the experiment is to demonstrate active controls of the Variable Camber Continuous Trailing Edge Flap (VCCTEF) system for gust load alleviation and real-time drag optimization. The wind tunnel model is a 8.2% sub-scale Common Research Model (CRM) wing. The wing structure is designed to provide a substantial degree of flexibility to represent that of a modern high-aspect ratio wing. Eight active control surfaces are employed in the VCCTEF. A new gust generator system was designed and installed by UW under a sub-contract with SSCI. The first test entry started in July 2019 and ended in September 2019. During this test entry, many significant issues were found with the hardware and software. The significant issues with the servos prevented the test objective from being completed. A follow-up second test entry in 2020 is being planned. The wing system is being repaired by SSCI. This paper reports on the progress of this experimental effort and the aeroservoelastic (ASE) model validation which was conducted during the test entry.

Nguyen, Nhan↗

Real-Time Digital Simulation of Inertial Response with Hardware-in-the-Loop Implementation on the CART3 Wind Turbine at the National Wind Technology Center

With increasing penetrations of wind power on electric grids, the stability and reliability of interconnected power systems may be impacted. In some countries that have developed renewable energy sources and systems, grid codes have been revised to require wind power plants (WPPs) to provide ancillary services to support the power system frequency in case of severe grid events. To do this, wind turbine generators (WTGs) should be deloaded to reserve a certain amount of active power for primary frequency response; however, deloading curtails annual energy production, and the market for this type of service needs to be further developed. In this report, we focus on the temporary frequency support provided by WTGs through inertial response. WTGs have potential to provide inertial response, but appropriate control methods should be implemented. With the implemented inertial control methods, wind turbines are capable of increasing their active power output by releasing some of their stored kinetic energy when a frequency excursion occurs. Active power can be temporarily boosted above the maximum power points, after which the rotor speed decelerates, and subsequently an active power output reduction restores the kinetic energy. In this report, we develop two types of models for wind power systems: the first is common, based on the wind power aerodynamic equation, and the power coefficient can be regressed using nonlinear functions; the second is much more complicated, wherein the wind turbine system is modeled using the Fatigue, Aerodynamics, Structures, and Turbulence Modeling (FAST) tool with several degrees of freedoms. A nine-bus test power system is built in Simulink and the Real-Time Digital Simulator, respectively, which are used to evaluate the frequency support performance of the WPPs. We implement two distinct types of inertial control methods in the modeled wind turbines: frequency-based inertial control (FBIC) and stepwise inertial control (SIC). We compare the performances of the two methods in terms of their frequency nadirs, rates of change of frequency, and recovery times. We conclude the results under various wind speeds and penetration cases, which provide insight into designing the inertial response of WTGs. Further, we discuss the impact of the parameters on the performance of the inertial control methods. We evaluate both the scaling factors for the FBIC method and the slope values for the TLIC methods. The simulation work shows the characteristics of different inertial responses compared to conventional synchronous generators. Based on the simulation results, we modify, improve, and test the inertial control methods under a more realistic wind turbine model based on FAST. We then validate the inertial responses under highly turbulent wind conditions generated by TurbSim, and we examine their influences on the turbine mechanical components. The extensive simulation proves the effectiveness of the proposed inertial control methods as well as the nine-bus test power system. We then reconsider the parameters. We rebuild the same test power system using Real time Simulator Computer Aided Design (RSCAD), and we implement the inertial control methods in the real Controls Advanced Research Turbine (CART3), which is prepared for the hardware-in-the-loop field-test simulation. After the setups for the hardware and software hybrid simulation platform are complete, the inertial response is further tested on a real wind turbine for the first time, in which CART3 release the controlled inertial response against the emulated frequency excursion, provided by the real-time simulated power system test bed in RTDS.

17 WIND ENERGY↗

Multi-version software reliability through fault-avoidance and fault-tolerance

A number of experimental and theoretical issues associated with the practical use of multi-version software to provide run-time tolerance to software faults were investigated. A specialized tool was developed and evaluated for measuring testing coverage for a variety of metrics. The tool was used to collect information on the relationships between software faults and coverage provided by the testing process as measured by different metrics (including data flow metrics). Considerable correlation was found between coverage provided by some higher metrics and the elimination of faults in the code. Back-to-back testing was continued as an efficient mechanism for removal of un-correlated faults, and common-cause faults of variable span. Software reliability estimation methods was also continued based on non-random sampling, and the relationship between software reliability and code coverage provided through testing. New fault tolerance models were formulated. Simulation studies of the Acceptance Voting and Multi-stage Voting algorithms were finished and it was found that these two schemes for software fault tolerance are superior in many respects to some commonly used schemes. Particularly encouraging are the safety properties of the Acceptance testing scheme.

Vouk, Mladen A.↗

Test Generator for MATLAB Simulations

MATLAB Automated Test Tool, version 3.0 (MATT 3.0) is a software package that provides automated tools that reduce the time needed for extensive testing of simulation models that have been constructed in the MATLAB programming language by use of the Simulink and Real-Time Workshop programs. MATT 3.0 runs on top of the MATLAB engine application-program interface to communicate with the Simulink engine. MATT 3.0 automatically generates source code from the models, generates custom input data for testing both the models and the source code, and generates graphs and other presentations that facilitate comparison of the outputs of the models and the source code for the same input data. Context-sensitive and fully searchable help is provided in HyperText Markup Language (HTML) format.

Henry, Joel↗

Orion Optical Navigation Progress Toward Exploration Mission 1

Optical navigation of human spacecraft was proposed on Gemini and implemented successfully on Apollo as a means of autonomously operating the vehicle in the event of lost communication with controllers on Earth. The Orion emergency return system utilizing optical navigation has matured in design over the last several years, and is currently undergoing the final implementation and test phase in preparation for Exploration Mission 1 (EM-1) in 2019. The software development is past its Critical Design Review, and is progressing through test and certification for human rating. The filter architecture uses a square-root-free UDU covariance factorization. Linear Covariance Analysis (LinCov) was used to analyze the measurement models and the measurement error models on a representative EM-1 trajectory. The Orion EM-1 flight camera was calibrated at the Johnson Space Center (JSC) electro-optics lab. To permanently stake the focal length of the camera a 500 mm focal length refractive collimator was used. Two Engineering Design Unit (EDU) cameras and an EDU star tracker were used for a live-sky test in Denver. In-space imagery with high-fidelity truth metadata is rare so these live-sky tests provide one of the closest real-world analogs to operational use. A hardware-in-the-loop test rig was developed in the Johnson Space Center Electro-Optics Lab to exercise the OpNav system prior to integrated testing on the Orion vehicle. The software is verified with synthetic images. Several hundred off-nominal images are also used to analyze robustness and fault detection in the software. These include effects such as stray light, excess radiation damage, and specular reflections, and are used to help verify the tuning parameters chosen for the algorithms such as earth atmosphere bias, minimum pixel intensity, and star detection thresholds.

Holt, Greg N.↗

Shuttle relative navigation of a tethered satellite mission with current on board software

A Shuttle mission planned in 1991 will test the feasibility of tethers in space. This mission, a joint effort between Italy and the United States, will connect a satellite (built by the Italians) to the Shuttle with a 20 km long tether. This mission poses unique navigation problems. The flight software on the Shuttle was never designed to account for the low level acceleration that is generated by the gravity gradient. IMUs on the Shuttle was never designed to account for the low level acceleration that is generated by the gravity gradient. Inertial Maneuvering Units on the shuttle will sense the acceleration of the tether but it turns out that incorporating the continuous accelerometer noise also generates large error growth. Relative navigation is another important issue since the majority of the mission will be conducted while the satellite is out of the visual range of the crew. Some kind of feedback on the motion of the satellite will be desirable. Feedback of the satellite motion can be generated by using the rendezvous radar. To process the radar measurements, the flight software uses a 13 state Kalman Filter, but unfortunately with the filter currently tuned as it is, valid measurements tend to be ignored. This is due to the constraint of the tether on the satellite, which is an unmodeled force. Analysis shows that with proper tuning, relative navigation is possible.

Lee, Kevin A.↗