Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Fault-tolerance experiments with the JPL STAR computer.

Results of fault-tolerance experiments performed using an experimental computer with dynamic (standby) redundancy, including replaceable subsystems and a 'program rollback' provision to eliminate transient-caused errors. After a brief review of the specification of fault-tolerance with respect to transient faults, including a description of the method of injection of transient faults in software and system tests, fault-tolerance experiments carried out with this computer with regard to the determination of fault classes, software verification, system verification, and recovery stability are summarized. A test and repair processor is described which constitutes a special monitor unit of the computer and is used to obtain information for fault detection in the other subsystems of the computer and to ensure that proper recovery occurs when a fault is detected.

Avizienis, A.↗

Integrated testing and verification system for research flight software design document

The NASA Langley Research Center is developing the MUST (Multipurpose User-oriented Software Technology) program to cut the cost of producing research flight software through a system of software support tools. The HAL/S language is the primary subject of the design. Boeing Computer Services Company (BCS) has designed an integrated verification and testing capability as part of MUST. Documentation, verification and test options are provided with special attention on real time, multiprocessing issues. The needs of the entire software production cycle have been considered, with effective management and reduced lifecycle costs as foremost goals. Capabilities have been included in the design for static detection of data flow anomalies involving communicating concurrent processes. Some types of ill formed process synchronization and deadlock also are detected statically.

Taylor, R. N.↗

Extended Bandwidth Spread Spectrum Time Domain Reflectometry Cable Test for Thermal Aging, Low Resistance Fault, and Water Detection

In 2022, researchers at Pacific Northwest National Laboratory (PNNL) used the Accelerated and Real-Time Environmental Nodal Assessment (ARENA) cable and motor test bed to characterize spread spectrum time domain reflectometry (SSTDR) and compare the responses of an SSTDR instrument to those of a frequency domain reflectometry (FDR) instrument. Results showed both techniques could detect and locate cable anomalies such as phase-to-phase low resistance and shorts, thermal insulation damage, mechanical insulation damage, and the presence or absence of water in some conditions. The SSTDR tests used a commercial instrument provided by LiveWire Innovations Inc. This commercial instrument performed tests at 6, 12, 24, and 48 MHz bandwidth. The results of these tests were compared to FDR tests where bandwidths could be extended up to 1.3 GHz, although the best responses for cable tests were from 100 to 500 MHz. Lower bandwidth signals can propagate better along the cable while higher bandwidths have higher resolution for impedance change reflections allowing more precise indication of location and separation of anomalies. The 2022 research found that FDR responses were clearer than SSTDR and speculated that a higher bandwidth SSTDR could more successfully detect and locate cable anomalies. One advantage of the SSTDR system investigated was that it was designed for energized online use up to 1,000 volts, which may be a significant advantage for nuclear power plant use. The LiveWire SSTDR instrument is an established product in the rail and aircraft industry and updating the SSTDR hardware parameters is difficult to justify without more conclusive testing. Therefore, a software adjustable laboratory SSTDR instrument was developed by PNNL and was used to test extended bandwidth SSTDR cable tests. Within the ARENA test bed, 42 cable conditions were tested with the PNNL SSTDR, FDR, and the LiveWire SSTDR—each operating at four different bandwidths. Observations and conclusions regarding the relative performance of the three instruments over different bandwidths are note below. Responses of the PNNL SSTDR (at 50 MHz) and the LiveWire SSTDR (at 48 MHz) were similar. The PNNL SSTDR higher frequency bandwidths behaved as expected showing sharper peaks and higher noise. This validated the PNNL SSTDR as a reasonable implementation of the SSTDR technology. Lower bandwidth SSTDR responses (particularly 6 and 12 MHz) may have increased value for use within longer cables but were not particularly effective at identifying anomalous cable behavior in the 100 ft cables tested here. The higher bandwidths of the PNNL SSTDR (50, 100, 200, and 400 MHz) did not provide substantially clearer cable reflectometry responses, but having the higher frequency responses available did add to the cable test evaluation. Strong responses to shorts and low impedance faults between phases were particularly evident in the higher bandwidth PNNL SSTDR and the FDR data. Measurements were repeatable, with similar responses obtained from a thermally aged cable for tests taken a month apart. Signal noise was affected in the unshielded cable by the local in-tray cable arrangement including proximity to metal edges and rungs of the cable tray. Foam isolation of the cable from the tray metal reduced in both FDR and SSTDR responses. Cable condition monitoring in nuclear power plants will likely benefit from both more informative off-line testing methods and from the development of on-line methods for continuous monitoring of cables in use. The LWRS-funded ARENA test bed was a valuable resource for this development and direct comparison of nuclear electrical cable condition monitoring technologies. Test results are targeted to guide industry advancement of testing and monitoring tools for cable aging management.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

NASA Shuttle Training Aircraft flight simulation overview

The Shuttle Training Aircraft (STA) is a variable stability, variable control law flying simulator used by NASA/JSC to train astronauts in the final landing phase of a Space Shuttle Orbiter. A general outline is given for the STA flight simulation system. An overview is given of the software generation and verification process through the Advanced Validation System (AVAS). The flight test techniques for software verification will be reviewed and the process for releasing the software for flight training will be covered. The astronaut STA training syllabus is examined. Parameter matching with the Orbiter in the final approach phase of de-orbit and landing is briefly examined. Simulation performance will be assessed against flight data, performance measurement, and cue synchronization.

Justiz, Charles R.↗

An Integrated Analysis-Test Approach

This viewgraph presentation provides an overview of a project to develop a computer program which integrates data analysis and test procedures. The software application aims to propose a new perspective to traditional mechanical analysis and test procedures and to integrate pre-test and test analysis calculation methods. The program also should also be able to be used in portable devices and allows for the 'quasi-real time' analysis of data sent by electronic means. Test methods reviewed during this presentation include: shaker swept sine and random tests, shaker shock mode tests, shaker base driven model survey tests and acoustic tests.

Kaufman, Daniel↗

Structural Analysis and Test Comparison of a 20-Meter Inflation-Deployed Solar Sail

Under the direction of the NASA In-Space Propulsion Technology Office, the team of L Garde, NASA Jet Propulsion Laboratory, Ball Aerospace, and NASA Langley Research Center has been developing a scalable solar sail configuration to address NASA s future space propulsion needs. Prior to a flight experiment of a full-scale solar sail, a comprehensive test program was implemented to advance the technology readiness level of the solar sail design. These tests consisted of solar sail component, subsystem, and sub-scale system ground tests that simulated the aspects of the space environment such as vacuum and thermal conditions. In July 2005, a 20-m four-quadrant solar sail system test article was tested in the NASA Glenn Research Center s Space Power Facility to measure its static and dynamic structural responses. Key to the maturation of solar sail technology is the development of validated finite element analysis (FEA) models that can be used for design and analysis of solar sails. A major objective of the program was to utilize the test data to validate the FEA models simulating the solar sail ground tests. The FEA software, ABAQUS, was used to perform the structural analyses to simulate the ground tests performed on the 20-m solar sail test article. This paper presents the details of the FEA modeling, the structural analyses simulating the ground tests, and a comparison of the pretest and post-test analysis predictions with the ground test results for the 20-m solar sail system test article. The structural responses that are compared in the paper include load-deflection curves and natural frequencies for the beam structural assembly and static shape, natural frequencies, and mode shapes for the solar sail membrane. The analysis predictions were in reasonable agreement with the test data. Factors that precluded better correlation of the analyses and the tests were unmeasured initial conditions in the test set-up.

Sleight, David W.↗

Ontological Modeling for Integrated Spacecraft Analysis

Current spacecraft work as a cooperative group of a number of subsystems. Each of these requiresmodeling software for development, testing, and prediction. It is the goal of my team to create anoverarching software architecture called the Integrated Spacecraft Analysis (ISCA) to aid in deploying the discrete subsystems' models. Such a plan has been attempted in the past, and has failed due to the excessive scope of the project. Our goal in this version of ISCA is to use new resources to reduce the scope of the project, including using ontological models to help link the internal interfaces of subsystems' models with the ISCA architecture.I have created an ontology of functions specific to the modeling system of the navigation system of a spacecraft. The resulting ontology not only links, at an architectural level, language specificinstantiations of the modeling system's code, but also is web-viewable and can act as a documentation standard. This ontology is proof of the concept that ontological modeling can aid in the integration necessary for ISCA to work, and can act as the prototype for future ISCA ontologies.

ontological modeling↗

MBSE Validation and Verification: Case Study for LADEE

The Lunar Atmosphere Dust Environment Explorer (LADEE) mission orbited the moon in order to measure the density, composition, and time variability of the lunar dust environment. The successful mission launched September 7, 2013 and was de-orbited and impacted the moon's surface on April 17, 2014. The ground-side and onboard flight software for the mission was developed using a “Model-Based Software Engineering” (MBSE) methodology combined with strong reuse of Government and Commercial Off-The Shelf (G/COTS) components. Models of the spacecraft and flight software were developed in a graphical dynamics modeling package. Flight Software requirements were prototyped and refined using the simulated models. After the model was shown to work as desired in the simulation framework, C-code software was automatically generated from the models. The auto-generated software was then tested in real-time Processor-in-the-Loop and Hardware-in-the-Loop test beds. “Traveling Road Show” test beds were used for early integration tests with payloads and other subsystems. Traditional techniques for verifying computational sciences models were used to characterize the spacecraft simulation. A lightweight set of formal methods analysis, static analysis, formal inspection, and code coverage analyses were utilized to further reduce defects in the onboard flight software artifacts. These techniques were applied early and often in the development process, iteratively increasing the capabilities of software and fidelity of vehicle models and test beds.

Model-Based Software Engineering, Validation and V↗

WISP: Watching grid Infrastructure Stealthily through Proxies (Final Technical Report)

The complex interdependencies of cyber systems (sensors and communications), physical grids and associated electricity market operations make protecting electric power grids a significant challenge. The energy sector is constantly under new, targeted, advanced and dangerous cyber-attacks that have the potential to result in the loss of human life. These threats are further exacerbated by our need to modernize the grid. One focus of cyber security research in smart grids is the securing of the SCADA system through advanced intrusion detection systems (IDS) and bad data detection algorithms in state estimation. These methods either require full knowledge of the system topology and parameters or fail to understand the physical behaviors under attack. WISP (Watching grid Infrastructure Stealthily through Proxies) is designed to provide additional protection to the power grid using only publicly available data. In particular, WISP exploits the spatio-temporal nature of the real time locational marginal prices (LMPs), in conjunction with other information such as bids, weather, outages and load data to analyze anomalous power pricing behaviors and then correlate those observations to localize regions of interest and identify potential cyber events. WISP is non-intrusive as the tool is deployed as a service in the Cloud or on premise and provides reliable information to system operators for enhanced situational awareness, without impeding energy delivery functions. The WISP technology comprises three modules: the data-driven anomaly detection core, the vulnerability and risk analysis and the root cause analysis. The data-driven anomaly detection core performs the tasks of feature selection, anomaly detection and attack region localization. The vulnerability and risk analysis module provides system level information of the vulnerable variables and times, assisting the operators in selecting monitoring and protection nodes. The root cause analysis module takes the detection results and identifies potential operational conditions that contribute to the detected anomalies. In Phase I, we have demonstrated the feasibility and effectiveness of WISP. We developed a realistic electricity market simulator capable of generating normal and attack market data under various operational conditions. We developed a series of cyber-attack detection and analysis algorithms and evaluated them under multiple data sources. Finally, we integrated all modules into an end-to-end software, providing functions for data management, data analytics and visualization. Specifically, we have achieved: (i) real-time data acceptance from external utility interfaces with >99% acceptance rate; (ii) high performance anomaly detection algorithms with >98% detection accuracy and <0.1% false alarm rate; and (iii) ultra-low computing delay <50 milliseconds. Additionally, our team developed algorithms to identify the vulnerable variables in electricity market operations and root cause analysis functions to identify major contributors to the price spikes. These ancillary modules are necessary when deploying WISP in real world industry environment. In Phase II, we have demonstrated the effectiveness of WISP software on realistic largescale power systems. We performed red team testing for the Phase I WISP software and identified software vulnerabilities and implemented corresponding mitigation solutions. We adapted the electricity market simulator for the Texas synthetic 2000-bus system and generated datasets for the false data injection attacks. We created database and visualization interfaces for the Texas system and the ISO New England system. We performed software optimization in terms of operation efficiency, computing speed and detection accuracy. Finally, we tested the software on the Texas system and the ISO New England system and evaluated the detection performance. Overall, we achieved above 89% detection rate, below 3% false alarm rate and below 37 seconds of end-to-end detection delay.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Powering OSCAR

Recycling waste has been an issue on Earth for decades. The OSCAR project seeks to find ways to make sure that it does not become an issue in space. The main focus of OSCAR is the combustion of waste and reclamation of gaseous products in microgravity. The first phase of testing relies on a ground rig that operates both under normal (Earth) gravity and in drop tower tests that briefly simulate a microgravity environment. In the second phase, a test will be performed during a suborbital flight were the experiment will be carried out in microgravity. Throughout the spring term, interns have played an integral part in continuing the progress made by the project. They performed work in upgrading the electrical and mechanical systems that make up OSCAR. They made multiple improvements to the test rig's operating software to improve readability and usability. They prepared and edited documents that were vital to the engineering process. And, they were responsible for performing lab tests and refining the lab operations document and procedure. The interns were a big help in maintaining the rigorous test schedule. OSCAR, which stands for Orbital Syngas Commodity Augmentation Reactor, is to find a way to turn astronaut waste into chemical energy. The two parts of this are important: finding a way to dispose of waste generated in space, and seeing if there is a way to recycle that waste into chemical energy. The importance of the disposal aspect is that there is currently no way to dispose of, or recycle, waste that is created in space other than jettisoning it (which is what the ISS does via empty supply capsules). As manned missions go deeper into space, that method will no longer be viable, as a craft would essentially be littering the space and planets that they visit. Energy reclamation is also important because of the high monetary and spatial costs of sending supplies on space missions. Every little bit extra that can be reused out of what is sent can save room and funds for other supplies. The facet of this problem that the OSCAR project is focusing on is how to combust waste in zero gravity. Combustion in the presence of gravity is one of those things that is taken for granted. When something burns on Earth, the flames rise above the fuel as oxygen flows from underneath. In microgravity, the flames surround the object completely, which restricts the amount of oxygen that can reach the fuel, and retards the combustion. OSCAR uses a vortex reaction chamber to counter this phenomenon. The OSCAR test rig will eventually be tested on a suborbital flight to see if it is an effective solution to the issue in real-world conditions. Currently, there is a prototype test rig that is fully functional. This rig has been previously tested in a 2 second drop test at Glenn Research Center’s (GRC) Zero Gravity Facility (ZGF). (The free-fall conditions of the drop mimic microgravity, if only for a brief period of time). This session’s focus was on upgrading the test rig and software, updating the paperwork, performing additional lab tests, and readying the rig for the five second drop test, again at GRC. II. Upgrades The state of the testing rig at the start of the session was in between its configurations for the two second drop tower and the five second drop tower. The rig needed upgrades to address various insufficiencies that either were discovered during the two second campaign or were a direct result of the differences between the two drop tower setups. The main differences that had to be handled were the increase in shock loads from 30g to 65g, a difference in drop indicating signal (on the falling edge of a pulse instead of a change from high to low), and the ambient pressure of the test apparatus (the two second tower dropped the rig in atmosphere, while the five second tower drops in vacuum).

Cauvel, Thomas↗

Developing a space network interface simulator: The NTS approach

This paper describes the approach used to redevelop the Network Control Center (NCC) Test System (NTS), a hardware and software facility designed to make testing of the NCC Data System (NCCDS) software efficient, effective, and as rigorous as possible prior to operational use. The NTS transmits and receives network message traffic in real-time. Data transfer rates and message content are strictly controlled and are identical to that of the operational systems. NTS minimizes the need for costly and time-consuming testing with the actual external entities (e.g., the Hubble Space Telescope (HST) Payload Operations Control Center (POCC) and the White Sands Ground Terminal). Discussed are activities associated with the development of the NTS, lessons learned throughout the project's lifecycle, and resulting productivity and quality increases.

Hendrzak, Gary E.↗

Development of SEDS data system flight software

The Small Expendable-tether Deployer System (SEDS) is being built for a 1991 flight on a Delta launch vehicle. SEDS will deploy a 50 lb instrument satellite as an end mass at the end of a 20 km tether. The objective of the experiment is to test the SEDS design concept by demonstrating that the system will satisfactorily deploy the full 20 km tether without stopping prematurely, come to a smooth stop on application of the brake, and cut the tether at the proper time after it swings to the vertical. SEDS will also collect data that will be used to test the accuracy of tether dynamics models for this type of deployment. Radar tracking is planned. In addition, the SEDS on-board computer system will record, store, and continuously transmit data over the Delta II S-band telemetry channel. Initial testing of the software under simulated flight conditions was performed. These tests used both assembly language routines running on SEDS data systems and C-language routines on an IBM-PC. As the software now stands relatively few additions are needed before the entire set of flight software is complete.

Pierson, William E.↗

Selection of Components for the Remote, Canister-Monitoring System

This report documents the selection of components as part of the efforts initiated to develop a remote, canister-monitoring system (RCMS) for determining and monitoring environmental conditions within dry fuel storage canisters containing aluminum clad spent nuclear fuel (ASNF) at the Idaho National Laboratory (INL). These efforts are in support of Department of Energy Office of Environmental Management (DOE-EM) investigations into technical issues associated with extended dry storage (50+ years) of ASNF. The capability to establish and monitor the performance of ASNF in situ provides the opportunity to (1) evaluate the appropriate technologies for monitoring, (2) collect canister environment conditions as soon as possible, (3) verify and validate current laboratory-based study results and analytic modeling approaches, and (4) potentially identify additional dry storage options for ASNF at the INL site. The improved understanding of ASNF behavior gained by performing this work would also contribute to the safety basis for extended dry storage in current and future configurations as well as to provide information for future transportation, conditioning, and disposal of ASNF. The parameters to be monitored by the RCMS include temperature, relative humidity, hydrogen gas concentration and radiation environment (dose). Components are selected based on the expected environmental conditions within the canister and fuel storage area, and the desired performance of the RCMS. Several of these components have been purchased and received. Future activities include component testing and calibration, software development for operation of the integrated sensor module and fabrication of a representative test volume. The results of these tests and changes to desired performance characteristics will inform subsequent activities.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Software engineering project management - A state-of-the-art report

The management of software engineering projects in the aerospace industry was investigated. The survey assessed such features as contract type, specification preparation techniques, software documentation required by customers, planning and cost-estimating, quality control, the use of advanced program practices, software tools and test procedures, the education levels of project managers, programmers and analysts, work assignment, automatic software monitoring capabilities, design and coding reviews, production times, success rates, and organizational structure of the projects.

Thayer, R. H.↗

Experiments in fault tolerant software reliability

The reliability of voting was evaluated in a fault-tolerant software system for small output spaces. The effectiveness of the back-to-back testing process was investigated. Version 3.0 of the RSDIMU-ATS, a semi-automated test bed for certification testing of RSDIMU software, was prepared and distributed. Software reliability estimation methods based on non-random sampling are being studied. The investigation of existing fault-tolerance models was continued and formulation of new models was initiated.

Mcallister, David F.↗

Utilizing Code Generation from Models for Electric Aircraft Motor Controller Flight Software

The processes followed to develop and test safety-critical flight software significantly increase development effort and overhead in comparison to both non-safety-critical and non-flight software. Generating code from models can be used to reduce development effort; however, the processes for using code generation to develop flight software are relatively immature. This work presents an approach for developing safety-critical flight software utilizing code generation from models to reduce development time and effort. The presented use-case is of electric aircraft motor control software developed for NASA's X-57 Maxwell aircraft.

flight software↗

Active High Assurance Authentication Protocol (AHAAP)

The AHAAP Maturation Project involves maturation and evaluation of a patented zero-trust tamper-resistant high-assurance session-less dynamic and active device authentication protocol that simultaneously authenticates identity and provides integrity verification in a single step, substantially reducing the risk of cyberattack, and eliminating the need for costly and complex conventional communication security systems requirements (i.e., cryptography, Public Key Infrastructure (PKI), and key management). These cybersecurity attributes of the technology must be preserved when applying the technology to different cybersecurity solutions, including Command & Control (C&C), Over-the-Air (OTA) update, Common Access Card (CAC), and distributed energy resource (DER) implementations, among others. The technology research objective is to test and verify that the cybersecurity attributes of the technology are not degraded in different cybersecurity applications. The primary technology development objective is to build minimum viable products to demonstrate the technology addresses today’s cybersecurity threats so that prospective investors, strategic partners, regulatory agencies, and commercial customers can interact with and assess the protection assured by the technology. The AHAAP Maturation Project goal is to develop, test, and validate one or more AHAAP implementations. The AHAAP Maturation Project tasks are: (i) engineer AHAAP implementation software, (ii) build a functional prototype that implements the AHAAP software for demonstration, testing, analysis, and evaluation purposes, and (iii) generate a report detailing the results of the AHAAP C&C software and hardware implementation. The final project deliverables are: (i) AHAAP software implementation and prototype, (ii) a report from Sandia National Laboratories detailing the results of the AHAAP implementations.

97 MATHEMATICS AND COMPUTING↗

A progress report on a NASA research program for embedded computer systems software

The paper presents the results of the second stage of the Multipurpose User-oriented Software Technology (MUST) program. Four primary areas of activities are discussed: programming environment, HAL/S higher-order programming language support, the Integrated Verification and Testing System (IVTS), and distributed system language research. The software development environment is provided by the interactive software invocation system. The higher-order programming language (HOL) support chosen for consideration is HAL/S mainly because at the time it was one of the few HOLs with flight computer experience and it is the language used on the Shuttle program. The overall purpose of IVTS is to provide a 'user-friendly' software testing system which is highly modular, user controlled, and cooperative in nature.

Foudriat, E. C.↗