Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,747 records · Page 97

CAIDA CUI Confirmation for OMRS & LCC SOCRRATES Emulator and iSEE Upgrade, Operations, & Analysis

This internship has focused on providing solutions for the Customer Avionics Interface Development and Analysis (CAIDA) subsystem. The main emulator that has been used during this internship is the Software-Only CEV (Crew Exploration Vehicle) Risk Reduction Analysis and Test Engineering Simulator (SOCRRATES). This emulator uses advanced math and physics methods to simulate specific points in a mission, such as ascent, entry, and orbit. Exploration Ground Systems (EGS) must ensure that all KSC based ground systems can be properly integrated with the flight vehicle software, therefore, the Modeling and Simulation Branch (NE-XM) of the KSC (Kennedy Space Center) Engineering Directorate supports a virtual environment that simulates the interface between ground systems and the flight vehicle. A primary component in assuring that is knowing whether the emulators have incorporated the correct CUIs (Compact Unique Identifiers) into their system, as well as understanding both the static and dynamic responses of the individual CUIs. Also, an effort for verification of Operational Maintenance Requirements Specifications (OMRS) and Launch Commit Criteria (LCC) that are supported by SOCRRATES for the Orion Crew Module were part of the project tasks this semester. This internship also focused on comparing two different simulation Commercial-off-the-shelf (COTS) products and to determine whether or not a COTS package was a viable replacement for the current software that the iSEE (Immersive Simulations and Engineering Environment) lab uses. Upon research and testing, I found that this software was not feasible for the lab. It could not easily load CAD (Computer-Aided Design) or CREO models, give live feedback while the user is in the environment, and was not compatible with a virtual reality headset, all of which are necessary for the lab.

Bundy, Caleb↗

hypredrive: high-level interface for solving linear systems with hypre

This software introduces a high-level interface designed to simplify solving linear systems using hypre, a renowned library for such computational challenges. It is crafted to be accessible and user-friendly, making the powerful capabilities of hypre available to a broader audience without requiring in-depth technical knowledge. The interface is characterized by its use of YAML for input, a format celebrated for its structured yet straightforward readability. This choice ensures that users can easily configure the software to meet their specific needs. Additionally, the software boasts an intuitive API that encapsulates hypre's functionalities, making it easier for users to interact with the process of solving linear systems. It is particularly beneficial for prototyping, offering a quick and efficient means to test various solver and preconditioner configurations. Furthermore, the software allows for the creation of an offline testing framework in which predefined linear systems are read from files and benchmarked with user-defined solution strategies. This makes it an invaluable tool for developers and researchers exploring and validating their computational models. Overall, the software serves as a bridge, bringing the advanced computational capabilities of hypre closer to users who may need more specialized technical expertise, thereby facilitating innovation and exploration in the field of numerical linear algebra.

Paludetto Magri, Victor↗

A hardware/software simulation for the video tracking system of the Kuiper Airborne Observatory telescope

This simulator was created so that C-141 Kuiper Airborne Observatory investigators could test their Airborne Data Acquisition and Management System software on a system which is generally more accessible than the ADAMS on the plane. An investigator can currently test most of his data acquisition program using the data computer simulator in the Cave. (The Cave refers to the ground-based computer facilities for the KAO and the associated support personnel.) The main Cave computer is interfaced to the data computer simulator in order to simulate the data-Exec computer communications. However until now, there has been no way to test the data computer interface to the tracker. The simulator described here simulates both the KAO Exec and tracker computers with software which runs on the same Hewlett-Packard (HP) computer as the investigator's data acquisition program. A simulator control box is hardwired to the computer to provide monitoring of tracker functions, to provide an operator panel similar to the real tracker, and to simulate the 180 deg phase shifting of the chopper squre-wave reference with beam switching. If run in the Cave, one can use their Exec simulator and this tracker simulator.

Boozer, G. A.↗

Assessing Requirements Quality through Requirements Coverage

In model-based development, the development effort is centered around a formal description of the proposed software system the model. This model is derived from some high-level requirements describing the expected behavior of the software. For validation and verification purposes, this model can then be subjected to various types of analysis, for example, completeness and consistency analysis [6], model checking [3], theorem proving [1], and test-case generation [4, 7]. This development paradigm is making rapid inroads in certain industries, e.g., automotive, avionics, space applications, and medical technology. This shift towards model-based development naturally leads to changes in the verification and validation (V&V) process. The model validation problem determining that the model accurately captures the customer's high-level requirements has received little attention and the sufficiency of the validation activities has been largely determined through ad-hoc methods. Since the model serves as the central artifact, its correctness with respect to the users needs is absolutely crucial. In our investigation, we attempt to answer the following two questions with respect to validation (1) Are the requirements sufficiently defined for the system? and (2) How well does the model implement the behaviors specified by the requirements? The second question can be addressed using formal verification. Nevertheless, the size and complexity of many industrial systems make formal verification infeasible even if we have a formal model and formalized requirements. Thus, presently, there is no objective way of answering these two questions. To this end, we propose an approach based on testing that, when given a set of formal requirements, explores the relationship between requirements-based structural test-adequacy coverage and model-based structural test-adequacy coverage. The proposed technique uses requirements coverage metrics defined in [9] on formal high-level software requirements and existing model coverage metrics such as the Modified Condition and Decision Coverage (MC/DC) used when testing highly critical software in the avionics industry [8]. Our work is related to Chockler et al. [2], but we base our work on traditional testing techniques as opposed to verification techniques.

Rajan, Ajitha↗

Space Launch System (SLS) Human Factors Engineering Modeling & Analysis

The Human Systems Integration & Engineering (HSI&E) team at NASA’s Marshall Space Flight Center (MSFC) strives to advocate for the humans in the loop of Space Launch System’s (SLS) ground operations. Using assessment methods like human simulation, virtual reality, and physical mockups, both flight hardware and ground support equipment (GSE) are evaluated for human integration. Those ranging from 5th percentile female (approximately 5’2” tall) to 95th percentile male (approximately 6’2” tall) should be able to perform all SLS stacking operations. Operations include element physical mates, element electrical mates, and testing activities. The primary human simulation software used is Process Simulate Human (PSH) made by Siemens. This software supplies highly accurate human manikins that can interact with CAD models. PSH was used to evaluate the Transportation and Integration Platform’s (TIP) side opening that was designed for access to the Payload Adapter (PLA) cables. Technicians will need to access these cables for testing purposes before element stacking at Kennedy Space Center (KSC). After performing an analysis in PSH using the TIP side opening, it was found that neither a 5th percentile female or a 95th percentile male could perform the task as the designers had intended. There is a C-beam that blocks access to the cables (both physically and visually). An alternative analysis was performed using PSH to look at another access point to the PLA cables. Although this method would disrupt already established procedures and produce more work, the designers confirmed it was an option. Instead of technicians accessing the cables through the side opening in the TIP, a human simulation was performed for going through a panel opening in the bottom of the TIP. This method requires removal of a TIP panel and a stepladder of at least 36 inches for a 5th percentile female to access the cables.

human factors↗

DSN advanced receiver: Breadboard description and test results

A breadboard Advanced Receiver for use in the Deep Space Network was designed, built, and tested in the laboratory. Field testing was also performed during Voyager Uranus encounter at DSS-13. The development of the breadboard is intended to lead towards implementation of the new receiver throughout the network. The receiver is described on a functional level and then in terms of more specific hardware and software architecture. The results of performance tests in the laboratory and in the field are given. Finally, there is a discussion of suggested improvements for the next phase of development.

Brown, D. H.↗

Software component quality evaluation

The paper describes a software inspection process that can be used to evaluate the quality of software components. Quality criteria, process application, independent testing of the process and proposed associated tool support are covered. Early results indicate that this technique is well suited for assessing software component quality in a standardized fashion. With automated machine assistance to facilitate both the evaluation and selection of software components, such a technique should promote effective reuse of software components.

Clough, A. J.↗

Preliminary Radiation Testing of a State-of-the-Art Commercial 14nm CMOS Processor/System-on-a-Chip

Hardness assurance test results of Intel state-of-the-art 14nm “Broadwell” U-series processor / System-on-a-Chip (SoC) for total ionizing dose (TID) are presented, along with exploratory results from trials at a medical proton facility. Test method builds upon previous efforts [1] by utilizing commercial laptop motherboards and software stress applications as opposed to more traditional automated test equipment (ATE).

microprocessor↗

TU-C-BRE-02: A Novel, Highly Efficient and Automated Quality Assurance Tool for Modern Linear Accelerators

Purpose: Quality assurance (QA) of complex linear accelerators is critical and highly time consuming. Varian’s Machine Performance Check (MPC) uses IsoCal phantom to test geometric and dosimetric aspects of the TrueBeam systems in <5min. In this study we independently tested the accuracy and robustness of the MPC tools. Methods: MPC is automated for simultaneous image-acquisition, using kV-and-MV onboard-imagers (EPIDs), while delivering kV-and-MV beams in a set routine of varying gantry, collimator and couch angles. MPC software-tools analyze the images to test: i) beam-output and uniformity, ii) positional accuracy of isocenter, EPIDs, collimating jaws (CJs), MLC leaves and couch and iii) rotational accuracy of gantry, collimator and couch. 6MV-beam dose-output and uniformity were tested using ionization-chamber (IC) and ICarray. Winston-Lutz-Tests (WLT) were performed to measure isocenter-offsets caused by gantry, collimator and couch rotations. Positional accuracy of EPIDs was evaluated using radio-opaque markers of the IsoCal phantom. Furthermore, to test the robustness of the MPC tools we purposefully miscalibrated a non-clinical TrueBeam by introducing errors in beam-output, energy, symmetry, gantry angle, couch translations, CJs and MLC leaves positions. Results: 6MV-output and uniformity were within ±0.6% for most measurements with a maximum deviation of ±1.0%. Average isocenter-offset caused by gantry and collimator rotations was 0.316±0.011mm agreeing with IsoLock (0.274mm) and WLT (0.41mm). Average rotation-induced couch-shift from MPC was 0.378±0.032mm agreeing with WLT (0.35mm). MV-and-kV imager-offsets measured by MPC were within ±0.15mm. MPC predicted all machine miscalibrations within acceptable clinical tolerance. MPC detected the output miscalibrations within ±0.61% while the MLC and couch positions were within ±0.06mm and ±0.14mm, respectively. Gantry angle miscalibrations were detected within ±0.1°. Conclusions: MPC is a useful tool for QA of TrueBeam systems and its automation makes it highly efficient for testing both geometric and dosimetric aspects of the machine. This is very important for hypo-fractionated SBRT treatments. Received support from Varian Medical Systems, Palo Alto, CA 94304-1038.

07 ISOTOPE AND RADIATION SOURCES↗

OSIRIS Validation and Verification Report

The On-Site Inspection RadioIsotopic Spectroscopy (OSIRIS) system is a gamma-ray spectroscopy instrument for on-site inspections conducted under the Comprehensive Nuclear-Test-Ban Treaty (CTBT). The OSIRIS software filters spectral analysis data, revealing information to users on only 17 CTBT-relevant fission-product isotopes. In this report, we review the CTBT requirements for on-site inspection radionuclide identifiers, plus additional requirements imposed by the design team. Then a series of validation tests conducted during OSIRIS development are described. The validation tests were designed to gauge if the nascent OSIRIS system met those requirements. We conclude with a set of recommended verification tests to ensure that newly-manufactured OSIRIS systems also will meet the requirements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Software Requirements Analysis as Fault Predictor

Waiting until the integration and system test phase to discover errors leads to more costly rework than resolving those same errors earlier in the lifecycle. Costs increase even more significantly once a software system has become operational. WE can assess the quality of system requirements, but do little to correlate this information either to system assurance activities or long-term reliability projections - both of which remain unclear and anecdotal. Extending earlier work on requirements accomplished by the ARM tool, measuring requirements quality information against code complexity and test data for the same system may be used to predict specific software modules containing high impact or deeply embedded faults now escaping in operational systems. Such knowledge would lead to more effective and efficient test programs. It may enable insight into whether a program should be maintained or started over.

Wallace, Dolores↗

Continuation of research into software for space operations support, volume 1

A prototype workstation executive called the Hardware Independent Software Development Environment (HISDE) was developed. Software technologies relevant to workstation executives were researched and evaluated and HISDE was used as a test bed for prototyping efforts. New X Windows software concepts and technology were introduced into workstation executives and related applications. The four research efforts performed included: (1) Research into the usability and efficiency of Motif (an X Windows based graphic user interface) which consisted of converting the existing Athena widget based HISDE user interface to Motif demonstrating the usability of Motif and providing insight into the level of effort required to translate an application from widget to another; (2) Prototype a real time data display widget which consisted of research methods for and prototyping the selected method of displaying textual values in an efficient manner; (3) X Windows performance evaluation which consisted of a series of performance measurements which demonstrated the ability of low level X Windows to display textural information; (4) Convert the Display Manager to X Window/Motif which is the application used by NASA for data display during operational mode.

Collier, Mark D.↗

Measurement of the Earth-Observer-1 Satellite X-Band Phased Array

The recent launch and successful orbiting of the EO-1 Satellite has provided an opportunity to validate the performance of a newly developed X-Band transmit-only phased array aboard the satellite. This paper will compare results of planar near-field testing before and after spacecraft installation as well as on-orbit pattern characterization. The transmit-only array is used as a high data rate antenna for relaying scientific data from the satellite to earth stations. The antenna contains distributed solid-state amplifiers behind each antenna element that cannot be monitored except for radiation pattern measurements. A unique portable planar near-field scanner allows both radiation pattern measurements and also diagnostics of array aperture distribution before and after environmental testing over the ground-integration and prelaunch testing of the satellite. The antenna beam scanning software was confirmed from actual pattern measurements of the scanned beam positions during the spacecraft assembly testing. The scanned radiation patterns on-orbit were compared to the near-field patterns made before launch to confirm the antenna performance. The near-field measurement scanner has provided a versatile testing method for satellite high gain data-link antennas.

Perko, Kenneth↗

Continuous Integration, In-Code Documentation, and Automation for Nuclear Quality Assurance Conformance

The Multiphysics Object Oriented Simulation Environment (MOOSE) is an open-source, finite element framework for solving highly coupled sets of nonlinear equations. The development of the framework and applications occurs concurrently using an agile, continuous-integration software package. Included in the framework is an in-code, extensible documentation system. Using these two tools in union with the repository management tools GitHub and GitLab, a software quality plan was created and followed such that MOOSE and a MOOSE-based application (BISON) have been shown to meet the American Society of Mechanical Engineers’ Nuclear Quality Assurance-1 standard. The approach relies heavily on automation for both testing and documentation. The resulting effort demonstrates that a rigorous software quality plan may be implemented that incurs a minimal impact on day-to-day development of the software, satisfying the stringent guidelines necessary to operate the software in a safety function within a nuclear facility.

97 MATHEMATICS AND COMPUTING↗

Validation of highly reliable, real-time knowledge-based systems

Knowledge-based systems have the potential to greatly increase the capabilities of future aircraft and spacecraft and to significantly reduce support manpower needed for the space station and other space missions. However, a credible validation methodology must be developed before knowledge-based systems can be used for life- or mission-critical applications. Experience with conventional software has shown that the use of good software engineering techniques and static analysis tools can greatly reduce the time needed for testing and simulation of a system. Since exhaustive testing is infeasible, reliability must be built into the software during the design and implementation phases. Unfortunately, many of the software engineering techniques and tools used for conventional software are of little use in the development of knowledge-based systems. Therefore, research at Langley is focused on developing a set of guidelines, methods, and prototype validation tools for building highly reliable, knowledge-based systems. The use of a comprehensive methodology for building highly reliable, knowledge-based systems should significantly decrease the time needed for testing and simulation. A proven record of delivering reliable systems at the beginning of the highly visible testing and simulation phases is crucial to the acceptance of knowledge-based systems in critical applications.

Johnson, Sally C.↗

RELAP5-3D Developer Guidelines and Programming Practices

Our ultimate goal is to create and maintain RELAP5-3D as the best software tool available to analyze nuclear power plants. This begins with writing excellent programming and requires thorough testing. This document covers development of RELAP5-3D software, the behavior of the RELAP5-3D program that must be maintained, and code testing.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Towards an Open, Distributed Software Architecture for UxS Operations

To address the growing need to evaluate, test, and certify an ever expanding ecosystem of UxS platforms in preparation of cultural integration, NASA Langley Research Center's Autonomy Incubator (AI) has taken on the challenge of developing a software framework in which UxS platforms developed by third parties can be integrated into a single system which provides evaluation and testing, mission planning and operation, and out-of-the-box autonomy and data fusion capabilities. This software framework, named AEON (Autonomous Entity Operations Network), has two main goals. The first goal is the development of a cross-platform, extensible, onboard software system that provides autonomy at the mission execution and course-planning level, a highly configurable data fusion framework sensitive to the platform's available sensor hardware, and plug-and-play compatibility with a wide array of computer systems, sensors, software, and controls hardware. The second goal is the development of a ground control system that acts as a test-bed for integration of the proposed heterogeneous fleet, and allows for complex mission planning, tracking, and debugging capabilities. The ground control system should also be highly extensible and allow plug-and-play interoperability with third party software systems. In order to achieve these goals, this paper proposes an open, distributed software architecture which utilizes at its core the Data Distribution Service (DDS) standards, established by the Object Management Group (OMG), for inter-process communication and data flow. The design decisions proposed herein leverage the advantages of existing robotics software architectures and the DDS standards to develop software that is scalable, high-performance, fault tolerant, modular, and readily interoperable with external platforms and software.

Cross, Charles D.↗

Army/NASA small turboshaft engine digital controls research program

The emphasis of a program to conduct digital controls research for small turboshaft engines is on engine test evaluation of advanced control logic using a flexible microprocessor based digital control system designed specifically for research on advanced control logic. Control software is stored in programmable memory. New control algorithms may be stored in a floppy disk and loaded directly into memory. This feature facilitates comparative evaluation of different advanced control modes. The central processor in the digital control is an Intel 8086 16 bit microprocessor. Control software is programmed in assembly language. Software checkout is accomplished prior to engine test by connecting the digital control to a real time hybrid computer simulation of the engine. The engine currently installed in the facility has a hydromechanical control modified to allow electrohydraulic fuel metering and VG actuation by the digital control. Simulation results are presented which show that the modern control reduces the transient rotor speed droop caused by unanticipated load changes such as cyclic pitch or wind gust transients.

Sellers, J. F.↗