Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Test Report”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Implementation of Plot File Testing in the DYNA3D/ParaDyn Software Quality Assurance Suite

Automated testing of DYNA3D/ParaDyn plot files was added to the DYNA3D/ParaDyn software quality assurance (SQA) test suite. The new capability extracts select data from the plot files generated during each verification run and compares it to the same baseline answers used to verify the problem. Deviations between baseline answers and plot file values are reported in the same manner as solution discrepancies, and differences in precision levels between the baseline answers and plot file results are accounted for. The new testing leverages the existing SQA test suite framework and test problems and the Python Mili reader and minimally increases the overall run time (< 5%) of the SQA test suite. This new capability provides incremental end-toend testing of the most common DYNA3D/ParaDyn simulation workflows.

42 ENGINEERING↗

Simplified inelastic constitutive models for ASME Section III, Division 5 design by inelastic analysis

This report describes the development of simplified, universal constitutive model that captures the high temperature monotonic and cyclic behavior of a range of commonly-used high temperature materials. The goal of the work is to provide a simple, universal constitutive model to replace the current bespoke models for Grade 91, 316H, and Alloy 617 included in Nonmandatory Appendix HBB-Z of the ASME Boiler & Pressure Vessel Code, and to extend this model to cover Alloy 800H. We initiated this work in response to feedback from reactor vendors and other Code users requesting simplified models, compared to the current models, that are easier to implement and use in commercial finite element analysis software. This report describes the completion of this effort by developing a model to correct the defects in standard model forms presently used for high temperature material modeling, described in past work, developing and implementing new numerical methods to train this model against test data, and then actually training the model for the four materials. The report provides a complete mathematical description of the model along with the tabulated material coefficients for the four materials. The final step will be to formulate an ASME Code change to introduce the new models into the Code.

36 MATERIALS SCIENCE↗

Software Engineering Laboratory Ada performance study: Results and implications

The SEL is an organization sponsored by NASA/GSFC to investigate the effectiveness of software engineering technologies applied to the development of applications software. The SEL was created in 1977 and has three organizational members: NASA/GSFC, Systems Development Branch; The University of Maryland, Computer Sciences Department; and Computer Sciences Corporation, Systems Development Operation. The goals of the SEL are as follows: (1) to understand the software development process in the GSFC environments; (2) to measure the effect of various methodologies, tools, and models on this process; and (3) to identify and then to apply successful development practices. The activities, findings, and recommendations of the SEL are recorded in the Software Engineering Laboratory Series, a continuing series of reports that include the Ada Performance Study Report. This paper describes the background of Ada in the Flight Dynamics Division (FDD), the objectives and scope of the Ada Performance Study, the measurement approach used, the performance tests performed, the major test results, and the implications for future FDD Ada development efforts.

Booth, Eric W.↗

A Genuine TEAM Player

Qualtech Systems, Inc. developed a complete software system with capabilities of multisignal modeling, diagnostic analysis, run-time diagnostic operations, and intelligent interactive reasoners. Commercially available as the TEAMS (Testability Engineering and Maintenance System) tool set, the software can be used to reveal unanticipated system failures. The TEAMS software package is broken down into four companion tools: TEAMS-RT, TEAMATE, TEAMS-KB, and TEAMS-RDS. TEAMS-RT identifies good, bad, and suspect components in the system in real-time. It reports system health results from onboard tests, and detects and isolates failures within the system, allowing for rapid fault isolation. TEAMATE takes over from where TEAMS-RT left off by intelligently guiding the maintenance technician through the troubleshooting procedure, repair actions, and operational checkout. TEAMS-KB serves as a model management and collection tool. TEAMS-RDS (TEAMS-Remote Diagnostic Server) has the ability to continuously assess a system and isolate any failure in that system or its components, in real time. RDS incorporates TEAMS-RT, TEAMATE, and TEAMS-KB in a large-scale server architecture capable of providing advanced diagnostic and maintenance functions over a network, such as the Internet, with a web browser user interface.

Source record↗

Low-Power, Load-Balancing Whole Home Electrification Solution: Cooperative Research and Development (Final Report)

Testing was conducted at the Systems Performance Laboratory in NREL’s Energy Systems Integration Facility to test the performance of 120V wall-mounted heat pumps, 120V heat pump water heaters (HPWH), Electric Vehicle Supply Equipment (EVSE), and other plug-in loads, using NeoCharge Smart Splitters and whole home energy software as appropriate. Four different simulated occupancy scenarios were used to evaluate the package of technology and controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Project Report: Automatic Sequence Processor Software Analysis

The Mission Planning and Sequencing (MPS) element of Multi-Mission Ground System and Services (MGSS) provides space missions with multi-purpose software to plan spacecraft activities, sequence spacecraft commands, and then integrate these products and execute them on spacecraft. Jet Propulsion Laboratory (JPL) is currently is flying many missions. The processes for building, integrating, and testing the multi-mission uplink software need to be improved to meet the needs of the missions and the operations teams that command the spacecraft. The Multi-Mission Sequencing Team is responsible for collecting and processing the observations, experiments and engineering activities that are to be performed on a selected spacecraft. The collection of these activities is called a sequence and ultimately a sequence becomes a sequence of spacecraft commands. The operations teams check the sequence to make sure that no constraints are violated. The workflow process involves sending a program start command, which activates the Automatic Sequence Processor (ASP). The ASP is currently a file-based system that is comprised of scripts written in perl, c-shell and awk. Once this start process is complete, the system checks for errors and aborts if there are any; otherwise the system converts the commands to binary, and then sends the resultant information to be radiated to the spacecraft.

sequencing↗

The Software Engineering Laboratory: An operational software experience factory

For 15 years, the Software Engineering Laboratory (SEL) has been carrying out studies and experiments for the purpose of understanding, assessing, and improving software and software processes within a production software development environment at NASA/GSFC. The SEL comprises three major organizations: (1) NASA/GSFC, Flight Dynamics Division; (2) University of Maryland, Department of Computer Science; and (3) Computer Sciences Corporation, Flight Dynamics Technology Group. These organizations have jointly carried out several hundred software studies, producing hundreds of reports, papers, and documents, all of which describe some aspect of the software engineering technology that was analyzed in the flight dynamics environment at NASA. The studies range from small, controlled experiments (such as analyzing the effectiveness of code reading versus that of functional testing) to large, multiple project studies (such as assessing the impacts of Ada on a production environment). The organization's driving goal is to improve the software process continually, so that sustained improvement may be observed in the resulting products. This paper discusses the SEL as a functioning example of an operational software experience factory and summarizes the characteristics of and major lessons learned from 15 years of SEL operations.

Basili, Victor R.↗

Follow-the-leader algorithm for the payload inspection and processing system

This report summarizes the author's summer 1995 work at NASA Kennedy Space Center in the Advanced System Division. The assignment was path planning for the Payload Inspection and Processing System (PIPS). PIPS is an automated system, programmed off-line for inspection of Space Shuttle payloads after integration and prior to launch. PIPS features a hyper-redundant 18-dof serpentine truss manipulator capable of snake-like motions to avoid obstacles. The path planning problem was divided into two segments: (1) determining an obstacle-free trajectory for the inspection camera at the manipulator tip to follow; and (2) development of a follow-the-leader (FTL) algorithm which ensures whole-arm collision avoidance by forcing ensuing links to follow the same tip trajectory. The summer 1995 work focused on the FTL algorithm. This report summarizes development, implementation, testing, and graphical demonstration of the FTL algorithm for prototype PIPS hardware. The method and code was developed in a modular manner so the final PIPS hardware may use them with minimal changes. The FTL algorithm was implemented using MATLAB software and demonstrated with a high-fidelity IGRIP model. The author also supported implementation of the algorithm in C++ for hardware control. The FTL algorithm proved to be successful and robust in graphical simulation. The author intends to return to the project in summer 1996 to implement path planning for PIPS.

Williams, Robert L., II↗

Radiometric Testing of Germicidal UV Products, Round 1: UV-C Towers and Whole-Room Luminaires (CALiPER Full Report)

This report analyzes the independently tested performance of 13 germicidal ultraviolet (GUV) products purchased between February and July 2022. The products were of three different types: • Seven portable, consumer-oriented GUV towers designed to be placed on the floor or a desk of an unoccupied room to disinfect air and surfaces. Five of these products used LED sources and two products used low-pressure mercury (LPM) sources. • One non-portable GUV whole-room luminaire designed to be installed on a ceiling to disinfect air when a room is occupied. This product used an LED source. • Five non-portable GUV troffer or high-bay style whole-room luminaires designed to be installed in or suspended from a ceiling to disinfect air and surfaces when a room is unoccupied. All five used LPM sources. Radiometric and electrical performance was evaluated for all 13 products. Photobiological safety was also assessed for two of the products because their documentation included testable claims. The test results were compared across products and to manufacturer or vendor claims. The testing identified many issues related to the accuracy of reported GUV product performance. Claims were often untestable, contradictory, ambiguous, or used incorrect units and/or terminology. And when claims were testable, they often did not match test results. For example, three products that claimed to emit UV-C emitted only UV-A. These product claim issues were more numerous with consumer-oriented tower products, but problems with accurate performance claims were found across all products. The UV-C radiant efficiency of the products varied widely, even among similar products using the same source technologies. For example, the UV-C radiant efficiency of LPM products varied by greater than a factor of three for the same product type, indicating a large potential energy savings opportunity for products that are better designed for efficiency. LED products had orders-of-magnitude lower UV-C radiant efficiency than LPM products. Several testing challenges and limitations were identified. Most significant among these is the capability to accurately test and report the performance of larger GUV products. Integrating spheres require a specialized and costly coating to test UV, and the testing laboratory for this round of products had only a 20-inch diameter hemisphere with this capability. Only 2 of the 10 UV-C emitting products could be tested in this sphere. Goniometer testing had a different size limitation in that mirrors typically used to increase goniometer test distance to the far field are not reflective of UV and therefore could not be used to increase test distance. As a result, 7 of 13 products could not be tested far field. The implication is that electronic files of UV-C intensity data typically imported into design software for designing GUV applications may not be reliable for predicting irradiance at arbitrary far-field distances. It is currently unclear if these are industry-wide testing laboratory limitations, and what solutions may exist to address them. Specifiers and buyers of GUV products will need accurate performance claims and data to safely and effectively deploy GUV technology to reduce the transmission of diseases in buildings. This CALiPER GUV Round 1 report demonstrates the significant education and training that is needed for manufacturers and vendors to accurately test and report the performance of their GUV products. Further standards and guidelines are needed to improve test methods, address testing limitations, and improve reporting of product performance. Additionally, the wide range in UV-C radiant efficiency of GUV products means there is a large energy-savings opportunity for more energy efficient GUV products.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Radiometric Testing of Germicidal UV Products, Round 1: UV-C Towers and Whole-Room Luminaires (CALiPER Summary Report)

This summary report analyzes the independently tested performance of 13 germicidal ultraviolet (GUV) products purchased between February and July 2022. A companion full report provides additional information and discussion of the tested products, test methods, and results. The products were of three different types: • Seven portable, consumer-oriented GUV towers designed to be placed on the floor or a desk of an unoccupied room to disinfect air and surfaces. Five of these products used LED sources and two products used low-pressure mercury (LPM) sources. • One non-portable GUV whole-room luminaire designed to be installed on a ceiling to disinfect air when a room is occupied. This product used an LED source. • Five non-portable GUV troffer or high-bay style whole-room luminaires designed to be installed in or suspended from a ceiling to disinfect air and surfaces when a room is unoccupied. All five used LPM sources. Radiometric and electrical performance was evaluated for all 13 products. Photobiological safety was also assessed for two of the products because their documentation included testable claims. The test results were compared across products and to manufacturer or vendor claims. The testing identified many issues related to the accuracy of reported GUV product performance. Claims were often untestable, contradictory, ambiguous, or used incorrect units and/or terminology. And when claims were testable, they often did not match test results. For example, three products that claimed to emit UV-C emitted only UV-A. These product claim issues were more numerous with consumer-oriented tower products, but problems with accurate performance claims were found across all products. The UV-C radiant efficiency of the products varied widely, even among similar products using the same source technologies. For example, the UV-C radiant efficiency of LPM products varied by greater than a factor of three for the same product type, indicating a large potential energy savings opportunity for products that are better designed for efficiency. LED products had orders-of-magnitude lower UV-C radiant efficiency than LPM products. Several testing challenges and limitations were identified. Most significant among these is the capability to accurately test and report the performance of larger GUV products. Integrating spheres require a specialized and costly coating to test UV, and the testing laboratory for this round of products had only a 20-inch diameter hemisphere with this capability. Only 2 of the 10 UV-C emitting products could be tested in this sphere. Goniometer testing had a different size limitation in that mirrors typically used to increase goniometer test distance to the far field are not reflective of UV and therefore could not be used to increase test distance. As a result, 7 of 13 products could not be tested far field. The implication is that electronic files of UV-C intensity data typically imported into design software for designing GUV applications may not be reliable for predicting irradiance at arbitrary far-field distances. It is currently unclear if these are industry-wide testing laboratory limitations, and what solutions may exist to address them. Specifiers and buyers of GUV products will need accurate performance claims and data to safely and effectively deploy GUV technology to reduce the transmission of diseases in buildings. This CALiPER GUV Round 1 report demonstrates the significant education and training that is needed for manufacturers and vendors to accurately test and report the performance of their GUV products. Further standards and guidelines are needed to improve test methods, address testing limitations, and improve reporting of product performance. Additionally, the wide range in UV-C radiant efficiency of GUV products means there is a large energy-savings opportunity for more energy efficient GUV products.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Agilent AgileBioFoundry CRADA (Final Report)

The mission of this CRADA with Agilent was to couple powerful MS platforms (QQQ, IM-QTOF-MS) with Agilent’s novel Ultra-High-Performance Liquid Chromatography (UHPLC) fast metabolomic workflows and perform ABF Machine Learning (ML) to generated datasets. Agilent transferred UHPLC methods to PNNL and LBNL and methods were implemented and demonstrated in both labs, achieving total acquisition times of < 10 min. Metabolites analyzed using Agilent’s shared methods included metabolites from central carbon metabolism, common across hosts, and metabolites unique to engineered strains. Standards were acquired in an UHPLC-Drift Tube Ion Mobility Mass Spectrometer (DTIMS) system for the first time within the context of ABF and methods were optimized based on Agilent’s protocols. Samples from ABF hosts Pseudomonas putida, Aspergillus pseudoterreus, Aspergillus niger and Rhodosporidium toruloides were analyzed using the UHPLC-DTIMS platform for a total of 276 runs. A data analysis workflow compatible with the Experimental Data Depot (EDD) and completely shareable was developed for the acquired UHPLC-DTIMS data. Samples were analyzed using a Data Independent Acquisition Approach (DIA), which for most of the standards provided more transitions therefore increasing detection confidence. Using the data acquired by PNNL, LBNL, and Agilent’s specifications from previous ML projects, SNL applied an ensemble ML strategy to pick the best performing model for automated LC-method selection. Finally, with the contribution of the participant labs and Agilent, SNL developed an Automated Method Selection (AMS) software tool to predict the best liquid chromatography method for analysis of any new molecules of interest. Samples with novel pathways and new metabolite targets of interest are generated at a high pace in the ABF. Therefore, our accomplishment in this CRADA improved the efficiency and accuracy of strain testing by developing and implementing fast analytical methods, robust processing tools, and software for predicting the best methods for UHPLC analysis.

97 MATHEMATICS AND COMPUTING↗

Utility of Big Area Additive Manufacturing for Part Production for Low-Head Hydropower (CRADA NFE-18-07280 Final Report)

ORNL worked with Cadens, LLC, to explore the use of additive manufacturing (AM) to produce low-cost parts for low-head hydropower systems. Cadens develops design optimization software that leverages the flexible, low-cost, high-strength benefits of AM and composite materials. Cadens also operates a micro-hydro lab to test AM components in controlled environments. Until now, Cadens’ tests have been limited to components of a size that they can cost-effectively manufacture using local commercial systems. This project provided an opportunity for Cadens to scale up their modular AM hydropower parts using the capabilities of Big Area Additive Manufacturing (BAAM). This project was a success and resulted in the design and fabrication of several end-use parts of a hydropower system, using a Big Area Additive Manufacturing (BAAM) system. The fabricated parts include a draft tube, thimble, runner housing mold, PVC end fitting and two PVC pipe supports. In addition, a runner system was fabricated using fused deposition modeling on a 3D Platform Workbench 400 Series System.

13 HYDRO ENERGY↗

Earth Observatory Satellite system definition study. Report no. 3: Design/cost tradeoff studies. Appendix A: EOS program WBS dictionary. Appendix B: EOS mission functional analysis

The work breakdown structure (WBS) dictionary for the Earth Observatory Satellite (EOS) is defined. The various elements of the EOS program are examined to include the aggregate of hardware, computer software, services, and data required to develop, produce, test, support, and operate the space vehicle and the companion ground data management system. A functional analysis of the EOS mission is developed. The operations for three typical EOS missions, Delta, Titan, and Shuttle launched are considered. The functions were determined for the top program elements, and the mission operations, function 2.0, was expanded to level one functions. Selection of ten level one functions for further analysis to level two and three functions were based on concern for the EOS operations and associated interfaces.

Source record↗

Performance Validation of Version 152.0 ANSER Control Laws for the F-18 HARV

The Actuated Nose Strakes for Enhanced Rolling (ANSER) Control Laws were modified as a result of Phase 3 F/A-18 High Alpha Research Vehicle (HARV) flight testing. The control law modifications for the next software release were designated version 152.0. The Ada implementation was tested in the Hardware-In-the-Loop (HIL) simulation and results were compared to those obtained with the NASA Langley batch Fortran implementation of the control laws which are considered the 'truth model.' This report documents the performance validation test results between these implementations for ANSER control law version 152.0.

Messina, Michael D.↗

Investigation of a Technique for Measuring Dynamic Ground Effect in a Subsonic Wind Tunnel

To better understand the ground effect encountered by slender wing supersonic transport aircraft, a test was conducted at NASA Langley Research Center's 14 x 22 foot Subsonic Wind Tunnel in October, 1997. Emphasis was placed on improving the accuracy of the ground effect data by using a "dynamic" technique in which the model's vertical motion was varied automatically during wind-on testing. This report describes and evaluates different aspects of the dynamic method utilized for obtaining ground effect data in this test. The method for acquiring and processing time data from a dynamic ground effect wind tunnel test is outlined with details of the overall data acquisition system and software used for the data analysis. The removal of inertial loads due to sting motion and the support dynamics in the balance force and moment data measurements of the aerodynamic forces on the model is described. An evaluation of the results identifies problem areas providing recommendations for future experiments. Test results are validated by comparing test data for an elliptical wing planform with an Elliptical wing planform section with a NACA 0012 airfoil to results found in current literature. Major aerodynamic forces acting on the model in terms of lift curves for determining ground effect are presented. Comparisons of flight and wind tunnel data for the TU-144 are presented.

Graves, Sharon S.↗

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

We report on a study to determine the maturity of different verification and validation technologies (V&V) on a representative example of NASA flight software. The study consisted of a controlled experiment where three technologies (static analysis, runtime analysis and model checking) were compared to traditional testing with respect to their ability to find seeded errors in a prototype Mars Rover. What makes this study unique is that it is the first (to the best of our knowledge) to do a controlled experiment to compare formal methods based tools to testing on a realistic industrial-size example where the emphasis was on collecting as much data on the performance of the tools and the participants as possible. The paper includes a description of the Rover code that was analyzed, the tools used as well as a detailed description of the experimental setup and the results. Due to the complexity of setting up the experiment, our results can not be generalized, but we believe it can still serve as a valuable point of reference for future studies of this kind. It did confirm the belief we had that advanced tools can outperform testing when trying to locate concurrency errors. Furthermore the results of the experiment inspired a novel framework for testing the next generation of the Rover.

Brat, Guillaume↗

Team Oriented Robotic Exploration Task on Scorpion and K9 Platforms

This final report describes the achievements that have been made in the project over the complete period of performance. The technical progress highlights the different areas of work in terms of Progress in Mechatronics, Sensor integration, Software Development. User Interfaces, Behavior Development and Experimental Results and System Testing. The different areas are: Mechatronics, Sensor integration, Software development, Experimental results and Basic System Testing, Behaviors Development and Advanced System Testing, User Interface and Wireless Communication.

Kirchner, Frank↗

The ICEBERG Test Stand for DUNE Cold Electronics Development

ICEBERG is a liquid argon time projection chamber at Fermilab for the purpose of testing detector components and software for the Deep Underground Neutrino Experiment (DUNE). The detector features a 1.15m x 1m anode plane following the specifications of the DUNE horizontal drift far detector and a newly installed X-ARAPUCA photodetector. The status of ICEBERG is reported along with analysis of noise, pulser, and cosmic ray data from the ninth run beginning May 2024 with the goal of advising the DUNE collaboration on the optimal wire readout electronics configuration. In addition, development of an absolute energy scale calibration method is currently underway using known sources such as cosmic ray muon Michel electrons at the ~10 MeV scale and $^{39}$Ar decay electrons at the ~100keV scale. Research into AI-based identification of such events at the data acquisition level is introduced.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗