SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

All sources NASA NTRS DOE OSTI

NASA NTRS2017

Verification Testing: Meet User Needs Figure of Merit

Verification is the process through which Modeling and Simulation(M&S) software goes to ensure that it has been rigorously tested and debugged for its intended use. Validation confirms that said software accurately models and represents the real world system. Credibility gives an assessment of the development and testing effort that the software has gone through as well as how accurate and reliable test results are. Together, these three components form Verification, Validation, and Credibility(VV&C), the process by which all NASA modeling software is to be tested to ensure that it is ready for implementation. NASA created this process following the CAIB (Columbia Accident Investigation Board) report seeking to understand the reasons the Columbia space shuttle failed during reentry. The reports conclusion was that the accident was fully avoidable, however, among other issues, the necessary data to make an informed decision was not there and the result was complete loss of the shuttle and crew. In an effort to mitigate this problem, NASA put out their Standard for Models and Simulations, currently in version NASA-STD-7009A, in which they detailed their recommendations, requirements and rationale for the different components of VV&C. They did this with the intention that it would allow for people receiving MS software to clearly understand and have data from the past development effort. This in turn would allow the people who had not worked with the MS software before to move forward with greater confidence and efficiency in their work. This particular project looks to perform Verification on several MATLAB (Registered Trademark)(The MathWorks, Inc.) scripts that will be later implemented in a website interface. It seeks to take note and define the limits of operation, the units and significance, and the expected datatype and format of the inputs and outputs of each of the scripts. This is intended to prevent the code from attempting to make incorrect or impossible calculations. Additionally, this project will look at the coding generally and note inconsistencies, redundancies, and other aspects that may become problematic or slow down the codes run time. Certain scripts lacking in documentation also will be commented and cataloged.

validation↗

NASA NTRS1993

Software metrics: The key to quality software on the NCC project

Network Control Center (NCC) Project metrics are captured during the implementation and testing phases of the NCCDS software development lifecycle. The metrics data collection and reporting function has interfaces with all elements of the NCC project. Close collaboration with all project elements has resulted in the development of a defined and repeatable set of metrics processes. The resulting data are used to plan and monitor release activities on a weekly basis. The use of graphical outputs facilitates the interpretation of progress and status. The successful application of metrics throughout the NCC project has been instrumental in the delivery of quality software. The use of metrics on the NCC Project supports the needs of the technical and managerial staff. This paper describes the project, the functions supported by metrics, the data that are collected and reported, how the data are used, and the improvements in the quality of deliverable software since the metrics processes and products have been in use.

Burns, Patricia J.↗

DOE OSTI2025

MTUQ: a framework for estimating moment tensors, point forces, and their uncertainties

SUMMARY We introduce MTUQ, an open-source Python package for seismic source estimation and uncertainty quantification, emphasizing flexibility and operational scalability. MTUQ provides MPI-parallelized grid search and global optimization capabilities, compatibility with 1-D and 3-D Green’s function database formats, customizable data processing, C-accelerated waveform and first-motion polarity misfit functions, and utilities for plotting seismic waveforms and visualizing misfit and likelihood surfaces. Applicability to a range of full- and constrained-moment tensor, point force, and centroid inversion problems is possible via a documented application programming interface, accompanied by example scripts and integration tests. We demonstrate the software using three different types of seismic events: (1) a 2009 intraslab earthquake near Anchorage, Alaska; (2) an episode of the 2021 Barry Arm landslide in Alaska; and (3) the 2017 Democratic People’s Republic of Korea underground nuclear test. With these events, we illustrate the well-known complementary character of body waves, surface waves, and polarities for constraining source parameters. We also convey the distinct misfit patterns that arise from each individual data type, the importance of uncertainty quantification for detecting multimodal or otherwise poorly constrained solutions, and the software’s flexible, modular design.

58 GEOSCIENCES↗

NASA NTRS1989

Automatic Parametric Testing Of Integrated Circuits

Computer program for parametric testing saves time and effort in research and development of integrated circuits. Software system automatically assembles various types of test structures and lays them out on silicon chip, generates sequency of test instructions, and interprets test data. Employs self-programming software; needs minimum of human intervention. Adapted to needs of different laboratories and readily accommodates new test structures. Program codes designed to be adaptable to most computers and test equipment now in use. Written in high-level languages to enhance transportability.

Jennings, Glenn A.↗

DOE OSTI2016

Performance Monitoring using Pecos (V.0.1)

Advances in sensor technology have rapidly increased our ability to monitor natural and human-made physical systems. In many cases, it is critical to process the resulting large volumes of data on a regular schedule and alert system operators when the system has changed. Automated quality control and performance monitoring can allow system operators to quickly detect performance issues. Pecos is an open source python package designed to address this need. Pecos includes built-in functionality to monitor performance of time series data. The software can be used to automatically run a series of quality control tests and generate customized reports which include performance metrics, test results, and graphics. The software was developed specifically for solar photovoltaic system monitoring, and is intended to be used by industry and the research community. The software can easily be customized for other applications. The following Pecos documentation includes installation instructions and examples, description of software features, and software license. It is assumed that the reader is familiar with the Python Programming Language. References are included for additional background on software components.

47 OTHER INSTRUMENTATION↗

NASA NTRS1993

Development of a methodology for assessing the safety of embedded software systems

A Dynamic Flowgraph Methodology (DFM) based on an integrated approach to modeling and analyzing the behavior of software-driven embedded systems for assessing and verifying reliability and safety is discussed. DFM is based on an extension of the Logic Flowgraph Methodology to incorporate state transition models. System models which express the logic of the system in terms of causal relationships between physical variables and temporal characteristics of software modules are analyzed to determine how a certain state can be reached. This is done by developing timed fault trees which take the form of logical combinations of static trees relating the system parameters at different point in time. The resulting information concerning the hardware and software states can be used to eliminate unsafe execution paths and identify testing criteria for safety critical software functions.

Garrett, C. J.↗

NASA NTRS1995

Adaptive Optimization of Aircraft Engine Performance Using Neural Networks

Preliminary results are presented on the development of an adaptive neural network based control algorithm to enhance aircraft engine performance. This work builds upon a previous National Aeronautics and Space Administration (NASA) effort known as Performance Seeking Control (PSC). PSC is an adaptive control algorithm which contains a model of the aircraft's propulsion system which is updated on-line to match the operation of the aircraft's actual propulsion system. Information from the on-line model is used to adapt the control system during flight to allow optimal operation of the aircraft's propulsion system (inlet, engine, and nozzle) to improve aircraft engine performance without compromising reliability or operability. Performance Seeking Control has been shown to yield reductions in fuel flow, increases in thrust, and reductions in engine fan turbine inlet temperature. The neural network based adaptive control, like PSC, will contain a model of the propulsion system which will be used to calculate optimal control commands on-line. Hopes are that it will be able to provide some additional benefits above and beyond those of PSC. The PSC algorithm is computationally intensive, it is valid only at near steady-state flight conditions, and it has no way to adapt or learn on-line. These issues are being addressed in the development of the optimal neural controller. Specialized neural network processing hardware is being developed to run the software, the algorithm will be valid at steady-state and transient conditions, and will take advantage of the on-line learning capability of neural networks. Future plans include testing the neural network software and hardware prototype against an aircraft engine simulation. In this paper, the proposed neural network software and hardware is described and preliminary neural network training results are presented.

Simon, Donald L.↗

NASA NTRS2013

STRS Radio Service Software for NASA's SCaN Testbed

NASA's Space Communication and Navigation(SCaN) Testbed was launched to the International Space Station in 2012. The objective is to promote new software defined radio technologies and associated software application reuse, enabled by this first flight of NASA's Space Telecommunications Radio System (STRS) architecture standard. Pre-launch testing with the testbed's software defined radios was performed as part of system integration. Radio services for the JPL SDR were developed during system integration to allow the waveform application to operate properly in the space environment, especially considering thermal effects. These services include receiver gain control, frequency offset, IQ modulator balance, and transmit level control. Development, integration, and environmental testing of the radio services will be described. The added software allows the waveform application to operate properly in the space environment, and can be reused by future experimenters testing different waveform applications. Integrating such services with the platform provided STRS operating environment will attract more users, and these services are candidates for interface standardization via STRS.

Mortensen, Dale J.↗

NASA NTRS2011

Space Telecommunications Radio System (STRS) Compliance Testing

The Space Telecommunications Radio System (STRS) defines an open architecture for software defined radios. This document describes the testing methodology to aid in determining the degree of compliance to the STRS architecture. Non-compliances are reported to the software and hardware developers as well as the NASA project manager so that any non-compliances may be fixed or waivers issued. Since the software developers may be divided into those that provide the operating environment including the operating system and STRS infrastructure (OE) and those that supply the waveform applications, the tests are divided accordingly. The static tests are also divided by the availability of an automated tool that determines whether the source code and configuration files contain the appropriate items. Thus, there are six separate step-by-step test procedures described as well as the corresponding requirements that they test. The six types of STRS compliance tests are: STRS application automated testing, STRS infrastructure automated testing, STRS infrastructure testing by compiling WFCCN with the infrastructure, STRS configuration file testing, STRS application manual code testing, and STRS infrastructure manual code testing. Examples of the input and output of the scripts are shown in the appendices as well as more specific information about what to configure and test in WFCCN for non-compliance. In addition, each STRS requirement is listed and the type of testing briefly described. Attached is also a set of guidelines on what to look for in addition to the requirements to aid in the document review process.

Handler, Louis M.↗

DOE OSTI2020

Experiences with a Flexible User Research Process to Build Data Change Tools

Scientific software development processes are understood to be distinct from commercial software development practices due to uncertain and evolving states of scientific knowledge. Sustaining these software products is a recognized challenge, but under-examined is the usability and usefulness of such tools to their scientific end users. User research is a well-established set of techniques (e.g., interviews, mockups, usability tests) applied in commercial software projects to develop foundational, generative, and evaluative insights about products and the people who use them. Currently these approaches are not commonly applied and discussed in scientific software development work. The use of user research techniques in scientific environments can be challenging due to the nascent, fluid problem spaces of scientific work, varying scope of projects and their user communities, and funding/economic constraints on projects.In this paper, we reflect on our experiences undertaking a multi-method user research process in the Deduce project. The Deduce project is investigating data change to develop metrics, methods, and tools that will help scientists make decisions around data change. There is a lack of common terminology since the concept of systematically measuring and managing data change is under explored in scientific environments. To bridge this gap we conducted user research that focuses on user practices, needs, and motivations to help us design and develop metrics and tools for data change. This paper contributes reflections and the lessons we have learned from our experiences. We offer key takeaways for scientific software project teams to effectively and flexibly incorporate similar processes into their projects.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1992

Autonomous power system brassboard

The Autonomous Power System (APS) brassboard is a 20 kHz power distribution system which has been developed at NASA Lewis Research Center, Cleveland, Ohio. The brassboard exists to provide a realistic hardware platform capable of testing artificially intelligent (AI) software. The brassboard's power circuit topology is based upon a Power Distribution Control Unit (PDCU), which is a subset of an advanced development 20 kHz electrical power system (EPS) testbed, originally designed for Space Station Freedom (SSF). The APS program is designed to demonstrate the application of intelligent software as a fault detection, isolation, and recovery methodology for space power systems. This report discusses both the hardware and software elements used to construct the present configuration of the brassboard. The brassboard power components are described. These include the solid-state switches (herein referred to as switchgear), transformers, sources, and loads. Closely linked to this power portion of the brassboard is the first level of embedded control. Hardware used to implement this control and its associated software is discussed. An Ada software program, developed by Lewis Research Center's Space Station Freedom Directorate for their 20 kHz testbed, is used to control the brassboard's switchgear, as well as monitor key brassboard parameters through sensors located within these switches. The Ada code is downloaded from a PC/AT, and is resident within the 8086 microprocessor-based embedded controllers. The PC/AT is also used for smart terminal emulation, capable of controlling the switchgear as well as displaying data from them. Intelligent control is provided through use of a T1 Explorer and the Autonomous Power Expert (APEX) LISP software. Real-time load scheduling is implemented through use of a 'C' program-based scheduling engine. The methods of communication between these computers and the brassboard are explored. In order to evaluate the features of both the brassboard hardware and intelligent controlling software, fault circuits have been developed and integrated as part of the brassboard. A description of these fault circuits and their function is included. The brassboard has become an extremely useful test facility, promoting artificial intelligence (AI) applications for power distribution systems. However, there are elements of the brassboard which could be enhanced, thus improving system performance. Modifications and enhancements to improve the brassboard's operation are discussed.

Merolla, Anthony↗

NASA NTRS2007

Solar Airplanes and Regenerative Fuel Cells

A solar electric aircraft with the potential to "fly forever" has captured NASA's interest, and the concept for such an aircraft was pursued under Aeronautics Environmental Research Aircraft and Sensor Technology (ERAST) project. Feasibility of this aircraft happens to depend on the successful development of solar power technologies critical to NASA's Exploration Initiatives; hence, there was widespread interest throughout NASA to bring these technologies to a flight demonstration. The most critical is an energy storage system to sustain mission power during night periods. For the solar airplane, whose flight capability is already limited by the diffuse nature of solar flux and subject to latitude and time of year constraints, the feasibility of long endurance flight depends on a storage density figure of merit better than 400-600 watt-hr per kilogram. This figure of merit is beyond the capability of present day storage technologies (other than nuclear) but may be achievable in the hydrogen-oxygen regenerative fuel cell (RFC). This potential has led NASA to undertake the practical development of a hydrogen-oxygen regenerative fuel cell, initially as solar energy storage for a high altitude UAV science platform but eventually to serve as the primary power source for NASAs lunar base and other planet surface installations. Potentially the highest storage capacity and lowest weight of any non-nuclear device, a flight-weight RFC aboard a solar-electric aircraft that is flown continuously through several successive day-night cycles will provide the most convincing demonstration that this technology's widespread potential has been realized. In 1998 NASA began development of a closed cycle hydrogen oxygen PEM RFC under the Aeronautics Environmental Research Aircraft and Sensor Technology (ERAST) project and continued its development, originally for a solar electric airplane flight, through FY2005 under the Low Emissions Alternative Power (LEAP) project. Construction of the closed loop system began in 2002 at the NASA Glenn Research Center in Cleveland, Ohio. System checkout was completed, and testing began, in July of 2003. The initial test sequences were done with only a fuel cell or electrolyzer in the test rig. Those tests were used to verify the test apparatus, procedures, and software. The first complete cycles of the fully closed loop, regenerative fuel cell system were successfully completed in the following September. Following some hardware upgrades to increase reactant recirculation flow, the test rig was operated at full power in December 2003 and again in January 2004. In March 2004 a newer generation of fuel cell and electrolyzer stacks was substituted for the original hardware and these stacks were successfully tested at full power under cyclic operation in June of 2004.

Bents, David J.↗

DOE OSTI2021

Added value for integrated marine energy data systems

Launched in 2019, the Portal and Repository for Information on Marine Renewable Energy (PRIMRE) provides centralized access, standardization, community building, and integration of United States (U.S.) databases, tools and codes, and other resources that cover a range of marine energy information. The PRIMRE universe contains a series of Knowledge Hubs that represent data and information on testing of marine energy devices (MHKDR); environmental effects (Tethys); engineering and technical papers (Tethys Engineering); descriptions of marine energy companies and technologies (Marine Energy Projects Database); codes and models (Marine Energy Software); and guidance on testing and measurements (Telesto). Content is added to PRIMRE by applying a set of Guidelines and Best Practices (PRIMRE Guidelines). An aggregate search across the PRIMRE site enables users to find data and information from all the PRIMRE Knowledge Hubs simultaneously, using a single entry-point (PRIMRE Search). In addition to providing access to a range of data and information on marine energy development, testing, and effects, PRIMRE allows for the development of value added products and processes that will help move the marine energy industry forward. The PRIMRE team has recently launched two key initiatives in the U.S.—Signature Projects and Lessons Learned. Outputs and outcomes from these two initiatives will be highlighted in this paper. The Signature Projects initiative is intended to bring focus to a selection of ongoing and completed marine energy projects funded by the U.S. Department of Energy’s Water Power Technologies Office (WPTO), and to inform the marine energy community of what investigations have been undertaken, what tools are available, and where gaps in information persist. Each Signature Project tags papers, reports, and data from large marine energy research projects, providing easy access and attention to all the output and associated products from each project. The Lessons Learned initiative is intended to ensure that hard-won achievements are recognized and available for those who come later, that missteps and unfortunate outcomes can be prevented in future, and that efficiencies and effective shortcuts can be publicized and used as the marine energy industry moves forward. This initiative builds off the Knowledge Hubs and reaches out to members of the marine energy community, particularly technology developers and researchers, to integrate experience in the development, deployment, assessment, success, and challenges while creating this new industry and field of study.

Copping, Andrea E.↗

DOE OSTI2021

Added value for integrated marine energy data systems

Copping, Andrea E.↗

DOE OSTI2021

Added Value for Integrated Marine Energy Data Systems (February 2021)

Launched in 2019, the Portal and Repository for Information on Marine Renewable Energy (PRIMRE) provides centralized access, standardization, community building, and integration of United States (U.S.) databases, tools and codes, and other resources that cover a range of marine energy information. The PRIMRE universe contains a series of Knowledge Hubs that represent data and information on testing of marine energy devices (MHKDR); environmental effects (Tethys); engineering and technical papers (Tethys Engineering); descriptions of marine energy companies and technologies (Marine Energy Projects Database); codes and models (Marine Energy Software); and guidance on testing and measurements (Telesto). Content is added to PRIMRE by applying a set of Guidelines and Best Practices (PRIMRE Guidelines). An aggregate search across the PRIMRE site enables users to find data and information from all the PRIMRE Knowledge Hubs simultaneously, using a single entry-point (PRIMRE Search). In addition to providing access to a range of data and information on marine energy development, testing, and effects, PRIMRE allows for the development of valueadded products and processes that will help move the marine energy industry forward. The PRIMRE team has recently launched two key initiatives in the U.S.-Signature Projects and Lessons Learned. Outputs and outcomes from these two initiatives will be highlighted in this paper. The Signature Projects initiative is intended to bring focus to a selection of ongoing and completed marine energy projects funded by the U.S. Department of Energy's Water Power Technologies Office (WPTO), and to inform the marine energy community of what investigations have been undertaken, what tools are available, and where gaps in information persist. Each Signature Project tags papers, reports, and data from large marine energy research projects, providing easy access and attention to all the output and associated products from each project. The Lessons Learned initiative is intended to ensure that hard-won achievements are recognized and available for those who come later, that missteps and unfortunate outcomes can be prevented in future, and that efficiencies and effective shortcuts can be publicized and used as the marine energy industry moves forward. This initiative builds off the Knowledge Hubs and reaches out to members of the marine energy community, particularly technology developers and researchers, to integrate experience in the development, deployment, assessment, success, challenges while creating this new industry and field of study.

data sharing↗

DOE OSTI2020

Bayes Inference Engine (BIE) Test Plan: TiltConeBeamComboDMLinear

The Bayes Inference Engine (BIE) is a general software tool intended to be used primarily in the analysis of radiographic data for density. An analysis is set up in the BIE by representing the problem as a collection of modules called glyphs. All glyphs to be used in creating the forward model of the experiment will be tested separately for a range of inputs.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Bayes Inference Engine (BIE) Test Plan: TiltConeBeamComboDMGeometric

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1990

Software verification plan for GCS

This verification plan is written as part of an experiment designed to study the fundamental characteristics of the software failure process. The experiment will be conducted using several implementations of software that were produced according to industry-standard guidelines, namely the Radio Technical Commission for Aeronautics RTCA/DO-178A guidelines, Software Consideration in Airborne Systems and Equipment Certification, for the development of flight software. This plan fulfills the DO-178A requirements for providing instructions on the testing of each implementation of software. The plan details the verification activities to be performed at each phase in the development process, contains a step by step description of the testing procedures, and discusses all of the tools used throughout the verification process.

Dent, Leslie A.↗