Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

TPGITF user's manual

The primary purpose of TPG interface (TPGITF) software is to create test patterns, according to a mathematical model, for a real device. In order for the device actually to be tested or to be accurately simulated, a means is required to transform the TPGITF generated test into forms acceptable as input to logic test equipment or to a software logic simulator. The MACRODATA-200 Logic Test System and the LOGSIM logic simulator are the particular systems supported by the TPGITF software. A description is presented of the TPGITF software processor. It is assumed that the reader is familiar with the TPG, LOGSIM, and TOIL systems. Flow charts are given.

Pitts, E. R.↗

FY2021 Improvements to the New CTH Code Verification & Validation Test Suite

Over the past few years, the CTH multiphysics hydrocode has overhauled its software quality and testing processes, implementing current best practices in software quality and building a robust V&V test suite comprised of traditional hydrocode verification problems, including ASC Tri-Lab Test Suite and Enhanced Tri-Lab Test Suite problems, as well as validation problems for some of CTH’s most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards building this new test suite was made in FY19 and FY20. In FY21, the test suite has been expanded to include verification and validation tests of the Steinberg-Guinan-Lund (ST) viscoplastic model and the Johnson Cook (JFRAC) fracture model. Additionally, two new verification tests were added, covering hydrodynamics and high explosive (HE) modeling capabilities: the Kidder Gaussian density problem and the Escape of HE Products (EHEP) problem from the Tri-Lab Test Suite. This report discusses each of these test problems in detail. Verification test results are compared to analytic solutions. Validation test results are compared to experimental data. Wherever possible, convergence or mesh refinement studies are included. Additionally, while implementing the Kidder verification problem, a bug was identified that affects the use of tables to initialize pressure or density in 1D or 2D calculations. A brief discussion of the bug and its fix is included. CTH demonstrates good performance overall on the new test suite problems. Simulation results showed good agreement with analytic solutions for the Kidder problem, with convergence rates ranging between 1.8 and sub-linear, and relatively good agreement for the EHEP problem, though convergence rates for pressure and density were nearly 0. The ST and JFRAC strain rate loading verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data, including Taylor rod impact testing, for the materials tested. Future V&V work will focus on adding 2D and 3D versions of existing verification tests as well as adding validation tests of other frequently used capabilities such as other fracture models.

42 ENGINEERING↗

Comparison of steady-state analytical wake models implemented in wind farm analysis software

A common set of mathematical wind turbine wake models are implemented in a few, well-adopted computational tools for wind farm wake modelling. Although the referenced mathematical formulations are common, implementation details may lead to differences in results. This study presents a systematic comparison of the implementation of mathematical wake models in open source, Python-based wind turbine wake modelling software, and a set of the models are directly compared. Despite aligning only the mathematical model parameters and retaining the default computational model parameters, good agreement is found across most of the model implementations, and additional agreement is expected upon further parameters alignment.

17 WIND ENERGY↗

Creating Continuous Integration Infrastructure for Software Development on U.S. Department of Energy High-Performance Computing Systems

The Exascale Computing Project (ECP) software deployment effort developed and advanced DevOps capabilities. One goal was to enable robust continuous integration (CI) workflows that span the protected high performance computing (HPC) environments found within many of the Department of Energy’s (DOE) national laboratories. This article highlights several challenges encountered with enabling automation, such as charging models for CI jobs, and meeting individualized security requirements that revolve around strongly associating running code with a human identity. Here, it also describes how the Jacamar CI tool evolved to meet latter requirements and became a key aspect of the solutions currently offered. Derived from this experience, we offer a conceptual framework for understanding current and future CI challenges at DOE facilities and offer suggestions for long-term solutions.

97 MATHEMATICS AND COMPUTING↗

The Silver Lining

Clouds are shareable scientific instruments that create the potential for reproducibility by ensuring that all investigators have access to a common execution platform on which computational experiments can be repeated and compared. By virtue of the interface they present, they also lead to the creation of digital artifacts compatible with the cloud, such as images or orchestration templates, that go a long way-and sometimes all the way-to representing an experiment in a digital, repeatable form. In this article, I describe how we developed these natural advantages of clouds in the Chameleon testbed and argue that we should leverage them to create a digital research marketplace that would make repeating experiments as natural and viable part of research as sharing ideas via reading papers is today.

Cloud computing↗

Design-to-Deployment Continuum Platform for Microscopes and Computing Ecosystems

Science ecosystems with networked computing systems and physical instruments are increasingly being deployed with a goal to achieve the productivity promised by AI-supported remote automation. In support of these efforts, the virtual infrastructure twins (VITs) have been successfully utilized to develop the orchestration codes for these ecosystems without requiring physical access to expensive instruments, such as electron microscopes. Currently, the utility of such a VIT is severely limited by the computing capacity and capability of the computing system used as its host. Furthermore, codes developed on the VIT typically need to be transferred and refactored for production use, particularly, on high-performance systems with accelerators. In response, we develop a design-to-deployment continuum platform wherein a VIT runs natively on the ecosystem's own computing system, and thereby facilitates the continual in-situ testing and transition of codes for production use. Here, we describe the development and testing of software for remote microscope steering and GPU-based image reconstruction using this platform on a multi-GPU computing system networked to Nion microscopes. We demonstrate a continual transition of steering and reconstruction codes developed under VIT platform to production ecosystem deployment.

Al-Najjar, Anees [Oak Ridge National Laboratory (O↗

Geomagnetically Induced Current Field Test on Large Grid-Connected Power Transformers: Analysis, Model Development, and Simulations

Geomagnetic-induced current (GIC) flow in power grids can cause undesirable effects such as transformer overheating, harmonics, higher reactive power demand, etc. Many simulation models have been developed to study these effects, but real-world verification on modern transformer designs is rare. Here, this paper presents the first long-duration GIC field test in the U.S. performed on high-voltage, grid-connected transformers featuring winding clamps and tie rods instead of conventional tie bars. Field measurements were taken to evaluate GIC effects. These measurements also aided in developing and validating thermal and electromagnetic transient (EMT) models of the transformers. During the test, significant current and voltage distortions were observed along with considerable transformer reactive power losses. Analysis of the field measurements showed that the transformers’ hottest spot was at the inner windings, and their k-factors were close to factory test and software default values. Thermal simulations indicated that the transformers would not violate their thermal limits even for a GIC waveform that peaks at about 200 A/phase. EMT simulations revealed that increased transformer loading may reduce GIC-induced reactive power demand and harmonics in certain scenarios. The study also highlighted potential inaccuracies in using the k-factor method to calculate transformer reactive power losses.

EMTDC↗

Evaluation of Energy Storage Potential of Unconventional Shale Reservoirs Using Numerical Simulation of Cyclic Gas Injection

Compressed air energy storage (CAES) stores energy as compressed air in underground formations, typically salt dome caverns. When electricity demand grows, the compressed air is released through a turbine to produce electricity. CAES in the US is limited to one plant built in 1991, due in part to the inherent risk and uncertainty of developing subsurface storage reservoirs. As an alternative to CAES, we propose using some of the hundreds of thousands of hydraulically fractured horizontal wells to store energy as compressed natural gas in unconventional shale reservoirs. To store energy, produced or “sales” natural gas is injected back into the formation using excess electricity and is later produced through an expander to generate electricity. To evaluate this concept, we performed numerical simulations of cyclic natural gas injection into unconventional shale reservoirs using cmg-gem commercial reservoir modeling software. We tested short-term (diurnal) and long-term (seasonal) energy storage potential by modeling well injection and production gas flowrates as a function of bottom-hole pressure. First, we developed a conceptual model of a single fracture stage in an unconventional shale reservoir to characterize reservoir behavior during cyclic injection and production. Next, we modeled cyclic injection in the Marcellus shale gas play using published data. Results indicate that Marcellus unconventional shale reservoirs could support both short- and long-term energy storage at capacities of 100–1000 kWe per well. The results indicate that energy storage in unconventional shale gas wells may be feasible and warrants further investigation.

25 ENERGY STORAGE↗

SU-E-T-442: Sensitivity of Quality Assurance Tools to Delivery Errors On a Magnetic Resonance-Imaging Guided Radiation Therapy (MR-IGRT) System

Purpose: To test the sensitivity of the quality assurance (QA) tools actively used on a clinical MR-IGRT system for potential delivery errors. Methods: Patient-specific QA procedures have been implemented for a commercially available Cobalt-60 MR-IGRT system. The QA tools utilized were a MR-compatible cylindrical diode-array detector (ArcCHECK) with a custom insert which positions an ionization chamber (Exradin A18) in the middle of the device, as well as an in-house treatment delivery verification program. These tools were tested to investigate their sensitivity to delivery errors. For the ArcCHECK and ion chamber, a baseline was established with a static field irradiation to a known dose. Variations of the baseline were investigated which included rotated gantry, altered field size, directional shifts, and different delivery time. In addition, similar variations were tested with the automated delivery verification program that compared the treatment parameters in the machine delivery logs to the ones in the plan. To test the software, a 3-field conformal plan was generated as the baseline. Results: ArcCHECK noted at least a 13% decrease in passing rate from baseline in the following scenarios: gantry rotation of 1 degree from plan, 5mm change in field size, 2mm lateral shift, and delivery time decrease. Ion chamber measurements remained consistent for these variations except for the 5 second decrease in delivery time scenario which resulted in an 8% difference from baseline. The delivery verification software was able to detect and report the simulated errors such as when the gantry was rotated by 0.6 degrees, the beam weighting was changed by a percent, a single multileaf collimator was moved by 1cm, and the dose was changed from 2 to 1.8Gy. Conclusion: The results show that the current tools used for patient specific QA are capable of detecting small errors in RT delivery with presence of magnetic field.

60 APPLIED LIFE SCIENCES↗

TU-H-CAMPUS-IeP3-02: Neurovascular 4D Parametric Imaging Using Co-Registration of Biplane DSA Sequences with 3D Vascular Geometry Obtained From Cone Beam CT

Purpose: To create 4D parametric images using biplane Digital Subtraction Angiography (DSA) sequences co-registered with the 3D vascular geometry obtained from Cone Beam-CT (CBCT). Methods: We investigated a method to derive multiple 4D Parametric Imaging (PI) maps using only one CBCT acquisition. During this procedure a 3D-DSA geometry is stored and used subsequently for all 4D images. Each time a biplane DSA is acquired, we calculate 2D parametric maps of Bolus Arrival Time (BAT), Mean Transit Time (MTT) and Time to Peak (TTP). Arterial segments which are nearly parallel with one of the biplane imaging planes in the 2D parametric maps are co-registered with the 3D geometry. The values in the remaining vascular network are found using spline interpolation since the points chosen for co-registration on the vasculature are discrete and remaining regions need to be interpolated. To evaluate the method we used a patient CT volume data set for 3D printing a neurovascular phantom containing a complete Circle of Willis. We connected the phantom to a flow loop with a peristaltic pump, simulating physiological flow conditions. Contrast media was injected with an automatic injector at 10 ml/sec. Images were acquired with a Toshiba Infinix C-arm and 4D parametric image maps of the vasculature were calculated. Results: 4D BAT, MTT, and TTP parametric image maps of the Circle of Willis were derived. We generated color-coded 3D geometries which avoided artifacts due to vessel overlap or foreshortening in the projection direction. Conclusion: The software was tested successfully and multiple 4D parametric images were obtained from biplane DSA sequences without the need to acquire additional 3D-DSA runs. This can benefit the patient by reducing the contrast media and the radiation dose normally associated with these procedures. Partial support from NIH Grant R01-EB002873 and Toshiba Medical Systems Corp.

60 APPLIED LIFE SCIENCES↗

Assessment of the Phase-to-Ground Fault Apparent Admittance Method with Phase/Ground Boundaries to Detect Types of Electrical Faults for Protective Relays Using Signature Library and Simulated Events

Protective relays in electric power grids recognize the types of electrical faults in a few seconds. The most common detection method to detect the types of electrical faults is based on measuring the angle between the zero and negative sequence currents. However, it is not completely accurate because the phase-to-phase-ground and phase-to-ground electrical faults could have the same detection conditions. Therefore, engineers need to plot the events after an electrical fault to observe the nature of the incidents in detail. In this study, the phase-to-ground fault apparent (PGFA) admittance method with phase/ground boundaries identified the types of electrical faults located in distribution power lines and feeders. This method was based on measuring the PGFA admittance magnitudes for the faulted and nonfaulted phases, resulting in greater than zero and near zero, respectively. The PGFA admittance algorithm was built with MATLAB/Simulink software and tested with signature library and grid simulation events. The PGFA method with phase/ground boundaries was evaluated with the confusion matrix. The measured and predicted values matched in more than 90% of the tests, and the PGFA admittance method with phase/ground boundaries presented an accuracy of 94.3% and a precision of 100%.

42 ENGINEERING↗

hpcswtest

The HPC Software stack testing framework

Berg, Paul↗

Acoustic Array Development for Wind Turbine Noise Characterization

This report discusses the design and use of a multi-arm, logarithmic spiral acoustic array by the National Renewable Energy Laboratory (NREL) for measurement and characterization of wind turbine-generated noise. The array was developed in collaboration with a team from the University of Colorado Boulder. This design process is a continuation of the elliptical array design work done by Simley. A description of the array system design process is presented, including array shape design, mechanical design, design of electronics and the data acquisition system, and development of post-processing software. System testing and calibration methods are detailed. Results from the initial data acquisition campaign are offered and discussed. Issues faced during this initial deployment of the array are presented and potential remedies discussed.

17 WIND ENERGY↗

ASC-ATDM Performance Portability Requirements for 2015-2019

This report outlines the research, development, and support requirements for the Advanced Simulation and Computing (ASC ) Advanced Technology, Development, and Mitigation (ATDM) Performance Portability (a.k.a., Kokkos) project for 2015 - 2019 . The research and development (R&D) goal for Kokkos (v2) has been to create and demonstrate a thread - parallel programming model a nd standard C++ library - based implementation that enables performance portability across diverse manycore architectures such as multicore CPU, Intel Xeon Phi, and NVIDIA Kepler GPU. This R&D goal has been achieved for algorithms that use data parallel pat terns including parallel - for, parallel - reduce, and parallel - scan. Current R&D is focusing on hierarchical parallel patterns such as a directed acyclic graph (DAG) of asynchronous tasks where each task contain s nested data parallel algorithms. This five y ear plan includes R&D required to f ully and performance portably exploit thread parallelism across current and anticipated next generation platforms (NGP). The Kokkos library is being evaluated by many projects exploring algorithm s and code design for NGP. Some production libraries and applications such as Trilinos and LAMMPS have already committed to Kokkos as their foundation for manycore parallelism an d performance portability. These five year requirements includes support required for current and antic ipated ASC projects to be effective and productive in their use of Kokkos on NGP. The greatest risk to the success of Kokkos and ASC projects relying upon Kokkos is a lack of staffing resources to support Kokkos to the degree needed by these ASC projects. This support includes up - to - date tutorials, documentation, multi - platform (hardware and software stack) testing, minor feature enhancements, thread - scalable algorithm consulting, and managing collaborative R&D.

97 MATHEMATICS AND COMPUTING↗

Model of the Product Development Lifecycle.

While the increased use of Commercial Off-The-Shelf information technology equipment has presented opportunities for improved cost effectiveness and flexibility, the corresponding loss of control over the product's development creates unique vulnerabilities and security concerns. Of particular interest is the possibility of a supply chain attack. A comprehensive model for the lifecycle of hardware and software products is proposed based on a survey of existing literature from academic, government, and industry sources. Seven major lifecycle stages are identified and defined: (1) Requirements, (2) Design, (3) Manufacturing for hardware and Development for software, (4) Testing, (5) Distribution, (6) Use and Maintenance, and (7) Disposal. The model is then applied to examine the risk of attacks at various stages of the lifecycle.

He, Sunny L.↗

24.1.3.1.1 – Frisch Grid CZT Spectrometer

During FY18, BNL continued helping FLIR to integrate the instrument prototype, improving the readout software and testing electronics. BNL and LLNL carried out more measurements with the 4x4 arrays in laboratory conditions using several Cs sources and reanalyzed the raw data from the field measurements. LLNL processed the old recalibrated data and new data collected in the lab. These efforts allowed us to understand the cause of the discrepancies observed during the measurements at the Westinghouse Fuel Fabrication Facility (WFFF). The problem was traced back to the original ASIC and DAQ firmware provided by the ASIC developers. A program error and some other deficiencies were identified in the original firmware. These problems, which caused missing some detected events from the data stream, never showed up in the lab environment. So, they were not spotted before the field test. The ASIC designers are currently working to address these problems and will provide the updated firmware for the next field measurements.

36 MATERIALS SCIENCE↗

24.1.3.1.1 – Frisch Grid CZT Spectrometer

During FY18, BNL continued helping FLIR to integrate the instrument prototype, improving the readout software and testing electronics. BNL and LLNL carried out more measurements with the 4x4 arrays in laboratory conditions using several Cs sources and reanalyzed the raw data from the field measurements. LLNL processed the old recalibrated data and new data collected in the lab. These efforts allowed us to understand the cause of the discrepancies observed during the measurements at the Westinghouse Fuel Fabrication Facility (WFFF). The problem was traced back to the original ASIC and DAQ firmware provided by the ASIC developers. A program error and some other deficiencies were identified in the original firmware. These problems, which caused missing some detected events from the data stream, never showed up in the lab environment. So, they were not spotted before the field test. The ASIC designers are currently working to address these problems and will provide the updated firmware for the next field measurements.

97 MATHEMATICS AND COMPUTING↗