SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Hardware-in-the-Loop Testing of Wide-Area Damping Controller for Field Implementation in Large-scale Power Grid

In our previous work, an adaptive measurement-driven wide-area damping controller (WADC) for suppressing inter-area oscillations has been proposed and a hardware prototype was developed and validated through hardware-in-the-loop tests. As a continuation of the work, this paper introduces a WADC software prototype to handle the realistic challenges for field implementation in the control room of the power grid. The WADC software is developed and operated as an openPDC adapter with a graphical user interface (GUI) to monitor the WADC inputs and output, the communication delays and other variables. The software prototype has been fully tested through an enhanced hardware-in-the-loop (HIL) test setup. Its performance is verified under various realistic communication uncertainties, such as random time delays and data losses, with different communication protocols. The experiment results have proven the WADC software can deliver sufficient damping to suppress the targeted oscillation mode in handling various communication uncertainties for future field deployment.

Jia, Xinlan↗

DOE OSTI2016

SU-F-T-61: Treatment Planning Observations for the CivaSheet Directional Brachytherapy Device Using VariSeed 9.0

Purpose: The VariSeed 9.0 brachytherapy TPS is recently available and has new features such as ability to rotate a brachytherapy source away from normal to the imaging plane. Consequently, a dosimetric analysis was performed for a directional brachytherapy source (CivaSheet) with tests of this functionality and experiences from clinical treatment planning were documented. These observations contribute to safe, practical, and accurate use of such new software features. Methods: Several tests were established to evaluate the new rotational feature, specific to the CivaSheet for the first patients treated using this new brachytherapy device. These included suitability of imaging slice-thickness and in-plane resolution, window/level adjustments for brachytherapy source visualization, commissioning the source physical length for performing rotations, and using different planar and 3D window views to identify source orientation. Additional CivaSheet-specific tests were performed to determine the dosimetric influence on target coverage: changing the source tilt angle, source positioning in the treatment plan based on the CivaSheet rectangular array of CivaDots, and influence of prescription depth on the necessary treatment margin for adequate target coverage. Results: Higher imaging-resolution produced better accuracy for source orientation and positioning, with sub-millimeter CT slice-thickness and in-plane resolution preferred. Source rotation was possible only in sagittal or coronal views. The process for validating source orientation required iteratively altering rotations then checking them in the 3D view, which was cumbersome given the absence of quantitative plan documentation to indicate orientation. Given the small Pd-103 source size, influence of source tilt within 30° was negligible for <1.0 cm. Influence of source position was important when the source was positioned in/out of the adjacent source plane, causing changes of 15%, 7%, and 3% at depths of 0.5, 0.7, and 1.0 cm. Conclusion: The new TPS rotational feature worked well, but several issues were identified to improve the treatment planning process. Research supported in part by CivaTech Oncology, Inc. for Dr. Rivard.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2022

Towards Ultra-high-resolution E3SM Land Modeling on Exascale Computers

Here we present an ultra-high-resolution E3SM land model (uELM) for high-fidelity land simulations targeting new Exascale computers. After considering modeling infrastructure compatibility and ELM software features, we designed a parallel model for the uELM development targeting hybrid architectures of new US Exascale computers. We also described a function unit test framework to expedite the piece-wise code porting (with compiler directives), verification, and global variable management. Furthermore, in this study, we report an early uELM model development using OpenACC within a function unit test framework on a pre-Exascale computer, demonstrate the performance of a uLEM submodel with a 3.0-time speedup, and summarize the code porting experience regarding global variable handling, deepcopy, memory reduction, and parallel loop reconstruction.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Computational capacity in hydrodynamic real-time hybrid simulation applied to simulate the dynamic response of floating offshore wind turbines

Real-time hybrid simulation (RTHS) mitigates similitude distortions in model-scale tests of floating offshore wind turbines (FOWTs) by coupling physical experiments with numerical models in real time. The coupling requires faster-than-real-time numerical computations to satisfy temporal similitude with the physical experiment, presenting a bottleneck for using more complex numerical models in RTHS. This paper presents a hydrodynamic-RTHS (hydro-RTHS) framework for FOWTs that simulates the hydrodynamics physically and the aerodynamics numerically with sensor feedback from the physical testing. The framework adapts the three-loop hardware architecture to leverage greater computational resources and mitigate strict temporal requirements, enabling more computationally demanding numerical analyses in hydro-RTHS. The three-loop hardware architecture integrates multiple machines, each dedicated to either numerical analysis or RTHS controls, with a rate-transition algorithm to synchronize the tasks executed across the different machine processors. Virtual and physical tests verified and validated the hydro-RTHS framework, respectively. The ”virtual” tests, which approximates the physical domain numerically, verified the RTHS framework with respect to a numerical full-scale complete FOWT model simulated in the open-source software, OpenFAST. The virtual tests were able to maintain comparable control signals while enabling greater computational resources for the numerical calculations. Real-world physical tests demonstrated that the hydro-RTHS framework computes aerodynamic forces similar to the complete OpenFAST model, validating the hydro-RTHS framework using the three-loop hardware architecture. Findings show that the hydro-RTHS framework with the three-loop hardware architecture is computationally efficient, with reserve capacity to simulate more complex problems due to the customized software, hardware, and rate-transition algorithm.

17 WIND ENERGY↗

DOE OSTI2021

BeeSwarm: Enabling Parallel Scaling Performance Measurement in Continuous Integration for HPC Applications

Testing is one of the most important steps in software development–it ensures the quality of software. Continuous Integration (CI) is a widely used testing standard that can report software quality to the developer in a timely manner during development progress. Performance, especially scalability, is another key factor for High Performance Computing (HPC) applications. There are many existing profiling and performance tools for HPC applications, but none of these are integrated into CI tools. In this work, we propose BeeSwarm, an HPC container based parallel scaling performance system that can be easily applied to the current CI test environments. BeeSwarm is mainly designed for HPC application developers who need to monitor how their applications can scale on different compute resources. We demonstrate BeeSwarm using a multi-physics HPC application with Travis CI, GitLab CI and GitHub Actions while using ChameleonCloud and Google Compute Engine as the compute backends. Finally, our results show that BeeSwarm can be used for scalability and performance testing of HPC applications.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2016

SU-G-BRB-02: An Open-Source Software Analysis Library for Linear Accelerator Quality Assurance

Purpose: Routine linac quality assurance (QA) tests have become complex enough to require automation of most test analyses. A new data analysis software library was built that allows physicists to automate routine linear accelerator quality assurance tests. The package is open source, code tested, and benchmarked. Methods: Images and data were generated on a TrueBeam linac for the following routine QA tests: VMAT, starshot, CBCT, machine logs, Winston Lutz, and picket fence. The analysis library was built using the general programming language Python. Each test was analyzed with the library algorithms and compared to manual measurements taken at the time of acquisition. Results: VMAT QA results agreed within 0.1% between the library and manual measurements. Machine logs (dynalogs & trajectory logs) were successfully parsed; mechanical axis positions were verified for accuracy and MLC fluence agreed well with EPID measurements. CBCT QA measurements were within 10 HU and 0.2mm where applicable. Winston Lutz isocenter size measurements were within 0.2mm of TrueBeam’s Machine Performance Check. Starshot analysis was within 0.2mm of the Winston Lutz results for the same conditions. Picket fence images with and without a known error showed that the library was capable of detecting MLC offsets within 0.02mm. Conclusion: A new routine QA software library has been benchmarked and is available for use by the community. The library is open-source and extensible for use in larger systems.

43 PARTICLE ACCELERATORS↗

DOE OSTI2014

SU-E-J-266: A Pitfall of a Deformable Image Registration in Lung Cancer

Purpose: For four-dimensional (4D) planning and adaptive radiotherapy, deformable image registration (DIR) is needed and the accuracy is essential. We evaluated the accuracy of one free-downloadable DIR software library package (NiftyReg) and one commercial DIR software (MIM) in lung SBRT cancer patients. Methods: A rigid and non-rigid registrations were implemented to our in-house software. The non-rigid registration algorithm of the NiftyReg and MIM was based on the free-form deformation. The accuracy of the two software was evaluated when contoured structures to peak-inhale and peak-exhale 4DCT image data sets were measured using the dice similarity coefficient (DSC). The evaluation was performed in 20 lung SBRT patients. Results: In our visual evaluation, the eighteen cases show good agreement between the deformed structures for the peak-inhale phase and the peak-exhale phase structures (more than 0.8 DSC value). In the evaluation of the DSC in-house software, averaged DSC values of GTV and lung, heart, spinal cord, stomach and body were 0.862 and 0.979, 0.932, 0.974, 0.860, 0.998, respectively. As the Resultof the registration using the MIM program in the two cases which had less than 0.7 DSC value when analyzed using the in-house software, the DSC value were improved to 0.8. The CT images in a case with low DSC value shows the tumor was surrounded by the structure with the similar CT values, which were the chest wall or the diaphragm. Conclusion: Not only a free-downloadable DIR software but also a commercial software may provide unexpected results and there is a possibility that the results would make us misjudge the treatment planning. Therefore, we recommend that a commissioning test of any DIR software should be performed before clinical use and we should understand the characteristics of the software.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2017

Building a Virtual Ecosystem Dynamic Model for Root Research

Not Available

Xu, Yang↗

DOE OSTI2021

Validating Intra-Plate Power Distributions in the Advanced Test Reactor

We report that the neutronics software, HELIOS, was validated in 2015 for performing core reload design and safety analysis of the Advanced Test Reactor. However, when HELIOS was benchmarked against historic fission-wire measurements (i.e., zero-power full-core measurements) a statistically resolved calculation-to-measurement bias was discovered. The azimuthal power along each fuel plate computed by HELIOS has consistently shown to under-predict measurements made by fission-wires in historic zero-power tests near the fuel element side-plates. It was hypothesized during the HELIOS software validation work, that this bias is attributable to local moderation in coolant vents in the side-plates axially just above and below the fission-wires on the fuel-plate edges. This work used detailed MCNP and MC21 models of the side-plate vents to test this hypothesis. By comparing the average azimuthal biases between HELIOS, and 2D and 3D MCNP models, and a 3D MC21 model, it was found that the HELIOS azimuthal bias is not due to the measurement.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2024

FORCE Regression Testing

Via programs including the Light Water Reactor Sustainability and Integrated Energy Systems, the U.S. Department of Energy has invested in the Framework for Optimization of ResourCes and Economics (FORCE) software framework (Idaho National Laboratory 2024a) for the technical and economic analysis of nuclear-integrated energy systems (IES). Nuclear IES expand the use of nuclear from traditional baseload electricity generation to a flexible and adaptive source of combined heat and power. Nuclear heat can be used in the production of a variety of energy currencies such as hydrogen and ammonia as well as other heat applications including water desalination and district heating. FORCE is designed with the intent to provide interconnected analysis tools that enable the accurate technical and economic assessment of specific nuclear IES configurations for individual energy markets. FORCE consists of three main analysis pathways: HYBRID (Idaho National Laboratory 2024b), which contains high-resolution physical models for IES; Holistic Energy Resource Optimization Network (HERON) (Idaho National Laboratory 2024c), which analyzes IES long-term economic viability; and Optimization of Real-time Capacity Allocation (ORCA) (Idaho National Laboratory 2024d), designed for real-time control of IES via digital twins and optimal decision making, including autonomous and remote operation research. Development of the FORCE ecosystem is guided by three pillars: capability, which assures that the computational requirements of IES analysis are met by the software tools; reliability, which provides for consistent code performance and expected behaviors; and accessibility, which lowers the barrier to entry for using the software and accelerates analysis by users beyond the FORCE primary developers. Reliability of the FORCE ecosystem is established according to the American Nuclear Society?s Nuclear Quality Assurance (NQA-1) program [American Society of Mechanical Engineers 1982], with specific levels of software quality assurance (SQA) within NQA-1 applied to each software tool in FORCE. As the tools within FORCE have matured, some integration algorithms to accurately connect the software tools for holistic analysis have been developed and deployed within the FORCE software repository. In accordance with NQA-1 standards, regression tests are required to guarantee the software performs consistently even when new capabilities are added to the software. In this report, we document the deployment of both unit tests, which test the consistent behavior of small pieces of the FORCE code base, as well as integration tests, which test the consistent performance of full use cases for the FORCE integration algorithms. We further document the encapsulation of these tests within a test harness, which collectively checks for each successful test completion on demand. Finally, we document the automation of the test harness using GitHub Actions [GitHub 2024], which require all tests succeed before any new capability or other changes can be added to the FORCE integration software

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

MTUQ: a framework for estimating moment tensors, point forces, and their uncertainties

SUMMARY We introduce MTUQ, an open-source Python package for seismic source estimation and uncertainty quantification, emphasizing flexibility and operational scalability. MTUQ provides MPI-parallelized grid search and global optimization capabilities, compatibility with 1-D and 3-D Green’s function database formats, customizable data processing, C-accelerated waveform and first-motion polarity misfit functions, and utilities for plotting seismic waveforms and visualizing misfit and likelihood surfaces. Applicability to a range of full- and constrained-moment tensor, point force, and centroid inversion problems is possible via a documented application programming interface, accompanied by example scripts and integration tests. We demonstrate the software using three different types of seismic events: (1) a 2009 intraslab earthquake near Anchorage, Alaska; (2) an episode of the 2021 Barry Arm landslide in Alaska; and (3) the 2017 Democratic People’s Republic of Korea underground nuclear test. With these events, we illustrate the well-known complementary character of body waves, surface waves, and polarities for constraining source parameters. We also convey the distinct misfit patterns that arise from each individual data type, the importance of uncertainty quantification for detecting multimodal or otherwise poorly constrained solutions, and the software’s flexible, modular design.

58 GEOSCIENCES↗

DOE OSTI2016

Performance Monitoring using Pecos (V.0.1)

Advances in sensor technology have rapidly increased our ability to monitor natural and human-made physical systems. In many cases, it is critical to process the resulting large volumes of data on a regular schedule and alert system operators when the system has changed. Automated quality control and performance monitoring can allow system operators to quickly detect performance issues. Pecos is an open source python package designed to address this need. Pecos includes built-in functionality to monitor performance of time series data. The software can be used to automatically run a series of quality control tests and generate customized reports which include performance metrics, test results, and graphics. The software was developed specifically for solar photovoltaic system monitoring, and is intended to be used by industry and the research community. The software can easily be customized for other applications. The following Pecos documentation includes installation instructions and examples, description of software features, and software license. It is assumed that the reader is familiar with the Python Programming Language. References are included for additional background on software components.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Experiences with a Flexible User Research Process to Build Data Change Tools

Scientific software development processes are understood to be distinct from commercial software development practices due to uncertain and evolving states of scientific knowledge. Sustaining these software products is a recognized challenge, but under-examined is the usability and usefulness of such tools to their scientific end users. User research is a well-established set of techniques (e.g., interviews, mockups, usability tests) applied in commercial software projects to develop foundational, generative, and evaluative insights about products and the people who use them. Currently these approaches are not commonly applied and discussed in scientific software development work. The use of user research techniques in scientific environments can be challenging due to the nascent, fluid problem spaces of scientific work, varying scope of projects and their user communities, and funding/economic constraints on projects.In this paper, we reflect on our experiences undertaking a multi-method user research process in the Deduce project. The Deduce project is investigating data change to develop metrics, methods, and tools that will help scientists make decisions around data change. There is a lack of common terminology since the concept of systematically measuring and managing data change is under explored in scientific environments. To bridge this gap we conducted user research that focuses on user practices, needs, and motivations to help us design and develop metrics and tools for data change. This paper contributes reflections and the lessons we have learned from our experiences. We offer key takeaways for scientific software project teams to effectively and flexibly incorporate similar processes into their projects.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Added value for integrated marine energy data systems

Launched in 2019, the Portal and Repository for Information on Marine Renewable Energy (PRIMRE) provides centralized access, standardization, community building, and integration of United States (U.S.) databases, tools and codes, and other resources that cover a range of marine energy information. The PRIMRE universe contains a series of Knowledge Hubs that represent data and information on testing of marine energy devices (MHKDR); environmental effects (Tethys); engineering and technical papers (Tethys Engineering); descriptions of marine energy companies and technologies (Marine Energy Projects Database); codes and models (Marine Energy Software); and guidance on testing and measurements (Telesto). Content is added to PRIMRE by applying a set of Guidelines and Best Practices (PRIMRE Guidelines). An aggregate search across the PRIMRE site enables users to find data and information from all the PRIMRE Knowledge Hubs simultaneously, using a single entry-point (PRIMRE Search). In addition to providing access to a range of data and information on marine energy development, testing, and effects, PRIMRE allows for the development of value added products and processes that will help move the marine energy industry forward. The PRIMRE team has recently launched two key initiatives in the U.S.—Signature Projects and Lessons Learned. Outputs and outcomes from these two initiatives will be highlighted in this paper. The Signature Projects initiative is intended to bring focus to a selection of ongoing and completed marine energy projects funded by the U.S. Department of Energy’s Water Power Technologies Office (WPTO), and to inform the marine energy community of what investigations have been undertaken, what tools are available, and where gaps in information persist. Each Signature Project tags papers, reports, and data from large marine energy research projects, providing easy access and attention to all the output and associated products from each project. The Lessons Learned initiative is intended to ensure that hard-won achievements are recognized and available for those who come later, that missteps and unfortunate outcomes can be prevented in future, and that efficiencies and effective shortcuts can be publicized and used as the marine energy industry moves forward. This initiative builds off the Knowledge Hubs and reaches out to members of the marine energy community, particularly technology developers and researchers, to integrate experience in the development, deployment, assessment, success, and challenges while creating this new industry and field of study.

Copping, Andrea E.↗

DOE OSTI2021

Added value for integrated marine energy data systems

Copping, Andrea E.↗

DOE OSTI2021

Added Value for Integrated Marine Energy Data Systems (February 2021)

Launched in 2019, the Portal and Repository for Information on Marine Renewable Energy (PRIMRE) provides centralized access, standardization, community building, and integration of United States (U.S.) databases, tools and codes, and other resources that cover a range of marine energy information. The PRIMRE universe contains a series of Knowledge Hubs that represent data and information on testing of marine energy devices (MHKDR); environmental effects (Tethys); engineering and technical papers (Tethys Engineering); descriptions of marine energy companies and technologies (Marine Energy Projects Database); codes and models (Marine Energy Software); and guidance on testing and measurements (Telesto). Content is added to PRIMRE by applying a set of Guidelines and Best Practices (PRIMRE Guidelines). An aggregate search across the PRIMRE site enables users to find data and information from all the PRIMRE Knowledge Hubs simultaneously, using a single entry-point (PRIMRE Search). In addition to providing access to a range of data and information on marine energy development, testing, and effects, PRIMRE allows for the development of valueadded products and processes that will help move the marine energy industry forward. The PRIMRE team has recently launched two key initiatives in the U.S.-Signature Projects and Lessons Learned. Outputs and outcomes from these two initiatives will be highlighted in this paper. The Signature Projects initiative is intended to bring focus to a selection of ongoing and completed marine energy projects funded by the U.S. Department of Energy's Water Power Technologies Office (WPTO), and to inform the marine energy community of what investigations have been undertaken, what tools are available, and where gaps in information persist. Each Signature Project tags papers, reports, and data from large marine energy research projects, providing easy access and attention to all the output and associated products from each project. The Lessons Learned initiative is intended to ensure that hard-won achievements are recognized and available for those who come later, that missteps and unfortunate outcomes can be prevented in future, and that efficiencies and effective shortcuts can be publicized and used as the marine energy industry moves forward. This initiative builds off the Knowledge Hubs and reaches out to members of the marine energy community, particularly technology developers and researchers, to integrate experience in the development, deployment, assessment, success, challenges while creating this new industry and field of study.

data sharing↗

DOE OSTI2020

Bayes Inference Engine (BIE) Test Plan: TiltConeBeamComboDMLinear

The Bayes Inference Engine (BIE) is a general software tool intended to be used primarily in the analysis of radiographic data for density. An analysis is set up in the BIE by representing the problem as a collection of modules called glyphs. All glyphs to be used in creating the forward model of the experiment will be tested separately for a range of inputs.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Bayes Inference Engine (BIE) Test Plan: TiltConeBeamComboDMGeometric

97 MATHEMATICS AND COMPUTING↗