Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72

MAMA Software Features: Errors, Uncertainty, and Standards

This document reviews the sources of uncertainty, standards, and the UQ development plan for the MAMA software. Our intention is to allow users to generate quantification data with uncertainty based on the contributing back end sources. We do not intend to add in front end uncertainty into the software itself, due to the numerous different instruments that could be used, and the enormous variation in factors that would add to that uncertainty among different users, samples, and sample prep routines. We could not possibly or reasonably address them all. We will however, add in the uncertainty component from the image scale bar, which must be provided by the user as an input to the software, and could be used to incorporate any front end uncertainty. (Note: the detailing of these front end uncertainties is beyond the scope of this software effort.) The verification testing we have done generates uncertainties that are fundamentally pixel based. Given the uncertainty in the scale bar, we can then propagate the uncertainty and convert to uncertainty in all calculated results in microns (or whatever unit the scale bar is in.) Users can then add any additional instrumentation and sample prep uncertainty to the resulting output as appropriate for the data calculation and analysis being performed.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantification and Uncertainty in Particle Morphological Analysis

A key part of forensic analysis of interdicted nuclear materials is examining the microstructure of the materials, which are frequently in the form of particulates. We are developing methods for quantifying the morphology of particle sets imaged using scanning electron microscopy. In order to use this data effectively, we need to understand the uncertainties involved in measuring the morphology of particles. This presentation discusses the sources of uncertainty in scanning electron microscopy, and presents the results of an internal user test of the MAMA software package being developed under a DHS Transformational and Applied Research program. The steps required to establish morphological standards similar to NIST standards are discussed.

36 MATERIALS SCIENCE↗

DOE SBIR Phase II Final Technical Report - Assessing Climate Change Effects on Wind Energy

Specialized Vertum Partners software tools were prototyped, tested and commercialized to allow wind energy stakeholders to assess the uncertainties of climate change on wind power production and distribution. This project resulted in three commercially proven products and a marketing tool. The first was a Weather Research and Forecasting Model (WRF) based resource evaluation system. The second was a web-based service providing global 10m wind data from multiple sources to wind industry subscription customers. The third product addressed the needs of our utility clients looking at climate change effects on electricity distribution. For this we collaborated on the Santa Ana Wildfire Threat Index (SAWTi), which was released publicly last quarter. Finally to promote these products and educate potential users we released “Gust or Bust”, a graphic-novel styled marketing publication.

17 WIND ENERGY↗

Warthog: A MOOSE-Based Application for the Direct Code Coupling of BISON and PROTEUS

The Nuclear Energy Advanced Modeling and Simulation (NEAMS) program from the Department of Energy's Office of Nuclear Energy provides a robust toolkit for the modeling and simulation of current and future advanced nuclear reactor designs. This toolkit provides these technologies organized across product lines: two divisions targeted at fuels and end-to-end reactor modeling, and a third for integration, coupling, and high-level workflow management. The Fuels Product Line and the Reactor Product line provide advanced computational technologies that serve each respective field well, however, their current lack of integration presents a major impediment to future improvements of simulation solution fidelity. There is a desire for the capability to mix and match tools across Product Lines in an effort to utilize the best from both to improve NEAMS modeling and simulation technologies. This report details a new effort to provide this Product Line interoperability through the development of a new application called Warthog. This application couples the BISON Fuel Performance application from the Fuels Product Line and the PROTEUS Core Neutronics application from the Reactors Product Line in an effort to utilize the best from all parts of the NEAMS toolkit and improve overall solution fidelity of nuclear fuel simulations. To achieve this, Warthog leverages as much prior work from the NEAMS program as possible, and in doing so, enables interoperability between the disparate MOOSE and SHARP frameworks, and the libMesh and MOAB mesh data formats. This report describes this work in full. We begin with a detailed look at the individual NEAMS framework technologies used and developed in the various Product Lines, and the current status of their interoperability. We then introduce the Warthog application: its overall architecture and the ways it leverages the best existing tools from across the NEAMS toolkit to enable BISON-PROTEUS integration. Furthermore, we show how Warthog leverages a tool known as DataTransferKit to seamlessly enable the transfer for solution data between disparate frameworks and mesh formats. To end, we demonstrate tests for the direct software coupling of BISON and PROTEUS using Warthog, and discuss current impediments and solutions to the construction of physically realistic input models for this coupled BISON-PROTEUS system.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Novel Plasmonic Photocathodes for Electron-Ion Colliders

Our aim was to explore new photocathode materials and schemes to develop strategies and technologies for next generation nuclear physics accelerator capabilities, particularly for Electron Ion Colliders (EIC). We successfully implemented an experimental setup for light incidence at an acute angle onto metallic photocathodes in UHV, in order to excite surface Plasmon resonance, hence increasing light absorption by the metallic surface and tested the photoemitted current. We successfully tested the setup with a hot cathode as well as Plasmonic silver-MgO samples and obtained excellent results. We extended our studies to shorter wavelengths to help defeat the work function of the metal. We also used oblique incidence thin film deposition onto gratings to achieve optimized Plasmonic excitation leading to stronger EM field and also lower emittance. We tested and used adequate software to model our samples and simulate our experimental results. We incorporated the concept of Fano resonances applied to gratings to better interpret our experimental results.

36 MATERIALS SCIENCE↗

Status of EM Pump Modeling Capability for VTR

SAS4A/SASSYS-1 is a simulation tool used to perform deterministic analyses of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal-cooled nuclear reactors. Most recently, SAS4A/SASSYS-1 has been selected as the safety analysis software for the Versatile Test Reactor (VTR), a new materials testing Sodium Fast Reactor (SFR) to be built by the Department of Energy. In order to support analysis of the VTR, which will utilize ElectroMagnetic (EM) pumps as the primary coolant pumps, the development of new EM pump modeling capabilities has been initiated for SAS4/SASSYS-1. The new physics-based EM pump model captures systems-level transient performance based on equivalent circuit theory and is highly flexible to model a wide range of electromagnetic pumps of the three-phase linear induction type subject to changes in power supply and plant conditions. Within the equivalent circuit framework, two sub-models are developed to provide options for analysts both with and without a detailed geometric characterization of their pump such that minimal information is required to achieve a realistic working model, but specific details of a particular pump design may be captured if sufficient information is provided. In addition, heat generated from pump operation and its transport through the plant system can be modeled to better capture the behavior of certain transients. This paper will outline the model and derive the governing equations of the new EM pump model. An initial comparison between the simple EM pump model and experimental data is made. This comparison shows that the equivalent circuit model can capture pump performance, with greater accuracy near the rated conditions. In order to demonstrate the transient behavior of the new model, a simple transient with an EM pump replacing the centrifugal pumps in the Advanced Burner Test Reactor is included.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Status of EM Pump Modeling Capability for VTR

SAS4A/SASSYS-1 is a simulation tool used to perform deterministic analyses of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal-cooled nuclear reactors. Most recently, SAS4A/SASSYS-1 has been selected as the safety analysis software for the Versatile Test Reactor (VTR), a new materials testing Sodium Fast Reactor (SFR) to be built by the Department of Energy. In order to support analysis of the VTR, which will utilize ElectroMagnetic (EM) pumps as the primary coolant pumps, the development of new EM pump modeling capabilities has been initiated for SAS4/SASSYS-1. The new physics-based EM pump model captures systems-level transient performance based on equivalent circuit theory and is highly flexible to model a wide range of electromagnetic pumps of the three-phase linear induction type subject to changes in power supply and plant conditions. Within the equivalent circuit framework, two sub-models are developed to provide options for analysts both with and without a detailed geometric characterization of their pump such that minimal information is required to achieve a realistic working model, but specific details of a particular pump design may be captured if sufficient information is provided. In addition, heat generated from pump operation and its transport through the plant system can be modeled to better capture the behavior of certain transients. This paper will outline the model and derive the governing equations of the new EM pump model. An initial comparison between the simple EM pump model and experimental data is made. This comparison shows that the equivalent circuit model can capture pump performance, with greater accuracy near the rated conditions. In order to demonstrate the transient behavior of the new model, a simple transient with an EM pump replacing the centrifugal pumps in the Advanced Burner Test Reactor is included.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

CTF Theory Manual: Version 4.3

Coolant-Boiling in Rod Arrays—Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for light water reactor (LWR) vessel analysis. It uses a two-fluid, three-field (i.e., fluid film, fluid drops, and vapor) modeling approach. Both subchannel and three-dimensional Cartesian forms of its governing equations are available for the solution. The code was originally developed by Pacific Northwest Laboratory in 1980, and had been used and modified by several institutions over the last few decades. COBRA-TF also found use at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently rebranded as CTF. CTF was later adopted in the early 2010s by Oak Ridge National Laboratory (ORNL) for use in the Consortium for Advanced Simulation of Light Water Reactors (CASL) program, which led to a significant advancement of the code software quality, modeling accuracy, testing systems, and capabilities for improved support of modeling of common LWR nominal and transient behavior. As part of the improvement process, it was necessary to generate sufficient documentation for the public domain code which had lacked such material upon being adopted by RDFMG. This document serves as a theory manual for CTF, detailing the many two-phase heat transfer, drag, and important accident scenario models contained in the code, as well as the numerical solution process utilized. Additional documents available in the CTF documentation suite include the user manual and verification and validation manual.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

CTF Theory Manual: Version 4.4

Coolant-Boiling in Rod Arrays – Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for light-water reactor (LWR) vessel analysis. It uses a two-fluid, three-field (i.e., fluid film, fluid drops, and vapor) modeling approach. Both subchannel and 3D Cartesian forms of its governing equations are available for the solution. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last few decades. COBRA-TF also found use at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently rebranded as CTF. CTF was later adopted in the early 2010s by Oak Ridge National Laboratory (ORNL) for use in the Consortium for Advanced Simulation of Light Water Reactors (CASL) program, which led to a significant advancement of the code’s software quality, modeling accuracy, testing systems, and capabilities for improved support in modeling common LWR nominal and transient behavior. As part of the improvement process, it was necessary to generate sufficient documentation for the public domain code which had lacked such material upon being adopted by RDFMG. This document serves as a theory manual for CTF, detailing the many two-phase heat transfer, drag, and important accident scenario models contained in the code, as well as the numerical solution process utilized. Additional documents available in the CTF documentation suite include the user manual and the verification and validation manual.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Development of POTATO for 2S Module Grading for the CMS Phase-2 Outer Tracker Upgrade

Due to the High Luminosity-Large Hadron Collider (HL-LHC) upgrade, several detectors of the Compact Muon Solenoid (CMS) will need to be replaced, specifically the new Outer Tracker (OT) that will be assembled with 13,200 silicon modules. The OT is composed of two types of modules; the PS (pixel-strip) and the 2S (strip-strip) modules. With a large influx of production of modules, extensive testing is required to ensure quality of the modules. This research introduces POTATO (Phase-II Outer Tracker Analyzer of Test Outputs), a specialized software developed in C++ to analyze, grade, and store results in a centralized database. Module data will be collected from various international production facilities. The implementation of POTATO will facilitate with selecting the best performing modules for the Outer Tracker upgrade. This research is focused on the implementation of the analysis of 2S Module results within POTATO.

Klupshas, Anna↗

Development of POTATO for 2S Module Grading for the CMS Phase-2 Outer Tracker Upgrade

Due to the High Luminosity-Large Hadron Collider (HL-LHC) upgrade, several detectors of the Compact Muon Solenoid (CMS) will need to be upgraded, specifically the new Outer Tracker detector that will be composed of 13,200 silicon modules. The Outer Tracker features two types of modules; the PS (pixel-strip) and the 2S (strip-strip) modules. With a large influx of production of modules, extensive testing is required to ensure they fulfill the performance requirements. This research introduces POTATO (Phase-II Outer Tracker Analyzer of Test Outputs), a specialized software developed in C++ to analyze, grade, and store results in a centralized database since module data will be collected from various international production facilities. The implementation of POTATO will facilitate the selection of the best performing modules for the Outer Tracker upgrade. This paper is focused on the implementation of the analysis of 2S Module results within POTATO.

43 PARTICLE ACCELERATORS↗

Passband Signal Detection at the Edge

Algorithms for radio frequency (RF) spectrum awareness need to be compatible with edge hardware to be practical for many applications. We developed a signal detection and classification model for the ZCU111 RF System-on-a-Chip (RFSoC) that operates on the fast Fourier transform of passband RF data. The system can detect and classify multiple signals of interest and display the predictions in real-time. The model consists of a modified ConvNeXt backbone and YOLOv3 head to operate on the Deep Learning Processing Unit on the RFSoC. We gathered datasets for training and testing by using a software defined radio to transmit example signals of Wi-Fi 802.11 b/g, Wi-Fi 802.11 n, FM Radio, LTE and LTE-M. By leveraging multiple inputs on the RFSoC frontend, the datasets span up to 4 GHz of bandwidth. The models showed high performance in classification accuracy, center frequency error, bandwidth error, and detection accuracy for both single and multi-signal datasets.

42 ENGINEERING↗

Vitis CI/CD & Containerization

Modern development flows that use tooling for automated building, testing, and deployment of software are becoming the norm for large scale software and hardware projects. These flows offer quite a few advantages that make them desirable, but when attempting to implement them for projects that use FPGAs, some complications can arise when attempting to integrate them with traditional FPGA toolchains and deployment workflows. In this poster, we present early our early efforts integrating the Vitis FPGA toolchain into a modern, Kuberentes and Github actions based CI/CD pipeline.

Hawks, Benjamin G. [Fermilab]↗

ARPA-E Grid Optimization (GO) Competition Challenge 3

Synthetic Input Data and Team Results for the GO Competition Challenge 3 for Events 1 - 4 and the Sandbox, along with problem and format descriptions and code to validate data and solutions, are available here. Data for industry scenarios will not be made public. The Grid Optimization (GO) Competition Challenge 3 focused on the security-constrained optimal power flow (SCOPF) problem. It is part of a continuing effort begun with Challenges 1 and 2, to successfully discover, develop, and test innovative and disruptive software solutions for critical energy challenges and to overcome existing barriers. The broader goal of the of the GO Competition is to accelerate the development of transformational and disruptive methods for solving problems related to the electric power grid and to provide a transparent, fair, and comprehensive evaluation of new solution methods. Challenge 3 used multiperiod dynamic markets, including advisory models for extreme weather events, day-ahead markets, and the real-time markets with an extended look-ahead. In Event 4, whose submission window was August 31-September 4, 2023, 14 teams solved for the objective values of 669 scenarios (39 scenarios required solutions both with and without line switching being allowed). The 591 synthetic scenarios from 9 network models (3.6 GB) are available here. Ten teams were funded to participate and 7 won prizes totaling $2,400,000. The largest prize ($550,000) went to Mississippi State University. An additional $600,000 was awarded in Event 3 (6/15-16/2023). No prizes were awarded in Events 1 (1/25-27/2023) or 2 (4/13-14/2023). For more information on the competition and challenge see the "GO Competition Challenge 3 Information" resource below.

ACOPF↗

Assessment of Envelope- and Machine Learning-Based Electrical Fault Type Detection Algorithms for Electrical Distribution Grids

This study introduces envelope- and machine learning (ML)-based electrical fault type detection algorithms for electrical distribution grids, advancing beyond traditional logic-based methods. The proposed detection model involves three stages: anomaly area detection, ML-based fault presence detection, and ML-based fault type detection. Initially, an envelope-based detector identifying the anomaly region was improved to handle noisier power grid signals from meters. The second stage acts as a switch, detecting the presence of a fault among four classes: normal, motor, switching, and fault. Finally, if a fault is detected, the third stage identifies specific fault types. This study explored various feature extraction methods and evaluated different ML algorithms to maximize prediction accuracy. The performance of the proposed algorithms is tested in an emulated software–hardware electrical grid testbed using different sample rate meters/relays, such as SEL735, SEL421, SEL734, SEL700GT, and SEL351S near and far from an inverter-based photovoltaic array farm. The performance outcomes demonstrate the proposed model’s robustness and accuracy under realistic conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

IoT Firmware Emulation and Its Security Application in Fuzzing: A Critical Revisit

As IoT devices with microcontroller (MCU)-based firmware become more common in our lives, memory corruption vulnerabilities in their firmware are increasingly targeted by adversaries. Fuzzing is a powerful method for detecting these vulnerabilities, but it poses unique challenges when applied to IoT devices. Direct fuzzing on these devices is inefficient, and recent efforts have shifted towards creating emulation environments for dynamic firmware testing. However, unlike traditional software, firmware interactions with peripherals that are significantly more diverse presents new challenges for achieving scalable full-system emulation and effective fuzzing. This paper reviews 27 state-of-the-art works in MCU-based firmware emulation and its applications in fuzzing. Instead of classifying existing techniques based on their capabilities and features, we first identify the fundamental challenges faced by firmware emulation and fuzzing. We then revisit recent studies, organizing them according to the specific challenges they address, and discussing how each specific challenge is addressed. We compare the emulation fidelity and bug detection capabilities of various techniques to clearly demonstrate their strengths and weaknesses, aiding users in selecting or combining tools to meet their needs. Finally, we highlight the remaining technical gaps and point out important future research directions in firmware emulation and fuzzing.

Zhou, Wei (ORCID:0000000178340839)↗

Off-line data analysis and data reduction from digitally controlled random test systems.

This paper discusses the merits of employing the new computer-controlled random environment control systems for fast and efficient large-scale data analysis when they are not being used for test control. Hardware and software requirements are stated. Several of the more familiar frequency functions are defined from the Fourier coefficients, the main product of the Fourier processors used in these control systems. Another function, the probability density function, is defined and suggestions for its application are made. An analysis example is presented. Some programming tips are listed, and the accuracy and reliability of frequency analysis measurements are considered.

Chapman, C. P.↗

SEASAT A satellite scatterometer

The analyses performed in the early period of the program which formed the basis of the sensor design is reviewed, along with the sensor design. The test program is outlined, listing all tests performed and the environmental exposure (simulated) for each, as applicable. Ground support equipment designed and built for assembly integration and field testing is described. The software developed during the program and the algorithms/flow diagrams which formed the bases for the software are summarized.

Bianchi, R.↗