Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Cyberattack Detection and Mitigation on Central Volt‐VAr Using Circuit Law and Machine Learning

ABSTRACT In a distribution grid, voltage is maintained within a nominal range through a Volt‐VAr function that controls capacitor banks, reactive power of distributed energy resources (DER), and on‐load tap changers (OLTC). Availability of communications helps with the implementation of central Volt‐VAr control; however, it also opens the system to cyberattacks, causing voltage disturbances. Previous work has shown the adverse impacts of false data injection (FDI) on the central Volt‐VAr control; however, very few works have studied methods to detect and mitigate FDI on Volt‐VAr control. This paper addresses gaps in the detection and mitigation of FDI on the measurement packets of a central Volt‐VAr control. This work uses a two‐stage algorithm for cyberattack detection since the accuracy of a single‐stage machine learning (ML)–based detection method decreases while dealing with unseen data. The first stage is based on the verification of measurements against circuit laws, and the second stage utilizes a tree search algorithm and an ML method to detect the falsified data. This paper compares long short‐term memory (LSTM) and bidirectional LSTM (BiLSTM) as the employed ML algorithms. Finally, the mitigation algorithm replaces the falsified data with the estimated output of the ML algorithm. The effectiveness of the proposed method is tested for several cases using the IEEE 13‐bus test system in PSCAD software.

Beikbabaei, Milad [Bradley Department of Electrica↗

Porting the Kitten Lightweight Kernel Operating System to RISC-V

Hardware design in high-performance computing (HPC) is often highly experimental. Exploring new designs is difficult and time-consuming, requiring lengthy vendor cooperation. RISC-V is an open-source processor ISA that improves the accessibility of chip design, including the ability to do hardware/software co-design using open-source hardware and tools. Co-design allows design decisions to easily flow across the hardware/software boundary and influence future design ideas. However, new hardware designs require corresponding software to drive and test them. Conventional operating systems like Linux are massively complex and modification is time-prohibitive. In this paper, we describe our port of the Kitten lightweight kernel operating system to RISC-V in order to provide an alternative to Linux for conducting co-design research. Kitten's small code base and simple resource management policies are well matched for quickly exploring new hardware ideas that may require radical operating system modifications and restructuring. Our evaluation shows that Kitten on RISC-V is functional and provides similar performance to Linux for single-core benchmarks. This provides a solid foundation for using Kitten in future co-design research involving RISC-V.

Gordon, Nick↗

Lowering and Runtime Support for Fortran’s Multi-Image Parallel Features using LLVM Flang, PRIF, and Caffeine

This paper provides an overview of the multi-image parallel features in Fortran 2023 and their implementation in the LLVM flang compiler and the Caffeine parallel runtime library. The features of interest support a Single-Program, Multiple-Data (SPMD) programming model based on executing multiple “images”, each of which is a program instance. The features also support a Partitioned Global Address Space (PGAS) in the form of “coarray” distributed data structures. The paper discusses the lowering of multi-image features to the Parallel Runtime Interface for Fortran (PRIF) and the implementation of PRIF in the Caffeine parallel runtime library. This paper also provides an early view into the design of a new multi-image dialect of the LLVM Multi-Level Intermediate Representation (MLIR). We describe validation and testing of the resulting software stack, and demonstrate that performance compares favorably to another open-source compiler and runtime library: GNU Compiler Collection (GCC) gfortran and OpenCoarrays, respectively.

Bonachea, Dan↗

pvlib python: 2023 project update

pvlib python is a community-developed, open-source software toolbox for simulating the performance of solar photovoltaic (PV) energy components and systems. It provides reference implementations of over 100 empirical and physics-based models from the peer-reviewed scientific literature, including solar position algorithms, irradiance models, thermal models, and PV electrical models. In addition to individual low-level model implementations, pvlib python provides high-level workflows that chain these models together like building blocks to form complete “weather-to-power” photovoltaic system models. It also provides functions to fetch and import a wide variety of weather datasets useful for PV modeling. pvlib python has been developed since 2013 and follows modern best practices for open-source python software, with comprehensive automated testing, standards-based packaging, and semantic versioning. Its source code is developed openly on GitHub and releases are distributed via the Python Package Index (PyPI) and the conda-forge repository. pvlib python’s source code is made freely available under the permissive BSD-3 license. Here we (the project’s core developers) present an update on pvlib python, describing capability and community development since our 2018 publication (Holmgren, Hansen, & Mikofski, 2018).

14 SOLAR ENERGY↗

Status of EM Pump Modeling Capability for VTR

SAS4A/SASSYS-1 is a simulation tool used to perform deterministic analyses of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal-cooled nuclear reactors. Most recently, SAS4A/SASSYS-1 has been selected as the safety analysis software for the Versatile Test Reactor (VTR), a new materials testing Sodium Fast Reactor (SFR) to be built by the Department of Energy. In order to support analysis of the VTR, which will utilize ElectroMagnetic (EM) pumps as the primary coolant pumps, the development of new EM pump modeling capabilities has been initiated for SAS4/SASSYS-1. The new physics-based EM pump model captures systems-level transient performance based on equivalent circuit theory and is highly flexible to model a wide range of electromagnetic pumps of the three-phase linear induction type subject to changes in power supply and plant conditions. Within the equivalent circuit framework, two sub-models are developed to provide options for analysts both with and without a detailed geometric characterization of their pump such that minimal information is required to achieve a realistic working model, but specific details of a particular pump design may be captured if sufficient information is provided. In addition, heat generated from pump operation and its transport through the plant system can be modeled to better capture the behavior of certain transients. This paper will outline the model and derive the governing equations of the new EM pump model. An initial comparison between the simple EM pump model and experimental data is made. This comparison shows that the equivalent circuit model can capture pump performance, with greater accuracy near the rated conditions. In order to demonstrate the transient behavior of the new model, a simple transient with an EM pump replacing the centrifugal pumps in the Advanced Burner Test Reactor is included.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Status of EM Pump Modeling Capability for VTR

SAS4A/SASSYS-1 is a simulation tool used to perform deterministic analyses of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal-cooled nuclear reactors. Most recently, SAS4A/SASSYS-1 has been selected as the safety analysis software for the Versatile Test Reactor (VTR), a new materials testing Sodium Fast Reactor (SFR) to be built by the Department of Energy. In order to support analysis of the VTR, which will utilize ElectroMagnetic (EM) pumps as the primary coolant pumps, the development of new EM pump modeling capabilities has been initiated for SAS4/SASSYS-1. The new physics-based EM pump model captures systems-level transient performance based on equivalent circuit theory and is highly flexible to model a wide range of electromagnetic pumps of the three-phase linear induction type subject to changes in power supply and plant conditions. Within the equivalent circuit framework, two sub-models are developed to provide options for analysts both with and without a detailed geometric characterization of their pump such that minimal information is required to achieve a realistic working model, but specific details of a particular pump design may be captured if sufficient information is provided. In addition, heat generated from pump operation and its transport through the plant system can be modeled to better capture the behavior of certain transients. This paper will outline the model and derive the governing equations of the new EM pump model. An initial comparison between the simple EM pump model and experimental data is made. This comparison shows that the equivalent circuit model can capture pump performance, with greater accuracy near the rated conditions. In order to demonstrate the transient behavior of the new model, a simple transient with an EM pump replacing the centrifugal pumps in the Advanced Burner Test Reactor is included.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

CTF Theory Manual: Version 4.3

Coolant-Boiling in Rod Arrays—Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for light water reactor (LWR) vessel analysis. It uses a two-fluid, three-field (i.e., fluid film, fluid drops, and vapor) modeling approach. Both subchannel and three-dimensional Cartesian forms of its governing equations are available for the solution. The code was originally developed by Pacific Northwest Laboratory in 1980, and had been used and modified by several institutions over the last few decades. COBRA-TF also found use at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently rebranded as CTF. CTF was later adopted in the early 2010s by Oak Ridge National Laboratory (ORNL) for use in the Consortium for Advanced Simulation of Light Water Reactors (CASL) program, which led to a significant advancement of the code software quality, modeling accuracy, testing systems, and capabilities for improved support of modeling of common LWR nominal and transient behavior. As part of the improvement process, it was necessary to generate sufficient documentation for the public domain code which had lacked such material upon being adopted by RDFMG. This document serves as a theory manual for CTF, detailing the many two-phase heat transfer, drag, and important accident scenario models contained in the code, as well as the numerical solution process utilized. Additional documents available in the CTF documentation suite include the user manual and verification and validation manual.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

CTF Theory Manual: Version 4.4

Coolant-Boiling in Rod Arrays – Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for light-water reactor (LWR) vessel analysis. It uses a two-fluid, three-field (i.e., fluid film, fluid drops, and vapor) modeling approach. Both subchannel and 3D Cartesian forms of its governing equations are available for the solution. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last few decades. COBRA-TF also found use at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently rebranded as CTF. CTF was later adopted in the early 2010s by Oak Ridge National Laboratory (ORNL) for use in the Consortium for Advanced Simulation of Light Water Reactors (CASL) program, which led to a significant advancement of the code’s software quality, modeling accuracy, testing systems, and capabilities for improved support in modeling common LWR nominal and transient behavior. As part of the improvement process, it was necessary to generate sufficient documentation for the public domain code which had lacked such material upon being adopted by RDFMG. This document serves as a theory manual for CTF, detailing the many two-phase heat transfer, drag, and important accident scenario models contained in the code, as well as the numerical solution process utilized. Additional documents available in the CTF documentation suite include the user manual and the verification and validation manual.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Development of POTATO for 2S Module Grading for the CMS Phase-2 Outer Tracker Upgrade

Due to the High Luminosity-Large Hadron Collider (HL-LHC) upgrade, several detectors of the Compact Muon Solenoid (CMS) will need to be replaced, specifically the new Outer Tracker (OT) that will be assembled with 13,200 silicon modules. The OT is composed of two types of modules; the PS (pixel-strip) and the 2S (strip-strip) modules. With a large influx of production of modules, extensive testing is required to ensure quality of the modules. This research introduces POTATO (Phase-II Outer Tracker Analyzer of Test Outputs), a specialized software developed in C++ to analyze, grade, and store results in a centralized database. Module data will be collected from various international production facilities. The implementation of POTATO will facilitate with selecting the best performing modules for the Outer Tracker upgrade. This research is focused on the implementation of the analysis of 2S Module results within POTATO.

Klupshas, Anna↗

Development of POTATO for 2S Module Grading for the CMS Phase-2 Outer Tracker Upgrade

Due to the High Luminosity-Large Hadron Collider (HL-LHC) upgrade, several detectors of the Compact Muon Solenoid (CMS) will need to be upgraded, specifically the new Outer Tracker detector that will be composed of 13,200 silicon modules. The Outer Tracker features two types of modules; the PS (pixel-strip) and the 2S (strip-strip) modules. With a large influx of production of modules, extensive testing is required to ensure they fulfill the performance requirements. This research introduces POTATO (Phase-II Outer Tracker Analyzer of Test Outputs), a specialized software developed in C++ to analyze, grade, and store results in a centralized database since module data will be collected from various international production facilities. The implementation of POTATO will facilitate the selection of the best performing modules for the Outer Tracker upgrade. This paper is focused on the implementation of the analysis of 2S Module results within POTATO.

43 PARTICLE ACCELERATORS↗

Passband Signal Detection at the Edge

Algorithms for radio frequency (RF) spectrum awareness need to be compatible with edge hardware to be practical for many applications. We developed a signal detection and classification model for the ZCU111 RF System-on-a-Chip (RFSoC) that operates on the fast Fourier transform of passband RF data. The system can detect and classify multiple signals of interest and display the predictions in real-time. The model consists of a modified ConvNeXt backbone and YOLOv3 head to operate on the Deep Learning Processing Unit on the RFSoC. We gathered datasets for training and testing by using a software defined radio to transmit example signals of Wi-Fi 802.11 b/g, Wi-Fi 802.11 n, FM Radio, LTE and LTE-M. By leveraging multiple inputs on the RFSoC frontend, the datasets span up to 4 GHz of bandwidth. The models showed high performance in classification accuracy, center frequency error, bandwidth error, and detection accuracy for both single and multi-signal datasets.

42 ENGINEERING↗

Vitis CI/CD & Containerization

Modern development flows that use tooling for automated building, testing, and deployment of software are becoming the norm for large scale software and hardware projects. These flows offer quite a few advantages that make them desirable, but when attempting to implement them for projects that use FPGAs, some complications can arise when attempting to integrate them with traditional FPGA toolchains and deployment workflows. In this poster, we present early our early efforts integrating the Vitis FPGA toolchain into a modern, Kuberentes and Github actions based CI/CD pipeline.

Hawks, Benjamin G. [Fermilab]↗

ARPA-E Grid Optimization (GO) Competition Challenge 3

Synthetic Input Data and Team Results for the GO Competition Challenge 3 for Events 1 - 4 and the Sandbox, along with problem and format descriptions and code to validate data and solutions, are available here. Data for industry scenarios will not be made public. The Grid Optimization (GO) Competition Challenge 3 focused on the security-constrained optimal power flow (SCOPF) problem. It is part of a continuing effort begun with Challenges 1 and 2, to successfully discover, develop, and test innovative and disruptive software solutions for critical energy challenges and to overcome existing barriers. The broader goal of the of the GO Competition is to accelerate the development of transformational and disruptive methods for solving problems related to the electric power grid and to provide a transparent, fair, and comprehensive evaluation of new solution methods. Challenge 3 used multiperiod dynamic markets, including advisory models for extreme weather events, day-ahead markets, and the real-time markets with an extended look-ahead. In Event 4, whose submission window was August 31-September 4, 2023, 14 teams solved for the objective values of 669 scenarios (39 scenarios required solutions both with and without line switching being allowed). The 591 synthetic scenarios from 9 network models (3.6 GB) are available here. Ten teams were funded to participate and 7 won prizes totaling $2,400,000. The largest prize ($550,000) went to Mississippi State University. An additional $600,000 was awarded in Event 3 (6/15-16/2023). No prizes were awarded in Events 1 (1/25-27/2023) or 2 (4/13-14/2023). For more information on the competition and challenge see the "GO Competition Challenge 3 Information" resource below.

ACOPF↗

Assessment of Envelope- and Machine Learning-Based Electrical Fault Type Detection Algorithms for Electrical Distribution Grids

This study introduces envelope- and machine learning (ML)-based electrical fault type detection algorithms for electrical distribution grids, advancing beyond traditional logic-based methods. The proposed detection model involves three stages: anomaly area detection, ML-based fault presence detection, and ML-based fault type detection. Initially, an envelope-based detector identifying the anomaly region was improved to handle noisier power grid signals from meters. The second stage acts as a switch, detecting the presence of a fault among four classes: normal, motor, switching, and fault. Finally, if a fault is detected, the third stage identifies specific fault types. This study explored various feature extraction methods and evaluated different ML algorithms to maximize prediction accuracy. The performance of the proposed algorithms is tested in an emulated software–hardware electrical grid testbed using different sample rate meters/relays, such as SEL735, SEL421, SEL734, SEL700GT, and SEL351S near and far from an inverter-based photovoltaic array farm. The performance outcomes demonstrate the proposed model’s robustness and accuracy under realistic conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

IoT Firmware Emulation and Its Security Application in Fuzzing: A Critical Revisit

As IoT devices with microcontroller (MCU)-based firmware become more common in our lives, memory corruption vulnerabilities in their firmware are increasingly targeted by adversaries. Fuzzing is a powerful method for detecting these vulnerabilities, but it poses unique challenges when applied to IoT devices. Direct fuzzing on these devices is inefficient, and recent efforts have shifted towards creating emulation environments for dynamic firmware testing. However, unlike traditional software, firmware interactions with peripherals that are significantly more diverse presents new challenges for achieving scalable full-system emulation and effective fuzzing. This paper reviews 27 state-of-the-art works in MCU-based firmware emulation and its applications in fuzzing. Instead of classifying existing techniques based on their capabilities and features, we first identify the fundamental challenges faced by firmware emulation and fuzzing. We then revisit recent studies, organizing them according to the specific challenges they address, and discussing how each specific challenge is addressed. We compare the emulation fidelity and bug detection capabilities of various techniques to clearly demonstrate their strengths and weaknesses, aiding users in selecting or combining tools to meet their needs. Finally, we highlight the remaining technical gaps and point out important future research directions in firmware emulation and fuzzing.

Zhou, Wei (ORCID:0000000178340839)↗

The ICEBERG Test Stand for DUNE Cold Electronics Development

ICEBERG is a liquid argon time projection chamber at Fermilab for the purpose of testing detector components and software for the Deep Underground Neutrino Experiment (DUNE). The detector features a 1.15m x 1m anode plane following the specifications of the DUNE horizontal drift far detector and a newly installed X-ARAPUCA photodetector. The status of ICEBERG is reported along with analysis of noise, pulser, and cosmic ray data from the ninth run beginning May 2024 with the goal of advising the DUNE collaboration on the optimal wire readout electronics configuration. In addition, development of an absolute energy scale calibration method is currently underway using known sources such as cosmic ray muon Michel electrons at the ~10 MeV scale and $^{39}$Ar decay electrons at the ~100keV scale. Research into AI-based identification of such events at the data acquisition level is introduced.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Hybrid Heavy Duty Diesel Power System for Off-Road Applications—Concept Validation

A multiyear power system R&D program was completed with the objective of developing an off-road hybrid heavy duty diesel engine with front end accessory drive-integrated energy storage. This system was validated to deliver 10.5–25.6% reduction in fuel consumption over current Tier 4 Final-based 18L diesel engines, over various off-road machine application cycles. The power system consisted of a downsized heavy-duty diesel 13L engine containing advanced combustion technologies, capable of elevated peak cylinder pressures and thermal efficiencies, thermal barrier coatings, exhaust waste heat recovery via SuperTurbo™ turbocompounding, and hybrid energy assisting and recovery through both mechanical and electrical systems. Following the concept definition, design, and analysis phases of the program, the final phase focused on building and validating the performance and efficiency in laboratory tests. While aspects of the system such as start/stop and reduced off-road cooling package energy losses were only analytically evaluated, the main 13L concept engine with full hybrid system was successfully built and tested in steady-state and in transient certification and real-world application cycles. Extensive simulations in Caterpillar's DYNASTY™ software environment utilized the validation test data to assess performance more fully and confidently over varied cycles and strategies. An average fuel consumption reduction of 17.9% was realized, and the majority (~13%) of the benefit stemmed from the core concept 13L engine. In conclusion, a total cost of ownership analysis provides context to commercial viability and where adoption focus should be placed.

33 ADVANCED PROPULSION SYSTEMS↗

Primer for OTERR Core Reloading Optimization

OTERR (Optimization of Test Reactor Reloading) is a software tool which assists in finding optimal fuel assembly reloading patterns for nuclear reactors. It was created specifically to support the Versatile Test Reactor (VTR) program, but its functionality is general enough to be applied to most fast spectrum reactors which use hexagonal prismatic fuel elements. This document is meant to be a primer for new users of OTERR to walk through example workflows for core reloading optimization cases. Simple cases are followed step-by-step to discuss what needs to be done to complete a reloading optimization sequence. Note that the intent of this document is to provide practical examples for users to follow along with so they can quickly start using OTERR and then make changes to fit their own modeling needs. Detail is limited in terms of addressing additional features not used in these examples and especially lacking in discussion of theory used in the code. To better address these points, users are highly encouraged to refer to the OTERR User Manual and the OTERR Theory Manual.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗