Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Application of quantitative methods for reliability testing of a nuclear power plant digital rod position indication diagnostic system - 391

Obsolescence, aging, reliability, and performance issues are driving nuclear facilities to replace conventional analog Instrumentation and Control (I and C) systems with digital technologies. In addition, the designs of the next generation of nuclear reactors, including Small Modular Reactors (SMRs), will incorporate digital I and C for most, if not all, of their safety and non-safety related functions. As part of an on-going research and development (R and D) effort under the auspices of the U.S. Department of Energy (DOE), Analysis and Measurement Services Corporation (AMS) is developing a platform to provide automated testing of digital I and C systems and create a standard method of evaluation for reliability assessments. This hands-on R and D effort has produced a Software Reliability Tester (SRT), which is a set of software and hardware tools designed to automate the testing of digital I and C systems to measure and quantify how well the systems perform under normal operating conditions and in the presence of faults. Furthermore, the SRT provides the foundation for a practical tool to automate verification and validation (V and V) activities and reduce the amount of testing time of digital I and C systems. When combined with its capabilities of integrating both reliability and fault tolerance quantification, the SRT can be used to ensure that digital I and C implementations are both safe and cost-effective for the nuclear industry. This paper describes the application of the SRT to perform V and V of a new Digital Rod Position Indication (DRPI) diagnostic system. The DRPI diagnostic system is a digital system that monitors the rod address and rod position data bus voltages of typical DRPI systems in nuclear power plants to detect and diagnose faults. For this application, the SRT was configured to exercise the inputs of the DRPI diagnostic system, and test cases were generated for common system faults such as address and data bit errors, bus voltage, and timing problems. These test cases were applied by the SRT hardware as voltage inputs to the DRPI diagnostic system and the outputs were compared to expected values generated by a model of the DRPI diagnostic system. Included in the paper is a description of the overall design of the SRT including the hardware and software architectures. Methodologies for automating test cases are also described. V and V using the SRT demonstrates the benefits of automated testing and qualification to provide a quantitative assessment of reliability and cost effective implementation of digital I and C in existing and next generation nuclear power plants. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Verification of EvaluateFLux Utility Program

The EvaluateFlux program is a post-processing utility program for DIF3D, specifically DIF3D-VARIANT which handles Cartesian and hexagonal geometries. The EvaluateFlux program was developed to allow users to obtain flux and power traverses through the geometry domain, and its initial purpose was to facilitate foil analysis by evaluating the flux solution from DIF3D-VARIANT and combining it with foil cross section data. The EvaluateFlux program can calculate the neutron flux, as well as the reaction rates, at any user provided evaluation point. It does this by identifying the spatial mesh associated with the evaluation point and then evaluates the polynomial based neutron flux moments stored in the NHFLUX file at that point. The output of EvaluateFlux varies depending on the input setup. The maximum output includes the neutron flux and microscopic and macroscopic reaction rates at each evaluation point. The purpose of this work is to verify the outputs of EvaluateFlux. Simple models that have hand calculatable results are first defined and used to verify the EvaluateFlux outputs. More complex cases are then added where a duplicate program of EvaluateFlux that uses PrintTables outputs of the binary files is used to verify the EvaluateFlux outputs. In those complex cases, hand calculations of selected evaluation points were also displayed to confirm the software verification. For all the tests done, the hand calculations agreed well with those calculated by EvaluateFlux. For the larger complex problems, the duplicate program that can process hundreds of evaluation points was able to identify that zero points within some meshes have large errors. This aspect was attributed to the truncation error on the input provided to the duplicate program and is not a concern for the accuracy of the EvaluateFlux software.

97 MATHEMATICS AND COMPUTING↗

Verification of the EvaluateFlux Utility Program

The EvaluateFlux program is a post-processing utility program for DIF3D, specifically DIF3D-VARIANT which handles Cartesian and hexagonal geometries. The EvaluateFlux program was developed to allow users to obtain flux and power traverses through the geometry domain, and its initial purpose was to facilitate foil analysis by evaluating the flux solution from DIF3D-VARIANT and combining it with foil cross section data. The EvaluateFlux program can calculate the neutron flux, as well as the reaction rates, at any user provided evaluation point. It does this by identifying the spatial mesh associated with the evaluation point and then evaluates the polynomial based neutron flux moments stored in the NHFLUX file at that point. The output of EvaluateFlux varies depending on the input setup. The maximum output includes the neutron flux and microscopic and macroscopic reaction rates at each evaluation point. The purpose of this work is to verify the outputs of EvaluateFlux. Simple models that have hand calculatable results are first defined and used to verify the EvaluateFlux outputs. More complex cases are then added where a duplicate program of EvaluateFlux that uses PrintTables outputs of the binary files is used to verify the EvaluateFlux outputs. In those complex cases, hand calculations of selected evaluation points were also displayed to confirm the software verification. For all the tests done, the hand calculations agreed well with those calculated by EvaluateFlux. For the larger complex problems, the duplicate program that can process hundreds of evaluation points was able to identify that zero points within some meshes have large errors. This aspect was attributed to the truncation error on the input provided to the duplicate program and is not a concern for the accuracy of the EvaluateFlux software.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

UQpy v4.1: Uncertainty quantification with Python

This paper presents the latest improvements introduced in Version 4 of the UQpy, Uncertainty Quantification with Python, library. In the latest version, the code was restructured to conform with the latest Python coding conventions, refactored to simplify previous tightly coupled features, and improve its extensibility and modularity. To improve the robustness of UQpy, software engineering best practices were adopted. A new software development workflow significantly improved collaboration between team members, and continuous integration and automated testing ensured the robustness and reliability of software performance. Continuous deployment of UQpy allowed its automated packaging and distribution in system agnostic format via multiple channels, while a Docker image enables the use of the toolbox regardless of operating system limitations.

97 MATHEMATICS AND COMPUTING↗

Impedance Measurement Box

The IMB 50V software provides functionality for design of impedance measurement tests or sequences of tests, execution of these tests or sequences, processing measured responses and displaying and saving of the results. The software consists of a Graphical User Interface that allows configuration of measurement parameters and test sequencing, a core engine that controls test sequencing, execution of measurements, processing and storage of results and a hardware/software data acquisition interface with the IMB hardware system.

Morrison, William↗

Assessment of Different Approaches for Measuring Shear Fracture Appearance in Charpy Tests

In this work, different approaches for establishing shear fracture appearance (SFA) on tested Charpy specimens were assessed and compared, namely (in order of increasing expected accuracy) estimates based on characteristic forces from instrumented Charpy tests, optical measurements using image analysis software, and measurements performed with the aid of a scanning electron microscope. Comparisons between different SFA values for 129 instrumented Charpy tests currently included in the National Institute of Standards and Technology database allowed us to establish the relationships between the different available approaches and formulate recommendations for the revision of the standards ASTM E2298-18, Standard Test Method for Instrumented Impact Testing of Metallic Materials, and ISO 14556:2015, Metallic Materials — Charpy V-Notch Pendulum Impact Test — Instrumented Test Method, which currently provide four empirical correlations that can be used to estimate SFA.

36 MATERIALS SCIENCE↗

Predicting Deformation of Parts from HP Printers due to Sintering with Modeling and Simulation (CRADA NFE-18-07363)

This work proposes to leverage Oak Ridge National Laboratory’s (ORNL) sintering simulation software developed at the Manufacturing Demonstration Facility to 1) investigate the deformation of sintered parts and 2) to develop fast surrogate-based optimization methods for HP Inc. This includes the development of ORNL’s software on HP systems, integration and testing with HP part geometries and material properties, the development of surrogate models based on the results of the simulation, and modifications to the software based on feedback from HP. The expected impacts of this work are a drastic reduction in print costs, an increase in printer throughput, and the identification of novel, possibly exotic materials for 3D printing. This work will also decrease the time to market for HP’s print technology by decreasing the amount of resources and type dedicated to physical testing.

42 ENGINEERING↗

Simulation of DWPF Chemical Process Cell Using a Reaction Calorimeter

The Defense Waste Processing Facility (DWPF) converts liquid radioactive waste into glass using a Sludge Receipt Adjustment Tank (SRAT) and Slurry Mix Evaporator (SME) in addition to other processes. The SRAT and SME processes can be simulated on a small-scale using the Mettler-Toledo Reaction Calorimeter (RC1). This equipment is able to automate the execution and monitoring of experiments involving nonradioactive chemical simulants. During the chemical processing of sludge in the SRAT process, foam begins to form and can foam over the reaction vessel. The current antifoam used at DWPF creates a risk of increased flammability and has a limited pH range. Usually, mercury is circulated back into the reaction vessel during the SRAT process, making it difficult to remove. To combat foam over, novel antifoams will be tested during the boil-up process using the RC1. To improve mercury extraction, 3D-printed coalescer columns will be tested within the Mercury Water Wash Tank (MWWT) of the RC1. Testing of Simulant Sludge Batch 6 (SB6) was performed to ensure: the sludge would form a stable foam at boiling during full SRAT/SME runs; the antifoam would reduce the amount of foam within the vessel The sludge and a Precipitate Reactor Feed Tank (PRFT) simulant with monosodium titanate (MST) were mixed separately, combined, and then heated to boiling. As shown below, the antifoam used was able to eliminate the foam within the vessel, as expected. The FormLabs Form2 3D Printer can be used to create roughly 3-inch tall and 1-inch diameter columns from clear and ceramic resins. The columns will utilize chemical and physical forces to draw the mercury out of a condensed offgas stream leaving the RC1 reaction vessel. These columns will be tested during full SRAT/SME runs on the basis of how well they are able to collect elemental mercury. In preparation for full-scale runs, the RC1 equipment was assembled onto a custom table and tested with water runs. The software used to control automation, iControl, has a user-friendly interface that allows the experiment to be altered as needed. An example of the data recorded during an experimental run is represented in Figure 1 below. Water runs were utilized as a way to prove if the RC1 system was functioning in the following areas: Boil-up rates, Chemical additions using pumps, Temperature readings, Balance readings, Probe readings, Offgas system, Agitation. Future Plans: Five novel antifoams will be tested during full SRAT/SME runs. The most effective antifoam will be utilized in DWPF's Chemical Process Cell. The design of the Mercury Extraction Coalescer can be further manipulated to increase the extraction of not only elemental mercury, but other heavy metals in environmental remediation processes as well.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Data-driven Alignment of the Tracker for the Mu2e Experiment

An alignment of the Mu2e Tracker is investigated using the Mu2e Offline Software and Millepede-II. Simulated misalignments of Tracker planes were inserted between Monte-Carlo event generation and before reconstruction using randomly generated $(x,y,z)$-translations and rotations of the rigid-body planes in the detector model. Cosmic ray muons, with no magnetic field present in the Detector Solenoid, will follow a straight-line trajectory. A maximum-likelihood fit is used to reconstruct a track and determine its parameters. Tracks traversing at least four planes, with ten registered straw hits, and a maximum time residual of $20$ ns are selected to be used in an alignment sample. The cuts were chosen to discard tracks with low information content, such as those with high levels of multiple scattering or those with low numbers of measurements contributing to a single track fit. Millepede-II produces the resulting alignment constants according to a simultaneous least-squares fit of the alignment parameters and the track parameters for all input tracks. The improved alignment constants are used to repeat the process and recover an increased number of suitable tracks, further improving the estimate of the alignment constants in subsequent iterations. A performance study of the process was conducted on a misaligned Tracker in the case of translation-only, and translation plus rotational misalignments. In both cases, the correct alignment constants were recovered to within statistical error after three global fit iterations. Additionally, a continuous integration system was developed for the \texttt{Mu2e/Offline} GitHub repository, introducing a convenient automated testing process for all proposed changes (``pull requests"). The tests developed included a full build of the software, followed by tests of the validation routines, geometry overlap checking, and multi-threading mode. Additionally, code quality checks and low-statistics physics comparison checks a re also available.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

An elastography method based on the scanning contact resonance of a piezoelectric cantilever

Purpose: Most tissues may become significantly stiffer than their normal states when there are lesions inside. The tissue's modulus can then act as an identification parameter for clinic diagnosis of tumors or fibrosis, which leads to elastography. This study introduces a novel elastography method that can be used for modulus imaging of superficial organs. Methods: This method is based on the scanning contact-resonance of a unimorph piezoelectric cantilever. The cantilever vibrates in its bending mode with the tip pressed tightly on the sample. The contact resonance frequency of the cantilever-sample system is tracked at each scanning point, from which the sample's modulus can be derived based on a beam dynamic model and a contact mechanics model. Scanning is performed by a three-dimensional motorized stage and the whole system is controlled by a homemade software program based on LabVIEW. Results: Testing onin vitro beef tissues indicates that the fat and the muscle can be easily distinguished using this system, and the accuracy of the modulus measurement can be comparable with that of nanoindentation. Imaging on homemade gelatin phantoms shows that the depth information of the abnormalities can be qualitatively obtained by varying the pressing force. The detection limit of this elastography method is specially examined both experimentally and numerically. Results show that it can detect the typical lesions in superficial organs with the depth of several centimeters. The lateral resolution of this elastography method/system is better than 0.5 mm, and could be further enhanced by using more scanning points. Conclusions: The proposed elastography system can be regarded as a sensitive palpation robot, which may be very promising in early diagnosis of tumors in superficial organs such as breast and thyroid.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Neutron Spectrum Determination for the Multi-Mission Radioisotope Thermoelectric Generator (MMRTG) with a Multi-Sphere Spectrometer

This report presents the work that was performed to determine the neutron energy spectrum (spectrum) of the Multi-Mission Radioisotope Thermoelectric Generator (MMRTG) with a neutron Multi-Sphere Spectrometer (MSS). The spectrometer measurements were performed when the generator is in an INL Materials and Fuels Complex (MFC) laboratory. The measurements were used in a spectrum unfolding software to calculate the neutron spectrum. Based on initial testing of the MSS spectrometer and experience with the unfolding software, an MMRTG spectrum is reported and a justification for the spectrum is provided.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Maximizing Efficiency and Quality: Leveraging Automated Testing for Laboratory Commissioning

The traditional commissioning process uses sampling to select equipment for functional acceptance testing when large quantities of equipment are present. Although this approach is generally effective in identifying wide-spread issues, it has several shortcomings: it fails to evaluate equipment not included in the sample, provides only a one-time validation of equipment operation, and the standard documentation is a simple checklist of pass/fail questions. During the construction and commissioning process of the new Research and Innovation Laboratory (RAIL) in Golden, CO, the National Renewable Energy Laboratory team engaged Group14 Engineering to implement a Connected Commissioning process using fault detection and diagnostic software for automated functional acceptance testing. This presentation highlights the advantages offered by automated functional testing in this critical laboratory setting: (1) sampling 100% of BAS-connected equipment during functional testing, (2) testing results backed by data beyond the traditional pass/fail checklist, and (3) an automated test process that can be regularly executed by the building management team for ongoing commissioning throughout the life of the building. The presentation will also cover technical challenges associated with Connected Commissioning and the important conversations with key stakeholders that need to occur well before functional acceptance testing in order to successfully implement the automated testing processes.

automated testing↗

Maximizing Efficiency and Quality: Leveraging Automated Testing for Laboratory Commissioning

The traditional commissioning process for a building often implements sampling rates to select equipment for functional acceptance testing when large quantities of equipment are present. While this approach is generally effective in identifying wide-spread issues, it has several key shortfalls. (1) It provides a one-time validation of equipment operation in which the standard documentation is a simple checklist of pass/fail questions. (2) It fails to evaluate equipment not included in the sample rate selection. During the construction and commissioning process of the new Research and Innovation Laboratory (RAIL) in Golden, CO, the National Renewable Energy Laboratory team engaged Group14 Engineering to implement a Connected Commissioning process using fault detection and diagnostic software for automated functional acceptance testing. The goal of this presentation will be to highlight the advantages offered by automated functional testing in this critical laboratory setting. These are primarily (1) sampling 100% of BAS-connected equipment during functional testing, (2) testing results backed by data beyond the traditional pass/fail checklist, and (3) an automated test process that can be regularly executed by the building management team for ongoing commissioning throughout the life of the building. The presentation will also cover technical challenges associated with connected commissioning and the important conversations with the key stakeholders that need to occur well before functional acceptance testing in order to successfully implement the automated testing processes.

automated testing↗

kynema-fmb [SWR-23-07]

Kynema-FMB (FKA: Kynema) is an open-source performance portable flexible multibody (FMB) dynamics solver designed for time-domain simulations. While originally tailored for wind turbine structural dynamics, the formulation and implementation are those of a general flexible-multidbody dynamics solver that can readily be applied to a wide range of systems. Kynema was designed with a narrow focus, namely to provide a lightweight, fast, accurate FMD solver for coupling to computational-fluid-dynamics (CFD) codes, especially the CFD codes in the Kynema suite, for fluid-structure-interaction (FSI) simulations. Kynema-FMB is equipped to model systems that can be represented as a collection of beams and rigid bodies that are connected through constraints. Degrees of freedom are defined in the inertial/global frame of reference and include displacements and rotations (formally as rotation matrices, but stored as quaternions). The underlying formulation is built on a Lie-group time integrator designed for index-3 differential-algebraic equations, which is second-order accurate in time (Bruls et al., 2012). Beam models are based on geometrically exact beam theory and are discretized as high-order spectral finite elements similar to those in BeamDyn (Wang et al., 2017). The governing equations for a FMD system like a wind turbine constitute a highly nonlinear system of constrained partial-differential equations. Kynema-FMB uses analytical Jacobians in the nonlinear-system solves in each time step. Linear systems use sparse storage and several third-party sparse-linear-system solvers are enabled. Ill conditioning of linear systems is mitigated with preconditioning described in Bottasso et al, 2008. Kynema-FMB is integrated with a simple open-source controller (ROSCO). There is an application programming interface (API) for coupling to geometry-resolved CFD (like that in Sharma et al., 2023) and actuator-force CFD (like that in Kuhn et al., 2025). In the latter, for actuator-line models, Kynema-FMB includes an internal blade-element solver that depends on user-provided lookup tables for coefficients of lift and drag, i.e., aerodynamic polars. Kynema-FMB is written in C++ and leverages Kokkos and Kokkos-Kernels (KokkosEcosystem) as its performance portability layer enabling simulations on both CPU and GPU systems. The repository is equipped with extensive automated testing at the unit and regression/system levels. The following describes the high-level development objectives conceived for Kynema: *Kynema will follow modern software development best practices, including test-driven development (TDD), version control, hierarchical automated testing, and continuous integration (CI) for a robust development environment. *The core data structures are memory efficient and enable vectorization and parallelization at multiple levels. *Data structures are data-oriented to exploit methods for accelerated computing including high utilization of chip resources (e.g., single instruction multiple data (SIMD) instruction sets) and parallelization using GP-GPUs. *The computational algorithms incorporate robust open-source libraries for mathematical operations, resource allocation, and data management. *The API design considers multiple stakeholder needs and ensure integration with existing and future ecosystems for data science, machine learning, and AI. *Kynema-FMB is written in modern C++ and leverages Kokkos as its performance-portability library with inspiration from the kynema stack.

Sprague, MichaelA.↗

An Open-Source Framework for Rapid Validation of Scientific ASICs

Spacely is an open-source framework for the post-silicon validation of analog, digital, and mixed-signal ASICs (Application-Specific Integrated Circuits) which maximizes the reuse of hardware and software, reducing the time taken to achieve meaningful test results. Spacely specifically addresses the needs of small, flexible ASIC design teams commonly found in academia or research institutions which benefit most from sharing the overhead of test stand creation between many unique ASIC designs. Spacely is a set of software, firmware, and design practices. It targets two primary hardware platforms (NI-PXI and Caribou) as well as offering extensible support for bench instruments. Spacely provides a high-level Python interface to all test hardware for accessibility, while also giving more sophisticated teams the opportunity to integrate custom test firmware. The design principles of Spacely are presented in brief. Current documentation is available at https://github.com/SpacelyProject/spacely-docs.

Quinn, Adam [Fermilab]↗

An Open-Source Framework for Rapid Validation of Scientific ASICs

Spacely is an open-source framework for the post-silicon validation of analog, digital, and mixed-signal ASICs (Application-Specific Integrated Circuits) which maximizes the reuse of hardware and software, reducing the time taken to achieve meaningful test results. Spacely specifically addresses the needs of small, flexible ASIC design teams commonly found in academia or research institutions which benefit most from sharing the overhead of test stand creation between many unique ASIC designs. Spacely is a set of software, firmware, and design practices. It targets two primary hardware platforms (NI-PXI and Caribou) as well as offering extensible support for bench instruments. Spacely provides a high-level Python interface to all test hardware for accessibility, while also giving more sophisticated teams the opportunity to integrate custom test firmware. The design principles of Spacely are presented, along with a demonstrative example of using Spacely to test a pixel detector readout ASIC.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Pronghorn: A Porous Media Thermal-Hydraulics Core Simulator and its Validation with the SANA Experiments

Pebble bed High Temperature Reactors (HTRs) are characterized by many advantageous design features, such as excellent passive heat removal in accidents, large margins to fuel failure, and online refueling potential. However, a significant challenge in the core modeling of pebble bed reactors is the complex fuel-coolant structure. This paper presents a new porous media simulation code, Pronghorn, that aims to alleviate modeling challenges for pebble bed reactors by providing a fast-running, medium- fidelity core simulator. Pronghorn is intended to accelerate the design and analysis cycle for pebble bed and prismatic HTRs by permitting fast scoping studies and providing boundary conditions for systems-level analysis. Pronghorn is built on the Multiphysics Object-Oriented Simulation Environment (MOOSE) using modern software practices and a thorough testing framework. This paper describes the physical models used in Pronghorn and demonstrates Pronghorn’s capability for modeling gas-cooled pebble bed HTRs by presenting simulation results obtained for the German SANA pebble bed decay heat experiments. Within the limitations of the porous media approximation and existing available closure relationships, Pronghorn predicts the SANA experimental pebble temperatures well, expanding the code’s validation base. A brief code-to-code comparison shows a similar level of accuracy with other porous media simulation tools; this enhances Pronghorn’s advantages of an arbitrary equation of state, unstructured mesh capabilities, compressible flow models, high coupling potential to MOOSE fuels performance and systems-level thermal-hydraulics codes, and modern software design.

42 ENGINEERING↗

Development of a versatile hybrid testing system for seismic experimentation

The hybrid testing method for earthquake engineering was developed to evaluate the seismic performance of civil structural systems. During hybrid testing, part of the structure, called physical substructure, is physically tested using hydraulic loading equipment while the rest of the structure, named numerical substructure, is numerically simulated with a computer model. Thus, hybrid testing allows a complex physical substructure being tested experimentally, while the relatively simple part of the structure is numerically simulated to economically obtain the full structural response. Recently, a versatile hybrid testing system was built at Western Michigan University consisting of a shake table, an actuator/reaction system, and an advanced hybrid testing controller. Such a testing system is capable of conducting various seismic experiments such as displacement-based pseudodynamic substructure testing as well as force-based real time dynamic hybrid testing. Because of its versatility and easy operation at the benchmark scale, the developed testing system is particularly suitable for the development of advanced hybrid testing techniques and, earthquake engineering education/outreach activities. The development of the testing system is described in this article focusing on the hardware and software integrations. A three story shake table hybrid test is presented as an example to demonstrate the system’s capability and feasibility.

42 ENGINEERING↗