Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Evaluation of China Experimental Fast Reactor Start-up Tests (Final Report, Revision 1)

This report documents the results and observations on the Coordinated Research Project (CRP) of the International Atomic Energy Agency (IAEA) on “Neutronics Benchmark of CEFR Start-Up Tests.” The China Experimental Fast Reactor (CEFR) is a 65MWt sodium-cooled fast reactor with highly enriched uranium oxide fuel. The reactor achieved first criticality in 2010, and a series of start-up tests were conducted to measure various reactor physics parameters. In 2018, the IAEA launched the CRP for validation and qualification of member states' computation capabilities in the field of fast reactor simulation by utilizing the measured data in the CEFR start-up test. Twenty-nine international organizations from eighteen member countries, including Argonne National Laboratory, have participated in the CRP. The CEFR start-up tests offer a rare opportunity to validate U.S. nuclear engineering software because it is a well-specified benchmark with corresponding measurements for a recently built fast reactor starting up with a known fuel composition (fresh fuel). Previous fast reactor validation benchmarks frequently involve reactors that have already been started up and contain irradiated fuel that is difficult to characterize with high certainty.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Modeling and Simulation of Austenitic Welds and Coarse-grained Specimens: Part II

The Pacific Northwest National Laboratory (PNNL) is conducting confirmatory research for the U.S. Nuclear Regulatory Commission (NRC) to evaluate commercially available nondestructive examination (NDE) modeling and simulation software used in the nuclear industry. Simulation results from ultrasonic testing (UT) models can inform the design and qualification of inspection techniques and help interpret inspection results. CIVA is a modeling and simulation package developed by the French Alternative Energies and Atomic Energy Commission (CEA). CIVA was selected for this study because it is readily available and has been used for NDE in the US commercial nuclear power industry. This report is focused on completing the efforts initiated in the previous PNNL report to evaluate UT modeling and simulation performance, reliability, and accuracy in relation to common inservice inspection (ISI) scenarios in nuclear power plants (NPP). This work will be used to provide guidance when establishing methods to perform and evaluate simulations for more standardized model implementation, simulation analysis, and interpretation of results.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Code Coverage Status of the ARC Code DASSH-F

The Argonne Reactor Code (ARC) software system supports users in their fast reactor design goals by providing neutronic, thermal-hydraulic, and structural analysis capabilities. DASSH-F serves as a steady state thermal hydraulic capability within the ARC system and replaces the SE2-ANL software that preceded it. This document identifies the set of test problems used to assess the code coverage for DASSH-F. The goal is to document what parts of the existing DASSH-F code are touched by the set of test problems and which are not. Because the verification work remains to be done on DASSH-F, one can assume that most of these issues will be resolved as part of that work. The code coverage analysis of DASSH-F was performed with the Code Coverage Tool of the Intel Fortran compiler which requires modifications to the compilation of DASSH-F. The code coverage tables are given for each submodule of DASSH-F. Because DASSH-F links to modules in DIF3D, some details on coverage changes to the DIF3D linked files is provided. As will be seen, most of the uncovered parts/files can be ignored because they are either for error message and debugging output or obviously not needed by DASSH-F today. Seven features of the DASSH-F code were identified to not be covered by the existing testing suite and thus additional verification test problems are suggested to fully cover these sections.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

10 Boron-film-based gas detectors at ESS

The development of detectors for the European Spallation Source is an important parallel element to the effort put into the design and construction of the neutron source and instruments. The 10Boron-film-based detector developments that started over a decade ago as basic detector concepts have now reached technical maturity after intense prototyping work and numerous testing campaigns. Several of the ESS beamlines that will soon enter the commissioning phase started welcoming the detector systems built with the 10 B-film converter technology. The real-size demonstrators evolved in the last 2–3 years into a diverse suite of gas proportional counters for use in diffraction, reflectometry and small-angle scattering studies in spite of the operational complexity posed by the requirements for large-area coverage, low material budget and robustness for operation in the high-flux and high-radiation environment of ESS. The detectors are now being shipped to ESS or undergoing the last performance and calibration tests before being handed over to the instrument teams for installation in the host beamlines. A common feature of these detector systems is the very large number of readout channels that they are instrumented with in order to fulfill the demanding requirements for sensitivity, spatial resolution and count-rate capability. Across all of the detector types that will operate at ESS, the integration, testing and commissioning of the read-out technologies and software tools for data reduction, calibration and analysis are the focus of the detector and integration teams. These will yield a wealth of knowledge about their operation as well as initial results on the in-situ performance, a very important asset to ensure rapid commissioning of the detectors when neutrons from the ESS source become available. In this paper we will give an overview of the 10 B-film-based detector technologies included in the ESS detector suite that are currently facing the transition from the production phase to installation and integration with the other beamline components, which comes with its own specific challenges of both organizational and technical nature.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

PV Validation Hub

The Validation Hub will be a clearinghouse for the transfer of novel algorithms and software from the PV research community to industry. Potential algorithms tested in the Hub could include the estimation of various PV loss factors and the detection of various operational issues. The primary function of the Hub will be for developers to submit executable code which will run on hosted data sets. Developers will receive private reports on the accuracy and performance (e.g., run-time) of the submitted algorithms, and public high level summaries will be hosted. These summaries will indicate the organization who submitted the algorithm (e.g., links to GitHub pages, documentation websites, etc.), high-level accuracy metrics, and standardized performance metrics. These results will be stored in a publicly available database, accessible through the Hub, with the ability for users to sort and filter the results. In short, the Hub will be presented to public users as a collection of interactive leaderboards, organized around specific analysis tasks pertinent to the PV data science community. These tasks include things such as the estimation of various PV loss factors and the detection of various operational issues. We will present progress on the development of this hub, including preliminary results of comparative validation of PV data science algorithms and progress towards building the platform itself.

algorithm↗
DOE OSTI2024

UN-SiC TRISO Post Irradiation Examination Developmental Work

As part of efforts to strengthen INL?s post irradiation analysis capabilities with non-Advanced Gas Reactor (AGR) tristructural isotropic (TRISO) fuels, two developmental activities were conducted. The first activity was to determine how best to analyze uranium nitride TRISO fuel kernels using electron probe microanalysis, while the second activity focused on developing a method to deconsolidate TRISO fuel particles that have been encased in a silicon carbide matrix. Because these two activities were unrelated, they have been presented separately in this report. Initial EPMA analyses showed nitrogen contents that far exceeded the concentration expected for UN--a line compound. Further examination showed that current literature values for the mass absorption coefficient (MAC) for the N ka X-ray absorbed by U ranged from approximately 1600 to 9500, with most values tending toward 9500. Measuring UN with five different progressively increasing accelerating voltages followed by using the modeling program xMAC suggests the actual MAC is approximately 2115. Additional MAC modifications were required to produce reasonable analytical results. Because of the inaccuracies of necessary MAC coefficients, UN analysis via scanning electron microscopy (SEM) is likely to produce inaccurate results. This is because SEM software does not typically allow the user to alter MACs. Tests have been performed to examine the feasibility of an electrochemical technique to liberate irradiated TRISO fuel from a SiC matrix without damaging the outer pyrolytic carbon layer of the fuel particle. The method is performed by electrochemically exposing the SiC to magnesium metal forming Mg2Si and C. Following exposure, the small SiC samples showed slight mass increases with no evidence of conversion to Mg2Si and C nor obvious degradation of the SiC samples.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Heuristic Evaluation Methods Applied to a Predictive Maintenance Chatbot

The need for an accessible iterative approach for evaluating prospective artificial intelligence (AI)/ML based technologies in the nuclear industry is needed, given the nature of algorithms and rapid advancements. This paper explores existing heuristic design principles for user-centered design and evaluates them based on their relevancy and usefulness for evaluating AI/ ML based technologies. Researchers at the Idaho National Laboratory (INL) have developed a machine learning software application called VIsualization for PrEdictive maintenance Recommendation (VIPER), which is used to help users understand and engage with the tool to learn more about work orders, data used, predictive maintenance, and machine learning (ML) algorithms. Early user research studies used to access VIPER’s technology readiness level have occurred; however, there is room for further improvement of the software through heuristic evaluations along with other methods and user testing. This work describes the applicability of heuristic evaluation methods and cognitive walkthroughs to help ensure human readiness for prospective AI/ ML based applications, using VIPER as a candidate use case. This work supports industry in ensuring that prospective AI/ML based technologies are usable and useful for plant personnel at nuclear power plants, ultimately leading to their safe, reliable, and efficient use.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Heuristic Evaluation Methods Applied to a Predictive Maintenance Chatbot

The need for an accessible iterative approach for evaluating prospective artificial intelligence (AI)/ML based technologies in the nuclear industry is needed, given the nature of algorithms and rapid advancements. This paper explores existing heuristic design principles for user-centered design and evaluates them based on their relevancy and usefulness for evaluating AI/ ML based technologies. Researchers at the Idaho National Laboratory (INL) have developed a machine learning software application called VIsualization for PrEdictive maintenance Recommendation (VIPER), which is used to help users understand and engage with the tool to learn more about work orders, data used, predictive maintenance, and machine learning (ML) algorithms. Early user research studies used to access VIPER?s technology readiness level have occurred; however, there is room for further improvement of the software through heuristic evaluations along with other methods and user testing. This work describes the applicability of heuristic evaluation methods and cognitive walkthroughs to help ensure human readiness for prospective AI/ ML based applications, using VIPER as a candidate use case. This work supports industry in ensuring that prospective AI/ML based technologies are usable and useful for plant personnel at nuclear power plants, ultimately leading to their safe, reliable, and efficient use. PowerPoint for conference that was reviewed in PRS and LRS PRS/CON-25-05379 and INL/CON-25-82946

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Advanced Transmission Technologies – GETs and HPCs Session 2: Advanced Power Flow Control and Transmission Topology Optimization

The INL TADA GETs Cohort Session 2, held on November 7, 2025, conducted in collaboration with ScottMadden, focused on two core Advanced Transmission Technologies (ATTs): Advanced Power Flow Control (APFC) and Transmission Topology Optimization (TTO). These technologies are pivotal in enhancing grid flexibility, reliability, and cybersecurity resilience. APFC, particularly through modular FACTS devices like Modular Static Synchronous Series Compensators (M-SSSCs), enables dynamic voltage injection to reroute power flows. The session highlighted the deployment benefits of APFC, such as rapid installation, minimal civil works, and re-deployability. Regulatory drivers like FERC Order 2023 mandate the inclusion of Grid-Enhancing Technologies (GETs) in interconnection studies. Case studies from Central Hudson, CAISO, and National Grid (UK) demonstrated APFC’s effectiveness in congestion relief and cost savings. The session also addressed cybersecurity concerns, including firmware vulnerabilities, SCADA integration risks, and supply chain dependencies. Participants engaged in interactive exercises to rank cybersecurity and supply chain risks, emphasizing the need for robust digital assurance strategies. TTO involves software-based reconfiguration of transmission networks to optimize power flow without new infrastructure. The session showcased its operational value, with examples from SPP, PJM, and MISO showing significant congestion cost reductions. Cybersecurity vulnerabilities were discussed, particularly in API security and software supply chains, referencing incidents like SolarWinds and attacks on Danish utilities. Digital assurance exercises explored worst-case scenarios, attack paths, and mitigation responsibilities between vendors and utilities. Reliability challenges such as algorithm stability, vendor dependency, and operator trust were also examined. Cross-cutting themes emphasized the importance of digital assurance tools, including Software Bills of Materials (SBOMs) and hardware-in-loop testing. Human performance, training, and operational confidence were identified as critical enablers of technology adoption. The session concluded with a preview of Session 3, which will focus on High Performance Conductors (HPCs) and risk-based cybersecurity tools. Session 2 of 3.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Sensitivity Analysis of MFiX-PIC Parameters Using Nodeworks, PSUADE, and DAKOTA

The study presented in this report was aimed to demonstrate UQ analysis performed not only with Nodeworks, but also two other well-established UQ software tools from the U.S. DOE’s National Laboratories (PSUADE from Lawrence Livermore National Laboratory and DAKOTA from Sandia National Laboratory). It is important to emphasize that the motivation of this study was not to determine the best UQ software, but to verify if the global sensitivity analyses from the end-to-end workflow in Nodeworks are consistent with the results of other two UQ software. The components of Nodeworks from Python’s ecosystem have been tested as standalone libraries. However, an assessment study for the complete workflow targeting a specific UQ analysis has not been performed for Nodeworks. Hence, this study is expected to serve as an equivalent of solution verification for Nodeworks using other established UQ tools as reference solution. For this purpose, three distinct flow configurations (i.e., settling bed, bubbling fluidized, and circulating fluidized bed) have been used as representative multiphase flow problems of interest. The results of the systematic simulation campaigns performed in an earlier study using the particle-in-cell (PIC) approach in the Multiphase Flow with Interphase eXchanges (MFIX) suite of solvers (i.e., MFiX-PIC) was utilized. The same set of tabulated results was provided as input to the different UQ software for global sensitivity analysis. Results for the three cases indicate that based on the Sobol’ Sensitivity Indices method the order of importance ranking determined by Nodeworks for the Sobol’ Total Sensitivity Indices is consistent with PSUADE and DAKOTA in each case for the five model parameters considered. The input files for Nodeworks for the three cases are also shared through NETL’s Gitlab repository for the reader interested in reproducibility and further analysis (See Section 1.2).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A Standardized Analysis Process Using Digital Image Correlation to Calculate In Situ Cladding Strain from Modified Burst Tests for Fuel Performance Code Validation

Historical data collection on nuclear fuel cladding materials has focused on generating a statistically significant amount of data to assess the material and its failure behavior. Furthermore, data generated to support material model and failure criteria development were previously posttest evaluations, so a large number of tests was required to gain new understanding. A way to expedite this process is to develop techniques capable of generating large, high-fidelity data sets from a single test with lower uncertainty or quantified uncertainty. One such example of this approach is Oak Ridge National Laboratory’s use of modified burst tests (MBTs) to analyze the mechanical behavior and failure conditions of cladding during a simulated reactivity-initiated accident (RIA). Each test incorporates digital image correlation (DIC) analysis techniques that are used to assess the accumulated strain in situ, as well as eventual cladding failure. This work has been fruitful in defining strain-to-failure conditions for materials like silicon carbide (SiC) fiber–reinforced/SiC matrix composite tubes (SiC/SiC), iron-chromium-aluminum (FeCrAl) alloy tubes, and chromium-coated Zircaloy-4 tubes. However, there are numerous DIC software available, including open-source and proprietary software. The different DIC software use various algorithms to process images and calculate displacement values. Using these different software and algorithms can lead to varying results, and perhaps larger-than-expected uncertainties. In the present study, previously published MBT data encompassing a variety of test conditions were reanalyzed with two different DIC software to assess the variance in the calculated strain results. The data consisted of SiC/SiC, FeCrAl, and chromium-coated Zircaloy-4 tubes. Plots of the calculated strains during the transient revealed good agreement between the two DIC software. The average root-mean-square errors between the two software was 0.20% strain, which is slightly larger than a previously reported error value for these tests. In conclusion, this variance in results is low enough that this analysis method can be used for code validation.

Reactivity-initiated accident↗
DOE OSTI2020

Structural Analysis Approach for the Defense Programs Package 3 (DPP-3)

The Pacific Northwest National Laboratory (PNNL) is the design authority for a new Type B hazardous materials transportation package designated as the Defense Programs Package 3 (DPP-3) for the U.S. Department of Energy (DOE) National Nuclear Security Administration (NNSA). The DPP-3 has been developed using similar materials and fabrication methods employed in previous U.S. Nuclear Regulatory Commission (NRC), DOE, and NNSA certified packages. The DPP-3 design criteria are derived from the American Society of Mechanical Engineers (ASME) Boiler and Pressure Vessel Code (BPVC), NNSA guidance and NRC regulatory guides in order to safely and securely transport a variety of payloads. Final regulatory approval by the NNSA will require physical testing to demonstrate that the containment vessel (CV) remains leaktight after enduring the entire regulatory testing sequence prescribed in Title 10 of the Code of Federal Regulations Part 71 (10 CFR 71). In order to gain confidence that the DPP-3 will remain leaktight after testing, the DPP-3 has been structurally analyzed using the Finite Element Analysis (FEA) software LS-DYNA. The FEA analyses serve two general purposes: first, they aid in design and development of the package, and second, they advise as to which drop orientations are expected to cause the most damage during regulatory testing. This paper will discuss how the design criteria are incorporated into analytical techniques needed to evaluate the FEA structural simulation results for 10 CFR 71 conditions to give confidence the DPP-3 testing campaign will be successful.

Sakalaukus Jr., Peter J.↗
DOE OSTI2022

Automated Vulnerability Detection (AVUD) for Compiled Smart Grid Software

This project developed and implemented a system for conducting cybersecurity vulnerability detection of smart grid components and systems by performing static analysis of compiled software (“firmware”). The resulting system for automated vulnerability detection (AVUD) was implemented as part of Oak Ridge National Laboratory’s existing test bed for smart meters, the Sustainable Campus Initiative. The work consisted of two phases: the first phase implemented the necessary software and computational models to perform the analysis, and the second phase demonstrated the system on example firmware in partnership with smart meter manufacturer Sensus USA, Inc. The resulting system won an R&D 100 award and has been successfully commercialized, winning a National Laboratory Consortium Commercialization Award.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Using containers to speed up development, to run integration tests and to teach about distributed systems

GlideinWMS is a workload manager provisioning resources for many experiments including CMS and DUNE. The software is distributed both as native packages and specialized production containers. Following an approach used in other communities like web development we built our workspaces, system-like containers to ease development and testing. Developers can change the source tree or check out a different branch and quickly reconfigure the services to see the effect of their changes. In this paper, we’ll talk about what differentiates workspaces from other containers. We’ll describe our base system composed of three containers. A one-node cluster including a compute element and a batch system. A GlideinWMS Factory controlling pilot jobs. And a scheduler and Frontend, to submit jobs and provision resources. Additional containers can be used for optional components. This system can easily run on a laptop and we’ll share our evaluation of different container runtimes, with an eye for ease of use and performance. Finally, we’ll talk about our experience as developers and with students. The GlideinWMS workspaces are easily integrated with IDEs like VS Code, simplifying debugging and allowing development and testing of the system also when offline. They simplified the training and onboarding of new team members and Summer interns. And they were useful in workshops where students could have first-hand experience with the mechanisms and components that, in production, run millions of jobs.

Mambelli, Marco↗
DOE OSTI2025

Using Containers to Speed Up Development, to Run Integration Tests and to Teach About Distributed Systems

GlideinWMS is a workload manager provisioning resources for many experiments, including CMS and DUNE. The software is distributed both as native packages and specialized production containers. Following an approach used in other communities like web development, we built our workspaces, system-like containers to ease development and testing. Developers can change the source tree or check out a different branch and quickly reconfigure the services to see the effect of their changes. In this paper, we will talk about what differentiates workspaces from other containers. We will describe our base system, composed of three containers: a one-node cluster including a compute element and a batch system, a GlideinWMS Factory controlling pilot jobs, and a scheduler and Frontend to submit jobs and provision resources. Additional containers can be used for optional components. This system can easily run on a laptop, and we will share our evaluation of different container runtimes, with an eye for ease of use and performance. Finally, we will talk about our experience as developers and with students. The GlideinWMS workspaces are easily integrated with IDEs like VS Code, simplifying debugging and allowing development and testing of the system even when offline. They simplified the training and onboarding of new team members and summer interns. And they were useful in workshops where students could have first-hand experience with the mechanisms and components that, in production, run millions of jobs.

Mambelli, Marco [Fermilab] (ORCID:0000000294892681↗
DOE OSTI2024

Providing Experimental Infrastructure for Accelerating Advanced Reactor Demonstrations through the National Reactor Innovation Center

A suite of experimental infrastructure projects has been developed by the National Reactor Innovation Center to accelerate advanced reactor demonstrations and facilitate their development, addressing crucial gaps in data, materials characterization, and modeling. First, the Molten Salt Thermophysical Examination Capability (MSTEC) provides a specialized platform for post-irradiation characterization of molten salt reactor fuel, coolant salts, and structural materials, essential for supporting the design and operation of advanced reactors and future commercial molten salt reactor development and licensing. The Virtual Test Bed (VTB) complements these efforts by leveraging advanced modeling and simulation tools to evaluate reactor performance and safety. Serving as a library of reference models, the VTB offers a database of multiphysics reactor models, facilitating rapid safety evaluations and includes continuous software quality assurance, crucial for accelerating deployment while maintaining reliability. Additionally, the Helium Component Test Facility (HeCTF) addresses the need for high-temperature helium-cooled reactor component testing. As the first-of-its-kind facility in the United States, HeCTF emulates high-temperature gas reactor conditions, reducing time and cost associated with component validation, thereby accelerating reactor development. Finally, In-cell Thermal Creep Frames provide a unique solution for obtaining thermal creep data from irradiated materials, critical for materials qualification and licensing. Developed by the National Reactor Innovation Center, these compact frames enable the examination of previously irradiated materials, overcoming traditional limitations and enhancing the understanding of mechanical properties crucial for reactor development. Collectively, these experimental infrastructure projects form a comprehensive framework aimed at expediting advanced reactor demonstrations, fostering innovation, and ensuring the viability of next-generation nuclear energy solutions.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

NUMERICAL PREDICTIONS OF MEAN PERFORMANCE AND DYNAMIC BEHAVIOR OF A 10 MWe SCO2 COMPRESSOR WITH TEST DATA VALIDATION

High-fidelity aerodynamic analysis has been demonstrated for mean performance and unsteady dynamics in a sCO2 compressor designed by Hanwha Power Systems Americas for a 10 MWe Concentrating Solar Power plant. Simulations were performed with CRUNCH CFD® software tool that was matured to accurately model near critical real fluid effects in sCO2. Pre-test predictions for mean performance were validated with test data collected later. Performance predictions were accurate and captured sensitivity of the efficiency to inlet temperature of CO2 as well as steep drop-off at high flow rates due to condensation in the inlet throat. Detailed analysis was performed to understand the source of these performance losses at near critical conditions. Unsteady dynamic effects in the compressor at off-design conditions were also identified and quantified. In particular a system wide “condensation surge” condition was detected at high flow coefficients that results in large amplitude pulsations with accompanying mass flow fluctuations at low frequencies and has potential to cause damage in closed loop systems.

hosangadi, ashvin↗