Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “code verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Software Verification Toolkit (SVT): Survey on Available Software Verification Tools and Future Direction

Writing software is difficult. However, writing complex, well tested and designed, and functionally correct software is incredibly difficult. An entire field of study is devoted to the validation and verification of software to address this problem, and in this paper we analyze the landscape of currently available third party software. We have divided our analyses into three separate subsections with regards to software validation: formal methods, static analysis, and test generation. Formal verification is the most complex method in which to validate software correctness, but also the most thorough as it truly validates the mathematical validity of the source code. Static analysis generally is relegated to abstract syntax tree traversal techniques to find errors related to faulty software such as memory leaks or stack overflow issues. Automatic test generation is similar in implementation to static analysis, but pushes a bit further in verifying the boundedness of function inputs and outputs with regards to annotated or parsed criteria. The crux of this report is to analyze and describe the software tools that implement these techniques to validate and verify software. Pros and cons related to installation, utilization, and capabilities of the frameworks are described, and reproducible examples are provided with a focus on usability. The initial survey concluded that the most interesting tools of note are Z3, Isabelle/HOL, and TLA+ with regards to formal verification; and Infer, Frama-C, and SonarQube with regards to static analysis. With these tools in mind, a final conjecture is provided that describes future avenues of utilizing these tools for developing a verification framework to assist in validating existing software at Sandia National Laboratories.

97 MATHEMATICS AND COMPUTING↗

The Verification and Validation of a Magnetic Plasma Fluid Model Utilizing the MOOSE (Multiphysics Object Oriented Simulation Environment) Framework

As the goal of achieving fusion power on the grid comes closer to fruition, fully coupled multiphysics models of fusion devices will be crucial. Currently, there are two main approaches to developing these platforms: (1) loosely coupled, where one couples existing codes and solvers together through input and output parameters and data, and (2) tightly coupled, where one develops the necessary models within a singular, integrated framework. This work focuses on the latter approach for magnetically confined fusion devices by developing a fluid-based plasma-edge model within the Multiphysics Object Oriented Simulation Environment (MOOSE) Framework. This effort is coordinated with other efforts to develop, test, demonstrate, and deploy fusion relevant multiphysics capabilities including electromagnetics, particle-in-cell plasma, tritium transport, and fusion blanket design. This new model is an expansion of the MOOSE-based plasma application, Zapdos, which was originally formulated to model low-temperature, non-magnetized plasma processes. Verification, benchmarking, and validation studies have been conducted. Verification studies involved utilizing the method of manufactured solutions and comparing the convergence slope of a known solution to the theoretical slope. Benchmarking consists of comparisons to existing edge codes, namely BOUT++ and SOLEDGE3X. Validation efforts focused on comparisons against open-source data from the TCV tokamak.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗

CTF Theory Manual: Version 4.4

Coolant-Boiling in Rod Arrays – Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for light-water reactor (LWR) vessel analysis. It uses a two-fluid, three-field (i.e., fluid film, fluid drops, and vapor) modeling approach. Both subchannel and 3D Cartesian forms of its governing equations are available for the solution. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last few decades. COBRA-TF also found use at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently rebranded as CTF. CTF was later adopted in the early 2010s by Oak Ridge National Laboratory (ORNL) for use in the Consortium for Advanced Simulation of Light Water Reactors (CASL) program, which led to a significant advancement of the code’s software quality, modeling accuracy, testing systems, and capabilities for improved support in modeling common LWR nominal and transient behavior. As part of the improvement process, it was necessary to generate sufficient documentation for the public domain code which had lacked such material upon being adopted by RDFMG. This document serves as a theory manual for CTF, detailing the many two-phase heat transfer, drag, and important accident scenario models contained in the code, as well as the numerical solution process utilized. Additional documents available in the CTF documentation suite include the user manual and the verification and validation manual.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Requirements Description of the PERSENT Software

This report presents the modeling and simulation capabilities of Argonne National Laboratory’s PERSENT (PERturbation and SENsitivity for Transport) code [1] that is used in modern commercial deployment reactor technologies. The identified capabilities will be used to establish the set of PERSENT verification tasks necessary to verify PERSENT for usage on commercial projects. A similar path was followed for the REBUS [2] and DIF3D [3] software packages.

97 MATHEMATICS AND COMPUTING↗

High-Temperature Gas-Cooled Pebble-Bed Reactors Running In And Transient Modeling Capabilities Demonstration

This study presents a comprehensive benchmarking and verification effort of several thermal-hydraulic and multiphysics capabilities for high-temperature gas-cooled reactor (HTGR) applications. The first part of this effort focuses on the running-in verification of Griffin's multiphysics capabilities, specifically for simulating the evolution of Pebble Bed reactor cores from startup to equilibrium. In the absence of validation data, code-to-code comparisons are conducted with Kugelpy, showing good agreement for key quantities like maximum power density and fresh core k-eigenvalue predictions. However, discrepancies in equilibrium core predictions suggest potential issues with cross sections, underscoring the need for further refinement and evaluation. The HTTF system analysis code benchmark involves RELAP5-3D, SAM, and GAMMA+ to assess their predictive capabilities for HTTF behavior under both normal operation and pressurized conduction cooldown (PCC) transient conditions. While there is good agreement in predicting major parameters such as coolant temperature, solid temperature, and flow distribution, discrepancies in transient behavior highlight differences in modeling approaches, nodalizations, and heat transfer models. The HTTF lower plenum CFD benchmark employs nekRS to simulate flow mixing phenomena, successfully capturing relevant flow physics and demonstrating mesh independence in complex geometries. Preliminary results suggest a relatively uniform temperature field but significant unsteadiness in the flow, requiring time-averaging analyses. The GPBR200 system analysis code benchmark uses SAM's core channel and porous media models, incorporating an RCCS loop for decay heat removal. During steady-state and transient conditions, including protected de-pressurized and pressurized loss of forced cooling (DLOFC and PLOFC), both models show good agreement in predicting temperature profiles and key parameters. Notably, while the core channel model underpredicts convective heat transfer effects, both models maintain temperatures well below the TRISO fuel safety limit. These benchmarking efforts collectively enhance the predictive capabilities of the tools used in HTGR design and safety analysis, guiding developments to improve their accuracy and applicability.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Foundations of plasma standards

Abstract The field of low-temperature plasmas (LTPs) excels by virtue of its broad intellectual diversity, interdisciplinarity and range of applications. This great diversity also challenges researchers in communicating the outcomes of their investigations, as common practices and expectations for reporting vary widely in the many disciplines that either fall under the LTP umbrella or interact closely with LTP topics. These challenges encompass comparing measurements made in different laboratories, exchanging and sharing computer models, enabling reproducibility in experiments and computations using traceable and transparent methods and data, establishing metrics for reliability, and in translating fundamental findings to practice. In this paper, we address these challenges from the perspective of LTP standards for measurements, diagnostics, computations, reporting and plasma sources. This discussion on standards, or recommended best practices, and in some cases suggestions for standards or best practices, has the goal of improving communication, reproducibility and transparency within the LTP field and fields allied with LTPs. This discussion also acknowledges that standards and best practices, either recommended or at some point enforced, are ultimately a matter of judgment. These standards and recommended practices should not limit innovation nor prevent research breakthroughs from having real-time impact. Ultimately, the goal of our research community is to advance the entire LTP field and the many applications it touches through a shared set of expectations.

data and reaction mechanisms↗

Implementation of Additional Models into the MACCS Code for Nearfield Consequence Analysis

The NRC’s Non-Light Water Reactor Vision and Strategy report discusses the MACCS code readiness for nearfield analyses. To increase the nearfield capabilities of MACCS, the plume meander model from Ramsdell and Fosmire was integrated into MACCS and the MACCS plume meander model based on U.S. NRC Regulatory Guide 1.145 was updated. Test cases were determined to verify the plume meander model implementation into MACCS 4.1. The results using the implemented MACCS plume meander models match the comparisons with other codes and analytical calculations. This verifies that the additional MACCS plume meander models have been successfully implemented into MACCS 4.1. This report documents the verification of these model implementations into MACCS and a comparison of the results using

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Data Analysis of Energy Code Compliance in Commercial Buildings (Rev. 1)

What percent of newly constructed commercial buildings comply with the energy code? How much energy and cost could be saved if the compliance increased? Which code requirements have both low compliance rates and high savings potential? These are the questions U.S. Department of Energy (DOE) is trying to answer through its Commercial Energy Code Field Study. Previous commercial studies have been very limited and did not result in a widely accepted and tested methodology. DOE’s goal is to create a standardized methodology that can produce actionable results at a reasonable study cost, that can be used by state and local governments and utilities and provides valuable information to policy makers. The field study team implemented the pilot methodology, compiling a data set of 230 office and retail buildings in two climate zones. The approach is based on identifying lost savings on a total energy cost basis rather than simply counting the quantity of measures that do not meet code. This report is focused on the analysis of the collected data. The primary goal was to analyze the data collected during the field study and determine the actual energy cost impact of each measure in a non-compliance situation. The energy impact results allowed for ranking the measures to identify which have the highest potential for lost savings. These results combined with the time required to verify each measure will allow future compliance verification to focus on measures that had a large impact on energy use over the life of the building and those that have the greatest savings recovery potential per verification hour.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

VENTSAR V3.0: A Python GUI for Estimating Contaminant Concentrations on or Near Buildings Due to Building Effects and Plume Rise and For Calculating Inhalation and Plume Shine Doses

VENTSAR: Originated as VENTAX (Smith and Weber 1983) on the IBM Mainframe at the Savannah River Site (SRS) as a Fortran program. Updated to VENTSAR XL V1.0 (Simpkins 1997) as a spreadsheet version using macros created in Microsoft Excel. Later updated to VENTSAR XL V2.0 (Dixon 2018) as a spreadsheet executing a modified version of the original VENTAX Fortran code. Estimates contaminant concentrations on or near a building from a release at a nearby location. Calculates concentrations for a given meteorological exceedance probability or for a given stability and wind speed combination. Can model a single building with or without a penthouse on top or a ground location from either a stack or ground release. Plume rise can be considered. Contaminant releases can be chemical or radioactive with downwind concentrations determined at user-specified distances. Wind passing over and around buildings creates a complicated dispersion pattern. Air-intake vents may be located on building roofs or near the ground downwind of a release source. An estimation of pollutant concentrations on or near a structure is important in determining expected pollutant levels. Meteorological data are selected based on a specific area of the site. Fortran-based VENTAX able to make fast, complex mathematical calculations. Not user-friendly VENTSAR XL V1.0 no longer supported due to obsolete Excel macros. VENTSAR XL V2.0 an interim solution using an Excel spreadsheet to interface with the modified VENTAX Fortran code. Requires user to have Microsoft Excel. Not an intuitive interface for someone unfamiliar with VENTSAR. Does not perform dose calculations. VENTSAR V3.0 goal to combine the strengths of previous versions of VENTSAR into a single, powerful yet user-friendly program with a Graphical User Interface (GUI). Not dependent upon a specific program or plug-ins. Self-contained package to be used on any computer running Microsoft Windows. User-friendly, intuitive GUI created in Python for parameter input. Executes same modified VENTAX Fortran code as VENTSAR XL V2.0. Outputs formatted text file of completed calculations for easy review and dissemination. Performs inhalation and plume shine dose calculations for up to 11 user-selected nuclides from a nuclide dose factor library of almost 500 nuclides. 12 test cases were created for verification of V1.0 and V2.0. Same test cases run in V3.0 to verify correct performance. V3.0 produced similar results to V1.0. Confirmed GUI did not alter calculations in any way. Comparisons of the test case results confirm the V3.0 GUI does not influence the VENTSAR calculations. Simply passes same input parameters to VENTAX Fortran code for execution. Provides end user an easy-to-use, intuitive tool to quickly make building effect and plume rise calculations, as well as, inhalation and plume shine dose calculations. No experience with or working knowledge of Fortran, Excel, command line, or macros required. Self-contained package allows VENTSAR be deployed to any Windows computer without the need for specific programs or plug-ins.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Verification of Flux Sensitivity Estimates Using the MCNP Tally Perturbation Tool

Nuclear data is commonly used in applications such as nuclear nonproliferation, safeguards, and criticality safety. More specifically, nuclear data is used in predictive simulation codes like the Monte-Carlo N-Particle (MCNP ® ) transport code, Serpent, and similar radiation transport codes. The improvement of nuclear data enables more precise and accurate simulations, which result in higher fidelity designs and reduced operational/procedural costs. Therefore, the improvement of nuclear data is of paramount importance across the nuclear community. Nuclear data is improved and validated through integral benchmark experiments. The design of benchmark experiments is an extensive process; therefore, these experiments are often optimized on multiple characteristics, including sensitivity to the nuclear data, during the design process. Sensitivity is a measure of how much a quantity changes due to changes in independent variables such as experimental configuration. An experimental design that has a larger sensitivity to the nuclear data of interest will have a larger impact on the accuracy and precision of the validated data. Past integral benchmark experiments have primarily used the effective multiplication factor ($k_{eff}$) as the predominant measured quantity; however, experiments designed with other quantities in mind would be able to optimize on validating different areas of the nuclear data. A primary goal of the EUCLID project is to design, constrain, and reduce compensating errors in experiments focused on quantities other than $k_{eff}$ to better validate nuclear data across the board. Currently, there is a capability in MCNP to easily calculate the sensitivity of $k_{eff}$ to specific nuclear data of numerous reactions types and isotopes (KSEN card); however, the sensitivity of other quantities must be estimated in more strenuous manners. For example, the perturbation feature (PERT card) of MCNP can be used to estimate first-order sensitivities of some response in fixed source simulations. A recent announcement revealed that the first- and second-order perturbation features in previous releases of MCNP contained a bug. It was identified that particles were being scored into the wrong energy bin. The bug is in the most recent public release (MCNP6.2); however, a patch has been added to the most up to date version (MCNP6.2.2) that has not been released publicly. A direct comparison of the PERT card results for an F4 (neutron flux averaged over a cell) tally before and after the patch are shown in figure 1. All simulations used in the sensitivity estimates in this report were performed with MCNP6.2.2. This work verifies the patched MCNP perturbation tool by comparing first order sensitivities made using the PERT card to estimates made using manual perturbation of the compact ENDF (ACE) files.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Report of the Atmosphere to Electrons Land-Based Mesoscale-to-Microscale Coupling Project (FY2020)

The overall goal of the Mesoscale-to-Microscale Coupling (MMC) project is to improve coupling between mesoscale and microscale simulations via improved guidance and new strategies for setting up simulations and for the development of new tools that can be used across the community. Including the mesoscale forcing is critical to modeling the full energy transfer across scales in the atmosphere. The project-specific objectives include: 1) To apply rigorous verification and validation (V&V) techniques to the new modeling tools that are developed as part of the project to ensure the accuracy of our codes and results and to develop estimates of the relative uncertainty. 2) To improve computational performance of the coupled MMC models through the development of methods that can be used to reduce turbulence spin-up time and hence the size of computational domains. 3) To improve representation of the surface layer in microscale models to enhance simulations of hub-height wind speed. 4) To develop guidance for the community describing the best ways to couple mesoscale and microscale models, including specific spatial scales at which the handoff to the microscale model should occur. 5) To prepare documentation and a suite of software tools that can be used across the community. And 6) To transition MMC research to the offshore environment. Major progress was made in each of these areas during FY20. The land-based portion of the project is reported herein, while the offshore portion will be reported separately. The team continued to advance the MMC tools and methodologies as well as to document their performance in journal papers and conference presentations, although several planned conferences were cancelled due to the COVID-19 pandemic.

54 ENVIRONMENTAL SCIENCES↗

Sierra/SolidMechanics 4.56 Verification Tests Manual

Presented in this document is a small portion of the tests that exist in the Sierra / SolidMechanics (Sierra / SM) verication test suite. Most of these tests are run nightly with the Sierra / SM code suite, and the results of the test are checked versus the correct analytical result. For each of the tests presented in this document, the test setup, a description of the analytic solution, and comparison of the Sierra / SM code results to the analytic solution is provided. Mesh convergence is also checked on a nightly basis for several of these tests. This document can be used to conrm that a given code capability is veried or referenced as a compilation of example problems. Additional example problems are provided in the Sierra / SM Example Problems Manual. Note, many other verication tests exist in the Sierra / SM test suite, but have not yet been included in this manual.

97 MATHEMATICS AND COMPUTING↗

Sierra/SolidMechanics 5.6 Verification Tests Manual

Presented in this document is a small portion of the tests that exist in the Sierra / SolidMechanics (Sierra / SM) verfication test suite. Most of these tests are run nightly with the Sierra / SM code suite, and the results of the test are checked versus the correct analytical result. For each of the tests presented in this document, the test setup, a description of the analytic solution, and comparison of the Sierra / SM code results to the analytic solution is provided. Mesh convergence is also checked on a nightly basis for several of these tests. This document can be used to confirm that a given code capability is verfied or referenced as a compilation of example problems. Additional example problems are provided in the Sierra / SM Example Problems Manual. Note, many other verfication tests exist in the Sierra / SM test suite, but have not yet been included in this manual.

97 MATHEMATICS AND COMPUTING↗

Challenges and Possible Solutions in Aeroelastic Modeling for the Distributed Wind Industry

Aeroelastic modeling (AM) is the primary methodology for structural and performance assessment of any wind turbine; it provides an understanding of the impact of design parameters on turbine loading and power response before witnessing it in the field. Despite these advantages, the use of AM in the distributed wind technology (DWT) sector is limited. This article represents a short summary of an in-depth assessment by the authors of the status of AM and its role within the distributed wind technology design standards. The research gathered input and feedback from a large number of U.S. and international stakeholders, reviewed technical strengths and weaknesses of the current edition of the design standards, analyzed the minutes from recent industry workshops and meetings, collected publicly available AM templates, and provided an evaluation of the existing AM codes. Several goals were achieved including providing strategies for the load assessment categorization of turbines based on rotor swept area and archetype, and guidance for AM verification and validation. Recommendations within this study will advance the value and the ease-of-use of AM, thereby allowing the industry to better capitalize this underutilized tool, resulting in a more efficient design process, an easier path to certification, and overall better and more reliable distributed wind technology products.

17 WIND ENERGY↗

Verification of the kinetic electron role in the microinstabilities in a negative triangularity model equilibrium

Effect of kinetic electrons on negative triangularity plasmas has been investigated and compared against the corresponding positive triangularity plasmas, using the global gyrokinetic code X-point Gyrokinetic Code with scale-separated delta-f option without Coulomb collisions. Our model magnetic equilibria have strong positive and negative triangularities and weak magnetic shear. However, unusually large ρ i > a and low density plasmas are chosen to maximize the nonlocal effect to investigate the finite ρ i effect and to be clearly away from kinetic ballooning modes. Similar conclusions to previous flux tube and global simulations have been obtained in this highly nonlocal model plasma: it is essential to include kinetic electrons in the micro-instability study of negative triangularity plasmas. Most physics findings agree with existing reports, with some disagreement. We offer a new “effective trapping fraction” concept that can add to the explanation of the growth rate difference between NT and PT plasmas, pointing to the significant variation in trapped particle fractions that have turning points in the mode growth regions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Wind Turbine Aeroelastic Stability in OpenFAST

Wind turbines are growing in size and increasingly suffer from aeroelastic instabilities. Unfortunately, numerical models often show inconsistent results during verification studies. We address this gap by first introducing novel linearization capabilities within the open-source aero-hydro-servo-elastic framework OpenFAST. Next, a code-to-code benchmark study is presented that compares modal parameters between OpenFAST and HAWCStab2 for a land-based version of the International Energy Agency 15-MW reference wind turbine modeled with quasi-steady aerodynamics. The two solvers are in strong agreement except for discrepancies in the second rotor flapwise modes. The differences are attributed to the torsional flexibility of the tower, which is assumed torsionally stiff in the OpenFAST model. Work is ongoing to close this modeling gap. The aeroelastic stability of a low-specific-power land-based wind turbine is also investigated. The impact of design choices is discussed, high-lighting how narrow the margins are between a stable design and an unstable design.

17 WIND ENERGY↗

Studying visual search without an eye tracker: an assessment of artificial foveation

Abstract Eye tracking is a useful tool for studying human cognition, both in the laboratory and in real-world applications. However, there are cases in which eye tracking is not possible, such as in high-security environments where recording devices cannot be introduced. After facing this challenge in our own work, we sought to test the effectiveness of using artificial foveation as an alternative to eye tracking for studying visual search performance. Two groups of participants completed the same list comparison task, which was a computer-based task designed to mimic an inventory verification process that is commonly performed by international nuclear safeguards inspectors. We manipulated the way in which the items on the inventory list were ordered and color coded. For the eye tracking group, an eye tracker was used to assess the order in which participants viewed the items and the number of fixations per trial in each list condition. For the artificial foveation group, the items were covered with a blurry mask except when participants moused over them. We tracked the order in which participants viewed the items by moving their mouse and the number of items viewed per trial in each list condition. We observed the same overall pattern of performance for the various list display conditions, regardless of the method. However, participants were much slower to complete the task when using artificial foveation and had more variability in their accuracy. Our results indicate that the artificial foveation method can reveal the same pattern of differences across conditions as eye tracking, but it can also impact participants’ task performance.

47 OTHER INSTRUMENTATION↗

Demonstration of a new unstructured mesh IMC x-ray transport capability in LAP codes

The Advanced Simulation and Computing (ASC) Transport project’s Jayenne Implicit Monte Carlo (IMC) transport library now includes an unstructured mesh capability and is available in a Lagrangian Applications Project (LAP) code. In this presentation, we discuss recent work by the LAP and Transport projects that provides an IMC transport capability for radiation hydrodynamics in the Lagrangian frame. Verification problems testing the new capabilities have been simulated and analyzed, i.e. Marshak wave, Mach 45, Su-Olsen, picket fence, and crooked pipe, both in one and two dimensions. We also present results on two stretch goal problems: a simplified COAX high energy density physics experiment and a supernova shock simulation. Finally, we identify current limitations and future work needed to bring a full capability to the user community.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗