Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “code verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Adapting Code Verification Methodology to Model Form

Code verification is an essential part of credibility analysis for computational models. It assesses whether the mathematical model is implemented correctly into the code and whether the numerical methods behave consistently, and is done before solution verification and validation. Robust guidance for code verification exists in the literature. However, there is no known, concise guide for selecting the approach based on the model form that also presents an overview of the common elements. This document was written to address this gap as an accessible reference for beginning a code-verification effort.

97 MATHEMATICS AND COMPUTING↗

Code Verification and Solution Verification framework in pin-resolved neutron transport code MPACT

Program verification in scientific computing encompasses the application of formal and mathematical techniques to a scientific computing code for its credibility, accuracy, and validity. Code Verification identifies bugs and performance issues in the software development stage. Solution Verification assesses the applicability of the code and the accuracy of the solution to problems of interest. Both activities utilize application cases and quantify the error against prescribed acceptance criteria. However, simply executing more application cases does not guarantee stronger or more comprehensive credibility. Here, we establish a verification framework that involves Code Verification and Solution Verification, both of which work together such that the overarching goal of “converge to the correct answer for the intended application” can be reasonably inferred. The application of such a verification framework is demonstrated using the pin-resolved neutron transport code MPACT, where standard unit tests and regression tests are covered, and where the Method of Exact Solutions and the Method of Manufactured Solutions are successfully used. Additionally, the applicability of Method of Manufactured Solutions is extended to the OECD/NEA C5G7 benchmark problems of practical material and geometric configurations. Solution Verification activities are demonstrated on a practical hierarchy of application models of increasing complexity ranging from 2D pin cell problems to 3D assembly problems. The convergence behavior and rate of convergence with respect to each individual variable are studied and provided. This framework can be adapted broadly to other fields involving scientific computing codes.

97 MATHEMATICS AND COMPUTING↗

Adopting Code Verification Methodology Based on Model Form

Code verification is an essential part of credibility analysis for computational models. It assesses whether the mathematical model is implemented correctly into the code and whether the numerical methods behave consistently, and is done before solution verification and validation. Robust guidance for code verification exists in the literature. However, there is no known, concise guide for selecting the approach based on the model form that also presents an overview of the common elements. This document was written to address this gap as an accessible reference for beginning a code-verification effort.

97 MATHEMATICS AND COMPUTING↗

Code-verification techniques for the method-of-moments implementation of the combined-field integral equation

Code verification plays an important role in establishing the credibility of computational simulations by assessing the correctness of the implementation of the underlying numerical methods. In computational electromagnetics, the numerical solution to integral equations incurs multiple interacting sources of numerical error, as well as other challenges, which render traditional code-verification approaches ineffective. In this paper, we provide approaches to separately measure the numerical errors arising from these different error sources for the method-of-moments implementation of the combined-field integral equation. Here, we demonstrate the effectiveness of these approaches for cases with and without coding errors.

97 MATHEMATICS AND COMPUTING↗

Code-verification techniques for the method-of-moments implementation of the magnetic-field integral equation

For computational physics simulations, code verification plays a major role in establishing the credibility of the results by assessing the correctness of the implementation of the underlying numerical methods. In computational electromagnetics, surface integral equations, such as the method-of-moments implementation of the magnetic-field integral equation, are frequently used to solve Maxwell's equations on the surfaces of electromagnetic scatterers. These electromagnetic surface integral equations yield many code-verification challenges due to the various sources of numerical error and their possible interactions. In this paper, we provide approaches to separately measure the numerical errors arising from these different error sources. We demonstrate the effectiveness of these approaches for cases with and without coding errors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Level 2 Milestone: Develop and Incorporate Novel Code Verification of Fundamental Equations in Gemma and Set Up Appropriate Tests

For computational physics simulations, code verification plays a major role in establishing the credibility of the results by assessing the correctness of the implementation of the underlying numerical methods. In computational electromagnetics, surface integral equations, such as the method-of-moments implementations of the electric-, magnetic-, and combinedfield integral equations, are frequently used to solve Maxwell’s equations on the surfaces of electromagnetic scatterers. These electromagnetic surface integral equations yield many code-verification challenges due to the various sources of numerical error and their possible interactions. In this report, we provide approaches to separately measure the numerical errors arising from these different error sources. We demonstrate the effectiveness of these approaches in Gemma.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Code verification for practically singular equations

We report the method-of-moments implementation of the electric-field integral equation (EFIE) yields many code-verification challenges due to the various sources of numerical error and their possible interactions. Matters are further complicated by singular integrals, which arise from the presence of a Green's function. To address these singular integrals, an approach is presented in wherein both the solution and Green's function are manufactured. Because the arising equations are poorly conditioned, they are reformulated as a set of constraints for an optimization problem that selects the solution closest to the manufactured solution. In this paper, we demonstrate how, for such practically singular systems of equations, computing the truncation error by inserting the exact solution into the discretized equations cannot detect certain orders of coding errors. On the other hand, the discretization error from the optimal solution is a more sensitive metric that can detect orders less than those of the expected convergence rate.

97 MATHEMATICS AND COMPUTING↗

Fuel cycle depletion validation and code-to-code verification studies for High Flux Isotope Reactor highly and low-enriched uranium fuel designs

Here, this paper documents fuel cycle depletion validation and code-to-code verification studies for the High Flux Isotope Reactor (HFIR) highly enriched uranium (HEU) and proposed low-enriched uranium (LEU) fuel designs. In support of HFIR’s world-leading performance, transport and depletion simulations are performed to ensure safe operations, design and qualify irradiation experiments, enhance core components and irradiation facilities, and design and characterize LEU fuel designs. Identifying well-validated, computationally efficient codes is required for the success of these efforts. The HFIR Controller, Shift, and VESTA codes were deployed to simulate HEU uranium–oxide dispersion fuel cycles at 85, 95, and 100 MW operations, as well as LEU fuel cycles operating at 95 MW with uranium–silicide dispersion and uranium–molybdenum monolithic alloy fuel forms. Excellent agreement between the codes and with experimentally obtained 235 U enrichment distributions provides increased confidence in the ability of these codes to model and simulate HFIR’s unique core design.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Code Verification of Multiple Physics-Fidelity Models in Hypersonic Aerodynamics

Hypersonic aerodynamics models exist across a range of physics fidelities with associated computational expenses. These models may be run independently or in a multifidelity framework that leverages their complementary strengths of speed for lower-fidelity and accuracy for higher-fidelity models. This work presents applied code verification of two lower-fidelity models contained within the Sandia hypersonic aerodynamics code. Each model has a different form that requires individualized verification approaches, including comparison to analytical solutions as well as manufactured solutions with order-of-accuracy testing. In conclusion, results of this effort include the identification and resolution of code errors and shortcomings, as well as the demonstration of code correctness and consistency for both models.

Aerodynamics↗

Zero power experiment for molten salt reactor - code verification and validation request

Molten Salt Reactors (MSRs) are one of the six perspective Generation IV nuclear technologies that should fulfil sustainability, economics, safety, and proliferation resistance goals. In recent years these concepts have attracted increased interest in research as well as in industry. In the context of developing new, innovative technology, a zero-power experiment would be an ideal option for improving the understanding of MSR systems under low-risk and low-cost conditions. The given research was focused on cross-verification of the nuclear codes for MSR modelling and simulations as required for the development of the first design of a potential facility and a draft of an experimental programme. The analysis included the evaluation of lattice and Monte Carlo codes. The study showed that all considered nuclear tools were in good agreement with each other. Although this does not mean the results will match the real experimental data, which is essential for the regulatory approval of a novel technology. Currently, experimental data is almost absent for MSR technology. Hence, a zero power experiment is needed to assure we can rely on modelling and simulation studies for further development of MSR technology and deliver real-world experiments to support the licensing of future MSRs. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Cross-Code Verification of Neutronics Analysis Tools at INL Applied for 238 Pu Production in the Advanced Test Reactor

Here, analyses are completed for experiments prior to experiment irradiation in the Advanced Test Reactor (ATR) at Idaho National Laboratory (INL). Various codes are used to qualify all experiments planned for insertion in the reactor, thereby ensuring that all safety and programmatic requirements are satisfied preirradiation. Among the common experiment analysis tools at INL are MCNP5 coupled to ORIGEN2 (MOPY) and MC21. MOPY uses MCNP5 for transport calculations along with calculations for fluxes and select reaction rates, and then ORIGEN2 handles the step-by-step and postirradiation depletion. MC21 handles all in-reactor transport and step-by-step, during-irradiation, depletion calculations, and then ORIGEN (SCALE 6.2.3) is used for decay and dose calculations postirradiation. The MOPY results, along with those obtained via two variations of the MC21 model, were compared in terms of 238 Pu production in the ATR’s H10 position. For the MOPY model, the MC21 model utilizing the HELIOS-based fission product (FP) library, and the MC21 model utilizing the expanded 1300 FP library, the during-cycle irradiation in-core heating results were sufficiently equivalent; however, the MOPY model and the MC21 model with the HELIOS library showed some differences relating to the respective FP libraries. Ultimately, the MC21 model with a 1300 FP library produced the most consistent results throughout the cycle, whereas the MC21 model that utilized the (smaller) HELIOS library was able to handle during-irradiation analysis but lacked certain short-lived FPs that significantly contributed to the total decay heat at shutdown. MOPY, on the other hand, was found to overpredict fission gas production, as a result of limitations in the ORIGEN2 code.

ATR↗

Incorporating Full Elastodynamic Effects and Dipping Fault Geometries in Community Code Verification Exercises for Simulations of Earthquake Sequences and Aseismic Slip (SEAS)

ABSTRACT Numerical modeling of earthquake dynamics and derived insight for seismic hazard relies on credible, reproducible model results. The sequences of earthquakes and aseismic slip (SEAS) initiative has set out to facilitate community code comparisons, and verify and advance the next generation of physics-based earthquake models that reproduce all phases of the seismic cycle. With the goal of advancing SEAS models to robustly incorporate physical and geometrical complexities, here we present code comparison results from two new benchmark problems: BP1-FD considers full elastodynamic effects, and BP3-QD considers dipping fault geometries. Seven and eight modeling groups participated in BP1-FD and BP3-QD, respectively, allowing us to explore these physical ingredients across multiple codes and better understand associated numerical considerations. With new comparison metrics, we find that numerical resolution and computational domain size are critical parameters to obtain matching results. Codes for BP1-FD implement different criteria for switching between quasi-static and dynamic solvers, which require tuning to obtain matching results. In BP3-QD, proper remote boundary conditions consistent with specified rigid body translation are required to obtain matching surface displacements. With these numerical and mathematical issues resolved, we obtain excellent quantitative agreements among codes in earthquake interevent times, event moments, and coseismic slip, with reasonable agreements made in peak slip rates and rupture arrival time. We find that including full inertial effects generates events with larger slip rates and rupture speeds compared to the quasi-dynamic counterpart. For BP3-QD, both dip angle and sense of motion (thrust versus normal faulting) alter ground motion on the hanging and foot walls, and influence event patterns, with some sequences exhibiting similar-size characteristic earthquakes, and others exhibiting different-size events. These findings underscore the importance of considering full elastodynamics and nonvertical dip angles in SEAS models, as both influence short- and long-term earthquake behavior and are relevant to seismic hazard.

Geochemistry & Geophysics↗

FY2021 Improvements to the New CTH Code Verification & Validation Test Suite

Over the past few years, the CTH multiphysics hydrocode has overhauled its software quality and testing processes, implementing current best practices in software quality and building a robust V&V test suite comprised of traditional hydrocode verification problems, including ASC Tri-Lab Test Suite and Enhanced Tri-Lab Test Suite problems, as well as validation problems for some of CTH’s most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards building this new test suite was made in FY19 and FY20. In FY21, the test suite has been expanded to include verification and validation tests of the Steinberg-Guinan-Lund (ST) viscoplastic model and the Johnson Cook (JFRAC) fracture model. Additionally, two new verification tests were added, covering hydrodynamics and high explosive (HE) modeling capabilities: the Kidder Gaussian density problem and the Escape of HE Products (EHEP) problem from the Tri-Lab Test Suite. This report discusses each of these test problems in detail. Verification test results are compared to analytic solutions. Validation test results are compared to experimental data. Wherever possible, convergence or mesh refinement studies are included. Additionally, while implementing the Kidder verification problem, a bug was identified that affects the use of tables to initialize pressure or density in 1D or 2D calculations. A brief discussion of the bug and its fix is included. CTH demonstrates good performance overall on the new test suite problems. Simulation results showed good agreement with analytic solutions for the Kidder problem, with convergence rates ranging between 1.8 and sub-linear, and relatively good agreement for the EHEP problem, though convergence rates for pressure and density were nearly 0. The ST and JFRAC strain rate loading verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data, including Taylor rod impact testing, for the materials tested. Future V&V work will focus on adding 2D and 3D versions of existing verification tests as well as adding validation tests of other frequently used capabilities such as other fracture models.

42 ENGINEERING↗