Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Code Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Software Verification Toolkit (SVT): Survey on Available Software Verification Tools and Future Direction

Writing software is difficult. However, writing complex, well tested and designed, and functionally correct software is incredibly difficult. An entire field of study is devoted to the validation and verification of software to address this problem, and in this paper we analyze the landscape of currently available third party software. We have divided our analyses into three separate subsections with regards to software validation: formal methods, static analysis, and test generation. Formal verification is the most complex method in which to validate software correctness, but also the most thorough as it truly validates the mathematical validity of the source code. Static analysis generally is relegated to abstract syntax tree traversal techniques to find errors related to faulty software such as memory leaks or stack overflow issues. Automatic test generation is similar in implementation to static analysis, but pushes a bit further in verifying the boundedness of function inputs and outputs with regards to annotated or parsed criteria. The crux of this report is to analyze and describe the software tools that implement these techniques to validate and verify software. Pros and cons related to installation, utilization, and capabilities of the frameworks are described, and reproducible examples are provided with a focus on usability. The initial survey concluded that the most interesting tools of note are Z3, Isabelle/HOL, and TLA+ with regards to formal verification; and Infer, Frama-C, and SonarQube with regards to static analysis. With these tools in mind, a final conjecture is provided that describes future avenues of utilizing these tools for developing a verification framework to assist in validating existing software at Sandia National Laboratories.

97 MATHEMATICS AND COMPUTING↗

MPACT Verification and Validation: Status and Plans

The MPACT code provides the capability to calculate the steady-state reactor core neutron distribution for operating nuclear power plant (PWR) conditions across multiple fuel cycles. This document provides an initial plan and summarizes the current status of the verification and validation (V&V) of MPACT.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Turbo-Design: Open-Source Radial Equilibrium Turbomachinery Solver: Part I - Turbines

Advances in 3D Geometrical Designs and Cooling have played a significant role in improving the efficiency of turbomachinery. However, these advancements must be effectively translated back to the modeler. Machine learning can facilitate this transition. Specifically, machine learning–based loss models can bridge the gap between 3D and 1D designs, enabling modelers not only to predict velocity triangles but also to extract additional geometric features. Currently, the design tools used at NASA have not been updated to support such integration—until now. TurboDesign is an open-source, Python-based framework that replaces TD2 (LEW-11029-1) and AXOD2 (LEW-16323-1), both of which are radial equilibrium solvers for axial turbines. The goal of this update is to enable the integration of machine learning loss models into radial equilibrium equations. Additionally, TurboDesign is designed to support radial machines. This paper presents the governing equations, the assumptions underlying the code, the integration of legacy loss models, an example of machine learning model integration, and a validation comparison with CFD. All code, tutorials, and documentation are available at: https://www.github.com/nasa/turbo-design

Radial Equilibrium↗

Modification and Validation of Conceptual Design Aerodynamic Prediction Method HASC95 With VTXCHN

A conceptual/preliminary design level subsonic aerodynamic prediction code HASC (High Angle of Attack Stability and Control) has been improved in several areas, validated, and documented. The improved code includes improved methodologies for increased accuracy and robustness, and simplified input/output files. An engineering method called VTXCHN (Vortex Chine) for predicting nose vortex shedding from circular and non-circular forebodies with sharp chine edges has been improved and integrated into the HASC code. This report contains a summary of modifications, description of the code, user's guide, and validation of HASC. Appendices include discussion of a new HASC utility code, listings of sample input and output files, and a discussion of the application of HASC to buffet analysis.

Aerodynamics prediction↗

X-ray conversion efficiency and radiation non-uniformity in the hohlraum experiments at Shenguang-III prototype laser facility

The hohlraum radiation properties are studied experimentally by the Shenguang-III prototype laser facility and numerically by the two-dimensional code LARED with the multi-group radiation transfer model. The measured radiation temperature is consistent with the prediction of the simulations in a wide laser energy range, suggesting that the x-ray conversion efficiency is around 75% at the peak radiation temperature. The delicate hohlraum experiments further show that the radiation intensity inside the hohlraum is significantly non-uniform. The measured radiation flux of the hot spot region is over twice higher than that of the re-emitted wall region. Good agreements between the experiments and simulations further demonstrate the validity of the LARED code to study the hohlraum radiation properties.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Role of Wind Tunnels and Computer Codes in the Certification and Qualification of Rotorcraft for Flight in Forecast Icing

The cost and time to certify or qualify a rotorcraft for flight in forecast icing has been a major impediment to the development of ice protection systems for helicopter rotors. Development and flight test programs for those aircraft that have achieved certification or qualification for flight in icing conditions have taken many years, and the costs have been very high. NASA, Sikorsky, and others have been conducting research into alternative means for providing information for the development of ice protection systems, and subsequent flight testing to substantiate the air-worthiness of a rotor ice protection system. Model rotor icing tests conducted in 1989 and 1993 have provided a data base for correlation of codes, and for the validation of wind tunnel icing test techniques. This paper summarizes this research, showing test and correlation trends as functions of cloud liquid water content, rotor lift, flight speed, and ambient temperature. Molds were made of several of the ice formations on the rotor blades. These molds were used to form simulated ice on the rotor blades, and the blades were then tested in a wind tunnel to determine flight performance characteristics. These simulated-ice rotor performance tests are discussed in the paper. The levels of correlation achieved and the role of these tools (codes and wind tunnel tests) in flight test planning, testing, and extension of flight data to the limits of the icing envelope are discussed. The potential application of simulated ice, the NASA LEWICE computer, the Sikorsky Generalized Rotor Performance aerodynamic computer code, and NASA Icing Research Tunnel rotor tests in a rotorcraft certification or qualification program are also discussed. The correlation of these computer codes with tunnel test data is presented, and a procedure or process to use these methods as part of a certification or qualification program is introduced.

Flemming, Robert J.↗

Toward Supersonic Retropropulsion CFD Validation

This paper begins the process of verifying and validating computational fluid dynamics (CFD) codes for supersonic retropropulsive flows. Four CFD codes (DPLR, FUN3D, OVERFLOW, and US3D) are used to perform various numerical and physical modeling studies toward the goal of comparing predictions with a wind tunnel experiment specifically designed to support CFD validation. Numerical studies run the gamut in rigor from code-to-code comparisons to observed order-of-accuracy tests. Results indicate that this complex flowfield, involving time-dependent shocks and vortex shedding, design order of accuracy is not clearly evident. Also explored is the extent of physical modeling necessary to predict the salient flowfield features found in high-speed Schlieren images and surface pressure measurements taken during the validation experiment. Physical modeling studies include geometric items such as wind tunnel wall and sting mount interference, as well as turbulence modeling that ranges from a RANS (Reynolds-Averaged Navier-Stokes) 2-equation model to DES (Detached Eddy Simulation) models. These studies indicate that tunnel wall interference is minimal for the cases investigated; model mounting hardware effects are confined to the aft end of the model; and sparse grid resolution and turbulence modeling can damp or entirely dissipate the unsteadiness of this self-excited flow.

Kleb, Bil↗

Expanded verification and validation studies of hypersonic aerodynamics with multiple physics-fidelity models

Hypersonic aerothermodynamics is an important domain of modern multiphysics simulation. The Multi-Fidelity Toolkit is a simulation tool being developed at Sandia National Laboratories to predict aerodynamic properties for compressible flows from a range of physics fidelities and computational speeds. These models include the Reynolds-averaged Navier–Stokes (RANS) equations, the Euler equations with momentum-energy integral technique (MEIT), and modified Newtonian aerodynamics with flat-plate boundary layer (MNA+FPBL) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities, as well as model validation with uncertainty considerations. Code verification activities on the MNA+FPBL model build on previous work by focusing on the viscous portion of the model. Viscous quantities of interest are compared against those from an analytical solution for flat-plate, inclined-plate, and cone geometries. The code verification methodology for the MEIT model is also presented. Test setup and results of code verification tests on the laminar and turbulent models within MEIT are shown. Solution-verification activities include grid-refinement studies on simulations that model the HIFiRE-1 wind tunnel experiments. These experiments are used for validation of all model fidelities. A thorough validation comparison with prediction error and uncertainty is also presented. Three additional HIFiRE-1 experimental runs are simulated in this study, and the solution verification and validation work examines the effects of the associated parameter changes on model performance. Finally, a study is presented that compares the computational costs and fidelities from each of the different models.

42 ENGINEERING↗

Leveraging MARVEL and SPHERE to Demonstrate NEAMS Thermal Hydraulics Codes

The Single Primary Heat Extraction and Removal Emulator (SPHERE) and Microreactor Applications Research Validation and Evaluation (MARVEL) were utilized to demonstrate thermal hydraulics codes of the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. A recent long-duration test of a sodium heat pipe conducted at the SPHERE facility was utilized for the validation of the heat pipe code Sockeye. The first 10 hours of operation featured a startup of the heat pipe from room temperature; this portion was modeled with Sockeye and compared to the experimental data. Measurements included several thermocouple measurements across the length of the heat pipe surface. Two of Sockeye’s heat pipe models were applied to experiment, as well as several models of the cooling at the condenser end of the heat pipe. Sockeye results gave a decent match to the experimental data, with notable discrepancy in the condenser section, where experimental data indicated a significant inactive length of the heat pipe. The MARVEL microreactor was modeled through a coupled simulation of System Analysis Module (SAM) and SubChannel Module (SCM). This multiscale coupled simulation was performed as an exercise to demonstrate the compatibility and applicability of these codes for thermal-hydraulic analysis of microreactors. The coupling between the SCM and SAM codes for multiscale modeling of MARVEL, was achieved through a domain overlapping approach. In this example a transient SAM simulation provided boundary conditions to SCM, and SCM provided pressure drop to SAM.

97 - MATHEMATICS AND COMPUTING↗

SCM overview & the EBR-II shutdown heat removal tests validation.

Pronghorn is an engineering-scale, coarse-mesh, thermal-hydraulics tool for supporting reactor-core simulations of advanced nuclear reactors. Most of the current efforts in Pronghorn have been devoted in developing porous finite-volume capabilities and adapting closure correlations for coarse-mesh thermal-hydraulics modeling. However, for liquid-metal reactors (LMRs) with wire-wrapped fuel pin assemblies, a pin-level thermal-hydraulic resolution is required for most safety case studies (pin rupture, channel blockage, etc.). For this purpose, a new Subchannel application is developed in MOOSE, which affords the required flow field resolution, while still preserving an engineering-scale approach. This new solver can be natively coupled to Pronghorn and other MOOSE objects to enable full-core, multi-physics, multi-scale engineering studies. This presentation presents the main features of the SCM code and demonstrates a validation case based on the EBR-II SHRT tests.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Verification and Validation Activities for the Multi-Fidelity Toolkit

The Multi-Fidelity Toolkit (MFTK) is a simulation tool being developed at Sandia National Laboratories for aerodynamic predictions of compressible flows over a range of physics fidelities and computational speeds. These models include the Reynolds-Averaged-Navier-Stokes (RANS) equations, the Euler equations, and modified Newtonian aerodynamics (MNA) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities as well as model validation with uncertainty considerations. Code verification is performed on the MNA model by comparing with an analytical solution for flat-plate and inclined-plate geometries. Solution-verification activities include grid-refinement studies of HIFiRE-1 wind tunnel measurements, which are used for validation, for all model fidelities. A thorough treatment of the validation comparison with prediction error and validation uncertainty is also presented.

42 ENGINEERING↗

Fracture mechanics life analytical methods verification testing

The objective was to evaluate NASCRAC (trademark) version 2.0, a second generation fracture analysis code, for verification and validity. NASCRAC was evaluated using a combination of comparisons to the literature, closed-form solutions, numerical analyses, and tests. Several limitations and minor errors were detected. Additionally, a number of major flaws were discovered. These major flaws were generally due to application of a specific method or theory, not due to programming logic. Results are presented for the following program capabilities: K versus a, J versus a, crack opening area, life calculation due to fatigue crack growth, tolerable crack size, proof test logic, tearing instability, creep crack growth, crack transitioning, crack retardation due to overloads, and elastic-plastic stress redistribution. It is concluded that the code is an acceptable fracture tool for K solutions of simplified geometries, for a limited number of J and crack opening area solutions, and for fatigue crack propagation with the Paris equation and constant amplitude loads when the Paris equation is applicable.

Favenesi, J. A.↗

AMR-Wind: A Performance-Portable, High-Fidelity Flow Solver for Wind Farm Simulations

We present AMR-Wind, a verified and validated high-fidelity computational-fluid-dynamics code for wind farm flows. AMR-Wind is a block-structured, adaptive-mesh, incompressible-flow solver that enables predictive simulations of the atmospheric boundary layer and wind plants. It is a highly scalable code designed for parallel high-performance computing with a specific focus on performance portability for current and future computing architectures, including graphical processing units (GPUs). In this paper, we detail the governing equations, the numerical methods, and the turbine models. Establishing a foundation for the correctness of the code, we present the results of formal verification and validation. The verification studies, which include a novel actuator line test case, indicate that AMR-Wind is spatially and temporally second-order accurate. The validation studies demonstrate that the key physics capabilities implemented in the code, including actuator disk models, actuator line models, turbulence models, and large eddy simulation (LES) models for atmospheric boundary layers, perform well in comparison to reference data from established computational tools and theory. We conclude with a demonstration simulation of a 12-turbine wind farm operating in a turbulent atmospheric boundary layer, detailing computational performance and realistic wake interactions.

17 WIND ENERGY↗

Go with the Radflow: Thermal radiation experiments in the high energy-density regime [Slides]

Los Alamos National Laboratory is a nuclear weapons laboratory supporting our nation's defense. In support of the mission is a high energy-density physics program in which we design and execute experiments to study radiation-hydrodynamics phenomena and improve the predictive capability of our large-scale multi-physics software codes on our supercomputers. The Radflow Project is maturing a unique spectroscopic measurement that yields a spatially dependent supersonic radiation wavefront profile. The spectroscopic measurement is much more constraining than the typically used radiography, which measures the density changes due to the shock as the radiation wave goes subsonic. Recently, the spectroscopic measurement has been applied to advanced targets with a detailed heterogeneity representing a single realization of a stochastic medium. The Radflow Project also conducts opacity experiments to explain the current conundrum of the experimental iron opacity differing from theory, which is important in modeling the sun. More than that, though, we need to be able to answer these science questions and be able to validate our theory and codes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Establishing Consensus Turbulence Statistics for Hot Subsonic Jets

Many tasks in fluids engineering require knowledge of the turbulence in jets. There is a strong, although fragmented, literature base for low order statistics, such as jet spread and other meanvelocity field characteristics. Some sources, particularly for low speed cold jets, also provide turbulence intensities that are required for validating Reynolds-averaged Navier-Stokes (RANS) Computational Fluid Dynamics (CFD) codes. There are far fewer sources for jet spectra and for space-time correlations of turbulent velocity required for aeroacoustics applications, although there have been many singular publications with various unique statistics, such as Proper Orthogonal Decomposition, designed to uncover an underlying low-order dynamical description of turbulent jet flow. As the complexity of the statistic increases, the number of flows for which the data has been categorized and assembled decreases, making it difficult to systematically validate prediction codes that require high-level statistics over a broad range of jet flow conditions. For several years, researchers at NASA have worked on developing and validating jet noise prediction codes. One such class of codes, loosely called CFD-based or statistical methods, uses RANS CFD to predict jet mean and turbulent intensities in velocity and temperature. These flow quantities serve as the input to the acoustic source models and flow-sound interaction calculations that yield predictions of far-field jet noise. To develop this capability, a catalog of turbulent jet flows has been created with statistics ranging from mean velocity to space-time correlations of Reynolds stresses. The present document aims to document this catalog and to assess the accuracies of the data, e.g. establish uncertainties for the data. This paper covers the following five tasks: Document acquisition and processing procedures used to create the particle image velocimetry (PIV) datasets. Compare PIV data with hotwire and laser Doppler velocimetry (LDV) data published in the open literature. Compare different datasets acquired at roughly the same flow conditions to establish uncertainties. Create a consensus dataset for a range of hot jet flows, including uncertainty bands. Analyze this consensus dataset for self-consistency and compare jet characteristics to those of the open literature. One final objective fulfilled by this work was the demonstration of a universal scaling for the jet flow fields, at least within the region of interest to aeroacoustics. The potential core length and the spread rate of the half-velocity radius were used to collapse of the mean and turbulent velocity fields over the first 20 jet diameters in a highly satisfying manner.

Bridges, James↗

Modeling Approach to Critical in the Upcoming CERBERUS Experiment

The planned Critical Experiment Reflected By coppEr to betteR Understand Scattering (CERBERUS) seeks to maximize sensitivity to elastic neutron scattering in the intermediate energy region (0.625 eV to 100 keV). It will be performed near the end of FY 2023 at the National Criticality Experiments Research Center (NCERC). Very few International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmarks are sensitive to copper in this region. Creating a benchmark sensitive in this area will make the Zeus benchmark series, an intermediate benchmark evaluation that uses a copper reflector, more useful for code and nuclear data validation. Approaching criticality in a safe manner is of utmost importance to avoid a criticality accident, which would present a safety concern and could cause damage to equipment. The two rules that are followed closely to ensure that a criticality accident does not occur are the 3/4 rule and the 1/2 rule. The 3/4 rule states that no more than 3/4 of a critical mass can be assembled by hand, and the 1/2 rule states that no more than 1/2 of the material expected to reach criticality, or 1/2 the distance needed to reach criticality, can be added before another measurement of the count rate has been taken. This work will discuss the approach to criticality as modeled in MCNP6® 1 particle transport code with the ENDF/B- VIII.0 cross-section library and the .00c data library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Simulating Hydrodynamics in Cosmology with CRK-HACC

Abstract We introduce CRK-HACC, an extension of the Hardware/Hybrid Accelerated Cosmology Code (HACC), to resolve gas hydrodynamics in large-scale structure formation simulations of the universe. The new framework couples the HACC gravitational N -body solver with a modern smoothed-particle hydrodynamics (SPH) approach called conservative reproducing kernel SPH (CRKSPH). CRKSPH utilizes smoothing functions that exactly interpolate linear fields while manifestly preserving conservation laws (momentum, mass, and energy). The CRKSPH method has been incorporated to accurately model baryonic effects in cosmology simulations—an important addition targeting the generation of precise synthetic sky predictions for upcoming observational surveys. CRK-HACC inherits the codesign strategies of the HACC solver and is built to run on modern GPU-accelerated supercomputers. In this work, we summarize the primary solver components and present a number of standard validation tests to demonstrate code accuracy, including idealized hydrodynamic and cosmological setups, as well as self-similarity measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Assess the key physics that underpins high-hydro coupling-efficiency in NDCX-II experiments and high-gain heavy ion direct drive target designs using proven hydro codes like HYDRA

The simulations provided in this milestone have solidified the theoretical underpinning of direct drive targets and also the ability to design experiments on NDCX II that will enhance our understanding of ion-beam hydrodynamic coupling, and thus be relevant to IFE. For the case of the IFE targets, we have studied hydro and implosion efficiency using HYDRA in ID, a starting point towards the goal of polar direct drive in geometry compatible with liquid wall chambers. Recent analysis of direct drive fusion energy targets using heavy ion beams has found high coupling efficiency of ion beam energy into implosion energy. However, to obtain optimal coupling, the ion energy must increase during the pulse in order to penetrate the outflowing ablated material, and deposit the energy close enough to the fuel so that the fuel achieves sufficient implosion velocity. We have computationally explored ID (radial) time dependent models of ion driven direct drive capsule implosions using the Arbitrary Lagrangian-Eulerian (ALE) code HYDRA, to help validate the theoretical analysis done so far, particularly exploring the effects of varying the ion energy and ion current over the course of the pulse. On NDCX II, experiments have been proposed to explore issues of ion penetration of the outflowing plasma over the course of the ion pulse. One possibility is to create a first pulse of ions that heats a planar target, and produces an outflow of material. A second pulse, {approx}10 ns after the first, of higher ion energy (and hence larger projected range) will interact with this outflow before reaching and further heating the target. We have investigated whether the change in range can be tailored to match the evolution of the ablation front. We have carried out simulations using the one-dimensional hydrodynamic code DISH and HYDRA to set parameters for this class of experiments. DISH was upgraded with an ion deposition algorithm, and we have carried out ID (planar) simulations. HYDRA was also used for ID (planar) and 2D (r,z) simulations of potential experiments. We have also explored whether similar physics could be studied using an energy ramp (i.e., a velocity tilt) rather than two separate pulses. We have shown that an optimum occurs in the macropulse duration (with fixed velocity tilt) that maximizes the shock strength. In the area of IFE target design we have continued to explore direct drive targets composed of deuterium-tritium fuel and ablator layers. We have extended our previous target designs at 0.44 MJ drive energy, gain 50, (50 MeV foot, 500 MeV main pulse, Rb ion, which requires a large number of beams due to a high beam space charge constraint) to a power plant scale 3.7 MJ drive energy, gain {approx}150 (220 MeV foot, 2.2 GeV main pulse, Hg ion) that eases requirements on the accelerator. We have studied the effects of two important design choices on ICF target performance. We have shown that increasing the number of foot pulses may reduce the target's in-flight adiabat and consequently improve its compressibility and fusion yield. As in the case of laser drive, the first three shocks are the most important to the target's performance, with additional shocks contributing only marginally to compression and burn. We have also demonstrated that ion range lengthening during the main pulse can further reduce the target adiabat and improve the efficiency with which beam energy is coupled into the target. (Ion range lengthening using two different kinetic energies for the foot and main pulse has previously proven effective in the design of high gain targets).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗