Results for “code validation” — Page 96

DOE OSTI2023

CTF Validation and Verification: Version 4.4

Coolant-Boiling in Rod Arrays- Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for light water reactor (LWR) analysis. It uses a two-fluid, three-field (i.e., fluid film, fluid drops, and vapor) modeling approach. Both subchannel and 3D Cartesian forms of nine conservation equations are available for LWR modeling. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last several decades. COBRA-TF is also used at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently became the CTF. One part of the improvement process includes validating the methods in CTF. This document seeks to provide a certain level of certainty and confidence in the predictive capabilities of the code for the scenarios it was designed to model—rod bundle geometries with operating conditions that are representative of prototypical pressurized water reactor (PWR)s and boiling water reactor (BWR)s in both normal and accident conditions. This is done by modeling a variety of experiments that simulate these scenarios and then presenting a qualitative and quantitative analysis of the results that demonstrates the accuracy to which CTF is capable of capturing specific quantities of interest.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS2020

Is Structured Agile an Oxymoron? Tales from Implementing and Executing Agile in a US Government Environment

To paraphrase a famous quote, "No plan survives contact with the reality." Software (SW) development is often a classic example of this: whatever the plan was for a particular development, it often does not survive contact with technical realities, budget realities, program realities and schedule realities. Traditionally, SW development has followed a waterfall methodology with requirements being rigorously specified before the design, which was completed before the coding and unit testing started, which were in turn finished before validation and verification started. This model of SW engineering derives much from the HW engineering of large systems, and has been the standard methodology used in US government software acquisitions and systems for decades, with highly variable results. US Government SW requirements are built around Waterfall concepts, which assume that the plan will survive contact with reality, or at least that modifications to the plan are relatively small, and relatively few.Because of the inefficiencies and difficulties inherent in Waterfall, the commercial SW world started using a different SW development methodology called Agile more than 20 years ago. Agile believes that a plan should evolve and learn rapidly in response to the realities encountered. At its core, there are a few key elements of Agile:- A small team of people which is highly flexible and adaptive. The team collaborates and interoperates through sophisticated development architectures and release environments- An iterative, incremental development and release approach which is based upon the concept that knowledge comes from experience within the team, and that the team makes decisions based upon what it knows- A team culture which prizes transparency, inspection and adaptation. These values are necessary so that the team experience and decision making is transparent and responsive to the realities encountered during development and testingSo, how to use Agile in a US Government environment? GMSEC (Goddard Mission Services Evolution Center) develops satellite ground system software for NASA and other US Government agencies. The SW developed by the team contains a large code base of many applications used within satellite mission operations centers. It spans the full gamut of SW development types: from SW which is in a classic maintenance and sustainment mode, to new developments with a fairly well understood scope and approach, to new developments whose scope and approach are quite unclear and which require significant research and prototyping. Team members move between all of these different types of SW development. Waterfall was inadequate to the programmatic and technical needs of the team, as well as the various types of SW development being done. The software plan was not surviving contact with the technical and programmatic realities experienced by the team. To address this, the team started a small pilot project in 2016 to test the use of Agile within a small subset of the team for a new web services application. In early 2018, the use of Agile was expanded to the whole team and all the software, but we had to fulfill the NASA SW development requirements. And we needed to do this while still remaining true to the key Agile elements of transparency, inspection and adaption. In order to do this, the team worked very closely with the Software Process Improvement (SPI) team at NASA Goddard, as well as NASA engineering manageme

Beech, Theresa W.↗

DOE OSTI2024

OC6 project Phase IV: validation of numerical models for novel floating offshore wind support structures

Abstract. This paper provides a summary of the work done within Phase IV of the Offshore Code Comparison Collaboration, Continued with Correlation and unCertainty (OC6) project, under International Energy Agency Wind Technology Collaboration Programme Task 30. This phase focused on validating the loading on and motion of a novel floating offshore wind system. Numerical models of a 3.6 MW horizontal-axis wind turbine atop the TetraSpar floating support structure were compared using measurement data from a 1:43-Froude-scale test performed in the University of Maine's Alfond Wind–Wave (W2) Ocean Engineering Laboratory. Participants in the project ran a series of simulations, including system equilibrium, surge offsets, free-decay tests, wind-only conditions, wave-only conditions, and a combination of wind and wave conditions. Validation of the models was performed by comparing the aerodynamic loading, floating support structure motion, tower base loading, mooring line tensions, and keel line tensions. The results show a relatively good estimation of the aerodynamic loading and a reasonable estimation of the platform motion and tower base fore–aft bending moment. However, there is a significant dispersion in the dynamic loading for the upwind mooring line. Very good agreement was observed between most of the numerical models and the experiment for the keel line tensions.

17 WIND ENERGY↗

NASA NTRSDate not supplied

Predictive Modeling of Carbon Ablators

Efforts to build a Predictive Material Modeling (PMM) framework from the micro-scale to the macro-scale are presented in this abstract. To reduce the need for extensive testing, accelerate the design cycle process, and reduce uncertainty margins applied to final designs, NASA is developing simulation and modeling tools that enable characterization of material properties and response to high-enthalpy environments. The Porous Microstructure Analysis (PuMA) code has been developed for computing macroscale (volume averaged) properties of porous materials using microscale images from micro-computed tomography (micro-CT). Microscale modeling requires a realistic representation of a material microstructure; these are obtained either synthetically during the design of the material or through X-ray micro-CT. Volume averaged properties are then used to inform macroscale material response models, such as those implemented in the Porous-material Analysis Toolbox based on OpenFOAM (PATO) software, also actively developed by NASA. The computational model in PATO is a generic heat and mass transfer model for porous reactive materials containing several solid phases and a single gas phase. The detailed chemical interactions occurring between the solid phases and the gas phase are modeled at the pore scale assuming local thermal equilibrium. These tools were developed to efficiently interface with other pre-existing codes such as SPARTA (direct simulation Monte Carlo), DPLR (hypersonic CFD), NEQAIR (radiative transport) and DAKOTA (uncertainty quantification and optimization). Detailed flight data (Mars Science Laboratory [MSL] Entry Descent and Landing Instrument [MEDLI]) is critical for validating these computational tools for NASA applications. Examples of modeling ablative material response using these codes will be presented including 3D simulations of the full-scale heatshield of the MSL capsule. The simulations demonstrate the ability of the modern material response code, PATO, to handle the material response of geometrically complex and large domains, through the use of massively parallel computations.

Thermal Protection Systems↗

NASA NTRSDate not supplied

Predictive Modeling of Carbon Ablators Using Micro and Macro-Scale Modeling

Efforts to build a Predictive Material Modeling (PMM) framework from the micro-scale to the macro-scale are presented in this abstract. To reduce the need for extensive testing, accelerate the design cycle process, and reduce uncertainty margins applied to final designs, NASA is developing simulation and modeling tools that enable characterization of material properties and response to high-enthalpy environments. The Porous Microstructure Analysis (PuMA) code has been developed for computing macroscale (volume averaged) properties of porous materials using microscale images from micro-computed tomography (micro-CT). Microscale modeling requires a realistic representation of a material microstructure; these are obtained either synthetically during the design of the material or through X-ray micro-CT. Volume averaged properties are then used to inform macroscale material response models, such as those implemented in the Porous-material Analysis Toolbox based on OpenFOAM (PATO) software, also actively developed by NASA. The computational model in PATO is a generic heat and mass transfer model for porous reactive materials containing several solid phases and a single gas phase. The detailed chemical interactions occurring between the solid phases and the gas phase are modeled at the pore scale assuming local thermal equilibrium. These tools were developed to efficiently interface with other pre-existing codes such as SPARTA (direct simulation Monte Carlo), DPLR (hypersonic CFD), NEQAIR (radiative transport) and DAKOTA (uncertainty quantification and optimization). Detailed flight data (Mars Science Laboratory [MSL] Entry Descent and Landing Instrument [MEDLI]) is critical for validating these computational tools for NASA applications. Examples of modeling ablative material response using these codes will be presented including 3D simulations of the full-scale heatshield of the MSL capsule. The simulations demonstrate the ability of the modern material response code, PATO, to handle the material response of geometrically complex and large domains, through the use of massively parallel computations.

Thermal Protection Systems↗

NASA NTRS2004

The HiVy tool set

Our aim is to validate mission-specific components of spacecraft flight software designs that are specified using state-charts and translated automatically to the final flight code for the mission. We established an automatic translation tool set from state-charts to SPIN for the validation of such mission-specific components.

translation↗

DOE OSTI2024

Development and validation of fully open-source R2S shutdown dose rate capabilities in OpenMC *

We present the first fully open-source capabilities for shutdown dose rate (SDR) calculations of fusion energy facilities based on the Rigorous 2-Step (R2S) methodology. These capabilities have been implemented in the OpenMC Monte Carlo particle transport code, building on its existing capabilities while also leveraging new features that have been added to the code to support SDR calculations, such as decay photon source generation. Each of the individual physics components in the R2S workflow—neutron transport, activation, decay photon source generation, and photon transport—have been verified through code-to-code comparisons with MCNP6.2 and FISPACT-II 4.0. These comparisons generally demonstrate excellent agreement between codes for each of the physics components. The full cell-based R2S workflow was validated by performing a simulation of the first experimental campaign from the Frascati Neutron Generator (FNG) ITER dose rate benchmark problem from the Shielding INtegral Benchmark Archive and Database (SINBAD). For short cooling times, the dose calculated by OpenMC agrees with the experimental measurements within the stated experimental uncertainties. For longer cooling times, an overprediction of the shutdown dose was observed relative to experiment, which is consistent with previous studies in the literature. Altogether, these features constitute a combination of capabilities in a single, open-source codebase to provide the fusion community with a readily-accessible option for SDR calculations and a platform for rapidly analyzing the performance of fusion technology.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2021

Machine Learning-enabled Scalable Performance Prediction of Scientific Codes

Hardware architectures become increasingly complex as the compute capabilities grow to exascale. Here, we present the Analytical Memory Model with Pipelines (AMMP) of the Performance Prediction Toolkit (PPT). PPT-AMMP takes high-level source code and hardware architecture parameters as input and predicts runtime of that code on the target hardware platform, which is defined in the input parameters. PPT-AMMP transforms the code to an (architecture-independent) intermediate representation, then (i) analyzes the basic block structure of the code, (ii) processes architecture-independent virtual memory access patterns that it uses to build memory reuse distance distribution models for each basic block, and (iii) runs detailed basic-block level simulations to determine hardware pipeline usage. PPT-AMMP uses machine learning and regression techniques to build the prediction models based on small instances of the input code, then integrates into a higher-order discrete-event simulation model of PPT running on Simian PDES engine. We validate PPT-AMMP on four standard computational physics benchmarks and present a use case of hardware parameter sensitivity analysis to identify bottleneck hardware resources on different code inputs. We further extend PPT-AMMP to predict the performance of a scientific application code, namely, the radiation transport mini-app SNAP. To this end, we analyze multi-variate regression models that accurately predict the reuse profiles and the basic block counts. We validate predicted SNAP runtimes against actual measured times.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

The Completion of Surrogate Testing for Low-Temperature TEX and a Look Towards the Future

To address the mounting need for below room temperature nuclear data validation, the Low-Temperature Thermal Epithermal eXperiments (LT-TEX) have been designed. Validation of low-temperature neutron cross sections is necessary to verify any operation at temperatures below room temperature which is typically observed in environments far from the equator. For example, a fissile material transportation truck may routinely observe ambient temperatures down to -40°C, which is the lower temperature bound of the normal conditions of transportation defined in the United States Title 10 Code of Federal Regulations §71.71c2. Additionally, sub-room temperature benchmarks can validate newly produced cross sections, that include novel thermal scattering laws, from North Carolina State University.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2025

A Look Towards the Execution of the Low-Temperature TEX Experimental Campaign

To address the mounting need for below roomtemperature nuclear data validation, the Low-Temperature Thermal Epithermal eXperiments (LT-TEX) have been designed. Validation of low-temperature neutron cross sections is necessary to verify any operation at temperatures below room temperature which is typically observed in environments far from the equator. For example, a fissile material transportation truck may routinely observe ambient temperatures down to -40°C, which is the lower temperature bound of the normal conditions of transportation defined in the United States Title 10 Code of Federal Regulations §71.71c2. Additionally, sub-room temperature benchmarks can validate newly produced cross sections, that include novel thermal scattering laws, from North Carolina State University.

LT-TEX↗

DOE OSTI2023

Nuclear Criticality Safety Integral Experiment Covariance Determination

Integral benchmarks for criticality safety and nuclear data validation require expensive uncertainty quantification studies. Commonly, the uncertainty quantification ignores correlations between experiments that share components. Experiments such as the TEX (Thermal/Epithermal eXperiments) campaigns consist of many shared parts between experiments, such as fuel, which creates a strong correlation in their errors. While these correlations are known to exist, they are often not estimated due to the complexity of such calculations. This paper describes a software package that uses an intuitive method of determining the covariance for each of the experimental components, providing a correlation matrix for each family of parts across the multiple cases examined within a benchmark. The code uses the TEX-HEU campaign as a proof of concept, and we show that the correlations can be calculated with information commonly found in ICSBEP (International Criticality Safety Benchmark Evaluation Project) benchmarks. The estimated covariances are used in χ 2 trending studies to evaluate their impact on nuclear data validation. The covariance determination code can be easily integrated into current benchmark evaluations as well as reevaluating legacy benchmark uncertainties. Uncertainty correlation calculations should become the baseline for criticality safety integral experiment benchmarks and can now be easily calculated with the described software package.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

Code for paper "Reconstructing an Implosion with Space-Time Smoothing of Velocimetry Traces"

New diagnostics to obtain high-temporal resolution observation of surface velocity provide a rich collection of data from high-explosive (HE) experiments. Using this data to estimate the temporal evolution of an imploding, HE-driven surface is of great interest for validating simulation of the physical system and for design of future experiments. This is the code for a paper in which we propose a method for using a Gaussian process to estimate the surface position over time and provide uncertainty estimates on that reconstruction accounting for measurement error, uncertainty to sparse spatial sampling velocity data, and robustness to outlying observations. In the paper, the code is applied on data from a hemispherical HE implosion experiment. This code is for release with the paper for peer-review, replicating the results and making the figures from the paper.

Grosskopf, Michael↗

NASA NTRS1990

Numerical study of shock-wave/boundary layer interactions in premixed hydrogen-air hypersonic flows

A computational study of shock wave/boundary layer interactions involving premixed combustible gases, and the resulting combustion processes is presented. The analysis is carried out using a new fully implicit, total variation diminishing (TVD) code developed for solving the fully coupled Reynolds-averaged Navier-Stokes equations and species continuity equations in an efficient manner. To accelerate the convergence of the basic iterative procedure, this code is combined with vector extrapolation methods. The chemical nonequilibrium processes are simulated by means of a finite-rate chemistry model for hydrogen-air combustion. Several validation test cases are presented and the results compared with experimental data or with other computational results. The code is then applied to study shock wave/boundary layer interactions in a ram accelerator configuration. Results indicate a new combustion mechanism in which a shock wave induces combustion in the boundary layer, which then propagates outwards and downstream. At higher Mach numbers, spontaneous ignition in part of the boundary layer is observed, which eventually extends along the entire boundary layer at still higher values of the Mach number.

Yungster, Shaye↗

NASA NTRS1991

Numerical study of shock-wave/boundary layer interactions in premixed hydrogen-air hypersonic flows

A computational study of shock wave/boundary layer interactions involving premixed combustible gases, and the resulting combustion processes is presented. The analysis is carried out using a new fully implicit, total variation diminishing (TVD) code developed for solving the fully coupled Reynolds-averaged Navier-Stokes equations and species continuity equations in an efficient manner. To accelerate the convergence of the basic iterative procedure, this code is combined with vector extrapolation methods. The chemical nonequilibrium processes are simulated by means of a finite-rate chemistry model for hydrogen-air combustion. Several validation test cases are presented and the results compared with experimental data or with other computational results. The code is then applied to study shock wave/boundary layer interactions in a ram accelerator configuration. Results indicate a new combustion mechanism in which a shock wave induces combustion in the boundary layer, which then propagates outwards and downstream. At higher Mach numbers, spontaneous ignition in part of the boundary layer is observed, which eventually extends along the entire boundary layer at still higher values of the Mach number.

Yungster, Shaye↗

DOE OSTI2020

Do Programmers Prefer Predictable Expressions in Code?

Source code is a form of human communication, albeit one where the information shared between the programmers reading and writing the code is constrained by the requirement that the code executes correctly. Programming languages are more syntactically constrained than natural languages, but they are also very expressive, allowing a great many different ways to express even very simple computations. Still, code written by developers is highly predictable, and many programming tools have taken advantage of this phenomenon, relying on language model surprisal as a guiding mechanism. Additionally, while surprisal has been validated as a measure of cognitive load in natural language, its relation to human cognitive processes in code is still poorly understood. In this paper, we explore the relationship between surprisal and programmer preference at a small granularity—do programmers prefer more predictable expressions in code? Using meaning-preserving transformations, we produce equivalent alternatives to developer-written code expressions and run a corpus study on Java and Python projects. In general, language models rate the code expressions developers choose to write as more predictable than these transformed alternatives. Then, we perform two human subject studies asking participants to choose between two equivalent snippets of Java code with different surprisal scores (one original and transformed). We find that programmers do prefer more predictable variants, and that stronger language models like the transformer align more often and more consistently with these preferences.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2007

Statistical Analysis of CFD Solutions from the Third AIAA Drag Prediction Workshop

The first AIAA Drag Prediction Workshop, held in June 2001, evaluated the results from an extensive N-version test of a collection of Reynolds-Averaged Navier-Stokes CFD codes. The code-to-code scatter was more than an order of magnitude larger than desired for design and experimental validation of cruise conditions for a subsonic transport configuration. The second AIAA Drag Prediction Workshop, held in June 2003, emphasized the determination of installed pylon-nacelle drag increments and grid refinement studies. The code-to-code scatter was significantly reduced compared to the first DPW, but still larger than desired. However, grid refinement studies showed no significant improvement in code-to-code scatter with increasing grid refinement. The third Drag Prediction Workshop focused on the determination of installed side-of-body fairing drag increments and grid refinement studies for clean attached flow on wing alone configurations and for separated flow on the DLR-F6 subsonic transport model. This work evaluated the effect of grid refinement on the code-to-code scatter for the clean attached flow test cases and the separated flow test cases.

Statistical analysis↗

NASA NTRS2007

Statistical Analysis of the AIAA Drag Prediction Workshop CFD Solutions

The first AIAA Drag Prediction Workshop (DPW), held in June 2001, evaluated the results from an extensive N-version test of a collection of Reynolds-Averaged Navier-Stokes CFD codes. The code-to-code scatter was more than an order of magnitude larger than desired for design and experimental validation of cruise conditions for a subsonic transport configuration. The second AIAA Drag Prediction Workshop, held in June 2003, emphasized the determination of installed pylon-nacelle drag increments and grid refinement studies. The code-to-code scatter was significantly reduced compared to the first DPW, but still larger than desired. However, grid refinement studies showed no significant improvement in code-to-code scatter with increasing grid refinement. The third AIAA Drag Prediction Workshop, held in June 2006, focused on the determination of installed side-of-body fairing drag increments and grid refinement studies for clean attached flow on wing alone configurations and for separated flow on the DLR-F6 subsonic transport model. This report compares the transonic cruise prediction results of the second and third workshops using statistical analysis.

Joseph H Morrison↗

NASA NTRS1996

Application of the kappa-omega Turbulence Model to Quasi-Three-Dimensional Turbomachinery Flows

Many computational fluid dynamics codes for turbomachinery use the Baldwin-Lomax (B-L) turbulence model. It is easy to implement in two dimensions and works well for predicting overall turbomachinery performance. However, it is awkward to implement in three dimensions, often has difficulty finding the length scale, has a crude transition model, and neglects freestream turbulence, surface roughness, and mass injection. The kappa-omega model developed by Wilcox is an appealing alternative for several reasons. First, it is the only two-equation model that can be integrated to the wall without requiring damping functions or the distance to the wall, and hence, should behave well numerically. Second, the effects of freestream turbulence, surface roughness, and mass injection are easily included in the model. Finally, transition can be simulated using the low Reynolds number version of the model. Menter applied the kappa-model to external flows and showed very good results for flows with adverse pressure gradients. Liu and Zheng described their implementation of the kappa-model in a cascade code that included an area change term to account for endwall convergence. They validated the model for a flat plate, and compared the B-L and kappa-models to measured surface pressures for a low-pressure turbine cascade. Since they did not use the low Reynolds number version of the model, their results showed problems resulting from early transition. In this Note the low Reynolds number kappa-model was incorporated in the author's quasi-three-dimensional turbomachinery analysis code. The code includes the effects of rotation, radius change, and stream-surface thickness variation, and also includes the B-L turbulence model. The kappa-omega model was implemented using many of Menter's recommendations and an implicit approximate-factorization scheme described by Baldwin and Barth. The model was tested for a transonic compressor with rotation and variable stream-surface radius and height, and for a transonic turbine vane with transition and heat transfer. Results were compared to the B-L model and to experimental data.

Chima, Rodrick V.↗