Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “code validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Design and execution of a verification, validation, and uncertainty quantification plan for a numerical model of left ventricular flow after LVAD implantation

Left ventricular assist devices (LVADs) are implantable pumps that act as a life support therapy for patients with severe heart failure. Despite improving the survival rate, LVAD therapy can carry major complications. Particularly, the flow distortion introduced by the LVAD in the left ventricle (LV) may induce thrombus formation. While previous works have used numerical models to study the impact of multiple variables in the intra-LV stagnation regions, a comprehensive validation analysis has never been executed. The main goal of this work is to present a model of the LV-LVAD system and to design and follow a verification, validation and uncertainty quantification (VVUQ) plan based on the ASME V&V40 and V&V20 standards to ensure credible predictions. The experiment used to validate the simulation is the SDSU cardiac simulator, a bench mock-up of the cardiovascular system that allows mimicking multiple operation conditions for the heart-LVAD system. The numerical model is based on Alya, the BSC’s in-house platform for numerical modelling. Alya solves the Navier-Stokes equation with an Arbitrary Lagrangian-Eulerian (ALE) formulation in a deformable ventricle and includes pressure-driven valves, a 0D Windkessel model for the arterial output and a LVAD boundary condition modeled through a dynamic pressure-flow performance curve. The designed VVUQ plan involves: (a) a risk analysis and the associated credibility goals; (b) a verification stage to ensure correctness in the numerical solution procedure; (c) a sensitivity analysis to quantify the impact of the inputs on the four quantities of interest (QoIs) (average aortic root flow $Q^{avg}_{Ao}$, maximum aortic root flow $Q^{max}_{Ao}$, average LVAD flow $Q^{avg}_{VAD}$, and maximum LVAD flow $Q^{max}_{VAD}$; (d) an uncertainty quantification using six validation experiments that include extreme operating conditions. Numerical code verification tests ensured correctness of the solution procedure and numerical calculation verification showed a grid convergence index (GCI)95% <3.3%. The total Sobol indices obtained during the sensitivity analysis demonstrated that the ejection fraction, the heart rate, and the pump performance curve coefficients are the most impactful inputs for the analysed QoIs. The Minkowski norm is used as validation metric for the uncertainty quantification. It shows that the midpoint cases have more accurate results when compared to the extreme cases. The total computational cost of the simulations was above 100 [core-years] executed in around three weeks time span in Marenostrum IV supercomputer. This work details a novel numerical model for the LV-LVAD system, that is supported by the design and execution of a VVUQ plan created following recognised international standards. We present a methodology demonstrating that stringent VVUQ according to ASME standards is feasible but computationally expensive.

59 BASIC BIOLOGICAL SCIENCES↗

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

Buffer-IPyC separation process in TRISO fuel particles simulated with Bison code

During High Temperature Gas-cooled Reactor (HTGR) operation, tristructural isotropic (TRISO) coated-particle fuel undergoes irradiation-induced changes in morphology and thermomechanical properties. Experimental results from the Advanced Gas Reactor (AGR) Fuel Development and Qualification Program show, among other things, the mechanism of gap formation between the buffer and inner pyrolytic carbon (IPyC) layers, which could be explored further via computational simulations using the Bison code. Two simulation models were developed, the debonding restricted model, where no gap formation between buffer and IPyC layers is permitted, and the debonding enabled model, where the gap between those layers is created. The inputs of the simulated models are based on the irradiation conditions from the AGR-1 experiment. The research included simulations on spherical and aspherical fuel types. Under the specific temperatures and fluences of the AGR-1 irradiation experiment, and the Bison simulations, it was concluded that the most common scenario is a gap formation along the buffer-IPyC interface, while the least possible scenario is the situation where there is no gap formation at the buffer-IPyC junction. The computational results confirmed that the sphericity of the fuel influences the thickness of the gap that occurs at the buffer-IPyC junction, in a way that with increasing aspect ratio the gap thickness increases. The results obtained for spherical and aspherical fuel are nearly identical. Finally, performed simulations match conclusions observed from the AGR-1 experiment, which as such shows that the Bison code is a good computational method for simulating the TRISO fuel. Future simulations will include the validation of performed research and comparison of the results between Bison and PARFUME codes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A thermodynamics-based damage model for the non-linear mechanical behavior of SiC/SiC ceramic matrix composites in irradiation and thermal environments

A damage model is developed and validated with experimental data for the non-linear mechanical behavior of SiC/SiC composite materials in nuclear applications. Cyclic thermal and mechanical loading associated with neutron irradiation effects of these composites leads to wide-spread and progressive micro-cracking that leads to loss of thermal conductivity and further enhancement of thermo-mechanical damage. A physics-based model of wide-spread micro-cracking is developed within the thermodynamic framework of continuum damage mechanics. Evolution equations for damage parameters that describe the growth of continuum damage are developed, where the material variables are obtained from experiments. The model novelty is in coupling mechanical, thermal, and irradiation damage through a consistent thermodynamic framework, including loss of thermal conductivity due to the evolution of mechanically induced micro-cracks. A number of thermo-mechanical experiments were conducted to confirm model assumptions. The model is shown to be validated with out-of-pile experiments, and then implemented using commercial finite element code COMSOL to the fuel cladding problem with normal and high radiation dose cases.

Materials Science↗

Addition of tabulated equation of state and neutrino leakage support to illinoisgrmhd

Here we have added support for realistic, microphysical, finite-temperature equations of state (EOS) and neutrino physics via a leakage scheme to illinoisgrmhd, an open-source GRMHD code for dynamical spacetimes in the einstein toolkit. These new features are provided by two new, nrpy+-based codes: nrpyeos, which performs highly efficient EOS table lookups and interpolations, and nrpyleakage, which implements a new, adaptive mesh refinement (AMR)-capable neutrino leakage scheme in the einstein toolkit. We have performed a series of strenuous validation tests that demonstrate the robustness of these new codes, particularly on the Cartesian AMR grids provided by carpet. Furthermore, we show results from fully dynamical GRMHD simulations of single unmagnetized neutron stars, and magnetized binary neutron star mergers. This new version of illinoisgrmhd, as well as nrpyeos and nrpyleakage, is pedagogically documented in jupyter notebooks and fully open source. The codes will be proposed for inclusion in an upcoming version of the einstein toolkit.

79 ASTRONOMY AND ASTROPHYSICS↗

Verification and Validation of Open-Source Computational Fluid Dynamics Capabilities in MOOSE

The Multiphysics Object Oriented Simulation Environment (MOOSE) advances predictive modeling in nuclear research by simplifying the application design process and making modeling more efficient and accessible to researchers and the broader community. Because of MOOSE’s critical role in the scientific computation field, verification and validation are important to evaluate the reliability and credibility of MOOSE’s code, simulations, and models. To assess MOOSE’s Navier Stokes module and turbulence models, the following verification and validation University of Manchester ERCOFTAC cases were simulated in MOOSE, and the results were compared: Case 032 Turbulent Flow in a 2D Channel Case 079 Natural Convection in an Enclosed Cavity

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

BISON fuel performance modeling optimization for experiment X447 and X447A using axial swelling and cladding strain measurements

With the recent need to qualify new reactor designs such as the Versatile Test Reactor (VTR), fuel performance calculations need to be performed to determine safety criteria of the proposed designs. In order to validate the fuel performance results obtained by a fuel performance code, BISON, for new reactor designs, legacy fuel from EBR-II and FFTF MFF with Post -Irradiation Examination (PIE) data need to be used as validation cases to benchmark models. Here in this work, BISON has been paired with the Fuels Irradiation & Physics Database (FIPD) and IFR Materials Information System (IMIS) to supply PIE data for comparison with simulations of EBR-II experiments X447/X447A. X447/X447A were assessed by implementing models for Fuel Cladding Chemical Interaction (FCCI) within BISON and optimizing the friction coefficient between the fuel surface and the cladding, the anisotropic swelling factor, and the HT9 first thermal creep scalar (which scales the first term in the HT9 creep equation) to best match the PIE axial fuel swelling height and cladding profilometry for all pins in X447/X447A. The optimal values were found using a generic algorithm developed to select different values for the three parameters until end criteria was met and error couldn’t be reduced further. The BISON-simulated cladding profilometry was evaluated using Standard Error of the Estimate (SEE) to account for the profile shape of the cladding profilometry. Optimal values for the friction coefficient, anisotropic fuel swelling factor, and HT9 first thermal creep scalar were found to best fit the BISON simulation results to the PIE measurements found in IMIS and FIPD. Improvements to current models are suggested to account for the underprediction of fuel swelling at low burnups and the overprediction of fuel swelling at higher burnups observed for the axial fuel swelling height. Although two pins in EBR-II X447/X447A (DP70 and DP75) were known to fail due to FCCI, none of the pins simulated in BISON reached a cumulative damage fraction (CDF) above 0.008 with FCCI correlations coupled in the BISON simulations. The error estimate generated for all pins in X447/X447A using optimal values was 209 µm, which is deemed acceptable.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

High-fidelity wind farm simulation methodology with experimental validation

The complexity and associated uncertainties involved with atmospheric-turbine-wake interactions produce challenges for accurate wind farm predictions of generator power and other important quantities of interest (QoIs), even with state-of-the-art high-fidelity atmospheric and turbine models. A comprehensive computational study was undertaken with consideration of simulation methodology, parameter selection, and mesh refinement on atmospheric, turbine, and wake QoIs to identify capability gaps in the validation process. For neutral atmospheric boundary layer conditions, the massively parallel large eddy simulation (LES) code Nalu-Wind was used to produce high-fidelity computations for experimental validation using high-quality meteorological, turbine, and wake measurement data collected at the Department of Energy/Sandia National Laboratories Scaled Wind Farm Technology (SWiFT) facility located at Texas Tech University’s National Wind Institute. The wake analysis showed the simulated lidar model implemented in Nalu-Wind was successful at capturing wake profile trends observed in the experimental lidar data.

17 WIND ENERGY↗

Heat Pipe Cooled Microreactors

Microreactor technologies are required to provide reliable carbon-free power generation in remote applications. The heat pipe cooled microreactor concept in particular offers notable advantages due to the passive operation of heat pipes enabling increased reliability and simplicity in a more compact form factor. There is a significant need for experimental work to aid and expedite the deployment of heat pipe microreactors due to their unique technological characteristics. Thus, there has been increased interest in heat pipe experiments by numerous institutions in order to support these efforts. The present work is a comprehensive review of heat pipe experiments, describing instrumentation, methods, phenomena of interest, and recent developments. In addition, legacy work on the operation of high-temperature heat pipes under irradiation is reviewed and discussed. Furthermore, the verification and validation efforts for the flagship heat pipe simulation code Sockeye are reviewed and requirements for future experiments are outlined. Lastly, future directions are proposed for heat pipe experimentation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Comparing Numerical Models of the TALOS Wave Energy Converter

In this study, we present the development of a numerical model of the TALOS Wave Energy Converter (WEC) in WEC-Sim and compare it with existing numerical in-house models from Lancaster and results from DNV's Sesam code. The objective of this work is to validate the performance of the TALOS WEC using WEC-Sim and compare the results with those obtained from other numerical models. The TALOS WEC is a promising technology for the generation of clean, renewable energy from ocean waves. The development of a reliable numerical model for the TALOS WEC is crucial for its design and optimization. To achieve this, we have implemented the TALOS WEC in WEC-Sim and compared the results to in-house models from Lancaster and to results from DNV's Sesam code. Our results show good agreement with the results from Lancaster and DNV, demonstrating the accuracy and reliability of the numerical model developed in WEC-Sim. This work advances the field of wave energy conversion by providing a verified numerical model of the TALOS WEC, which can be used for further optimization and design studies.

CFD↗

Flow instabilities in helical-coil steam generators for small modular reactors: A review

Here, this study covers the research and discoveries in two-phase flow-boiling instabilities available in the literature—specifically for a helical-coil steam generator (HCSG), including experimental findings, theoretical research, computational models, and system code analyses—supporting research and development of representative small modular reactors (SMRs). Like other new and advanced reactor systems, water-cooled SMRs require experimental data from both integral and separate thermal-hydraulics test facilities for the verification and validation (V&V) of the computational models and computer codes in order to design and obtain regulatory approval. The complex dynamics of two-phase flow-boiling instabilities includes flow regimes physics phenomena, flow-channel geometries, heat-transfer behavior, and interactions among the solid–liquid-gas within the system boundary, all of which are pivotal for understanding the design and operational challenges of SMRs. This study focuses on identifying the relevant knowledge gaps on boiling instabilities—specifically for a HCSG—and provides insights about future research direction optimizing the transport of thermal energy, mass-flow rates, and boundary conditions that ensure the adequate heat-transfer performance, operational stability, and safety associated with SMR systems.

20 FOSSIL-FUELED POWER PLANTS↗

Code-to-code comparison between FLASH and HYDRA in gas-puff Z-pinch modeling

The numerical modeling of gas-puff Z pinches involves the nonlinear coupling of a broad range of complex, multi-physics phenomena that makes such simulations challenging. The challenge is further compounded by nonlinear instabilities that can impact the dynamics of imploding gas-puff Z pinches, such as the magneto Rayleigh–Taylor instability (MRTI). If the growth rate and amplitude of the latter is comparable to the relevant timescales and properties of the imploding plasma, the MRTI can dramatically alter implosion dynamics, dictate pinch stability, and govern the plasma properties achievable in pulsed-power-driven laboratory experiments. National Laboratories and academic teams have developed numerical tools that can accurately model Z-pinch configurations and provide reliable design capabilities that can guide experimental choices and assist in interpreting experimental results. Most such tools, however, are not broadly available. Here, we present newly developed Z-pinch simulation capabilities of the publicly available FLASH code, applied in the study of MRTI growth and dynamical effects in gas-puff implosions. To verify the new implementations, we perform a comparison of FLASH gas-puff implosion simulations with previously published calculations with the HYDRA code from Lawrence Livermore National Laboratory, which have been validated with experimental data from the CESZAR pulsed-power driver at the University of California, San Diego. The experiments involved double- and triple-nozzle configurations, in an experimental attempt to stabilize the pinch to the MRTI. The code-to-code comparison shows similar results between the FLASH and HYDRA simulations, supporting the use of FLASH in the modeling of future gas-puff Z-pinch experiments at CESZAR.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Modeling of gap conductance for LWR fuel rods applied in the BISON code

A new gap conductance model is proposed in this study as a combination of Toptan’s model and the Ross-Stoute model. A variance-based sensitivity analysis is performed to understand how simulation results depend on all input parameters of the proposed model. Additionally, new modeling options (e.g. fill gas thermal conductivity, temperature jump distance, thermal accommodation coefficient, etc.) are added into the nuclear fuel performance code, BISON. The need for further investigation of the gap heat transfer between fuel and cladding in BISON motivated this study to evaluate its impact on the code’s predictions. New gap conductance modeling is proposed. A series of integral-effects validation tests is performed: (1) to demonstrate the impact of the proposed model on the code’s fuel temperature predictions at the beginning of life and through the reactor’s life; (2) to ensure that the proposed model is capable of accurately modeling gap heat transfer characteristics in real-world problems; and (3) to investigate the impact of the estimation of fission gas release on the fuel temperature predictions with the proposed model. Overall, the results indicate that the proposed gap conductance model improves BISON’s predictions.

42 ENGINEERING↗

Enhanced Models for the Simulation of Two-Phase Boiling Flow and Critical Heat Flux with the STAR-CCM+ and NEK-2P CFD Codes: Executive Summary (Final Report)

The goal of the project was to develop, verify and validate an advanced two-phase boiling flow modeling capability that enhances the existing two-phase flow modeling of the STAR-CCM+ Computational Fluid Dynamics (CFD) code. The project focused on the simulation of two phase flow and heat transfer phenomena that occur in Boiling Water Reactor (BWR) and Pressurized Water Reactor (PWR) fuel bundles under various operating conditions. The extended STAR-CCM+ two-phase flow models implemented during the project follow the approach similar to the Extended Boiling Framework [1-6] previously developed at Argonne but include more fundamental physical models of boiling phenomena. The development and validation of the extended two-phase models is supported by the U.S. DOE GAIN program and performed in collaboration with Framatome U.S. Inc.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Viscoelastic Modeling of Polymers in ALEGRA with the GAP Model

The Glassy Amorphous Polymer (GAP) model is a viscoelastic/plastic model developed at Los Alamos National Laboratory to accurately model a variety of polymers across a wide range of conditions and loading rates, including shock loading. In the present report we introduce and assess this model, newly implemented in the ALEGRA shock and multiphysics code, using a series of verification and application-related validation problems. We describe the mathematical and theoretical formulation of the model, as well as its implementation in ALEGRA, in detail. We provide verification results that assess the model implementation against published computational results, as well as validation results which we compare to existing experimental results when possible. These comparisons instill confidence in the implementation and indicate that the addition of the GAP model to the ALEGRA code provides users with a high-fidelity polymer modeling capability that is capable of recreating complex polymer phenomena.

36 MATERIALS SCIENCE↗

Analysis of the impact of parallel magnetic fluctuations on linear gyrokinetic stability in NSTX-U and verification of gyro-fluid models

In this work, we use the CGYRO gyrokinetic code to analyze two L- and one H-mode discharges from the National Spherical Torus Experiment (NSTX) and NSTX-Upgrade (NSTX-U) selected due to their different mix of ion-scale driftwaves, ion temperature gradient (ITG) mode and trapped electron mode (TEM), and electromagnetic instabilities, kinetic ballooning mode (KBM), and micro-tearing mode (MTM) in the plasma core. It is found that the effect of parallel magnetic fluctuations is strongly destabilizing to the unstable KBMs compared to calculations with only perpendicular magnetic fluctuations. Two discharges have a mix of ITG/TEM and MTMs that are predicted to be dominant instability across the plasma radius. The parallel magnetic fluctuations are found to have little effect on the MTM stability but are destabilizing to ITG/TEM modes. To test the validity of the gyro-fluid linear stability codes TGLF and GFS at low aspect ratio, a database of linear growth rates has been created using the CGYRO gyrokinetic code. The database is comprised of various parameter scans around a standardized set of NSTX-U core parameters. It contains a group of electrostatic cases and an electromagnetic group that includes the effects of perpendicular and parallel magnetic fluctuations. Comparing the results from the GFS and TGLF models, we find that GFS exhibits the best agreement with the database of CGYRO linear growth rates. Comparing the model results for the electromagnetic scans shows that GFS captures the effects of parallel magnetic fluctuations accurately, while the TGLF model does not, as it lacks sufficient perpendicular energy resolution.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Numerical relativity in spherical coordinates: A new dynamical spacetime and general relativistic MHD evolution framework for the Einstein Toolkit

We present SphericalNR, a new framework for the publicly available Einstein Toolkit that numerically solves the Einstein field equations coupled to the equations of general relativistic magnetohydrodynamic (GRMHD) in a 3+1 split of spacetime in spherical coordinates without symmetry assumptions. The spacetime evolution is performed using reference-metric versions of either the Baumgarte-Shapiro-Shibata-Nakamura equations or the fully covariant and conformal Z4 system with constraint damping. We have developed a reference-metric version of the Valencia formulation of GRMHD with a vector potential method, guaranteeing the absence of magnetic monopoles during the evolution. In our framework, every dynamical field (both spacetime and matter) is evolved using its components in an orthonormal basis with respect to the spherical reference metric. Furthermore, all geometric information about the spherical coordinate system is encoded in source terms appearing in the evolution equations. This allows for the straightforward extension of Cartesian high-resolution shock-capturing finite volume codes to use spherical coordinates with our framework. To this end, we have adapted GRHydro, a Cartesian finite volume GRMHD code already available in the Einstein Toolkit, to use spherical coordinates. We present the full evolution equations of the framework, as well as details of its implementation in the Einstein Toolkit. Finally, we validate SphericalNR by demonstrating it passes a variety of challenging code tests in static and dynamical spacetimes.

79 ASTRONOMY AND ASTROPHYSICS↗

Continued Validation Studies using the MOOSE Framework for Plasma Simulation with Electromagnetics

Resources and tools for the modeling and simulation of low-temperature plasma (LTP) discharges are increasingly vital to progress in the field in order to properly characterize and study complex source designs and plasma chemistries beyond the scope of traditional diagnostics. Open-source software provides powerful platforms for this work and can enable community-driven LTP R&D. Within the Multiphysics Object-Oriented Simulation Environment (MOOSE) open-source framework [1], capabilities have been demonstrated in the areas of plasma fluids (Zapdos [2]), plasma chemistry (CRANE [3]), and general electromagnetic wave theory (Electromagnetic Library for Kinetics & fluids [ELK] [4]). ELK has since been coupled to Zapdos/CRANE to enable fully coupled electromagnetic plasma simulations. This talk will detail the continued validation efforts and discuss Zapdos-ELK-CRANE code coupling with various-low temperature plasma sources. The impact of fully coupled electromagnetics on process parameters (e.g., temperature and electron/ion energy) versus an electrostatic description will also be discussed. [1] Permann et al., SoftwareX, 11 (2020) 100430. [2] Lindsay et al., J. Phys. D: Appl. Phys. 49 (2016) 235204. [3] Keniley et al., Talk, GEC Session DT3.00002 (2019). [4] Icenhour et al., Talk, GEC Session RR1.00006 (2019). Acknowledgements: INL Graduate Fellowship Program, NSF SI2 Grant 1740300, U.S. Dept. of Energy Office of Science Graduate Student Research Program

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗