Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

From Sim to Real: A Pipeline for Training and Deploying Traffic Smoothing Cruise Controllers

Designing and validating controllers for connected and automated vehicles to enhance traffic flow presents significant challenges, from the complexity of replicating real-world stop-and-go traffic dynamics in simulation, to the intricacies involved in transitioning from simulation to actual deployment. In this work, we present a full pipeline from data collection to controller deployment. Specifically, we collect 772 km of driving data from the I-24 in Tennessee, and use it to build a one-lane simulator, placing simulated vehicles behind real-world trajectories. Using policy-gradient methods with an asymmetric critic, we improve fuel efficiency by over 10% when simulating congested scenarios. Our comprehensive approach includes reinforcement learning for controller training, software verification, hardware validation and setup, and navigating various sim-to-real challenges. Furthermore, we analyze the controller's behavior and wave-smoothing properties, and deploy it on four Toyota Rav4’s in a real-world validation experiment on the I-24. Lastly, we release the driving dataset, the simulator and the trained controller, to enable future benchmarking and controller design.

42 ENGINEERING↗
DOE OSTI2022

Validation of NEAMS Tools Using MSRE Data

This report documents the benchmarks developed and performed for the tools and codes developed under the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program utilizing the MSRE experiment data. There are three focus areas explored in this work: fuel evolution, CFD, and system transient analyses. Fuel depletion is important for MSR reactor physics and fuel cycle analysis. Fuel depletion capability is currently being developed in the Griffin reactor physics code. To support this, a benchmark problem is developed using the MSRE data and an existing depletion code with flowing fuel analysis functionality (ADDER) to validate this new capability in Griffin. The ADDER calculation is compared with the TRITON-MSR results as well as the MSRE experimental data. This benchmark can be directly used to verify and validate the Griffin fuel depletion capability in future years. For CFD simulation, the MSRE CAD model is obtained from the Copenhagen Atomics and a mesh is generated for the MSRE inlet plenum. The Nek5000 code will be employed to find the flow distribution in the MSRE inlet plenum based on the mesh generated. For system analysis, a simple benchmark problem for three types of MSR system transients is developed. The SAM and SPECTRA codes are used to solve the simple problem, and the results from the two codes agree well. The SAM code is also employed to obtain the frequency response of the MSRE system at the 5 and 8 MWt power levels. The results agree well with the experiment measurements. These verification and validation efforts gives SAM users more confidence in MSR system transient simulations using SAM. Lastly, the SAM-Griffin Multiphysics coupling work is initiated. A simple one-way coupling of evaluating the precursor drift effect on the MSRE k-eff is demonstrated. This preliminary coupling work serves as the basis for future more complex Multiphysics simulation and modelling.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Evaluating Symmetry in 3-dimensional Simulation Data

The increasing use of three-dimensional simulations has led to an increased need for effective verification and validation, or V&V. Unfortunately, the high computational cost associated with three-dimensional simulations makes many standard V&V techniques cost-prohibitive. Given these circumstances, we must pay close attention to V&V metrics that can be evaluated using only a single simulation. One of the simplest of these metrics is the evaluation of physical symmetries. This report details a method of computing the deviation from symmetry in a three-dimensional dataset with an arbitrarily distributed mesh. Examples are presented for spherical and axisymmetric systems using the Paraview post-processing analysis workflow.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

An Analytic Benchmark for Neutron Boltzmann Transport with Downscattering—Part I: Flux and Eigenvalue Solutions

Computing in the energy dimension is one of the greatest challenges confronting present-day deterministic neutron transport solvers. Accurately resolving the neutron flux as neutrons downscatter across resonances in the nuclear cross sections currently requires considerable computing power and suffers from approximation errors. Flux uncertainty resulting from the uncertainty of the resonance structure is the single-largest cause of reactivity uncertainty. Any additional reference solution for the critical neutron downscattering problem with resonance phenomena would be a boon to verification and validation of neutronics codes. This paper establishes a benchmark to verify the accuracy of neutron transport criticality solvers along the energy dimension. For the first time, the analytic solution of the flux amplitude is derived in the particular case of an infinite homogeneous medium with isotropic scattering in the center of mass and an arbitrary number of no-threshold, neutral particle reaction resonances (e.g., radiative capture, fission, and resonance scattering). Furthermore, original analytic expressions are established to quantify the discrepancy between the ψ k (E) and ψ α (E) flux amplitudes, respective solutions of the multiplication factor k, or the exponential time-evolution frequency α eigenproblems. The physical study of these relations led to analysis of their first-order relative difference near the criticality condition α=0. Finally, numerical solutions are provided to a benchmark problem constituted of the first resonance of 239 Pu, the 6.67-eV resonance of 238 U, and a scattering isotope with a flat cross section, allowing for the computational verification of the energy resolution of current neutron transport criticality codes. Through these novel results, this analytic benchmark can serve as a reference to verify the energy resolution and sensitivity analysis of neutron transport criticality calculations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Involute Working Group – FSI Analysis of Fuel Plates Using Finite Volume and Finite Element Methods

The three involute plate research reactors RHF, HFIR, and FRM II have expressed an interest in using computational software to carry their steady-state safety analysis. Since these tools represent a significant departure from the methods used currently (one-dimensional), the acceptability of the new approach by regulators requires thorough verification and validation of these tools. Therefore, Argonne National Laboratory and the three involute-plate reactors formed an informal group called the Involute Working Group aiming at qualifying computational tools to perform steady-state safety analysis. The present report focuses on a comparison of finite volume and finite element methods to model solids in fluid-structure interaction problems with the goal to estimate the coolant flow-induced fuel plate deflections obtained with the two methods. The finite volume method will be obsoleted in STARCCM+ by the end of 2021, nevertheless, this evaluation is important because the method was used by ANL researchers to model the response of the fuel plates, despite its drawbacks, which are discussed in the report. It was essential to check how those estimates compare to the results obtained with the finite element method that is considered superior for structural analysis. Various geometries, i.e., flat, cylindrical and circle-involute fuel plates, as well as coolant flow speed, were considered. The comparison shows that, independently of the plate geometry, the finite volume method significantly underestimates the deflection as compared to finite element method for coarser meshes. When the discretization is developed as a result of a mesh sensitivity study using finite element method, the result obtained using finite volume method can be a few times smaller than the corresponding finite element method solution. A code-to-code comparison , between STAR-CCM+ and LS-DYNA was included in the analysis. Within the LS-DYNA models, two types of finite element formulations were used: solid and shell finite elements. Mesh sensitivity study showed that both approaches converge to a similar value that was obtained with STAR-CCM+ finite element solver. The evaluation of the computational solvers was extended by adding two benchmark cases from the STAR-CCM+ Verification Suite and presented in the Appendix A. The selected cases are: (1) bending of a cantilever beam under external load, and (2) cylindrical shell deformation analysis, known in the literature as ‘Scordelis-Lo roof’. The problems were solved with finite volume, and finite element methods, and the results confirmed the previously discussed findings. The analysis shows that the finite element solver is superior to the finite volume solver in terms of representation of model geometry and estimating the structural behavior of fuel plates. Depending on the ratio of the load to the flexibility of the plate, the finite volume solver can greatly under- or overestimate the structural response if a very carefully selected mesh is not used.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

ChatPORT: Fine-Tuned LLM for Easy Code {PORT}ing

Fine-tuning existing LLMs for specialized tasks has become a very attractive alternative due to its low cost and quick development cycle. With many pre-trained LLMs available, it is an increasingly complex task to choose the correct model as the starting point or base model. In this work we discuss ChatPORT - a specialized fine-tuned LLM geared towards providing correctly translated codes from one programming model to another. We evaluate a number of base models and compare and contrast their features and characteristics that make them a viable starting point. In this paper, we focus on the OpenMP offload porting capabilities of ChatPORT. We build our training data using kernels from the Heterogeneous Computing Benchmarks (HeCBench) [12] and the OpenMP Validation and Verification suite [5] to fine-tune the base models. We then test the model using unseen kernels extracted from the HeCBench benchmark suite. Our results show that: (1) not all open LLMs geared towards HPC are aware of programming models like OpenMP, (2) although all base models benefit from fine-tuning they learn differently and produce different correctness rates, (3) depending on the memory size and compute resource available, different base models can be used for fine-tuning without significantly affecting the quality of transpiled code they generate, (4) fine-tuning improved the correctness rate of the LLM by an average of 43.2%, and (5) feedback-based training data further increased the correctness rate by an average of 6% over the LLMs tested.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗
DOE OSTI2021

Microstructure-Based Estimation of Strength and Ductility Distributions for \(\alpha +\beta \) Titanium Alloys

Titanium alloys are processed to develop a wide range of microstructure configurations and therefore material properties. While these properties are typically measured experimentally, a framework for property prediction could greatly enhance alloy design and manufacturing. In this work, a microstructure-sensitive framework is presented for the prediction of strength and ductility as well as estimates of the bounds in variability for these properties. The framework explicitly considers distributions of microstructure via new approaches for instantiation of structure in synthetic samples. The parametric evaluation strategy, including the finite element simulation package FEpX, is used to create and test virtual polycrystalline samples to evaluate the variability bounds of mechanical properties in Ti-6Al-4V. Critical parameters for the property evaluation framework are provided by measurements of single crystal properties and advanced characterization of microstructure and slip system strengths in 2D and 3D. Property distributions for yield strength and ductility are presented, along with the validation and verification steps undertaken. Comparisons between strain localization and slip activity in virtual samples and in experimental grain-scale strain measurements are also discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Contact pressure analysis to allow improved design for the clearing plate in a biomass comminution system

For biomass processing systems, feedstocks with small but equal sizes can improve flowability and thermochemical outputs. The Crumbler rotary shear system was designed to achieve such ideal feedstocks to reduce costs and energy throughout the biomass supply chain. Improving the wear resistance of major components in this system is important to decrease the cost. Accelerating the feedstock flow through the rotary shear machine plays an equivalent role of improving its efficiency. An analytical analysis and a finite-element analysis of the stationary clearing plate are presented in this work. Here, these tools are used to investigate the effect of contact surface curvature on the impact pressure. The optimized new clearing plate design is expected to improve the component’s lifetime and wood chips flowability. The field tests confirm that the trend of the new clearing plate design guided by FEA. The optimization method, model verification, and validation experience applied in this work can also be applied to other static components with similar simple contact wear problems.

09 BIOMASS FUELS↗
DOE OSTI2020

SCALE capabilities for high temperature gas-cooled reactor analysis

The SCALE code system’s ability to address stochastic distributions of fuel particles within a graphite matrix has been revisited in both multigroup (MG) features and continuous-energy (CE) Monte Carlo methods. Furthermore, this paper describes current and emergent SCALE capabilities within the CSAS sequence to address double-heterogeneous systems and presents verification and validation studies of these methods and data. Good agreement was obtained for a high temperature gas-cooled reactor (HTGR) fuel pebble model between CSAS MG eigenvalue calculations and corresponding CE reference solutions. Code-to-code comparisons for this HTGR pebble model showed good agreement of CSAS-KENO and CSAS-Shift CE calculations and the Serpent and MCNP codes in terms of eigenvalues and reaction rate ratios. Validation studies based on two HTGR experiments resulted in good agreement between MG and CE results, as well as between experiment and calculation, although the level of agreement was significantly influenced by the applied ENDF/B nuclear data library.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Lattice physics calculations using the embedded self-shielding method in polaris, Part II: Benchmark assessment

Polaris is a 2D multigroup lattice physics capability in the SCALE code system used for the analysis of light water reactor fuel designs. In this work, verification and validation results of Polaris in SCALE 6.2 are presented. The SCALE/KENO continuous-energy Monte Carlo code is used as a reference to compare the results of more than 2,000 combinations of pressurized water reactor and boiling water reactor lattice designs and state points. Radiochemical assay measurements were also used to assess the accuracy of depletion calculations. Results show that Polaris, with ENDF/B-VII.1 cross section library, produces accurate lattice physics data for core simulators.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Analysis of ZPPR-15 experimental data for VTR software validation

As part of the Versatile Test Reactor (VTR) program, extensive validation work is being performed to demonstrate the fidelity of the Argonne Reactor Code (ARC) software package presently used for the core design studies. It is anticipated that this software will be also used for initial operations although additional software may be introduced at a later time to supplement or replace some components. The validation work was focused on accumulating reactor models that are consistent with the VTR and thus can be used to validate the accuracy of predictions made by the software used to design and operate the VTR. The U.S. does not have any active experimental facilities that can neutronically mockup the VTR core design. However, in the past, the U.S. had extensive experimental facilities for fast reactor neutronics. In that regard, the ZPPR-15 experiments carried out at ANL during the 1980s work best because the fuel form is closest to the VTR design, there is a considerable amount of processed data available for use, and existing staff are already familiar with the experimental machine and measurements. Because of previous collaborative work, many of the ZPPR-15 loadings of interest have already been processed into MCNP and preliminary ARC models, and a full uncertainty quantification has already been completed for many of the ZPPR-15 measurements. This manuscript covers the recent analysis work on the ZPPR-15 experiments and compares it with the experimental results. With respect to the ARC software components, this manuscript focuses on validation of the MC 2 , DIF3D and GAMSOR using the ZPPR-15 experimental data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Reproducible benchmark for the SNAP 8 experimental reactor at dry conditions

Here, this work provides fully reproducible benchmark models of the Systems for Nuclear Auxiliary Power (SNAP) 8 Experimental Reactor. Validation benchmarks of the criticality configuration experiments under dry conditions with no coolant are presented. In addition, relevant reactivity worth experiments, and measurement of power distributions are validated and presented here. Discrepancies between modeled and experimental results are at most 110 pcm for fuel and poison worths, and critical configurations that do not manipulate control elements are within 50 pcm. Larger discrepancies found in reflector element worth experiments are due to experimental methodology which was noted as being simplified due to limited calculational capabilities at the time, while discrepancy in the control element manipulated critical configuration is due the absence of structural components for modeling simplification. Power distributions closely follow what was observed in experiment with expected peaking in reflecting elements. All models are well documented with cited references describing and justifying assumptions, simplifications, and adjustments to reproduce the models with any nuclear safety codes; model inputs and outputs are stored in the snapReactors GitHub repository.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

Reproducible benchmark for the SNAP 8 experimental reactor at operating conditions

This work presents fully reproducible multiphysics benchmark models of the Systems for Nuclear Auxiliary Power (SNAP) 8 Experimental Reactor at operating conditions with coolant flow. Wet experiment (with coolant, at power) validation benchmarks are presented using both deterministic (Serpent-Griffin) and Monte-Carlo (OpenMC-Cardinal) multiphysics frameworks coupled with thermal-hydraulic solvers in MOOSE. Reactivity coefficient measurements including fuel temperature, isothermal temperature, and power coefficients show good agreement with experiments, with discrepancies within experimental uncertainty. Reactivity worth experiments for coolant, samarium, and xenon poisoning are reproduced with differences under 200 pcm. Comparison between Serpent-Griffin and OpenMC-Cardinal frameworks reveal multiphysics coupling introduces positive reactivity effects (100-200 pcm) compared to uniform temperature and density fields at nominal operating conditions. Comparison between Serpent-Griffin and reference Serpent solution shows that power distributions maintain consistent radial and axial peaking behavior. All models, assumptions, thermophysical and thermomechanical properties, and material definitions are thoroughly documented with cited references; model inputs and model generating scripts are stored in the snapReactors GitHub repository.

SNAP↗
DOE OSTI2023

Modular machine learning-based elastoplasticity: Generalization in the context of limited data

The development of highly accurate constitutive models for materials that undergo path-dependent processes continues to be a complex challenge in computational solid mechanics. Challenges arise both in considering the appropriate model assumptions and from the viewpoint of data availability, verification, and validation. Recently, data-driven modeling approaches have been proposed that aim to establish stress-evolution laws that avoid user-chosen functional forms by relying on machine learning representations and algorithms. However, these approaches not only require a significant amount of data but also need data that probes the full stress space with a variety of complex loading paths. Furthermore, they rarely enforce all necessary thermodynamic principles as hard constraints. Hence, they are in particular not suitable for low-data or limited-data regimes, where the first arises from the cost of obtaining the data and the latter from the experimental limitations of obtaining labeled data, which is commonly the case in engineering applications. In this work, we discuss a hybrid framework that can work on a variable amount of data by relying on the modularity of the elastoplasticity formulation where each component of the model can be chosen to be either a classical phenomenological or a data-driven model depending on the amount of available information and the complexity of the response. The method is tested on synthetic uniaxial data coming from simulations as well as cyclic experimental data for structural materials. The discovered material models are found to not only interpolate well but also allow for accurate extrapolation in a thermodynamically consistent manner far outside the domain of the training data. This ability to extrapolate from limited data was the main reason for the early and continued success of phenomenological models and the main shortcoming in machine learning-enabled constitutive modeling approaches. Training aspects and details of the implementation of these models into Finite Element simulations are discussed and analyzed.

42 ENGINEERING↗
DOE OSTI2024

A high-order explicit Runge-Kutta approximation technique for the shallow water equations

Here, we introduce a high-order space–time approximation of the Shallow Water Equations with sources that is invariant-domain preserving (IDP), well-balanced with respect to rest states, and employs a novel explicit Runge–Kutta (ERK) introduced in Ern and Guermond (SIAM J. Sci. Comput. 44(5), A3366–A3392, 2022) for systems of non-linear conservation equations. The resulting method is then numerically illustrated through verification and validation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Finite element procedure for thermomechanical and structural integrity analysis of beam intercepting devices subjected to free electron laser

High-energy particles, including photons (x-ray, γ-ray, bremsstrahlung), electrons, and protons, possess the capability to penetrate materials and deposit energy within them. The degree of absorption depends on both the energy and type of particles, as well as the properties of the materials with which they interact. This energy deposition can manifest either at the material's surface or throughout its volume, potentially resulting in various failure modes. The primary aim of this paper is to establish a structured analysis methodology for evaluating the structural integrity of beam-intercepting devices when subjected to high-energy particles. Here, the paper also reviews some of the underlying physics, pertinent to the scope of the thermomechanical analysis, potential failure modes, and introduces verification and validation methodologies. Engineers and researchers can utilize the guidelines presented in this paper to effectively plan the development of beam intercepting devices, thereby ensuring their reliability and performance in the presence of high-energy particle exposure.

Finite element analysis↗
DOE OSTI2023

Heat pump water heater enhanced with phase change materials thermal energy storage: Modeling study

A promising solution to improve the first hour rating (FHR) of a heat pump water heater (HPWH) involves employing a secondary tank which contains phase change material (PCM) capsules. To better understand the influence of PCM thermal storage on the HPWH operational performance, a dynamic model was developed to simulate and analyze the behavior of a newly developed HPWH technology that incorporates PCM storage into a standard HPWH to optimize key parameters such as the uniform energy factor and FHR. Mathematical models of several key components of the proposed HPWH-PCM integrated thermal energy storage (TES) system, e.g., water heater tank, PCM TES tank, evaporator, compressor, and expansion valve, have been elaborated. Also, a model-based control co-simulation platform was developed to integrate a embed PCM storage HPWH dynamic model with a control model for better supporting control design, analysis, verification, and validation. The model accuracy has been validated through comparing simulation results with lab test results, with a mean average percentage error of <5.5% for most of the selected performance variables. In addition, using the developed co-simulation platform, the demand response control strategy was studied to evaluate the load flexibility of the combined HPWH-PCM storage system by shifting system power usage to outside of the 3.5 h peak load period.

25 ENERGY STORAGE↗