SEARCH · Engineering Papers
Results for “Code Validation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Symmetry tuning of a near one-dimensional 2-shock platform for code validation at the National Ignition Facility
Here, we introduce a new quasi 1-D implosion experimental platform at the National Ignition Facility designed to validate physics models as well as to study various Inertial Confinement Fusion aspects such as implosion symmetry, convergence, hydrodynamic instabilities, and shock timing. The platform has been developed to maintain shell sphericity throughout the compression phase and produce a round hot core at stagnation. This platform utilizes a 2-shock 1 MJ pulse with 340 TW peak power in a near-vacuum AuHohlraum and a CH ablator capsule uniformly doped with 1% Si. We also performed several inflight radiography, symmetry capsule, and shock timing experiments in order to tune the symmetry of the capsule to near round throughout several epochs of the implosion. Finally, adjusting the relative powers of the inner and outer cones of beams has allowed us to control the drive at the poles and equator of the capsule, thus providing the mechanism to achieve a spherical capsule convergence. Details and results of the tuning experiments are described.
PIV Uncertainty Methodologies for CFD Code Validation at the MIR Facility
Currently, computational fluid dynamics (CFD) is widely used in the nuclear thermal hydraulics field for design and safety analyses. To validate CFD codes, high quality multi dimensional flow field data are essential. The Matched Index of Refraction (MIR) Flow Facility at Idaho National Laboratory has a unique capability to contribute to the development of validated CFD codes through the use of Particle Image Velocimetry (PIV). The significance of the MIR facility is that it permits non intrusive velocity measurement techniques, such as PIV, through complex models without requiring probes and other instrumentation that disturb the flow. At the heart of any PIV calculation is the cross-correlation, which is used to estimate the displacement of particles in some small part of the image over the time span between two images. This image displacement is indicated by the location of the largest peak. In the MIR facility, uncertainty quantification is a challenging task due to the use of optical measurement techniques. Currently, this study is developing a reliable method to analyze uncertainty and sensitivity of the measured data and develop a computer code to automatically analyze the uncertainty/sensitivity of the measured data. The main objective of this study is to develop a well established uncertainty quantification method for the MIR Flow Facility, which consists of many complicated uncertainty factors. In this study, the uncertainty sources are resolved in depth by categorizing them into uncertainties from the MIR flow loop and PIV system (including particle motion, image distortion, and data processing). Then, each uncertainty source is mathematically modeled or adequately defined. Finally, this study will provide a method and procedure to quantify the experimental uncertainty in the MIR Flow Facility with sample test results.
High-Temperature Gas-Cooled Reactors Multiphysics Simulation Demonstration and Code Validation
This study presents a comprehensive benchmarking and verification effort of several thermal-hydraulic and multiphysics capabilities for high-temperature gas-cooled reactor applications. The first part of this effort focuses on the running-in verification of Griffin’s multiphysics capabilities, specifically for simulating the evolution of pebble-bed reactor cores from startup to equilibrium. Since Fiscal Year 2024, improvements and enhancements have been implemented in Griffin, including simplifying the process to specify streamlines and developing the online cross-section generation capability. In the absence of validation data, code-to-code comparisons are conducted with kugelpy, showing good agreement for integral quantities like k-eff predictions and predictions for maximum power density. However, accuracy issues are noted for more detailed quantities like the spatial distribution of fission rate densities which will require further work to address. The second part of this report presents an improved System Analysis Module (SAM) core channel model where the effects of cross flow are considered during the pressurized loss of forced cooling transient, resulting in an improved agreement of the predicted pebble temperature with respect to the predictions from the SAM 2D porous media model. Additionally, the wall channeling effect due to variable porosity at the near wall region of the core is also investigated. Furthermore, to demonstrate Griffin’s online cross-section generation capability, a Multiphysics simulation is performed by coupling Griffin to the SAM core channel model. In the third part of the report, as a part of the Organisation for Economic Co-operation and Development/Nuclear Energy Agency (OECD/NEA) thermal-hydraulic code validation benchmark activity for a high-temperature gas-cooled reactor, the High Temperature Test Facility (HTTF) is investigated first using the NekRS computational fluid dynamics (CFD) code to study the flow mixing phenomenon in the lower plenum of the facility. Then, code-to-code and code-to-data comparisons are performed for Test PG27, which is a pressurized conduction cooldown (PCC) test, using five different codes by six organizations from five countries. The different simulations show good agreements in terms of the general trend but there are differences in some results such as the peak temperatures of different regions and heat removal rate.
Code validation of SAM using natural-circulation experimental data from the compact integral effects test (CIET) facility
The primary objective of this study is to validate the system analysis code, SAM, using experimental data from the Compact Integral Effects Test (CIET) experimental loop. SAM is a modern system analysis code being developed at Argonne National Laboratory for safety analysis of designs for advanced non-light water reactors (non-LWRs), such as sodium-cooled fast reactors, high-temperature gas-cooled reactors, and fluoride salt-cooled high-temperature reactors (FHRs). To support SAM code development for the wide range of non-LWR applications, it is of paramount importance to validate the code against experiments highly relevant to these reactor concepts. Additionally, the CIET facility, which was designed to reproduce the thermal-hydraulics response of FHRs under both forced- and natural-circulation conditions, has been identified and selected as one of the benchmark test facilities for SAM code validation. In this study, two sets of available CIET tests were selected for SAM code validation purposes, namely, power step change transient tests and steady-state natural-circulation tests. For all selected tests, SAM-predicted results show very good agreement with experimental data. The successful validation of SAM against these selected CIET experiments demonstrates that the computer code is well suited for thermal-hydraulics analysis of FHR designs.
SAM Code Validation using the Compact Integral Effects Test (CIET) Experimental Data
The primary objective of this study is to validate the system analysis code, SAM, using experimental data from the Compact Integral Effects Test (CIET) facility. The System Analysis Module (SAM) is an advanced and modern system analysis tool being developed at Argonne National Laboratory under the U.S. DOE Office of Nuclear Energy’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. Originally aiming at supporting sodium fast reactor (SFR) design, it is now extended to cover other non-light water reactor (non-LWR) concepts, such as high-temperature gas-cooled reactor (HTGR) designs, molten salt-fueled, and molten salt-cooled reactor designs. To support SAM code development for the wide range of non-LWR applications, it is of paramount importance to validate the code against experiments relevant to these reactor concepts. The Compact Integral Effects Test (CIET) facility, which was designed to reproduce the thermal-hydraulics response of fluoride salt-cooled high-temperature reactors (FHR) under both forced- and natural-circulation conditions, has been identified and selected as one of benchmark test facilities for SAM code validation. Among available CIET experiments, three sets of them with distinctive characteristics were selected for SAM code validation purpose. The three sets experiments are: 1) Power step change transient tests; 2) DHX-DRACS natural circulation tests; and 3) heater frequency response tests. For all tests, steady-state or transient, SAM-predicted results show very good agreement with experimental data. The successful validation of SAM against these selected CIET experiments demonstrates that the computer code is well suited for thermal-hydraulics analysis of FHR designs.
NEAMS Experimental Support for Code Validation, INL FY2009
The goal is for all modeling and simulation tools to be demonstrated accurate and reliable through a formal Verification and Validation (V&V) process, especially where such tools are to be used to establish safety margins and support regulatory compliance, or to design a system in a manner that reduces the role of expensive mockups and prototypes. Whereas the Verification part of the process does not rely on experiment, the Validation part, on the contrary, necessitates as many relevant and precise experimental data as possible to make sure the models reproduce reality as closely as possible. Hence, this report presents a limited selection of experimental data that could be used to validate the codes devoted mainly to Fast Neutron Reactor calculations in the US. Emphasis has been put on existing data for thermal-hydraulics, fuel and reactor physics. The principles of a new “smart” experiment that could be used to improve our knowledge of neutron cross-sections are presented as well. In short, it consists in irradiating a few milligrams of actinides and analyzing the results with Accelerator Mass Spectroscopy to infer the neutron cross-sections. Finally, the wealth of experimental data relevant to Fast Neutron Reactors in the US should not be taken for granted and efforts should be put on saving these 30-40 years old data and on making sure they are validation-worthy, i.e. that the experimental conditions and uncertainties are well documented.
SAM Code Validation on Frictional Pressure Drop through Pebble Beds
The System Analysis Module (SAM) is currently under development at Argonne National Laboratory as a modern system-level modeling and simulation tool for safety analyses of advanced non-light water reactors. This report presents a recent effort to validate the capability of SAM to predict the frictional pressure drop through pebble beds. Selected experimental data were used for code validation, including data from test facilities at Texas A&M University, Missouri University of Science and Technology, and North-West University of South Africa. SAM implements three empirical correlations to predict frictional pressure drop: the classical Ergun correlation; the KTA correlation, which is widely used in high-temperature gas-cooled reactor applications; and the Eisfeld and Schnitzlein correlation, which explicitly considers wall effect. Code validation was performed using all three correlations. For all selected experimental data, the KTA correlation shows the best performance and agrees very well with experimental measurement; the Eisfeld and Schnitzlein correlation, explicitly considering wall effects, shows acceptable accuracy, while there is no evidence that it is better than the KTA correlation; the Ergun correlation, however, over-predicts frictional pressure drop for most selected data points.
Consideration for the application of artificial neural networks to criticality code validation - 14270
The artificial neural network (ANN) is a consistent example for non-parametric parameter estimation and regression, with powerful universal approximation properties, that is distribution independent. ANN application to criticality code validation centers on aligning mathematical relationships between code validation parameters and neural network prediction for those parameter values. Two specific goals are: (1) an appropriate ANN architecture to determine validation parameter values, and (2) bootstrapping individual ANNs as a 'Prediction Interval' (PI) technique to estimate the Calculation Margin and Upper Subcritical Limit. The individual ANN workflow is segregated into Training, Validation (network), and Testing Sets, where the network predictive properties and performance are expressed in the latter set. The Bootstrap ANN replicates a large set of individual ANNs (taken from the original data distribution) where (1-α/2)100% PI estimates can be determined. Results from the ANN method are compared to a variety of validation examples: a 'toy example' from ANSI/ANS-8.24, Appendix D, a variety of methods noted in a Nuclear Criticality Safety Division 2009 paper, and several validation campaigns for highly enriched uranium and plutonium systems. The ANN method is robust and can be applied to single or multivariate inputs. A trained ANN can provide both an average estimate (e.g., single value) and an estimate over a range of independent variable values where the kUSL can be formed in a regression relationship suitable for extrapolation. The input dependence has been tested, ranging from 15 to over 400 sample size distributions. An expanded Shapiro-Wilk test (for sample sizes up to 5000) was implemented to confirm that the ANN method is transparent to distribution function. The Principle Component Analysis method was applied as an input preprocessing step embedded within the ANN in order to reduce dimensionality and correlation for multivariable inputs. This can potentially aid in determining accurate margins over applying arbitrary margins. The automatic optimization of the Bootstrap ANN PI is left for future consideration. (authors)
Examples of Use of SINBAD Database for Nuclear Data and Code Validation
Benchmark experiments can serve several purposes and the availability of suitable experimental data is fundamental to ensure that modelling tools meet the requirements of nuclear industry and licensing needs. Essentially, they are used for: - validation of nuclear cross-section data, - validation of nuclear codes and models used, - qualification and training of users through benchmarking and code comparison exercises. The Shielding Integral Benchmark Archive and Database (SINBAD) project was started in the early 1990's at the OECD Nuclear Energy Agency Data Bank (NEA DB) and the Radiation Safety Information Computational Center (RSICC) as a collection of quality experiments for validating and benchmarking computer codes and data for radiation transport and shielding applications. Currently, the SINBAD database comprises over 100 benchmark compilations and evaluations of relevance to: - reactor shielding, pressure vessel dosimetry (48); - fusion blanket neutronics (31); - accelerator shielding (23). In order to facilitate their use, the data are organized in the standardized format structure. The index and the master document (called abstract) use the Hyper Text Markup Language (HTML) format with links to text files, figures, Portable Document Format (pdf) documents and computer code inputs. The format allows easy access and forward/backward navigation among the data and has proved to be suitable, general enough and above all easy (and low-cost) to maintain. In addition to the characterization of the radiation source, description of the shielding set-up, the instrumentation and the relevant detector measurements, most sets in SINBAD contain also the deterministic or Monte Carlo radiation transport computer model used for the interpretation of the experiment and, where available, results from uncertainty analysis. The set of primary documents used for the benchmark compilation and evaluation are provided in computer readable form. The database is intended for different types of users, including nuclear data evaluators, computer code developers, experiment designers and university students. SINBAD is available from the NEA Data Bank and RSICC (see https://www.oecdnea.org/science/wprs/shielding/sinbad/). Up to now several hundreds of SINBAD packages were distributed from the NEA DB and RSICC. Since 2011 the maintenance and further development of the database is coordinated in the scope of the OECD NEA Nuclear Science Committee (NSC) Working Party on Scientific Issues of Reactor Systems (WPRS) Expert Group on Radiation Transport and Shielding (EGRTS). A key objective of the group is to identify, evaluate and preserve experimental data on shielding benchmarks. The Expert Group maintains close links with the International Reactor Physics Experiment Evaluation (IRPhE) and International Criticality Safety Benchmark Evaluation (ICSBEP) projects, as well as in co-ordination with the JEFF and EFF NEA Data Bank projects and with the SATIF community of accelerator shielding specialists. In the last years, much effort was devoted to the quality review of the available benchmark information.
Langmuir probe-based observables for plasma-turbulence code validation and application to the TORPEX basic plasma physics experiment
The methodology for plasma-turbulence code validation is discussed, with focus on the quantities to use for the simulation-experiment comparison, i.e., the validation observables, and application to the TORPEX basic plasma physics experiment [A. Fasoli et al., Phys. Plasmas 13, 055902 (2006)]. The considered validation observables are deduced from Langmuir probe measurements and are ordered into a primacy hierarchy, according to the number of model assumptions and to the combinations of measurements needed to form each of them. The lowest levels of the primacy hierarchy correspond to observables that require the lowest number of model assumptions and measurement combinations, such as the statistical and spectral properties of the ion saturation current time trace, while at the highest levels, quantities such as particle transport are considered. The comparison of the observables at the lowest levels in the hierarchy is more stringent than at the highest levels. Examples of the use of the proposed observables are applied to a specific TORPEX plasma configuration characterized by interchange-driven turbulence.
Methodology for turbulence code validation: Quantification of simulation-experiment agreement and application to the TORPEX experiment
A methodology for plasma turbulence code validation is discussed, focusing on quantitative assessment of the agreement between experiments and simulations. The present work extends the analysis carried out in a previous paper [P. Ricci et al., Phys. Plasmas 16, 055703 (2009)] where the validation observables were introduced. Here, it is discussed how to quantify the agreement between experiments and simulations with respect to each observable, how to define a metric to evaluate this agreement globally, and - finally - how to assess the quality of a validation procedure. The methodology is then applied to the simulation of the basic plasma physics experiment TORPEX [A. Fasoli et al., Phys. Plasmas 13, 055902 (2006)], considering both two-dimensional and three-dimensional simulation models.
Integral and Separate Effects Tests for Thermal Hydraulics Code Validation for Liquid-Salt Cooled Nuclear Reactors
The objective of the 3-year project was to collect integral effects test (IET) data to validate the RELAP5-3D code and other thermal hydraulics codes for use in predicting the transient thermal hydraulics response of liquid salt cooled reactor systems, including integral transient response for forced and natural circulation operation. The reference system for the project is a modular, 900-MWth Pebble Bed Advanced High Temperature Reactor (PB-AHTR), a specific type of Fluoride salt-cooled High temperature Reactor (FHR). Two experimental facilities were developed for thermal-hydraulic integral effects tests (IETs) and separate effects tests (SETs). The facilities use simulant fluids for the liquid fluoride salts, with very little distortion to the heat transfer and fluid dynamics behavior. The CIET Test Bay facility was designed, built, and operated. IET data for steady state and transient natural circulation was collected. SET data for convective heat transfer in pebble beds and straight channel geometries was collected. The facility continues to be operational and will be used for future experiments, and for component development. The CIET 2 facility is larger in scope, and its construction and operation has a longer timeline than the duration of this grant. The design for the CIET 2 facility has drawn heavily on the experience and data collected on the CIET Test Bay, and it was completed in parallel with operation of the CIET Test Bay. CIET 2 will demonstrate start-up and shut-down transients and control logic, in addition to LOFC and LOHS transients, and buoyant shut down rod operation during transients. Design of the CIET 2 Facility is complete, and engineering drawings have been submitted to an external vendor for outsourced quality controlled construction. CIET 2 construction and operation continue under another NEUP grant. IET data from both CIET facilities is to be used for validation of system codes used for FHR modeling, such as RELAP5-3D. A set of numerical models were developed in parallel to the experimental work. RELAP5-3D models were developed for the salt-cooled PB-AHTR, and for the simulat fluid CIET natural circulation experimental loop. These models are to be validated by the data collected from CIET. COMSOL finite element models were used to predict the temperature and fluid flow distribution in the annular pebble bed core; they were instrumental for design of SETs, and they can be used for code-to-code comparisons with RELAP5-3D. A number of other small SETs, and numerical models were constructed, as needed, in support of this work. The experiments were designed, constructed and performed to meet CAES quality assurance requirements for test planning, implementation, and documentation; equipment calibration and documentation, procurement document control; training and personnel qualification; analysis/modeling software verification and validation; data acquisition/collection and analysis; and peer review.
Guide to Using the WIND Toolkit Validation Code
In response to the U.S. Department of Energy's goal of using 20% wind energy by 2030, the Wind Integration National Dataset (WIND) Toolkit was created to provide information on wind speed, wind direction, temperature, surface air pressure, and air density on more than 126,000 locations across the United States from 2007 to 2013. The numerical weather prediction model output, gridded at 2-km and at a 5-minute resolution, was further converted to detail the wind power production time series of existing and potential wind facility sites. For users of the dataset it is important that the information presented in the WIND Toolkit is accurate and that errors are known, as then corrective steps can be taken. Therefore, we provide validation code written in R that will be made public to provide users with tools to validate data of their own locations. Validation is based on statistical analyses of wind speed, using error metrics such as bias, root-mean-square error, centered root-mean-square error, mean absolute error, and percent error. Plots of diurnal cycles, annual cycles, wind roses, histograms of wind speed, and quantile-quantile plots are created to visualize how well observational data compares to model data. Ideally, validation will confirm beneficial locations to utilize wind energy and encourage regional wind integration studies using the WIND Toolkit.
SMR safety through HTTF modeling and benchmark efforts for code validation for gas-cooled reactor applications
Accurate modeling and simulation tools for thermal-hydraulics calculations are a key element needed to design and license new advanced reactors including Small Modular Reactors (SMR) and Microreactors. Uncertainties in modeling and simulation can have significant safety and economic implications. The High Temperature Test Facility (HTTF) at Oregon State University (OSU) is a scaled integral effects experiment designed to investigate transient behavior in high-temperature gas-cooled prismatic-block nuclear reactors. High-quality measurement data is available from the HTTF that is suitable for a thermal-hydraulics code validation benchmark for gas-cooled reactor simulations. Here, this paper summarizes individual HTTF modeling efforts to date for tool validation at Idaho National Laboratory (INL), Argonne National Laboratory (ANL), Oregon State University (OSU) and Canadian Nuclear Laboratories (CNL) using system thermal-hydraulics codes, Computational Fluid Dynamics (CFD) codes and system-CFD code couplings. Also, the paper introduces the ongoing OECD Nuclear Energy Agency (NEA) High Temperature Gas Reactor Thermal-Hydraulics (HTGR T/H) benchmark that allows for better comparisons of results between different international modeling teams. The benchmark provides well defined computational problems that include code-to-code comparisons and comparisons to measured data. These problems provide an avenue for quantifying accuracy and identifying sources of uncertainty in thermal-hydraulics calculations, including in measured thermophysical properties, as part of validation for gas-cooled reactor simulation tools.
Validation study of sodium pool fire modeling efforts in $\mathrm{MELCOR}$ and $\mathrm{SPHINCS}$ codes
Discharge of sodium coolant into containment from a sodium-cooled fast reactor vessel can occur in the event of a pipe leak or break. In this situation, some of the liquid sodium droplets discharged from the coolant system will react with oxygen in the air before reaching the containment. This phase of the event is normally termed the sodium spray fire phase. Unreacted sodium droplets pool on the containment floor where continued reaction with containment atmospheric oxygen occurs. This phase of the event is normally termed the sodium pool fire phase. Both phases of these sodium-oxygen reactions (or fires) are important to model because of the heat addition and aerosol generation that occur. Any fission products trapped in the sodium coolant may also be released during this progression of events, which if released from containment could pose a health risk to workers and the public. The paper describes progress of an international collaborative research in the area of the sodium fire modeling in the sodium-cooled fast reactors between the United States and Japan under the framework of the Civil Nuclear Energy Research and Development Working Group. In this collaboration between Sandia National Laboratories and Japan Atomic Energy Agency, the validation basis for and modeling capabilities of sodium spray and pool fires in MELCOR of Sandia National Laboratories and SPHINCS of Japan Atomic Energy Agency are being enhanced. Here this study documents MELCOR and SPHINCS sodium pool fire model validation exercises against the JAEA’s sodium pool fire experiments, F7-1 and F7-2. The proposed enhancement of the sodium pool fire models in MELCOR through addition of thermal hydraulic and sodium spreading models that enable a better representation of experimental results is also described.
A Standardized Analysis Process Using Digital Image Correlation to Calculate In Situ Cladding Strain from Modified Burst Tests for Fuel Performance Code Validation
Historical data collection on nuclear fuel cladding materials has focused on generating a statistically significant amount of data to assess the material and its failure behavior. Furthermore, data generated to support material model and failure criteria development were previously posttest evaluations, so a large number of tests was required to gain new understanding. A way to expedite this process is to develop techniques capable of generating large, high-fidelity data sets from a single test with lower uncertainty or quantified uncertainty. One such example of this approach is Oak Ridge National Laboratory’s use of modified burst tests (MBTs) to analyze the mechanical behavior and failure conditions of cladding during a simulated reactivity-initiated accident (RIA). Each test incorporates digital image correlation (DIC) analysis techniques that are used to assess the accumulated strain in situ, as well as eventual cladding failure. This work has been fruitful in defining strain-to-failure conditions for materials like silicon carbide (SiC) fiber–reinforced/SiC matrix composite tubes (SiC/SiC), iron-chromium-aluminum (FeCrAl) alloy tubes, and chromium-coated Zircaloy-4 tubes. However, there are numerous DIC software available, including open-source and proprietary software. The different DIC software use various algorithms to process images and calculate displacement values. Using these different software and algorithms can lead to varying results, and perhaps larger-than-expected uncertainties. In the present study, previously published MBT data encompassing a variety of test conditions were reanalyzed with two different DIC software to assess the variance in the calculated strain results. The data consisted of SiC/SiC, FeCrAl, and chromium-coated Zircaloy-4 tubes. Plots of the calculated strains during the transient revealed good agreement between the two DIC software. The average root-mean-square errors between the two software was 0.20% strain, which is slightly larger than a previously reported error value for these tests. In conclusion, this variance in results is low enough that this analysis method can be used for code validation.
Validation and verification of MCNP6 against intermediate and high-energy experimental data and results by other codes
Abstract Not Provided