Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Benchmark Analysis

Tremendous progress has been achieved in the development of land models and their inclusion in Earth system models (ESMs). However, we still have very limited knowledge on the performance skills of these land models. This chapter introduces benchmark analysis, which is a procedure to measure performance of models against a set of defined standards. The benchmark analysis includes: (1) defining targeted aspects of model performance to be evaluated; (2) testing model performance in comparison with a set of benchmarks; (3) measuring model performance skill through quantitative metrics; and (4) evaluating model performance and offering suggestions for future model improvement.

Luo, Yiqi↗

Effect of Turbulence Models on Two Massively-Separated Benchmark Flow Cases

Two massively-separated flow cases (the 2-D hill and the 3-D Ahmed body) were computed with several different turbulence models in the Reynolds-averaged Navier-Stokes code CFL3D as part of participation in a turbulence modeling workshop held in Poitiers, France in October, 2002. Overall, results were disappointing, but were consistent with results from other RANS codes and other turbulence models at the workshop. For the 2-D hill case, those turbulence models that predicted separation location accurately ended up yielding a too-long separation extent downstream. The one model that predicted a shorter separation extent in better agreement with LES data did so only by coincidence: its prediction of earlier reattachment was due to a too-late prediction of the separation location. For the Ahmed body, two slant angles were computed, and CFD performed fairly well for one of the cases (the larger slant angle). Both turbulence models tested in this case were very similar to each other. For the smaller slant angle, CFD predicted massive separation, whereas the experiment showed reattachment about half-way down the center of the face. These test cases serve as reminders that state- of-the-art CFD is currently not a reliable predictor of massively-separated flow physics, and that further validation studies in this area would be beneficial.

Rumsey, Christopher L.↗

MULTIPHYSICS-MODELING OF FIRE-INDUCED URANIUM AEROSOL FORMATION – A-POSTERIORI BENCHMARKING OF EXPERIMENTS

The formulation and solution of a model that properly described the temperature profiles of uranium in fire conditions was prepared, verified and validated, to support a-posteriori benchmarking of historical experiments. Data from the multi-physics model combined with data regression from the experiments provides a useful tool for exploring sources of potential bias in historical experiments. The approaches used are augmented by visual observations and photographic evidence allowing for correlations between various phenomena, independent of whether or not that specific phenomena are part of the validated model. In this manner, the validated model is a tool for a-posteriori benchmarking, and not a model designed to replicate the experimental output exactly for any specific experiment. For experiments like the Clark (2015) experiments, this integrated model (including chemistry) demonstrated that the largest bias was associated in the metallurgy of the coupons. The model developed does serve as a basis for defending which of the historical alloys tested are the most appropriate for any other alloy being considered (e.g., one that has not yet been tested). The model identifies key reactions that impact uranium chemistry and can significantly bias experimental results. Through use of the model and energy balances, data from historical experiments by Elder and Tinkle (1980) were regressed and benchmarked. This study identifies that all uranium alloys are not equal and that there are distinct differences between the dominant alloys representing distinct metallurgical phases.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Benchmarking Monte Carlo codes for the modelling of low-energy neutron production target reactions

The increasing adoption of accelerator-based neutron sources (ABNS) for applications including neutron capture therapy (NCT) research has highlighted the need for accurate simulation tools. Precise modelling of the neutron production target is crucial to ensure that simulated predictions of neutron beam characteristics used for subsequent beam shaping assembly design are reliable. This work presents a comprehensive benchmarking of four widely-used Monte Carlo codes - Geant4, PHITS, FLUKA (CERN), and MCNP - for modelling low-energy neutron production target reactions. Using their recommended physics models and cross-section libraries, we evaluate each code’s performance in simulating four beam-target reactions: 7 Li(p,n) 7 Be, 9 Be(p,n) 9 B, 9 Be(d,n) 10 B, and C(d,n)N. Predictions of neutron yield, angular distributions, and energy spectra are compared against available thick target experimental data. Results show varying levels of agreement between the codes depending on the reaction type, energy range, and beam characteristics. Geant4, MCNP and PHITS are the overall best performing codes for the simulation of total neutron yield and yield in the forward direction across most reactions. Across energies where experimental benchmarks exist, inter-code discrepancies in total and forward-directed yield are typically 10 to 30%, with larger deviations at near-threshold incident ion energies. PHITS provides the best overall reproduction of experimental spectra, particularly for the 9 Be(p,n) 9 B reaction. Additionally, PHITS demonstrates superior computational performance for most reactions. These findings provide valuable guidance for ABNS design, highlighting the strengths and limitations of each code for the simulation of low-energy neutron production reactions.

43 PARTICLE ACCELERATORS↗

Reassessment of uncertainties for the PU-MET-INTER-002 benchmark - 14432

Uncertainty for the PU-MET-INTER-002 benchmark of ZPR-6/10 was unusually large for a ZPR assembly and was dominated by the uncertainties in matrix tube pitch and composition uncertainties for plutonium, graphite and stainless steel plates. The original uncertainty analysis for PU-MET-INTER-002 was limited by computer resources, software and the nuclear data available in 2002, all of which have been improved since. An as-built Monte Carlo model of ZPR-6/10 was used to quantify components of the transformation from the detailed model to a simplified RZ benchmark in 2002. Compositional uncertainties were estimated based upon TWODANT calculations of the RZ benchmark model (20 group, S{sub 8} - P{sub 1}). MC{sup 2}-2 was used with END/B-V.2 data to generate homogenized cross section data for TWODANT. The MC{sup 2}-2 calculations did not account for lattice cell spatial heterogeneity which was driven by the manual process required to generate ∼80 modifications to the deterministic model and by the software limitations of MC{sup 2}-2. Improvements to DIF3D-VARIANT, development of the MC{sup 2}-3 and BuildZPRModel codes, and better computer resources make accurate 3D transport calculations of reactivity changes practical today. BuildZPRModel imports the as-built geometry and creates a 'drawer' homogenized DIF3D model where each radial DIF3D mesh is the exact size of a single ZPR matrix tube and drawer. A MC{sup 2}-3 input is constructed for each drawer to produce homogenized cross section data where the spatial cell heterogeneity is captured by solving a 1D MOC transport calculation on the ultrafine energy group level. Collapsing 3D drawers into 1D MC{sup 2}-3 drawer models follows conventional procedures and is done by BuildZPRModel. MCNP6 was used to re-compute relevant geometry components of the uncertainty using ENDF/B-VII.0 data with the as-built model. Changes in the geometry components compared with earlier results are insignificant. DIF3D calculations of the compositional uncertainties were performed using 33, 70, 116, 230, 425, and 703 group energy structures and selectively combined with P{sub 3}-P{sub 7} transport approximations and P{sub 1} and P{sub 3} scattering kernels. 3D diffusion theory calculations were also performed for comparison. Many composition uncertainty components were essentially unchanged with the updated methodology. However, the dominant experimental uncertainty for PU-MET-INTER-002 is the composition of stainless steel. The new calculations reduce the stainless steel uncertainty from ∼115 pcm to ∼70 pcm which significantly reduces the total uncertainty for PU-MET-INTER-002. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Parameter Estimation of Actuators for Benchmark Active Control Technology (BACT) Wind Tunnel Model with Analysis of Wear and Aerodynamic Loading Effects

This report describes the development of transfer function models for the trailing-edge and upper and lower spoiler actuators of the Benchmark Active Control Technology (BACT) wind tunnel model for application to control system analysis and design. A simple nonlinear least-squares parameter estimation approach is applied to determine transfer function parameters from frequency response data. Unconstrained quasi-Newton minimization of weighted frequency response error was employed to estimate the transfer function parameters. An analysis of the behavior of the actuators over time to assess the effects of wear and aerodynamic load by using the transfer function models is also presented. The frequency responses indicate consistent actuator behavior throughout the wind tunnel test and only slight degradation in effectiveness due to aerodynamic hinge loading. The resulting actuator models have been used in design, analysis, and simulation of controllers for the BACT to successfully suppress flutter over a wide range of conditions.

Waszak, Martin R.↗

Leveraging observed soil heterotrophic respiration fluxes as a novel constraint on global-scale models

Microbially-explicit models may improve understanding and projections of carbon dynamics in response to future climate change, but their fidelity in simulating global-scale soil heterotrophic respiration (RH), a stringent test for soil biogeochemical models, has never been evaluated. We used statistical global RH products, as well as 7,821 daily site-scale RH measurements, to evaluate the spatio-temporal performance of one first-order decay model (CASA-CNP) and two microbially-explicit biogeochemical models (CORPSE and MIMICS) that were forced by two different climate datasets. CORPSE and MIMICS did not provide any measurable performance improvement; instead, the models were highly sensitive to the meteorological input data used to drive them. Spatial RH variability was generally well simulated except in the northern middle latitudes (~50°N) and arid regions; models captured the seasonal variability of RH well, but showed more divergence in tropic and arctic regions. Our results demonstrate that the next generation of biogeochemical models shows promise, but also needs to be improved for realistic spatio-temporal variability of RH. Finally, we emphasize the importance of net primary production, soil moisture, and soil temperature inputs, and that jointly evaluating soil models for their spatial (global scale) and temporal (site scale) performance provides crucial benchmarks for improving biogeochemical models.

Jian, Jinshi↗

SDI CFD MODELING ANALYSIS

The Savannah River Remediation (SRR) Organization requested that Savannah River National Laboratory (SRNL) develop a Computational Fluid Dynamics (CFD) method to mix and blend the miscible contents of the blend tanks to ensure the contents are properly blended before they are transferred from the blend tank; such as, Tank 50H, to the Salt Waste Processing Facility (SWPF) feed tank. The work described here consists of two modeling areas. They are the mixing modeling analysis during miscible liquid blending operation, and the flow pattern analysis during transfer operation of the blended liquid. The transient CFD governing equations consisting of three momentum equations, one mass balance, two turbulence transport equations for kinetic energy and dissipation rate, and one species transport were solved by an iterative technique until the species concentrations of tank fluid were in equilibrium. The steady-state flow solutions for the entire tank fluid were used for flow pattern analysis, for velocity scaling analysis, and the initial conditions for transient blending calculations. A series of the modeling calculations were performed to estimate the blending times for various jet flow conditions, and to investigate the impact of the cooling coils on the blending time of the tank contents. The modeling results were benchmarked against the pilot scale test results. All of the flow and mixing models were performed with the nozzles installed at the mid-elevation, and parallel to the tank wall. From the CFD modeling calculations, the main results are summarized as follows: (1) The benchmark analyses for the CFD flow velocity and blending models demonstrate their consistency with Engineering Development Laboratory (EDL) and literature test results in terms of local velocity measurements and experimental observations. Thus, an application of the established criterion to SRS full scale tank will provide a better, physically-based estimate of the required mixing time, and elevation of transfer pump for minimum sludge disturbance. (2) An empirical equation for a tank with no cooling coils agrees reasonably with the current modeling results for the dual jet. (3) From the sensitivity study of the cooling coils, it was found that the tank mixing time for the coiled tank was about two times longer than that of the tank fluid with no coils under the 1/10th scale, while the coiled tank required only 50% longer than the one without coils under the full scale Tank 50H. In addition, the time difference is reduced when the pumping U{sub o}d{sub o} value is increased for a given tank. (4) The blending time for T-shape dual jet pump is about 20% longer than that of 15{sup o} upward V-shape pump under the 1/10th pilot-scale tank, while the time difference between the two pumps is about 12% for the full-scale Tank 50H. These results are consistent with the literature information. (5) A transfer pump with a solid-plate suction screen operating at 130 gpm can be located 9.5 inches above settled sludge for 2 in screen height in a 85 ft waste tank without disturbing any sludge. Detailed results are summarized in Table 13. Final pump performance calculations were made by using the established CW pump design, and operating conditions to satisfy the two requirements of minimum sludge disturbance, and adequate blending of tank contents. The final calculation results show that the blending times for the coiled and uncoiled tanks coupled with the CW pump design are 159 and 83 minutes, respectively. All the results are provided in Table 16.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Simulation of a cascaded longitudinal space charge amplifier for coherent radiation generation

Longitudinal space charge (LSC) effects are generally considered as harmful in free-electron lasers as they can seed unfavorable energy modulations that can result in density modulations with associated emittance dilution. It was pointed out, however, that such \micro-bunching instabilities" could be potentially useful to support the generation of broadband coherent radiation. Therefore there has been an increasing interest in devising accelerator beam lines capable of controlling LSC induced density modulations. In the present paper we augment these previous investigations by combining a grid-less space charge algorithm with the popular particle-tracking program elegant. This high-fidelity model of the space charge is used to benchmark conventional LSC models. We then employ the developed model to optimize the performance of a cascaded longitudinal space charge amplifier using beam parameters comparable to the ones achievable at Fermilab Accelerator Science & Technology (FAST) facility currently under commissioning at Fermilab.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Feature review of photovoltaic modeling software utilizing blind performance assessment

While confidence in photovoltaic (PV) modeling software has always been essential, the rapid pace of new PV plant developments makes accuracy and credibility more critical than ever. Independent assessments, particularly through blind modeling comparisons, are therefore necessary to ensure unbiased benchmarking across PV modeling software. Previous studies have been limited by a narrow range of models compared, anonymized results, or system size. This study presents results from the first-ever onymous blind modeling comparison, evaluated using both lab- and utility-scale fixed-tilt, monofacial, south-facing systems at sub-hourly time intervals. Seven commercially used PV software tools were compared: 3E SynaptiQ, PlantPredict, PVsyst, RatedPower, SAM, SolarFarmer, and Solargis Evaluate. Predictions were submitted directly by software representatives, providing unique insights into each software’s implementation and resulting prediction behavior. Notable features, including plane-of-array (POA) transposition model, module temperature model, shading model, and performance model were analyzed and compared. Four summary tables compile these features of the software, serving as a resource to help users understand the methodological differences and select the most suitable software for their applications. The software tools show deviations from mean error in annual yield up to 2.5 % in the lab-scale system, increasing to 6.0 % for the utility-scale system. These differences arise from a combination of user decisions and the inherent behavior of the software, indicating the need for continuous and rigorous validation of modeling methods using these software tools against complex, real-world systems.

14 SOLAR ENERGY↗

Inertial Effects During the Process of Supercritical CO 2 Displacing Brine in a Sandstone: Lattice Boltzmann Simulations Based on the Continuum-Surface-Force and Geometrical Wetting Models

Inertial effects during the process of supercritical CO 2 displacing brine in porous media may not be negligible according to recent studies. Capturing the inertial effects of the physical CO 2 -brine system imposes a requirement on the grid resolution and viscosity to surface tension ratio for pore-scale simulations, which some commonly used simulators may not be able to meet. To fulfill the parameter requirement, we combine the continuum-surface-force based color-gradient lattice Boltzmann (LB) multiphase model and the geometrical wetting model and extend the model to 3D under the multiple-relaxation-time framework. We validate the model via simple benchmarks which show significant improvement over the traditional models. Furthermore, we perform 3D drainage simulations in a heterogeneous micromodel where the simulation result agrees well with experimental data, while our previous work fails to reproduce certain displacement patterns in the experiment due to the use of a traditional LB model that cannot fulfill the parameter requirement. Finally, we perform high-fidelity 3D drainage simulations to study the inertial effects in a Bentheimer sandstone sample. These findings show that stronger inertial effects generally help develop more CO 2 flow pathways for the same capillary number which results in higher CO 2 saturation, consistent with the micromodel results. The phenomena can be found in both low and high capillary number cases, indicating that the inertial effects are not dependent on the mean velocity. In addition, the change of the invasion patterns is not proportional to the change of inertial effects, thus exhibiting threshold behavior.

58 GEOSCIENCES↗

Large Eddy Simulation of Convective Heat Transfer in a Random Pebble Bed Using the Spectral Element Method

The development of fluoride-cooled high-temperature reactors has drastically increased the demand for an in-depth understanding of the heat transfer (HT) in packed beds cooled by liquid salts. The complex flow fields and space-dependent porosity found in a pebble bed require a detailed understanding to ensure the proper cooling of the reactor core during normal and accident conditions. As detailed experimental data are complicated to obtain for these configurations, high-fidelity simulation such as large eddy simulation and direct numerical simulation (DNS) can be employed to create a high-resolution heat transfer numerical database that can assist in addressing industrial-driven issues associated with the heat transfer behavior of fluoride-cooled high-temperature reactors. In this paper, we performed a series of large eddy simulation using computational fluid dynamics (CFD) code NekRS to investigate the heat transfer for a bed of 1741 pebbles. Further, the characteristics of the flow, such as average, rms, and time series of velocity and temperature, have been analyzed. Porous media averages have also been performed. The simulation results show a good agreement between non-conjugate heat transfer and conjugate heat transfer. The generated data will be used to benchmark heat transfer modeling methods and local maxima/minima of heat transfer parameters. It will also be used for supporting convective heat transfer quantification for Kairos Power and benchmarking lower fidelity models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Final Design for Thermal/Epithermal eXperiments using High 240 Pu Content Plutonium/Aluminum Zero Power Research Reactor Plates with Polyethylene Moderator (IER 520 Final Design CED-2 Report)

The US Department of Energy Nuclear Criticality Safety Program (NCSP) convened a multinational Thermal Epithermal eXperiments (TEX) meeting in July of 2011 to discuss the data and experimental needs of criticality safety practitioners. The number one and two priority integral experiment data needs were for 239 Pu and 240 Pu, with special emphasis on cross section performance in the intermediate energy range (from 0.625 eV to 100 keV). LLNL measured five critical configurations with LANL for the plutonium test bed (IER-184) and published the experiments as International Criticality Safety Benchmark Evaluation Project evaluation PUMET-MIXED-002. Modeling of the benchmark configurations using ENDF/B-VIII.0 nuclear data showed significant overprediction of reactivity for configurations that had a large percentage of fissions in the intermediate energy regime. This report documents a variation on the TEX plutonium test bed to provide a test of 240 Pu cross sections, with sensitivity of the configuration to 240 Pu radiative capture and fission cross sections a priority for the design.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Particle Receiver Models for Systems Analysis

Particle receivers are gaining importance in the field of Concentrating Solar Power (CSP) due to the high temperature that particles can achieve without degradation. Several researchers are studying the potential of this technology by means of system analyses, which need simple and light models of the system. This study presents two simple models for the particle receiver. The simplest model is a correlation obtained by fitting the results calculated with a more complex receiver model simulated in CFD. The other model is a 1D model, which is benchmarked against the same CFD results. Although both models achieve high coefficient of determination, R2, when compared to CFD results, the 1D model seems to provide more accurate results (especially during sunsets and sunrises). Both models are integrated into a tecno-economic model developed in previous work. The LCOE obtained with the 1D model is between 7% and 10% greater than the one obtained with the correlation.

González-Portillo, Luis F. (ORCID:0000000348643825↗

Chemical Modeling of the Reactivity of Short-Lived Greenhouse Gases: A Model Inter-Comparison Prescribing a Well-Measured, Remote Troposphere

We develop a new protocol for merging in situ measurements with 3-D model simulations of atmospheric chemistry with the goal of integrating over the data to identify the most reactive air parcels in terms of tropospheric production and loss of the greenhouse gases ozone and methane. Presupposing that we can accurately measure atmospheric composition, we examine whether models constrained by such measurements agree on the chemical budgets for ozone and methane. In applying our technique to a synthetic data stream of 14,880 parcels along 180W, we are able to isolate the performance of the photochemical modules operating within their global chemistry-climate and chemistry-transport models, removing the effects of modules controlling tracer transport, emissions, and scavenging. Differences in reactivity across models are driven only by the chemical mechanism and the diurnal cycle of photolysis rates, which are driven in turn by temperature, water vapor, solar zenith angle, clouds, and possibly aerosols and overhead ozone, which are calculated in each model. We evaluate six global models and identify their differences and similarities in simulating the chemistry through a range of innovative diagnostics. All models agree that the more highly reactive parcels dominate the chemistry (e.g., the hottest 10% of parcels control 25-30% of the total reactivities), but do not fully agree on which parcels comprise the top 10%. Distinct differences in specific features occur, including the regions of maximum ozone production and methane loss, as well as in the relationship between photolysis and these reactivities. Unique, possibly aberrant, features are identified for each model, providing a benchmark for photochemical module development. Among the 6 models tested here, 3 are almost indistinguishable based on the inherent variability caused by clouds, and thus we identify 4, effectively distinct, chemical models. Based on this work, we suggest that water vapor differences in model simulations of past and future atmospheres may be a cause of the different evolution of tropospheric O3 and CH4, and lead to different chemistry-climate feedbacks across the models.

greenhouse gases↗

Effects of anisotropies in turbulent magnetic diffusion in mean-field solar dynamo models

We study how anisotropies of turbulent diffusion affect the evolution of large-scale magnetic fields and the dynamo process on the Sun. The effect of anisotropy is calculated in a mean-field magnetohydrodynamics framework assuming that triple correlations provide relaxation to the turbulent electromotive force (so-called the 'minimal τ-approximation'). We examine two types of mean-field dynamo models: the well-known benchmark flux-transport model and a distributed-dynamo model with a subsurface rotational shear layer. For both models, we investigate effects of the double- and triple-cell meridional circulation, recently suggested by helioseismology and numerical simulations. To characterize the anisotropy effects, we introduce a parameter of anisotropy as a ratio of the radial and horizontal intensities of turbulent mixing. It is found that the anisotropy affects the distribution of magnetic fields inside the convection zone. The concentration of the magnetic flux near the bottom and top boundaries of the convection zone is greater when the anisotropy is stronger. It is shown that the critical dynamo number and the dynamo period approach to constant values for large values of the anisotropy parameter. The anisotropy reduces the overlap of toroidal magnetic fields generated in subsequent dynamo cycles, in the time-latitude 'butterfly' diagram. If we assume that sunspots are formed in the vicinity of the subsurface shear layer, then the distributed dynamo model with the anisotropic diffusivity satisfies the observational constraints from helioseismology and is consistent with the value of effective turbulent diffusion estimated from the dynamics of surface magnetic fields.

79 ASTRONOMY AND ASTROPHYSICS↗

PAMELA and ATIC signals from Kaluza-Klein dark matter

We study the possibility that Kaluza-Klein dark matter in a model with one universal extra dimension is responsible for the recent observations of the PAMELA and ATIC experiments. In this model, the dark matter particles annihilate largely to charged leptons, which enables them to produce a spectrum of cosmic ray electrons and positrons consistent with the PAMELA and ATIC measurements. To normalize to the observed signal, however, large boost factors ({approx}10{sup 3}) are required. Despite these large boost factors and significant annihilation to hadronic modes (35%), we find that the constraints from cosmic ray antiproton measurements can be satisfied. Relic abundance considerations in this model force us to consider a rather specific range of masses (approximately 600-900 GeV) which is very similar to the range required to generate the ATIC spectral feature. The results presented here can also be used as a benchmark for model-independent constraints on dark matter annihilation to hadronic modes.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗