Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Numerical benchmark of transient pressure-driven metallic melt flows

Fluid dynamics simulations of melting and crater formation at the surface of a copper cathode exposed to high plasma heat fluxes and pressure gradients are presented. The predicted deformations of the free surface and the temperature evolution inside the metal are benchmarked against previously published simulations. Despite the physical model being entirely hydrodynamic and ignoring a variety of plasma–surface interaction processes, the results are also shown to be remarkably consistent with the predictions of more advanced models, as well as experimental data. This provides a sound basis for future applications of similar models to studies of transient surface melting and droplet ejection from metallic plasma-facing components after disruptions.

36 MATERIALS SCIENCE↗

Application of Jacobian-free Newton–Krylov method in implicitly solving two-fluid six-equation two-phase flow problems: Implementation, validation and benchmark

This work represents a first-of-its-kind successful application to employ advanced numerical methods in solving realistic two-phase flow problems with two-fluid six-equation two-phase flow model. These advanced numerical methods include high-resolution spatial discretization scheme with staggered grids (high-order) fully implicit time integration schemes, and Jacobian-free Newton–Krylov (JFNK) method as the nonlinear solver. The computer code developed in this work has been extensively validated with existing experimental flow boiling data in vertical pipes and rod bundles, which cover wide ranges of experimental conditions, such as pressure, inlet mass flux, wall heat flux and exit void fraction. Additional code-to-code benchmark with the RELAP5-3D code further verifies the correct code implementation. The combined methods employed in this work exhibit strong robustness in solving two-phase flow problems even when phase appearance (boiling) and realistic discrete flow regimes are considered. Transitional flow regimes used in existing system analysis codes, normally introduced to overcome numerical difficulty, were completely removed in this work. As a result, this in turn provides the possibility to utilize more sophisticated flow regime maps in the future to further improve simulation accuracy.

42 ENGINEERING↗

System thermal-hydraulic modelling of the phénix dissymmetric test benchmark

Phénix is a French pool-type sodium-cooled prototype reactor; before the definitive shutdown, occurred in 2009, a final set of experimental tests are carried out in order to increase the knowledge on the operation and the safety aspect of the pool-type liquid metal-cooled reactors. One of the experiments was the Dissymmetric End-of-Life Test which was selected for the validation benchmark activity in the frame of SESAME project. The computer code validation plays a key role in the safety assessment of the innovative nuclear reactors and the Phénix dissymmetric test provides useful experimental data to verify the computer codes capability in the asymmetric thermal-hydraulic behaviour into a pool-type liquid metal-cooled reactor. This paper shows the comparison of the outcomes obtained with six different System Thermal-Hydraulic (STH) codes: RELAP5-3D©, SPECTRA, ATHLET, SAS4A/SASSYS-1, ASTEC-Na and CATHARE. The nodalization scheme of the reactor was individually achieved by the participants; during the development of the thermal-hydraulic model, the pool nodalization methodology had a special attention in order to investigate the capability of the STH codes to reproduce the dissymmetric effects which occur in each loop and into pools, caused by the azimuthal asymmetry of the boundary conditions. The modelling methodology of the participants is discussed and the main results are compared in this paper to obtain useful guide lines for the future modelling of innovative liquid metal pool-type reactors.

42 ENGINEERING↗

Multiscale modelling of the phénix dissymmetric test benchmark

The Phenix sodium-cooled fast reactor contains two pools in which characteristic 3D effects like thermal stratification and jets play a significant role. One of the two active heat exchanger sets fails in the dissymmetric test, leading to changes in the thermal stratification and asymmetric conditions in the reactor. Therefore 3D modelling using Computational Fluid Dynamics codes (CFD) is required to model this transient in sufficient detail. However, several aspects of the reactor, like the core and the secondary side of the heat exchanger, can be modelled more efficiently by System Thermal-Hydraulics codes (STH). Therefore multiscale models are developed by coupling CFD and STH codes, exploiting the strengths of both codes in terms of modelling options and computational costs. The results provide insight in the local flow patterns and the temperature distribution during the dissymmetric transient. The results and modelling choices of the participants are compared in this paper and the main findings are discussed in the light of lessons learned from the blind phase of the benchmark and providing recommendations for future modelling of pool-type liquid metal-cooled reactors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Material Interactions in Severe Accidents – Benchmarking the MELCOR V2.2 Eutectics Model for a BWR-3 Mark-I Station Blackout: Part II – Uncertainty Analysis

Single case comparisons between severe accident simulations can provide detailed insights into severe accident model behavior, however, they cannot offer insights into model uncertainty, sensitivity to uncertain parameters, or underlying model biases.Here in this analysis, the single case benchmark comparison of the MELCOR material interaction models for a station blackout (SBO) scenario of a boiling water reactor (BWR) using representative Fukushima Daiichi Unit 1 boundary conditions is expanded to include an uncertainty analysis. As part of this uncertainty analysis, 1200 simulations are performed for each material interaction model (2400 total), with random sampling of 14 uncertain MELCOR input parameters. Input parameters are selected for their impact on models representing core degradation processes. These include candling, fuel rod failure, debris quenching and dryout. The analysis performed here is not a traditional “best-estimate” uncertainty analysis that uses best-estimate parameters or identifies best-estimate figure of merit distributions. Instead, it is an exploratory uncertainty analysis that identifies and interrogates underlying model form biases of the two material interaction models (eutectics and interactive materials models). Uniform distributions are applied to all uncertain parameters to ensure coverage of the model parameter uncertainty space. Key findings from this study include underlying model form biases exhibited by material interaction models, and notable differences in accident progression outcomes between the material interaction models. This uncertainty study extends and confirms the conclusions from the first part of this study, which compared the impact of material interaction modeling on simulation of a short-term station blackout scenario with representative Fukushima Daiichi Unit I boundary conditions. In particular, this study confirms that the eutectics model generally exhibits accelerated degradation and failure of fuel components, the core plate, and the lower head. The eutectics model also has a tendency to exhibit a greater degree of core degradation, greater debris mass formation, and larger debris mass ejection. Finally, the eutectics model exhibits higher maximum temperatures for fuel, cladding, particulate debris, oxidic molten pool, and metallic molten pool components than the interactive materials model; interactive materials model simulations exhibit a soft “limitation” on maximum temperatures that is related to the temperature at which material relocation occurs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Assessing the capability of continuum and discrete particle methods to simulate gas-solids flow using DNS predictions as a benchmark

For this study, gas–solids flow in a three-dimension periodic domain was numerically investigated by direct numerical simulation (DNS), computational fluid dynamic-discrete element method (CFD-DEM) and two-fluid model (TFM). DNS data obtained by finely resolving the flow around every particle are used as a benchmark to assess the validity of coarser DEM and TFM approaches. The CFD-DEM predicts the correct cluster size distribution and under-predicts the macro-scale slip velocity even with a grid size as small as twice the particle diameter. The TFM approach predicts larger cluster size and lower slip velocity with a homogeneous drag correlation. Although the slip velocity can be matched by a simple modification to the drag model, the predicted voidage distribution is still different from DNS: Both CFD-DEM and TFM over-predict the fraction of particles in dense regions and under-predict the fraction of particles in regions of intermediate void fractions. Also, the cluster aspect ratio of DNS is smaller than CFD-DEM and TFM. Since a simple correction to the drag model can predict a correct slip velocity, it is hopeful that drag corrections based on more elaborate theories that consider voidage gradient and particle fluctuations may be able to improve the current predictions of cluster distribution.

42 ENGINEERING↗

Wind turbine response in waked inflow: A modelling benchmark against full-scale measurements

Predicting the power and loads of wind turbines in waked inflow conditions still presents a major modelling challenge. It requires the accurate modelling of the atmospheric flow conditions, wakes of upstream turbines and the response of the turbine of interest. Rigorous validations of model frameworks against measurements of utility-scale wind turbines in such scenarios remain limited to date. In this study, six models of different fidelity are compared against measurements from the DanAero experiment. The two benchmark cases feature a full-wake and partial-wake scenario, respectively. The simulations are compared against local pressure forces and inflow velocities measured on several blade sections of the downstream turbine, as well as met mast measurements and standard SCADA data. Regardless of the model fidelity, reasonable agreements are found in terms of the wake characteristics and turbine response. For instance, the azimuth variation of the mean aerodynamic forces acting on the blade was captured with a mean relative error of 15-20%. Additionally, while various model-specific deficiencies could be identified, the study highlights the need for further full-scale measurement campaigns with even more extensive instrumentation. Furthermore, it is concluded that validations should not be limited to integrated and/or time-averaged quantities that conceal characteristic spatial or temporal variations.

17 WIND ENERGY↗

Modeling of thermal pressurization in tight claystone using sequential THM coupling: Benchmarking and validation against in-situ heating experiments in COx claystone

We apply thermoporoelasticity and a sequentially coupling technique for modeling thermally-driven coupled Thermo-Hydro-Mechanical (THM) processes in tight claystone. A THM benchmark case with a corresponding analytic solution for thermoporoelasticity under a constant heat loading verifies the model. Thereafter, two in situ heating experiments are simulated for model validation: a smaller-scale heating experiment (TED experiment) and a larger-scale experiment (ALC experiment) in Callovo-Oxfordian (COx) claystone at the Meuse/Haute-Marne underground research laboratory in France. The model exhibits good performance to match the observed temperature and pore pressure evolution for the smaller-scale TED experiment. For the larger-scale ALC experiment, general trends of thermal-pressurization are captured in the modeling, but pressure is underestimated at some monitoring points during cool-down. This indicates that the THM response in the field may be affected by the variability of rock's properties or irreversible or time-dependent mechanical processes that are not included in the current thermoporoelastic model. The main contributions of this work are as follows: (1) we verify and validate the numerical simulator, TOUGH-FLAC, to be a valuable coupled THM modeling tool; (2) prove that the laboratory determined material parameters can be used as reference values for upscaling experiments. However, to better identify and quantify THM processes with modeling of in situ tests, more emphasize should be dedicated to obtaining high-quality mechanical deformation data.

58 GEOSCIENCES↗

Benchmarking magnetised three-wave coupling for laser backscattering: analytic solutions and kinetic simulations

Understanding magnetised laser–plasma interactions is important for controlling magneto-inertial fusion experiments and developing magnetically assisted radiation and particle sources. For nanosecond pulses at non-relativistic intensities, interactions are dominated by coherent three-wave interactions, whose nonlinear coupling coefficients became known only recently when waves propagate at oblique angles with the magnetic field. In this paper, backscattering coupling coefficients predicted by warm-fluid theory are benchmarked using particle-in-cell simulations in one spatial dimension, and excellent agreements are found for a wide range of plasma temperatures, magnetic field strengths and laser propagation angles, when the interactions are mediated by electron-dominant hybrid waves. Systematic comparisons between theory and simulations are made possible by a rigorous protocol. On the theory side, the initial boundary value problem of linearised three-wave equations is solved, and the transient-time solutions allow the effects of growth and damping to be distinguished. On the simulation side, parameters are carefully chosen and calibration runs are performed to ensure that comparisons are well controlled. Fitting simulation data to analytical solutions yields numerical growth rates that match theory predictions within error bars. Although warm-fluid theory is found to be valid for a wide parameter range, genuine kinetic effects have also been observed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

An Introduction to the Benchmarking and Publications for Non-Targeted Analysis Working Group

Non-targeted analysis (NTA) encompasses a rapidly evolving set of mass spectrometry techniques aimed at characterizing the chemical composition of complex samples, identifying unknown compounds, and/or classifying samples, without prior knowledge regarding the chemical content of the samples. Recent advances in NTA are the result of improved and more accessible instrumentation for data generation, and analysis tools for data evaluation and interpretation. As researchers continue to develop NTA approaches in various scientific fields, there is a growing need to identify, disseminate, and adopt community-wide method reporting guidelines. In 2018, NTA researchers formed the Benchmarking and Publications for Non-Targeted Analysis Working Group (BP4NTA) to address this need. Consisting of participants from around the world and representing fields ranging from environmental science and food chemistry to ‘omics and toxicology, BP4NTA provides resources addressing a variety of challenges associated with NTA. Furthermore, thus far, BP4NTA group members have aimed to establish consensus on NTA-related terms and concepts, and to create consistency in reporting practices by providing resources on a public website, including consensus definitions, reference content, and lists of available tools. Moving forward, BP4NTA will provide a setting for NTA researchers to continue discussing emerging challenges and contribute to additional harmonization efforts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Benchmarking Soft Sensors for Remote Monitoring of On-Site Wastewater Treatment Plants

On-site wastewater treatment plants (OSTs) are usually unattended, so failures often remain undetected and lead to prolonged periods of reduced performance. To stabilize the performance of unattended plants, soft sensors could expose faults and failures to the operator. In a previous study, we developed soft sensors and showed that soft sensors with data from unmaintained physical sensors can be as accurate as soft sensors with data from maintained ones. The monitored variables were pH and dissolved oxygen (DO), and soft sensors were used to predict nitrification performance. In the present study, we use synthetic data and monitor three plants to test these soft sensors. We find that a long solids retention time and a moderate aeration rate improve the pH soft-sensor accuracy and that the aeration regime is the main operational parameter affecting the accuracy of the DO soft sensor. We demonstrate that integrated design of monitoring and control is necessary to achieve robustness when extrapolating from one OST to another in the absence of plant-specific fine-tuning. Additionally, we provide a unique labeled dataset for further feature and data-driven soft-sensor development. Our benchmarking results indicate that it is feasible to monitor OSTs with unmaintained sensors and without plant-specific tuning of the developed soft sensors. This is expected to drastically reduce monitoring costs for OST-based sanitation systems.

54 ENVIRONMENTAL SCIENCES↗

Benchmarking an Embedded Adaptive Sampling Configuration Interaction Method for Surface Reactions: H 2 Desorption from and CH 4 Dissociation on Cu(111)

Embedded (emb-) correlated wavefunction (CW) theory enables accurate assessments of both ground- and excited-state reaction mechanisms involved in heterogeneous catalysis. Embedded multireference second-order perturbation theory (emb-MRPT2) based on reference wavefunctions generated via embedded complete active space self-consistent field (emb-CASSCF) theory is currently state-of-the-art. However, the factorial scaling of CASSCF limits the size of active space and the complexity of systems that can be studied. In this work, we assess the efficacy of an alternative CW method, adaptive sampling configuration interaction (ASCI)–which enables large active spaces to be used–for studying surface reactions. We couple ASCI with density functional embedding theory (DFET) and benchmark its performance for two reactions: H 2 desorption from and CH 4 dissociation on the Cu(111) surface. Unlike embedded complete active space second-order perturbation theory (emb-CASPT2) that accurately reproduces a measured H 2 desorption barrier, embedded ASCI, using a very large active space (though one that still comprises a small portion of the full set of orbitals) fails to do so. Adding an extra correlation term from embedded Møller–Plesset second-order perturbation theory (emb-MP2) improves the desorption barrier and endothermicity predictions. Thus, the inaccuracy of embedded ASCI comes from the missing dynamic correlation from the many other electrons and orbitals not included in the active space. For CH 4 dissociation, again embedded ASCI overestimates the dissociation barrier compared to emb-CASPT2 predictions. Adding dynamic correlation from emb-MP2 helps correct the barrier. However, this composite approach suffers from double counting of correlation within embedded ASCI followed by emb-MP2 calculations. We therefore conclude that the state-of-the-art emb-MRPT2 based on reference wavefunctions generated via emb-CASSCF remains the method of choice for studying surface reactions. emb-ASCI is useful when large active spaces beyond the limit of emb-CASSCF are essential, such as to study complex surface reactions with significant multiconfigurational character (static correlation) but weak dynamic correlation.

08 HYDROGEN↗

Quadratic Unitary Coupled-Cluster Singles and Doubles Scheme: Efficient Implementation, Benchmark Study, and Formulation of an Extended Version

An efficient implementation of the quadratic unitary coupled-cluster singles and doubles (qUCCSD) scheme for calculations of electronic ground and excited states using an unrestricted molecular spin–orbital formulation and an efficient tensor contraction library is reported. The accuracy of the qUCCSD scheme and the efficiency of the present implementation are demonstrated using extensive benchmark calculations of excitation energies and an application to S o → S 1 vertical excitation energies for cis- and trans-4a,4b-dihydrotriphenylene. The qUCCSD scheme has been shown to provide improved excitation energies compared with the UCC3 scheme formulated based on perturbation theory. Here, a UCC truncation scheme that can provide excitation energies correct through the fourth order is also presented to further improve the accuracy of the qUCCSD scheme.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Importance of Electron Correlation on the Geometry and Electronic Structure of [2Fe–2S] Systems: A Benchmark Study of the [Fe 2 S 2 (SCH 3 ) 4 ] 2–,3–,4– , [Fe 2 S 2 (SCys) 4 ] 2– , [Fe 2 S 2 (S- p -tol) 4 ] 2– , and [Fe 2 S 2 (S- o -xyl) 4 ] 2– Complexes

Iron–sulfur clusters are crucial for biological electron transport and catalysis. Obtaining accurate geometries, energetics, manifolds of their excited electronic states, and reduction energies is important to understand their role in these processes. Here, using a [2Fe–2S] model complex with Fe II and Fe III oxidation states, which leads to different charges, i.e., [Fe 2 S 2 (SMe) 4 ] 2–,3–,4– , we benchmarked a variety of computational methodologies ranging from density functional theory (DFT) to post-Hartree–Fock methods, including complete active space self-consistent field (CASSCF), multireference configuration interaction, the second-order N-electron valence state perturbation theory (NEVPT2), and the linearized integrand approximation of adiabatic connection (AC0) approaches. Additionally, we studied three experimentally well-characterized complexes, [Fe 2 S 2 (SCys) 4 ] 2– , [Fe 2 S 2 (S-o-tol) 4 ] 2– , and [Fe 2 S 2 (S-o-xyl) 4 ] 2– , via DFT methods. We conclude that the dynamic electron correlation is important for accurately predicting the geometry of these complexes. Broken symmetry (BS) DFT correctly predicts experimental geometries of low-spin multiplicity, while CASSCF does not. However, BS-DFT significantly overestimates the difference between the low- and high-spin electronic states for a given oxidation state. At the same time, CASSCF underestimates it but provides relative energies closer to the reference NEVPT2 results. Finally, AC0 provides energetics of NEVPT2 quality with the additional advantage of being able to use large CASSCF sizes. NEVPT2 gives the best estimates of the Fe III /Fe III → Fe II /Fe III (4.27 eV) and Fe II /F III → Fe II /F II (7.72 eV) reduction energies. The results provide insight into the electronic structure of these complexes and assist in the understanding of their physical properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Benchmark Calculations of Energetic Properties of Groups 4 and 6 Transition Metal Oxide Nanoclusters Including Comparison to Density Functional Theory

The heats of formation and the normalized clustering energies (NCEs) for the group 4 and group 6 transition metal oxide (TMO) trimers and tetramers have been calculated by the Feller-Peterson-Dixon (FPD) method. The heats of formation predicted by the FPD method do not differ much from those previously derived from the NCEs at the CCSD(T)/aT level except for the CrO3 nanoclusters. New and improved heats of formation for Cr3O9 and Cr4O12 were obtained using PW91 orbitals instead of Hartree-Fock (HF) orbitals. Diffuse functions are necessary to predict accurate heats of formation. The fluoride affinities (FAs) are calculated with the CCSD(T) method. The relative energies (REs) of different isomers, NCEs, electron affinities (EAs), and FAs of (MO2)n ( M = Ti, Zr, Hf, n = 1 – 4 ) and (MO3)n ( M = Cr, Mo, W, n = 1 – 3) clusters have been benchmarked with 55 exchange-correlation DFT functionals including both pure and hybrid types. The absolute errors of the DFT results are mostly less than ±10 kcal/mol for the NCEs and the EAs, and less than ±15 kcal/mol for the FAs. Hybrid functionals usually perform better than the pure functionals for the REs and NCEs. The performance of the two types of functionals in predicting EAs and FAs is comparable. The B1B95 and PBE1PBE functionals provide reliable energetic properties for most isomers. Long range corrected pure functionals usually give poor FAs. The standard deviation of the absolute error is always close to the mean errors and the probability distributions of the DFT errors are often not Gaussian (normal). The breadth of the distribution of errors and the maximum probability are dependent on the energy property and the isomer.

Environmental Molecular Sciences Laboratory↗

Bond Dissociation Energies for Diatomic Molecules Containing 3d Transition Metals: Benchmark Scalar-Relativistic Coupled-Cluster Calculations for 20 Molecules

Benchmark scalar-relativistic coupled-cluster calculations for dissociation energies of the 20 diatomic molecules containing 3d transition metals in the 3dMLBE20 database ( J. Chem. Theory Comput. 2015, 11, 2036) are reported in this paper. Electron correlation and basis set effects are systematically studied. The agreement between theory and experiment is in general satisfactory. For a subset of 16 molecules, the standard deviation between computational and experimental values is 9 kJ/mol with the maximum deviation being 15 kJ/mol. The discrepancies between theory and experiment remain substantial (more than 20 kJ/mol) for VH, CrH, CoH, and FeH. To explore the source of the latter discrepancies, the analysis used to determine the experimental dissociation energies for VH and CrH is revisited. It is shown that, if improved values are used for the heterolytic C–H dissociation energies of di- and trimethylamine involved in the experimental determination, the experimental values for the dissociation energies of VH and CrH are increased by 18 kJ/mol, such that D 0 (VH) = 223 ± 7 kJ/mol and D 0 (CrH) = 204 ± 7 kJ/mol (or D e (VH) = 233 ± 7 kJ/mol and D e (CrH) = 214 ± 7 kJ/mol). Finally, the new experimental values agree quite well with the calculated values, showing the consistency of the computation and the measured reaction thresholds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Parametrization and Benchmark of Long-Range Corrected DFTB2 for Organic Molecules

In this paper, we present the parametrization and benchmark of long-range corrected second-order density functional tight binding (DFTB), LC-DFTB2, for organic and biological molecules. The LC-DFTB2 model not only improves fundamental orbital energy gaps but also ameliorates the DFT self-interaction error and overpolarization problem, and further improves charge-transfer excited states significantly. Electronic parameters for the construction of the DFTB2 Hamiltonian as well as repulsive potentials were optimized for molecules containing C, H, N, and O chemical elements. We use a semiautomatic parametrization scheme based on a genetic algorithm. With the new parameters, LC-DFTB2 describes geometries and vibrational frequencies of organic molecules similarly well as third-order DFTB3/3OB, the de facto standard parametrization based on a GGA functional. Finally, LC-DFTB2 performs well also for atomization and reaction energies, however, slightly less satisfactorily than DFTB3/3OB.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Spin–Orbit Coupling via Four-Component Multireference Methods: Benchmarking on p-Block Elements and Tentative Recommendations

Within current electronic structure theory methods, fully relativistic four-component (4c) approaches based on the Dirac Hamiltonian treat spin–orbit coupling with the most rigor. The spin treatment arises naturally from the formulation and does not need to be included ad hoc. Spin–orbit splittings can provide insightful benchmark criteria for the assessment of 4c methods; however, there have not been extensive studies in this respect. Spin–orbit splittings of the p-block elements B–I were computed using the 4c-CASSCF, 4c-CASPT2, and 4c-MR-CISD+Q methods, as recently implemented in BAGEL, with uncontracted Dunning basis sets. Comparison with experiment reveals that the four-component methods yield good results, with most of the computed splittings falling within 15% of the experimental values. A large basis set is needed to obtain accurate splittings of the light elements B–F, while splittings of heavier elements show little basis dependence. The 4c-MR-CISD+Q method gave the best splittings for light elements, while 4c-CASSCF showed the best splittings for elements beyond fluorine. In conclusion, the 4c-CASPT2 method gave the best splittings for group 13 atoms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗