Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

3D J-Integral Capability in Grizzly

This report summarizes work done to develop a capability to evaluate fracture contour J-Integrals in 3D in the Grizzly code. In the current fiscal year, a previously-developed 2D implementation of a J-Integral evaluation capability has been extended to work in 3D, and to include terms due both to mechanically-induced strains and due to gradients in thermal strains. This capability has been verified against a benchmark solution on a model of a curved crack front in 3D. The thermal term in this integral has been verified against a benchmark problem with a thermal gradient. These developments are part of a larger effort to develop Grizzly as a tool that can be used to predict the evolution of aging processes in nuclear power plant systems, structures, and components, and assess their capacity after being subjected to those aging processes. The capabilities described here have been developed to enable evaluations of Mode- stress intensity factors on axis-aligned flaws in reactor pressure vessels. These can be compared with the fracture toughness of the material to determine whether a pre-existing flaw would begin to propagate during a pos- tulated pressurized thermal shock accident. This report includes a demonstration calculation to show how Grizzly is used to perform a deterministic assessment of such a flaw propagation in a degraded reactor pressure vessel under pressurized thermal shock conditions. The stress intensity is calculated from J, and the toughness is computed using the fracture master curve and the degraded ductile to brittle transition temperature.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Extensions to Dynamic System Simulation of Fissile Solution Systems

Previous reports have documented the results of applying dynamic system simulation (DSS) techniques to model a variety of fissile solution systems. The SUPO (Super Power) aqueous homogeneous reactor (AHR) was chosen as the benchmark for comparison of model results to experimental data for steadystate operation.1 Subsequently, DSS was applied to additional AHR to verify results obtained for SUPO and extend modeling to prompt critical excursions, ramp reactivity insertions of various magnitudes and rate, and boiling operations in SILENE and KEWB (Kinetic Experiment Water Boiler).2 Additional models for pressurized cores (HRE: Homogeneous Reactor Experiment), annular core geometries, and accelerator-driven subcritical systems (ADAHR) were developed and results reported.3 The focus of each of these models is core dynamics; neutron kinetics, thermal hydraulics, radiolytic gas generation and transport are coupled to examine the time-based evolution of these systems from start-up through transition to steady-state. A common characteristic of these models is the assumption that (a) core cooling system inlet temperature and flow and (b) plenum gas inlet pressure and flow are held constant; no external (to core) component operations that may result in dynamic change to these parameters are considered. This report discusses extension of models to include explicit reference to cooling structures and radiolytic gas handling. The accelerator-driven subcritical generic system model described in References 3 and 4 is used as a basis for this extension.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Assessing theoretical uncertainties in fission barriers of superheavy nuclei

Here, theoretical uncertainties in the predictions of inner fission barrier heights in superheavy elements have been investigated in a systematic way for a set of state-of-the-art covariant energy density functionals which represent major classes of the functionals used in covariant density functional theory. They differ in basic model assumptions and fitting protocols. Both systematic and statistical uncertainties have been quantified where the former turn out to be larger. Systematic uncertainties are substantial in superheavy elements and their behavior as a function of proton and neutron numbers contains a large random component. The benchmarking of the functionals to the experimental data on fission barriers in the actinides allows to reduce the systematic theoretical uncertainties for the inner fission barriers of unknown superheavy elements. However, even then they on average increase on moving away from the region where benchmarking has been performed. In addition, a comparison with the results of non-relativistic approaches is performed in order to define full systematic theoretical uncertainties over the state-of-the-art models. Even for the models benchmarked in the actinides, the difference in the inner fission barrier height of some superheavy elements reaches $5-6$ MeV. This uncertainty in the fission barrier heights will translate into huge (many tens of the orders of magnitude) uncertainties in the spontaneous fission half-lives.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

U.S. Solar Photovoltaic System Cost Benchmark Q1 2018

NREL has been modeling U.S. photovoltaic PV system costs since 2009. The U.S. Solar Photovoltaic System CostBenchmark Q1 2018 report benchmarks costs of U.S. solar PV for residential commercial and utility-scale systems built in the first quarter of 2018 Q1 2018. THE methodology includes bottom-up accounting for all system and project-development costs incurred when installing residential commercial and utility-scale systems and it models the capital costs for such systems.

14 SOLAR ENERGY↗

Benchmarking of manganese oxide materials with CO oxidation as catalysts for low temperature selective oxidation

Here CO oxidation behavior of different manganese oxide materials was studied as a model probe reaction to benchmark catalytic activities that could be useful for other aerobic oxidations. K-OMS-2, which showed intermediate activity [Ea = 3.0 and 6.3 kcal/mol for K-OMS-2 (made in solvent free procedure or SF) and K-OMS-2 (made via hydrothermal route or REF) respectively], were chosen for metal dopant studies using microwave assisted hydrothermal synthesis. These were further characterized using X-ray diffraction (XRD), N 2 sorption, Raman spectroscopy, scanning electron microscopy (SEM), and carbon monoxide temperature programmed reduction (CO-TPR). Additional characterization was carried out for Ni-K-OMS-2 materials using atomic absorption spectroscopy (AAS) and thermogravimetric analysis-mass spectroscopy (TGA-MS). Doping K-OMS-2 with Ni resulted in a large increase in oxygen mobility and re-adsorption, and the moderate activation energy for CO oxidation (13. kcal/mol) by Ni-K-OMS-2(SF) suggests that Ni-doped materials are good candidates for low temperature selective oxidation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

tether

Tether is a python module for benchmarking and assessing large language model (LLMs) performance at generic scientific tasks. The code generates benchmarks, uses the benchmark to prompt LLMs through automatic programming interfaces (APIs), and then logs the number of prompts an LLM correctly answers and presents the results as a completed benchmark.

Kaiser, Bryan [Los Alamos National Laboratory]↗

Results of the third Marine Ice Sheet Model Intercomparison Project (MISMIP+)

We present the result of the third Marine Ice Sheet Model Intercomparison Project, MISMIP+. MISMIP+ is intended to be a benchmark for ice-flow models which include fast sliding marine ice streams and floating ice shelves and in particular a treatment of viscous stress that is sufficient to model buttressing, where upstream ice flow is restrained by a downstream ice shelf. A set of idealized experiments first tests that models are able to maintain a steady state with the grounding line located on a retrograde slope due to buttressing and then explore scenarios where a reduction in that buttressing causes ice stream acceleration, thinning, and grounding line retreat. The majority of participating models passed the first test and then produced similar responses to the loss of buttressing. We find that the most important distinction between models in this particular type of simulation is in the treatment of sliding at the bed, with other distinctions – notably the difference between the simpler and more complete treatments of englacial stress but also the differences between numerical methods – taking a secondary role.

58 GEOSCIENCES↗

Effects of Angle of Attack and Velocity on Trailing Edge Noise

Trailing edge (TE) noise measurements for a NACA 63-215 airfoil model are presented, providing benchmark experimental data for a cambered airfoil. The effects of flow Mach number and angle of attack of the airfoil model with different TE bluntnesses are shown. Far-field noise spectra and directivity are obtained using a directional microphone array. Standard and diagonal removal beamforming techniques are evaluated employing tailored weighting functions for quantitatively accounting for the distributed line character of TE noise. Diagonal removal processing is used for the primary database as it successfully removes noise contaminates. Some TE noise predictions are reported to help interpret the data, with respect to flow speed, angle of attack, and TE bluntness on spectral shape and peak levels. Important findings include the validation of a TE noise directivity function for different airfoil angles of attack and the demonstration of the importance of the directivity function s convective amplification terms.

Hutcheson, Florence V.↗

Effects of Angle of Attack and Velocity on Trailing Edge Noise

Trailing edge (TE) noise measurements for a NACA 63-215 airfoil model are presented, providing benchmark experimental data for a cambered airfoil. The effects of flow Mach number and angle of attack of the airfoil model with different TE bluntnesses are shown. Far-field noise spectra and directivity are obtained using a directional microphone array. Standard and diagonal removal beamforming techniques are evaluated employing tailored weighting functions for quantitatively accounting for the distributed line character of TE noise. Diagonal removal processing is used for the primary database as it successfully removes noise contaminates. Some TE noise predictions are reported to help interpret the data, with respect to flow speed, angle of attack, and TE bluntness on spectral shape and peak levels. Important findings include the validation of a TE noise directivity function for different airfoil angles of attack and the demonstration of the importance of the directivity function s convective amplification terms.

Hutcheson, Florence V.↗

Centralized Activities in Support of the Radiative Forcing Model Intercomparison Project

A new paradigm in benchmark absorption-scattering radiative transfer is presented that enables both the globally-averaged and spatially-resolved testing of climate model radiation parameterizations using a novel benchmark computational strategy to uncover persistent sources of biases in the aerosol Instantaneous Radiative Effect (IRE). A proof-of-concept is demonstrated with the GFDL AM4 and CESM 1.2.2 climate models. Instead of prescribing atmospheric conditions and aerosols, as in prior intercomparisons, snapshots of the atmospheric state and aerosol optical properties from the participating models are used as inputs to a highly accurate radiation solver to uncover relevant biases unique to each climate model. These diagnostic results show that the models’ aerosol IRE bias is of the same magnitude as the persistent intermodel spread (~1 W/m2), and varies spatially and with intrinsic aerosol optical properties. The findings underscore the significance of native model error analysis and its ability to diagnose global biases, confirming its fundamental value for the Radiative Forcing Model Intercomparison Project (RFMIP).

58 GEOSCIENCES↗

Development of Accident Tolerant Fuel Options for Near Term Applications: Fuel Performance Modeling under Transient / Severe Accidents by MELCOR: PART I: Benchmark for SURRY: Short Term Station Black Out (STSBO)

Currently, existing LWR fuel technology is near its inherent limit of performance without improvement in fuel materials. As a result of the great earthquake of east Japan, along with the catastrophic tsunami, the Fukushima Daiichi boiling water plant was severely damaged. The light water reactors (LWRs) fuel gave rise to a serious discussion in the United States. In order to provide the development of Accident Tolerant Fuel (ATF) options for present day applications, MIT is leading a DOE project to search for enhanced accident tolerant fuels. Group members include MIT, UW-Madison, TAMU, AREVA, and Westinghouse. As part of the work, fuel performance modeling under transient / severe accidents: MELCOR is being used to analyze different kinds of materials under several limited accident conditions. While various research groups are obtaining the parameters of the experimental ATF materials, benchmarks for SURRY are being done by use of MELCOR in the University of Wisconsin-Madison. We chose version 1.8.6 for the edition of materials, and INL provided the uncertainty analysis between version 1.8.6 and version 2.1.0. Comparison will be done between potential ATF materials, which include FeCrAl, SiC, Cr, ZrSi, TiAlC, TiSiC and so on. Furthermore, zircaloy is used as the verification. Among all the parameters which influence the materials' performance, the temperature history and hydrogen generation will be the key factors in the future. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Modeling the IFR-1 Experiment: A BISON Metallic Fuel Benchmark

As the 1970s nuclear reactor fleet slowly begins the decommission process, the US Department of Energy Office of Nuclear Energy (DOE-NE) aims to stimulate and support the construction and implementation of new nuclear reactors across the country in hopes of continuing the generation of clean, reliable, resilient energy. As a result, various efforts have been introduced to accelerate this process, including the Versatile Test Reactor project (VTR) and the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

International benchmark calculations of field experiments at the Asse Salt Mine

The geomechanical modeling efforts and results for two benchmark calculations performed by Sandia National Laboratories (Sandia) under the third phase of an overall joint project investigating the behavior of advanced geomechanical constitutive models for rock salt are described and discussed in this report. Sandia recently joined the third phase of the project and is a contributing partner to this U.S./German joint effort entitled “Comparison of current constitutive models and simulation procedures on the basis of model calculations of the thermo-mechanical behavior and healing of rock salt”. The geomechanical models, corresponding results, and their comparison to the in-situ data associated with both the so-called Isothermal Free Convergence (IFC) and Heated Free Convergence Probe (HFCP) borehole experiments conducted by the Netherlands Energy Research Foundation, ECN, at the Asse Mine (Germany) in the mid-80’s are detailed herein.

Holland, John Francis↗

TRACE/PARCS modelling of rips trip transients for Lungmen ABWR

The objectives of this study are to examine the performances of the steady-state results calculated by the Lungmen TRACE/PARCS model compared to SIMULATE-3 code, as well as to use the analytical results of the final safety analysis report (FSAR) to benchmark the Lungmen TRACE/PARCS model. In this study, three power generation methods in TRACE were utilized to analyze the three reactor internal pumps (RIPs) trip transient for the purpose of validating the TRACE/PARCS model. In general, the comparisons show that the transient responses of key system parameters agree well with the FSAR results, including core power, core inlet flow, reactivity, etc. Further studies will be performed in the future using Lungmen TRACE/PARCS model. After the commercial operation of Lungmen nuclear power plant, TRACE/PARCS model will be verified. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

SCITUNE: Aligning Large Language Models with Human-Curated Scientific Multimodal Instructions

Instruction finetuning is a popular paradigm to align large language models (LLM) with human intent. Despite its popularity, this idea is less explored in improving the LLMs to align existing foundation models with scientific disciplines, concepts and goals. In this work, we present SciTune as a tuning framework to improve the ability of LLMs to follow scientific multimodal instructions. To test our methodology, we use a human-generated scientific instruction tuning dataset and train a large multimodal model LLaMA-SciTune that connects a vision encoder and LLM for science-focused visual and language understanding. LLaMA-SciTune significantly outperforms the state-of-the-art models in the generated figure types and captions in multiple scientific multimodal benchmarks. In comparison to the models that are fine-tuned with machine generated data only, LLaMA-SciTune surpasses human performance on average and in many sub-categories on the ScienceQA benchmark.

• Artificial intelligence (AI) / machine learning ↗

Deterministic Modeling of the High Temperature Test Reactor

Idaho National Laboratory (INL) is tasked with the development of reactor physics analysis capability of the Next Generation Nuclear Power (NGNP) project. In order to examine INL’s current prismatic reactor deterministic analysis tools, the project is conducting a benchmark exercise based on modeling the High Temperature Test Reactor (HTTR). This exercise entails the development of a model for the initial criticality, a 19 column thin annular core, and the fully loaded core critical condition with 30 columns. Special emphasis is devoted to the annular core modeling, which shares more characteristics with the NGNP base design. The DRAGON code is used in this study because it offers significant ease and versatility in modeling prismatic designs. Despite some geometric limitations, the code performs quite well compared to other lattice physics codes. DRAGON can generate transport solutions via collision probability (CP), method of characteristics (MOC), and discrete ordinates (Sn). A fine group cross section library based on the SHEM 281 energy structure is used in the DRAGON calculations. HEXPEDITE is the hexagonal z full core solver used in this study and is based on the Green’s Function solution of the transverse integrated equations. In addition, two Monte Carlo (MC) based codes, MCNP5 and PSG2/SERPENT, provide benchmarking capability for the DRAGON and the nodal diffusion solver codes. The results from this study show a consistent bias of 2–3% for the core multiplication factor. This systematic error has also been observed in other HTTR benchmark efforts and is well documented in the literature. The ENDF/B VII graphite and U235 cross sections appear to be the main source of the error. The isothermal temperature coefficients calculated with the fully loaded core configuration agree well with other benchmark participants but are 40% higher than the experimental values. This discrepancy with the measurement stems from the fact that during the experiments the control rods were adjusted to maintain criticality, whereas in the model, the rod positions were fixed. In addition, this work includes a brief study of a cross section generation approach that seeks to decouple the domain in order to account for neighbor effects. This spectral interpenetration is a dominant effect in annular HTR physics. This analysis methodology should be further explored in order to reduce the error that is systematically propagated in the traditional generation of cross sections.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Ab Initio Thermodynamic Model for Magnesium Carbonates and Hydrates

An ab initio thermodynamic framework for predicting properties of hydrated magnesium carbonate minerals has been developed using density-functional theory linked to macroscopic thermodynamics through the experimental chemical potentials for MgO, water, and CO2. Including semiempirical dispersion via the Grimme method and small corrections to the generalized gradient approximation of Perdew, Burke, and Ernzerhof for the heat of formation yields a model with quantitative agreement for the benchmark minerals brucite, magnesite, nesquehonite, and hydromagnesite. The model shows how small differences in experimental conditions determine whether nesquehonite, hydromagnesite, or magnesite is the result of laboratory synthesis from carbonation of brucite, and what transformations are expected to occur on geological time scales. Because of the reliance on parameter-free first principles methods, the model is reliably extensible to experimental conditions not readily accessible to experiment and to any mineral composition for which the structure is known or can be hypothesized, including structures containing defects, substitutions, or transitional structures during solid state transformations induced by temperature changes or processes such as water, CO2, or O2 diffusion. Demonstrated applications of the ab initio thermodynamic framework include an independent means to evaluate differences in thermodynamic data for lansfordite, predicting the properties of Mg analogs of Ca-based hydrated carbonates monohydrocalcite and ikaite which have not been observed in nature, and an estimation of the thermodynamics of barringtonite from the stoichiometry and a single experimental observation.

Environmental Molecular Sciences Laboratory↗

Dynamics of streamflow permanence in a headwater network: Insights from catchment-scale model simulations

The hillslope and channel dynamics that govern streamflow permanence in headwater systems have important implications for ecosystem functioning and downstream water quality. Recent advancements in process-based, semi-distributed hydrologic models that build upon empirical studies of streamflow permanence in well-monitored headwater catchments show promise for characterizing the dynamics of streamflow permanence in headwater systems. However, few process-based models consider the continuum of hillslope-stream network connectivity as a control on streamflow permanence in headwater systems. The objective of this study was to expand a process-based, catchment-scale hydrologic model to better understand the spatiotemporal dynamics of headwater streamflow permanence and to identify controls of streamflow expansion and contraction in a headwater network. Further, we aimed to develop an approach that enhanced the fidelity of model simulations, yet required little additional data, with the intent that the model might be later transferred to catchments with limited long-term and spatially explicit measurements. This approach facilitated network-scale estimates of the controls of streamflow expansion and contraction, albeit with higher degrees of uncertainty in individual reaches due to data constraints. Our model simulated that streamflow permanence was highly dynamic in first-order reaches with steep slopes and variable contributing areas. The simulated stream network length ranged from nearly 98±2% of the geomorphic channel extent during wet periods to nearly 50±10% during dry periods. The model identified a discharge threshold of approximately 1 mm d –1 , above which the rate of streamflow expansion decreases by nearly an order of magnitude, indicating a lack of sensitivity of streamflow expansion to hydrologic forcing during high-flow periods. Overall, we demonstrate that process-based, catchment-scale models offer important insights on the controls of streamflow permanence, despite uncertainties and limitations of the model. We encourage researchers to increase data collection efforts and develop benchmarks to better evaluate such models.

54 ENVIRONMENTAL SCIENCES↗