Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Improving and testing machine learning methods for benchmarking soil carbon dynamics representation of land surface models

Representation of soil organic carbon (SOC) dynamics in Earth system models (ESMs) is a key source of uncertainty in predicting carbon climate feedbacks. The magnitude of this uncertainty can be reduced by accurate representation of environmental controllers of SOC stocks in ESMs. In this study, we used data of environmental factors, field SOC observations, ESM projections and machine learning approaches to identify dominant environmental controllers of SOC stocks and derive functional relationships between environmental factors and SOC stocks. Our derived functional relationships predicted SOC stocks with similar accuracy as the machine learning approach. We used the derived relationships to benchmark the coupled model intercomparison project phase six ESM representation of SOC stocks. We found divergent environmental control representation in ESMs in comparison to field observations. Representation of SOC in ESMs can be improved by including additional environmental factors and representing their functional relationships with SOC consistent with observations.

54 ENVIRONMENTAL SCIENCES↗

Simultaneously Coupled Mechanical-Electrochemical-Thermal Simulation of Lithium-Ion Cells: Preprint

Understanding the combined electrochemical-thermal and mechanical response of a system has a variety of applications, for example, structural failure from electrochemical fatigue and the potential induced changes of material properties. For lithium-ion batteries, there is an added concern over the safety of the system in the event of mechanical failure of the cell components. In this work, we present a generic multi-scale simultaneously coupled mechanical-electrochemical-thermal model to examine the interaction between mechanical failure and electrochemical-thermal responses. We treat the battery cell as a homogeneous material while locally we explicitly solve for the mechanical response of individual components using a homogenization model and the electrochemical-thermal responses using an electrochemical model for the battery. A benchmark problem is established to demonstrate the proposed modeling framework. The model shows the capability to capture the gradual evolution of cell electrochemical-thermal responses, and predicts the variation of those responses under different short-circuit conditions.

25 ENERGY STORAGE↗

Hydraulic and mixing evaluations for SRS miscible liquid solutions

The hydraulic results demonstrate that pump head pressure of 20 psi recirculates about 5.6 liters/min flowrate through the existing 0.131-inch orifice when a valve connected to NT-41 is closed. In case of the valve open to NT-41, the solution flowrates to Savannah River Site (SRS) tanks, NT-21 and NT-41, are found to be about 0.5 lpm and 5.2 lpm, respectively. The modeling calculations for the mixing operations of miscible fluids contained in the SRS HB-Line tank NT-21 were performed by taking a three-dimensional Computational Fluid Dynamics (CFD) approach. The CFD modeling results were benchmarked against the literature results and the previous SRNL test results to validate the model. Final performance calculations were performed for the nominal case by using the validated model to quantify the mixing time for the HB-Line tank. The results demonstrate that when a pump recirculates a solution volume of 5.7 liters every minute out of the 72-liter tank contents containing two acid solutions of 2.7 M and 0 M concentrations (i.e., water), a minimum mixing time of 1.5 hours is adequate for the tank contents to get the tank contents adequately mixed. In addition, the sensitivity results for the tank contents of 8 M existing solution and 1.5 M incoming species show that the mixing time takes about 2 hours to get the solutions mixed. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

wa-hls4ml-paper

Code for plots, models, data generation and other utilities relating to the paper "wa-hls4ml: A Benchmark and Surrogate Models for hls4ml Resource and Latency Estimation" https://arxiv.org/abs/2511.05615 [FERMILAB-PUB-25-0359-CSAID]

Hawks, Ben [Fermi National Accelerator Laboratory ↗

Mixing Study for JT-71/72 Tanks

All modeling calculations for the mixing operations of miscible fluids contained in HB-Line tanks, JT-71/72, were performed by taking a three-dimensional Computational Fluid Dynamics (CFD) approach. The CFD modeling results were benchmarked against the literature results and the previous SRNL test results to validate the model. Final performance calculations were performed by using the validated model to quantify the mixing time for the HB-Line tanks. The mixing study results for the JT-71/72 tanks show that, for the cases modeled, the mixing time required for blending of the tank contents is no more than 35 minutes, which is well below 2.5 hours of recirculation pump operation. Therefore, the results demonstrate the adequacy of 2.5 hours’ mixing time of the tank contents by one recirculation pump to get well mixed.

42 ENGINEERING↗

HYDRAULICS AND MIXING EVALUATIONS FOR NT-21/41 TANKS

The hydraulic results demonstrate that pump head pressure of 20 psi recirculates about 5.6 liters/min flowrate through the existing 0.131-inch orifice when a valve connected to NT-41 is closed. In case of the valve open to NT-41, the solution flowrates to HB-Line tanks, NT-21 and NT-41, are found to be about 0.5 lpm and 5.2 lpm, respectively. The modeling calculations for the mixing operations of miscible fluids contained in the HB-Line tank NT-21 were performed by taking a three-dimensional Computational Fluid Dynamics (CFD) approach. The CFD modeling results were benchmarked against the literature results and the previous SRNL test results to validate the model. Final performance calculations were performed for the nominal case by using the validated model to quantify the mixing time for the HB-Line tank. The results demonstrate that when a pump recirculates a solution volume of 5.7 liters every minute out of the 72-liter tank contents containing two acid solutions of 2.7 M and 0 M concentrations (i.e., water), a minimum mixing time of 1.5 hours is adequate for the tank contents to get the tank contents adequately mixed. In addition, the sensitivity results for the tank contents of 8 M existing solution and 1.5 M incoming species show that the mixing time takes about 2 hours to get the solutions mixed.

42 ENGINEERING↗

Classical Benchmarks for Variational Quantum Eigensolver Simulations of the Hubbard Model

Simulating the Hubbard model is of great interest to a wide range of applications within condensed matter physics, however its solution on classical computers remains challenging in dimensions larger than one. The relative simplicity of this model, embodied by the sparseness of the Hamiltonian matrix, allows for its efficient implementation on quantum computers, and for its approximate solution using variational algorithms such as the variational quantum eigensolver. While these algorithms have been shown to reproduce the qualitative features of the Hubbard model, their quantitative accuracy in terms of producing true ground state energies and other properties, and the dependence of this accuracy on the system size and interaction strength, the choice of variational ansatz, and the degree of spatial inhomogeneity in the model, remains unknown. Here we present a rigorous classical benchmarking study, demonstrating the potential impact of these factors on the accuracy of the variational solution of the Hubbard model on quantum hardware, for systems with up to 32 qubits. We find that even when using the most accurate wavefunction ansätze for the Hubbard model, the error in its ground state energy and wavefunction plateaus for larger lattices, while stronger electronic correlations magnify this issue. Concurrently, spatially inhomogeneous parameters and the presence of off-site Coulomb interactions only have a small effect on the accuracy of the computed ground state energies. Our study highlights the capabilities and limitations of current approaches for solving the Hubbard model on quantum hardware, and we discuss potential future avenues of research.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

LANL Critical Benchmark Comparison Study and Subsequent Revision for Cases Involving LEU and MIX

As part of an international collaboration within the DOE Nuclear Criticality Safety Program (NCSP), LANL is involved in a comparison study to quantify differences in k-effective results from neutron transport simulations of critical benchmark experiments. The DOE NCSP Mission and Vision details the activity in which the French Institut de Radioprotection et de Sûreté Nucléaire (IRSN) leads the study with LANL, ORNL, and LLNL to compare results of various neutron transport codes and nuclear data libraries for ICSBEP benchmarks held in common by the entities. The task statement from the DOE NCSP Five-Year Execution Plan is given as: "The proposal is for IRSN to lead a new intercomparison based on the MORET code with the latest JEFF-3.3 data and ENDF/B-VIII.0 data, when available, using their existing comprehensive selection of 2,714 benchmarks and collate their results together with those from LLNL (COG), LANL (MCNP) and ORNL (SCALE). Due to the large number of benchmarks involved, this effort is envisioned to take three years with an additional year for IRSN to complete a summary report. The benchmark development will be performed independently to minimize modeling errors through discovery and resolution of discrepant results. A summary report will be generated (led by IRSN) to document the results of this study." This report documents results obtained for revisions made to cases involving Intermediate Enriched Uranium (IEU) and a mixture of Pu and Uranium (MIX), with a focus on the changes made to LANL benchmarks modeled with MCNP6 using ENDF/B-VII.1 nuclear data that appeared to have discrepant results when compared with results of other codes. Feedback was used to pinpoint review of particular benchmark input files and to revise them when necessary. This report documents the results of review and revision of specific benchmarks highlighted as possibly discrepant in the comparison study. In addition, there is an effort tied to this work involving collaboration between LANL XCP and NCS Divisions in the development of a shared review/revision procedure and use of a new benchmark repository.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Experimental and Numerical Investigation of Reduced Gravity Fluid Slosh Dynamics for the Characterization of Cryogenic Launch and Space Vehicle Propellants

As space programs increasingly investigate various options for long duration space missions the accurate prediction of propellant behavior over long periods of time in microgravity environment has become increasingly imperative. This has driven the development of a detailed, physics-based understanding of slosh behavior of cryogenic propellants over a range of conditions and environments that are relevant for rocket and space storage applications. Recent advancements in computational fluid dynamics (CFD) models and hardware capabilities have enabled the modeling of complex fluid behavior in microgravity environment. Historically, launch vehicles with moderate duration upper stage coast periods have contained very limited instrumentation to quantify propellant stratification and boil-off in these environments, thus the ability to benchmark these complex computational models is of great consequence. To benchmark enhanced CFD models, recent work focuses on establishing an extensive experimental database of liquid slosh under a wide range of relevant conditions. In addition, a mass gauging system specifically designed to provide high fidelity measurements for both liquid stratification and liquid/ullage position in a micro-gravity environment has been developed. This pUblication will summarize the various experimental programs established to produce this comprehensive database and unique flight measurement techniques.

Walls, Laurie K.↗

First-principle and empirical modelling of the global-scale ionosphere

The SUNDIAL program offers a unique opportunity to study ionospheric behavior on a global scale. As part of this program, data pertaining to solar, interplanetary, magnetospheric, ionospheric, and thermospheric conditions are collected simultaneously from a large number of satellite and ground-based sites spread around the world. In the coming years, these data should lead to a major improvement in both empirical and first-principle ionospheric models. As a benchmark against which to compare future progress, the present state of empirical and numerical ionospheric modeling is discussed. The discussion covers the capabilities and limitations of the existing models as well as the direction of future modeling efforts.

Schunk, R. W.↗

How well was total ozone abundance inferred with Mariner 9?

Ozone is a key to understanding atmospheric chemistry on Mars. Over 20 photochemical models of the martian atmosphere have been published, and O3 is often used as a benchmark for these models. O3 abundance has been inferred from instrumentation on several spacecraft, with the most complete coverage provided by Mariner 9. The Mariner 9 UV spectrometer scanned from 2100 to 3500 Angstroms with a spectral resolution of 15 Angstroms and an effective field-of-view of approximately 300 sq km. The only atmospheric absorption in the 2000 to 3000 A wavelength region was previously assumed to come from the Hartley band system of ozone, which has an opacity of order unity at winter polar latitudes. Therefore, the amount of ozone was inferred by fitting this absorption feature with laboratory data of ozone absorption. Mars O3 shows strong seasonal and latitudinal variation, with column abundances ranging from 0.2 micron-atm at equatorial latitudes to 60 micron-atm over northern winter polar latitudes (1 micron-atm is a column abundance of 2.689 x 10 exp 15 molecules cm(exp -2)). However, the O3 abundance is never great enough to significantly affect atmospheric temperatures or surface temperatures and frost amounts. Some of the previously-inferred O3 abundances are shown. A radiative transfer computer model is used to re-examine the Mariner 9 UV spectra. Assuming a constant mixing ratio for O3 and no chemical or radiative interaction between O3 and clouds/dust, it is shown that when typical amounts of dust and cloud are present that significant underestimation of O3 abundance occurs. A factor of 3 times as much O3 is needed to generate the same spectrum the spacecraft would measure for a cloudy, dusty atmosphere as for a clear atmosphere. If the scattering properties of martian clouds and dust were well known, then their appearance would not be a problem, as a model would be capable of retrieving the O3 abundance. However, these properties are not well known, which raises doubts about the effectiveness of the UV reflectance spectroscopy technique for measuring O3 abundance on Mars.

Lindner, Bernhard Lee↗

How well was total ozone abundance inferred with Mariner 9

Ozone is a key to understanding atmospheric chemistry on Mars. Over 20 photochemical models of the Martian atmosphere have been published, and O3 is often used as a benchmark for these models. O3 abundance has been inferred from instrumentation on several spacecraft, with the most complete coverage provided by Mariner 9. A radiative transfer computer model is used to re-examine the Mariner 9 UV spectra.

Lindner, B. L.↗

Modeling PCM-Enhanced Insulation System and Benchmarking EnergyPlus against Controlled Field Data

Phase-change materials (PCM) used in building envelopes appear to be a promising technology to reduce energy consumption and reduce/shift peak load. However, due to complexity in modeling the dynamic behavior of PCMs, current modeling tools either lack an accurate way of predicting the performance and impact of PCMs in buildings or validation of predicted or measured performance is not available. This paper presents a model of a PCM-enhanced dynamic-insulation system in EnergyPlus (E+) and compares the simulation results against field-measured data. Laboratory tests to evaluate thermal properties and to characterize the PCM and PCM-enhanced cellulose insulation system are also presented in this paper. Results indicate that the predicted daily average heat flux through walls from the E+ simulation was within 9% of field measured data. Future analysis will allow us to predict annual energy savings from the use of PCM in buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A PDF-Based Parameterization of Subgrid-Scale Hydrometeor Transport in Deep Convection

Abstract A parameterization scheme is proposed for the subgrid-scale transport of hydrometeors in an assumed probability density function (PDF) scheme. Joint distributions of vertical velocity and hydrometeor mixing ratios are typically unknown, but marginal (1D) PDFs of these variables are available. The parameterization is developed using high-resolution simulations of continental and tropical deep convection. A 3D cloud-resolving model (CRM) providing benchmark solutions has a horizontal grid spacing of 250 m and employs the Morrison microphysics scheme, which treats prognostically mass and number mixing ratios for four types of precipitating hydrometeors (rain, graupel, snow, and ice) as well as cloud droplet number mixing ratio. The subgrid-scale hydrometeor transport scheme assumes input given in the form of marginal PDFs of vertical velocity and hydrometeor mixing ratios; in this study, these marginal distributions are provided by the cloud-resolving model. Conditional sampling and scaling are then applied to the marginal distributions to account for subplume correlations. The parameterized fluxes tested for four episodes of deep convection show good agreement with benchmark fluxes computed directly from the CRM output. The results demonstrate the potential use of the subgrid-scale hydrometeor transport scheme in an assumed PDF scheme to parameterize the covariances of vertical velocity and hydrometeor mixing ratios.

Wong, May↗

Predicting Cost/Performance Trade-Offs for Whitney: A Commodity Computing Cluster

Recent advances in low-end processor and network technology have made it possible to build a "supercomputer" out of commodity components. We develop simple models of the NAS Parallel Benchmarks version 2 (NPB 2) to explore the cost/performance trade-offs involved in building a balanced parallel computer supporting a scientific workload. We develop closed form expressions detailing the number and size of messages sent by each benchmark. Coupling these with measured single processor performance, network latency, and network bandwidth, our models predict benchmark performance to within 30%. A comparison based on total system cost reveals that current commodity technology (200 MHz Pentium Pros with 100baseT Ethernet) is well balanced for the NPBs up to a total system cost of around $1,000,000.

Becker, Jeffrey C.↗

CFD-aided benchmark assessment of coal devolatilization one-step models in oxy-coal combustion conditions

Coal devolatilization, as first step in thermochemical processes involving solid fuels, has been targeted in plenty of CFD investigations: despite the variety of models that were developed to define the rate of the process and the amount of volatile matter released, not all of them are suitable for CFD simulations of large-scale coal combustors. Empirical models ensure both simplicity and feasibility, but not full reliability for all coal types and operating conditions. CFD modeling results for coal conversion during devolatilization in an entrained flow reactor and oxy-conditions are presented and compared to experimental data. A benchmark assessment of one-step models on the accuracy of the volatile yield prediction is then performed. It is shown that the heating rate strongly influences the devolatilization process and its modeling, not only in terms of rate but also in terms of yield, which differs significantly from the proximate analysis value. Furthermore, this indicates the need for a model able to predict the variation of coal volatile yield with temperature and heating rate, in addition to the kinetic model.

01 COAL, LIGNITE, AND PEAT↗

Fuel convergence sensitivity in indirect drive implosions

In inertial confinement fusion experiments at the National Ignition Facility, a spherical shell of deuterium–tritium fuel is imploded in an attempt to reach the conditions needed for fusion, self-heating, and eventual ignition. Since theory and simulations indicate that ignition efficacy in 1D improves with increasing imploded fuel convergence ratio, it is useful to understand the sensitivity of the scale-invariant fuel convergence on all measurable or inferable 1D parameters. In this paper, we develop a simple isobaric and isentropic compression scaling model incorporating sensitivity to the in-flight adiabat inferred from shock strengths, to measured implosion velocity, and to known initial ablator and fuel aspect ratio and mass ratio. The model is first benchmarked to 1D implosion simulations spanning a variety of relevant implosion designs. We then use the model to compare compressibility trends across all existing indirect-drive layered implosion data from the facility spanning three ablators [CH, carbon (C), and Be], for which in-flight fuel adiabats varied from 1.6 to 5 by varying the number of drive shocks from 2 to 4, peak implosion velocities varied by 1.4×, capsule radii by 50%, and initial fuel aspect ratios by 1.4×. We find that the strength of the first shock is the dominant contributor setting the maximum fuel convergence. We also observe additional sensitivities to successive shock strengths and fuel aspect ratios that improve the agreement between the expected and measured compression for carbon and Be designs with adiabats above 3. A principal finding is that the adiabat 2.5 C-shell designs exhibit less convergence than CH-shell designs of similar inferred in-flight adiabat.

Landen, O. L. (ORCID:0000000214998217)↗