Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Integrating State Data Assimilation and Innovative Model Parameterization Reduces Simulated Carbon Uptake in the Arctic and Boreal Region

Model representation of carbon uptake and storage is essential for accurate projection of the response of the arctic-boreal zone to a rapidly changing climate. Land model estimates of LAI and aboveground biomass that can have a marked influence on model projections of carbon uptake and storage vary substantially in the arctic and boreal zone, making it challenging to correctly evaluate model estimates of Gross Primary Productivity (GPP). To understand and correct bias of LAI and aboveground biomass in the Community Land Model (CLM), we assimilated the 8-day Moderate Resolution Imaging Spectroradiometer (MODIS) LAI observation and a machine learning product of annual aboveground biomass into CLM using an Ensemble Adjustment Kalman Filter (EAKF) in an experimental region including Alaska and Western Canada. Assimilating LAI and aboveground biomass reduced these model estimates by 58% and 72%, respectively. The change of aboveground biomass was consistent with independent estimates of canopy top height at both regional and site levels. The International Land Model Benchmarking system assessment showed that data assimilation significantly improved CLM's performance in simulating the carbon and hydrological cycles, as well as in representing the functional relationships between LAI and other variables. Here, to further reduce the remaining bias in GPP after LAI bias correction, we re-parameterized CLM to account for low temperature suppression of photosynthesis. The LAI bias corrected model that included the new parameterization showed the best agreement with model benchmarks. Combining data assimilation with model parameterization provides a useful framework to assess photosynthetic processes in LSMs.

58 GEOSCIENCES↗
DOE OSTI2026

Crowdsourcing the Frontier: Advancing Hybrid Physics‐ML Climate Simulation via a $\$$50,000 Kaggle Competition

Subgrid machine-learning (machine learning [ML]) parameterizations have the potential to introduce a new generation of climate models that incorporate the effects of higher-resolution physics without incurring the prohibitive computational cost associated with more explicit physics-based simulations. However, important issues, ranging from online instability to inconsistent online performance, have limited their operational use for long-term climate projections. To more rapidly drive progress in solving these issues, domain scientists and ML researchers opened up the offline aspect of this problem to the broader ML and data science community with the release of ClimSim, a NeurIPS Data sets and Benchmarks publication, and an associated Kaggle competition. This paper reports on the downstream results of the Kaggle competition by coupling emulators inspired by the winning teams' architectures to an interactive climate model (including full cloud microphysics, a regime historically prone to online instability) and systematically evaluating their online performance. Our results demonstrate that online stability in the low-resolution real-geography setting is reproducible across multiple diverse architectures, which we consider a key milestone. All tested architectures exhibit strikingly similar offline and online biases, though their responses to architecture-agnostic design choices (e.g., expanding the list of input variables) can differ significantly. Multiple Kaggle-inspired architectures achieve state-of-the-art results on certain metrics such as zonal mean bias patterns and global Root Mean Squared Error, indicating that crowdsourcing the essence of the offline problem is one path to improving online performance in hybrid physics-AI climate simulation.

Environmental sciences↗
DOE OSTI2024

High-yield implosion modeling using the Frustraum: Assessing and controlling the formation of polar jets and enhancing implosion performance with applied magnetization

Frustraums have a higher laser-to-capsule x-ray radiation coupling efficiency and can accommodate a large capsule, thus potentially generating a higher yield with less laser energy than cylindrical Hohlraums for a given Hohlraum volume [Amendt et al., Phys. Plasmas 26, 082707 (2019]. Frustraums are expected to have less m = 4 azimuthal asymmetries arising from the intrinsic inner-laser-beam geometry on the National Ignition Facility. An experimental campaign at Lawrence Livermore National Laboratory to demonstrate the high-coupling efficiency and radiation symmetry tuning of the Frustraum has been under way since 2021. Simulations benchmarked against experimental data show that implosions using Frustraums can achieve more yield with higher ignition margins than cylindrical Hohlraums using the same laser energy. Hydrodynamic jets in capsules along the Hohlraum axis, driven by radiation-flux asymmetries in a Hohlraum with a gold liner on a depleted uranium (DU) wall, are present around stagnation, and these “polar” jets can cause severe yield degradation. The early-time Legendre mode P4<0 radiation-flux asymmetry is a leading cause of these jets, which can be reduced by using an unlined DU Hohlraum because the shape of the shell is predicted to be more prolate. Magnetization can increase the implosion robustness and reduce the required hotspot ρR for ignition; therefore, magnetizing the Frustraum can maintain the same yield while reducing the required laser energy or increase the yield using the same laser energy—all under the constraint that the ignition margin is preserved. Reducing polar jets is particularly important for magnetized implosions because of the intrinsic toroidal hotspot ion temperature topology.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

An experimentally informed design process for future inertial confinement fusion facilities

The achievement of ignition in the laboratory has renewed interest in defining the requirements for a future high-gain inertial confinement fusion (ICF) facility. Our best chance of predicting future ICF performance is with 3-D radiation hydrodynamic simulations that have been benchmarked against experimental data, but their high computational cost is prohibitive for use in practical design studies. We introduce a hierarchical approach where 3-D simulations are tuned to match experimental measurements and used to train 3-D degradation models in 1-D simulations allowing for accurate predictions over the entire OMEGA direct-drive database. A genetic algorithm was used in combination with the trained 1-D simulations to search for optimal direct-drive implosion designs at driver energies ranging from 20 kJ to 10 MJ. As the fidelity of 3-D codes improves, this approach will provide a viable experimentally informed tool for defining the next ICF facility.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Statistical inference of anomalous thermal transport with uncertainty quantification for interpretive 2D SOL models

The critical task of inferring anomalous cross-field transport coefficients is addressed in simulations of boundary plasmas with fluid models. A workflow for parameter inference in the UEDGE fluid code is developed using Bayesian optimization with parallelized sampling and integrated uncertainty quantification. In this workflow, transport coefficients are inferred by maximizing their posterior probability distribution, which is generally multidimensional and non-Gaussian. Uncertainty quantification is integrated throughout the optimization within the Bayesian framework that combines diagnostic uncertainties and model limitations. As a concrete example, we infer the anomalous electron thermal diffusivity $\chi_\perp$ from an interpretive 2D model describing electron heat transport in the conduction-limited region with radiative power loss. The workflow is first benchmarked against synthetic data and then tested on H-, L-, and I-mode discharges to match their midplane temperature and divertor heat flux profiles. We demonstrate that the workflow efficiently infers diffusivity and its associated uncertainty, generating 2D profiles that match 1D measurements. Future efforts will focus on incorporating more complicated fluid models and analyzing transport coefficients inferred from a large database of experimental results.

Bayesian optimization↗
DOE OSTI2025

Metal-Insulation REBCO Pancake Coil With Solder Surface Shunt: Testing and Modeling

Rare-earth barium copper oxide (REBCO) high-temperature superconducting (HTS) magnets can generate very high magnetic fields with superior engineering current density and robust mechanical integrity. The no-insulation (NI) winding technique, including its metal-insulation (MI) variant, enables “self-protection” against localized overheating through inter-turn current sharing, improving defect tolerance and allowing temporary current overloads. In REBCO pancake coils, the current-sharing path is predominantly confined to the edges of the REBCO tapes due to insulating buffer layers. Applying a surface shunt using solder can effectively enhance current sharing in NI/MI coils via the REBCO tape edges. Here, in this paper, we present both experimental and numerical research on the current distribution in surface-shunt metal-insulation (SSMI) REBCO pancake coils. We tested a stainless steel co-wound MI REBCO double-pancake coil, before and after applying a soldered surface shunt, in a saturated liquid nitrogen bath. The SSMI coil was modeled using the H-formulation and rotated anisotropic resistivity to study its dynamic behavior, including inter-turn current sharing and intra-turn screening currents. Benchmarked by experimental data, the numerical model is able to study the defect tolerance of the SSMI coil during energization.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

PARET/ANL v7.7 User Guide

PARET was originally created in 1969 at what is now Idaho National Laboratory (INL), to analyze reactivity insertion events in research and test reactor cores cooled by light or heavy water, with fuel composed of either plates or pins. The use of PARET is also appropriate for fuel assemblies with curved fuel plates when their radii of curvatures are large with respect to the fuel plate thickness. The PARET/ANL version of the code has been developed at Argonne National Laboratory (ANL) under the sponsorship of the U.S. Department of Energy/NNSA since the inception of the Reactor Conversion Program. Since Reduced Enrichment for Research and Test Reactors (RERTR) began in 1978, PARET/ANL has been benchmarked to experimental data including SPERT testing, and used to determine the expected transient behavior of many reactors both inside and outside the Reactor Conversion Program. This document provides the pertinent information for the use of PARET/ANL v7.7.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

ORNL FY2024 Nuclear Data Evaluation Contributions: Cu, La, N, and Ta [Slides]

63,65 Cu angular distributions resolved for ENDF/B-VIII.1, consistent with both differential data and integral benchmark performance. 139 La RRR and URR evaluations will be merged with the LANL high energy evaluation, and to be submitted to the future ENDF-B release (post-VIII.1). 14 N RRR evaluation is planned to produce n+ 14 N, p+ 14 C, and a+ 11 B contributions to be submitted to the future ENDF-B release (post-VIII.1). 181 Ta covariances repaired and reported as intended in an errata to ENDF/B-VIII.1.

139-La↗
DOE OSTI2026

MIP dQ/dx Calibration in DUNE ND-LAr Prototypes with Pixelated Charge Readout

The Deep Underground Neutrino Experiment (DUNE) will be a next-generation long baseline neutrino oscillation experiment that will employ LArTPC technology in a near detector placed at Fermilab and a far detector at the Sanford Underground Research Facility, at a baseline of 1300 km. The DUNE Liquid Argon Near Detector (ND-LAr) design takes into account the high neutrino intensity expected from the beam at the Long-Baseline Neutrino Facility (LBNF): 35 modules, each containing two optically separated time projection chambers, are instrumented with a pixel-based, true 3D charge readout alongside scintillation light traps to disentangle the O(100) interactions expected per 10us beam spill. A robust prototyping program supports ND-LAr’s design: the 2x2 Demonstrator consists of four scaled-down ND-LAr modules exposed to the NuMI beam at Fermilab, and the Full Scale Demonstrator (FSD) is a single ND-LAr module tested with cosmic rays at the University of Bern. We present here an analysis of minimum ionizing particle (MIP) tracks selected from 2x2 beam data and FSD cosmic ray data used to benchmark the pixel-based charge readout simulation and calibration in both detectors, with the ultimate goal of validating the design of DUNE ND-LAr as well as informing future calibration methods. This poster will showcase the dependence of the charge response on track inclination as well as a per-pixel dQ/dX extraction.

Mandujano, Roberto [UC, Irvine]↗
DOE OSTI2024

Using automated machine learning for the upscaling of gross primary productivity

Estimating gross primary productivity (GPP) over space and time is fundamental for understanding the response of the terrestrial biosphere to climate change. Eddy covariance flux towers provide in situ estimates of GPP at the ecosystem scale, but their sparse geographical distribution limits larger-scale inference. Machine learning (ML) techniques have been used to address this problem by extrapolating local GPP measurements over space using satellite remote sensing data. However, the accuracy of the regression model can be affected by uncertainties introduced by model selection, parameterization, and choice of explanatory features, among others. Recent advances in automated ML (AutoML) provide a novel automated way to select and synthesize different ML models. In this work, we explore the potential of AutoML by training three major AutoML frameworks on eddy covariance measurements of GPP at 243 globally distributed sites. We compared their ability to predict GPP and its spatial and temporal variability based on different sets of remote sensing explanatory variables. Explanatory variables from only Moderate Resolution Imaging Spectroradiometer (MODIS) surface reflectance data and photosynthetically active radiation explained over 70 % of the monthly variability in GPP, while satellite-derived proxies for canopy structure, photosynthetic activity, environmental stressors, and meteorological variables from reanalysis (ERA5-Land) further improved the frameworks' predictive ability. We found that the AutoML framework Auto-sklearn consistently outperformed other AutoML frameworks as well as a classical random forest regressor in predicting GPP but with small performance differences, reaching an r 2 of up to 0.75. We deployed the best-performing framework to generate global wall-to-wall maps highlighting GPP patterns in good agreement with satellite-derived reference data. This research benchmarks the application of AutoML in GPP estimation and assesses its potential and limitations in quantifying global photosynthetic activity.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

The Role of Nuclear Data Sensitivities in Prompt α-Eigenvalue Predictions of Delayed Critical Benchmarks

Alpha (α) eigenvalues, which describe the logarithmic time derivative of the neutron population in a multiplying system, are integral to time-dependent behavior and diagnostic applications. However, uncertainties in the evaluated nuclear data can significantly impact the accuracy of transport simulations for such quantities. This work explores the use of machine learning models to predict two key outputs, α-eigenvalues and keff bias, using input features derived from α-eigenvalue sensitivities to nuclear data. The criticality safety benchmark models used in this study come from the International Handbook of Evaluated Criticality Safety Benchmark Experiments. Three models, random forest, XGBoost, and NGBoost, are trained on both energy-resolved and energy-summed α sensitivities. For the α-eigenvalue bias prediction, NGBoost achieved the highest R 2 (0.9476) using energy-resolved features, while XGBoost performed best using summed sensitivities. In contrast, when predicting the keff bias, all the models showed moderate predictive capability (best R 2 ≈ 0.72), as the mapping from the static α-sensitivities to the static keff bias was less direct. SHAP (SHapley Additive exPlanations) analysis was used to interpret the model predictions. Across both prediction tasks, the features associated with neutron capture [H-1 (n, γ)], uranium scattering reactions (such as 235 U elastic/inelastic), and actinide capture/fission reactions (such as 239 Pu and 234 U) were consistently identified as the most impactful. This highlights the key role of specific nuclear reactions and energy ranges in shaping both time-dependent and steady-state criticality behavior. These results demonstrated that α-sensitivities, despite being computed for time-dependent metrics, can provide valuable insights for predicting both α-eigenvalues and the keff bias. Moreover, machine learning models offer a promising pathway for uncovering important nuclear data dependencies and guiding future data evaluation efforts.

Nuclear data↗
DOE OSTI2025

DOE FAIR Surrogate Benchmarks Supporting AI and Simulation Research (SBI Surrogate Benchmark Initiative) (Final Report)

Computational Science is being revolutionized by integrating AI and simulation and, in particular, by deep learning surrogate models that can replace all or part of traditional large‐scale HPC computations. Such surrogates can achieve remarkable performance improvements, as much as several orders of magnitude, and save both compute time and energy. The Surrogate Benchmark Initiative (SBI) project creates a community repository and FAIR (Findable, Accessible, Interoperable, and Reusable) data ecosystem for HPC application surrogate benchmarks. The SBI team comes from Argonne National Laboratory (ANL), Indiana University (IU), Rutgers University, the University of Tennessee, Knoxville (UTK), and the University of Virginia(UVA). SBI repositories include data, code, and all relevant collateral artifacts, that the science and engineering community needs to use and reuse these data sets and surrogates. SBI repositories generate active research from both participants in SBI and the broader AI and domain science communities. This project develops surrogates that use several different neural nets to learn and quickly infer the results of simulations and data systems and capture them as surrogate benchmarks with a rich set of metadata, covering. Data; Model; Metrics specification; Machine specification; Science, Speed, Power Results, We research FAIR metadata for these benchmarks. We develop application surrogate examples as benchmarks across many fields (ANL, UTK, IU, UVA). We also study non Surrogate benchmarks that have many common features and similar issues regarding FAIRness. We work with MLCommons (UVA, UTK), which is a major machine learning benchmarking activity where we get metadata ontologies, software, and benchmarks, benchmarks have datasets, models, and metadata, and they need a technical framework developed by UTK and Rutgers and deployed by UVA. We study features of Surrogates, including performance, training set size, and uncertainty quantification (Rutgers, UVA and IU).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

FAIR Surrogate Benchmarks Supporting AI and Simulation Research (Final Report)

Computational Science is being revolutionized by integrating AI and simulation and, in particular, by deep learning surrogate models that can replace all or part of traditional large‐scale HPC computations. Such surrogates can achieve remarkable performance improvements, as much as several orders of magnitude, and save both compute time and energy. The Surrogate Benchmark Initiative (SBI) project creates a community repository and FAIR (Findable, Accessible, Interoperable, and Reusable) data ecosystem for HPC application surrogate benchmarks. The SBI team comes from Argonne National Laboratory (ANL), Indiana University (IU), Rutgers University, the University of Tennessee, Knoxville (UTK), and the University of Virginia (UVA). SBI repositories include data, code, and all relevant collateral artifacts that the science and engineering community need to use and reuse these data sets and surrogates. SBI repositories generate active research from both the participants in SBI and the broad community of AI and domain scientists. This project develops surrogates that use several different neural nets to learn and quickly infer the results of simulations and data systems and captures them as surrogate benchmarks with a rich set of metadata covering: Data; Model; Metrics specification; Machine specification; and Science, Speed, and Power Results. We research FAIR metadata for these benchmarks. We develop application surrogate examples as benchmarks across many fields (ANL, UTK, IU, UVA). We also study non-Surrogate benchmarks that have many common features and similar issues as regards FAIRness. We work with MLCommons (UVA, UTK), which is a major machine learning benchmarking activity where we get metadata ontologies, software, and benchmarks, Benchmarks have datasets, models, and metadata and they need a technical framework developed by UTK and Rutgers and deployed by UVA. We study features of Surrogates including performance, training set size, and uncertainty quantification (Rutgers, UVA and IU).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Cooling Matters: Benchmarking Large Language Models and Vision-Language Models on Liquid-Cooled Versus Air-Cooled H100 GPU Systems

The unprecedented growth in artificial intelligence (AI) workloads, recently dominated by large language models (LLMs) and vision-language models (VLMs), has intensified power and cooling demands in data centers. This study benchmarks LLMs and VLMs on two HGX nodes, each with 8× NVIDIA H100 graphics processing units (GPUs), using liquid and air cooling. Leveraging GPU Burn, Weights & Biases, and IPMItool, we collect detailed thermal, power, and computation data. Results show that the liquid-cooled systems maintain GPU temperatures between 41-50$^\circ$C, while the air-cooled counterparts fluctuate between 54-72$^\circ$C under load. This thermal stability of liquid-cooled systems yields 17% higher performance (54 TFLOPs/ GPU vs. 46 TFLOPs/GPU), performance-per-watt, reduced energy overhead, and greater system efficiency than the air-cooled counterparts. These findings underscore the energy and sustainability benefits of liquid cooling, offering a compelling path forward for hyperscale data centers seeking to optimize AI infrastructure. https://github.com/iscaas/Cooling-Matters.

Latif, Imran↗
DOE OSTI2024

Nuclear Data Sensitivity/Uncertainty Studies of Tantalum-Reflected Systems

Tantalum (Ta) is a refractory metal with high melting point and high corrosion resistance. This makes it useful as a mold material for plutonium casting operations. Unfortunately, there are few criticality benchmarks with high nuclear data sensitivities. Given that, it is desirable to design new experiments to provide additional validation data for nuclear criticality safety, which is the objective of the Thales project. Multiple application models were used to represent process conditions (either normal conditions or credible upset conditions) both at Los Alamos National Laboratory (LANL) and Savannah River Site (SRS). A total of 40 application models were obtained. Given this, it was useful to down-select the number of needed application models. This work documents the down-selection based on several nuclear data sensitivity/uncertainty metrics. In addition to showing the result of the specific down-selection used for the Thales project, this work discusses potential ways to represent a large number of application models with a smaller number of proposed experiment designs.

42 ENGINEERING↗
DOE OSTI2025

Thermal Hydraulics Validation Activities in the ART-GCR Campaign

The Advanced Reactor Technologies - Gas Cooled Reactor Campaign (ART-GCR) is part of the United States Department of Energy - Office of Nuclear Energy's Advanced Reactor Technologies program aimed at developing a High Temperature Gas-cooled Reactor (HTGR) which will offer enhancements in safety and efficiency. The Design, Methods, and Validation arm of the ART-GCR program provides experience and advanced tools for HTGR design and analysis. The Methods and Validation arm is developing data to validate predictions of decay heat removal through an extensive experimental campaign the Natural Convection Shutdown Heat Removal Test Facility at Argonne National Laboratory. In-core thermal hydraulics validation is being facilitated through the OECD/NEA's Thermal Hydraulic Code Validation Benchmark for High Temperature Gas-Cooled Reactors using HTTF Data. That benchmark contains code-to-code and code-to-data comparisons for 3 sets of HTGR thermal hydraulics phenomena. This ongoing benchmark activity has 16 participants from 9 countries developing leading insights into HTGR thermal hydraulics code validation. The ART-GCR campaign is also working on the development of state-of-the-art MOOSE-based models of the High Temperature Engineering Test Reactor (HTTR). Through the OECD/NEA's HTTR Loss of Forced Cooling (LOFC) program, the ART-GCR campaign is developing a multiphysics transient code validation benchmark based on 3 HTTR experiments that will provide an opportunity for international collaboration on multiphysics code validation.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Expanded Intercomparison of Nuclear Data Libraries Using Jupiter and Jupiter High-240 Experiments

There is a limited availability of plutonium experiments with sensitivity to lead in the ICSBEP (International Handbook of Evaluated Criticality Safety Benchmark Experiments) Handbook. The Jupiter and Jupiter High-240 experiments were performed at the National Criticality Experiments Research Center as a collaborative effort between Los Alamos National Laboratory and the Japan Atomic Energy Agency to assess lead void coefficients in a plutonium-lead system containing weapons- and reactor-grade plutonium, respectively. Concurrent with benchmark development, an intercomparison of calculations using different nuclear data libraries has been performed to assess the usability of the experimental data for nuclear data adjustment in a “softer-that-fast” neutron energy spectrum. Eigenvalue calculations using MCNP with the ENDF/B-VIII.0 and TENDL-2021 nuclear data libraries calculate closest to the benchmark values for Jupiter. Calculations using JENDL-5 and ENDF/B-VIII.1 match best with the Jupiter High-240 values. Lead void worth calculations using the various nuclear data libraries are all within 3σ of their respective measured values. Perturbation studies between ENDF/B-VIII.0 and ENDF/B-VIII.1 demonstrate an approximate increase in calculated eigenvalues for the Jupiter series experiments by ~240 pcm for plutonium (mostly 239 Pu) and ~120 pcm for lead accompanied by a decrease contributed by ~113 pcm for copper and ~13 pcm for stainless steel. Nuclear data sensitivities and uncertainties investigated using Whisper show slightly lower sensitivity to scatter than a lead-reflected plutonium sphere but greater sensitivity to neutron capture. The sensitivities between Jupiter and Jupiter High-240 for lead are very similar for both ENDF/B-VIII.0 and ENDF/B-VIII.1 nuclear data. These benchmarks are more sensitive to neutron capture in lead than other plutonium benchmark experiments and would be useful for both lead and 240 Pu validation. In conclusion, with the high degree of compensating effects between copper, lead, and plutonium cross sections, additional isolated Pb-Pu and Cu-Pu benchmarks would be beneficial in improving these nuclear data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗