Results for “model benchmark” — Page 43

NASA NTRS2024

Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applications

This technical report presents Prithvi-EO-2.0, a new geospatial foundation model that offers significant improvements over its predecessor, Prithvi-EO-1.0. Trained on 4.2M global time series samples from NASA’s Harmonized Landsat and Sentinel-2 data archive at 30m resolution, the new 300M and 600M parameter models incorporate temporal and location embeddings for enhanced performance across various geospatial tasks. Through extensive benchmarking with GEOBench, the 600M version outperforms the previous Prithvi-EO model by 8% across a range of tasks. It also outperforms six other geospatial foundation models when benchmarked on remote sensing tasks from different domains and resolutions (i.e. from 0.1m to 15m). The results demonstrate the versatility of the model in both classical earth observation and high-resolution applications. Early involvement of end-users and subject matter experts (SMEs) are among the key factors that contributed to the project’s success. In particular, SME involvement allowed for constant feedback on model and dataset design, as well as successful customization for diverse SME-led applications in disaster response, land use and crop mapping, and ecosystem dynamics monitoring. Prithvi-EO-2.0 is available on Hugging Face and IBM terratorch, with additional resources on GitHub. The project exemplifies the Trusted Open Science approach embraced by all involved organizations.

Daniela Szwarcman↗

DOE OSTI2022

Probing atomic physics at ultrahigh pressure using laser-driven implosions

Abstract Spectroscopic measurements of dense plasmas at billions of atmospheres provide tests to our fundamental understanding of how matter behaves at extreme conditions. Developing reliable atomic physics models at these conditions, benchmarked by experimental data, is crucial to an improved understanding of radiation transport in both stars and inertial fusion targets. However, detailed spectroscopic measurements at these conditions are rare, and traditional collisional-radiative equilibrium models, based on isolated-atom calculations and ad hoc continuum lowering models, have proved questionable at and beyond solid density. Here we report time-integrated and time-resolved x-ray spectroscopy measurements at several billion atmospheres using laser-driven implosions of Cu-doped targets. We use the imploding shell and its hot core at stagnation to probe the spectral changes of Cu-doped witness layer. These measurements indicate the necessity and viability of modeling dense plasmas with self-consistent methods like density-functional theory, which impact the accuracy of radiation transport simulations used to describe stellar evolution and the design of inertial fusion targets.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2026

Benchmarking state-of-the-art theory and empirical models of pionless neutrino-argon scattering in GENIE

Upcoming experiments need improved simulations of neutrino scattering. This work uses the popular GENIE event generator to test a variety of neutrino interaction models against recent MicroBooNE measurements of pionless charged-current interactions. The GENIE code can easily interchange model components, including nucleon form factor parameterizations, quasielastic cross-section calculations, treatments of the nuclear ground state and hadronic final-state interactions. Leveraging this software capability in comparisons with MicroBooNE data, the performance of some of GENIE’s most theoretically sophisticated model components is evaluated and contrasted with more empirically-driven alternatives.

Neutrino cross section↗

DOE OSTI2023

Benchmarks and results of the two-band Hubbard model from the Gutzwiller conjugate gradient minimization theory

Ground-state properties, such as energies and double occupancies, of a one-dimensional two-band Hubbard model are calculated using a first-principles Gutzwiller conjugate gradient minimization theory. The favorable agreement with the results from the density matrix renormalization group theory demonstrates the accuracy of our method. A rotationally invariant approach is further incorporated into the method to greatly reduce the computational complexity with a speedup of approximately 50 times. Moreover, we investigate the Mott transition between a metal and a Mott insulator by evaluating the charge gap. In conclusion, with greatly reduced computational effort, our method reproduces the phase diagram in reasonable agreement with the density matrix renormalization group theory.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2022

A Tanks-in-Series Approach to Estimate Parameters for Lithium-Ion Battery Models

Advanced Battery Management Systems (BMS) play a vital role in monitoring, predicting, and controlling the performance of lithium-ion batteries. BMS employing sophisticated electrochemical models can help increase battery cycle life and minimize charging time. However, in order to realize the full potential of electrochemical model-based BMS, it is critical to ensure accurate predictions and proper model parameterization. The accuracy of the predictions of an electrochemical model is dependent on the accuracy of its parameters, the values of which might change with battery cycling and aging. Parameter estimation for an electrochemical model is generally challenging due to the nonlinear nature and computational complexity of the model equations. To this end, this work utilizes the recently proposed Tanks-in-Series model for Li-ion batteries (J.Electrochem. Soc., 167, 013534 (2020)) to perform parameter estimation. The Tanks-in-Series approach allows for substantially faster parameter estimation compared to the original pseudo two-dimensional (p2D) model. The objective of this work is thus to demonstrate the gain in computational efficiency from the Tanks-in-Series approach. A sensitivity analysis of model parameters is also performed to benchmark the fidelity of the Tanks-in-Series model.

25 ENERGY STORAGE↗

DOE OSTI2022

Benchmarking VQE for the square-octagon-lattice Kitaev model [Slides\

Explore the source record for details and available documents.

Li, Andy Yiu↗

DOE OSTI2026

Benchmarking State-of-the-Art Theory and Empirical Models of Pionless Neutrino-Argon Scattering in GENIE

Neutrino event generators require a delicate balance between theory and empirically-driven models to achieve reliable simulations. GENIE is the most commonly used generator, bridging theory and experiment in modern neutrino physics. Its flexible framework makes it ideal for comparing different models across all aspects of neutrino interactions—from the nuclear ground state and primary vertex to final-state interactions. Recently, GENIE has incorporated several state-of-the-art, theory-driven models, including spectral-function descriptions of the nuclear ground state, axial form factors from first-principles lattice QCD calculations, and the Liège intranuclear cascade model for simulating final-state interactions. Compared to the previous baseline models in GENIE—such as the local Fermi gas, dipole-like axial form factor, and hA final-state interaction model—the new implementations are more physically realistic and incorporate more complete physics, including nuclear de-excitation. This poster presents the implementation of new models in GENIE and their performance in comparisons among these models against recent MicroBooNE cross-section measurements.

Liu, Liang [Fermilab] (ORCID:000000026753925X)↗

DOE OSTI2026

Benchmarking State-of-the-Art Theory and Empirical Models of Pionless Neutrino-Argon Scattering in GENIE

Neutrino event generators require a delicate balance between theory and empirically-driven models to achieve reliable simulations. GENIE is the most commonly used generator, bridging theory and experiment in modern neutrino physics. Its flexible framework makes it ideal for comparing different models across all aspects of neutrino interactions—from the nuclear ground state and primary vertex to final-state interactions. Recently, GENIE has incorporated several state-of-the-art, theory-driven models, including spectral-function descriptions of the nuclear ground state, axial form factors from first-principles lattice QCD calculations, and the Liège intranuclear cascade model for simulating final-state interactions. Compared to the previous baseline models in GENIE—such as the local Fermi gas, dipole-like axial form factor, and hA final-state interaction model—the new implementations are more physically realistic and incorporate more complete physics, including nuclear de-excitation. This poster presents the implementation of new models in GENIE and their performance in comparisons among these models against recent MicroBooNE cross-section measurements.

Liu, Liang [Fermilab] (ORCID:000000026753925X)↗

NASA NTRS1994

An alternative assessment of second-order closure models in turbulent shear flows

The performance of three recently proposed second-order closure models is tested in benchmark turbulent shear flows. Both homogeneous shear flow and the log-layer of an equilibrium turbulent boundary layer are considered for this purpose. An objective analysis of the results leads to an assessment of these models that stands in contrast to that recently published by other authors. A variety of pitfalls in the formulation and testing of second-order closure models are uncovered by this analysis.

Speziale, Charles G.↗

NASA NTRS1997

An Experimental Study of Characteristic Combustion-Driven Flow for CFD Validation

A series of uni-element rocket injector studies were completed to provide benchmark quality data needed to validate computational fluid dynamic models. A shear coaxial injector geometry was selected as the primary injector for study using gaseous hydrogen/oxygen and gaseous hydrogen/liquid oxygen propellants. Emphasis was placed on the use of nonintrusive diagnostic techniques to characterize the flowfields inside an optically-accessible rocket chamber. Measurements of the velocity and species fields were obtained using laser velocimetry and Raman spectroscopy, respectively. Qualitative flame shape information was also obtained using laser-induced fluorescence excited from OH radicals and laser light scattering studies of aluminum oxide particle seeded combusting flows. The gaseous hydrogen/liquid oxygen propellant studies for the shear coaxial injector focused on breakup mechanisms associated with the liquid oxygen jet under subcritical pressure conditions. Laser sheet illumination techniques were used to visualize the core region of the jet and a Phase Doppler Particle Analyzer was utilized for drop velocity, size and size distribution characterization. The results of these studies indicated that the shear coaxial geometry configuration was a relatively poor injector in terms of mixing. The oxygen core was observed to extend well downstream of the injector and a significant fraction of the mixing occurred in the near nozzle region where measurements were not possible to obtain. Detailed velocity and species measurements were obtained to allow CFD model validation and this set of benchmark data represents the most comprehensive data set available to date. As an extension of the investigation, a series of gas/gas injector studies were conducted in support of the X-33 Reusable Launch Vehicle program. A Gas/Gas Injector Technology team was formed consisting of the Marshall Space Flight Center, the NASA Lewis Research Center, Rocketdyne and Penn State. Injector geometries studied under this task included shear and swirl coaxial configurations as well as an impinging jet injector.

Santoro, Robert J.↗

NASA NTRS1997

An Experimental Study of Characteristic Combustion-Driven Flow for CFD Validation

A series of uni-element rocket injector studies were completed to provide benchmark quality data needed to validate computational fluid dynamic models. A shear coaxial injector geometry was selected as the primary injector for study using gaseous hydrogen/oxygen and gaseous hydrogen/liquid oxygen propellants. Emphasis was placed on the use of non-intrusive diagnostic techniques to characterize the flowfields inside an optically-accessible rocket chamber. Measurements of the velocity and species fields were obtained using laser velocimetry and Raman spectroscopy, respectively Qualitative flame shape information was also obtained using laser-induced fluorescence excited from OH radicals and laser light scattering studies of aluminum oxide particle seeded combusting flows. The gaseous hydrogen/liquid oxygen propellant studies for the shear coaxial injector focused on breakup mechanisms associated with the liquid oxygen jet under sub-critical pressure conditions. Laser sheet illumination techniques were used to visualize the core region of the jet and a Phase Doppler Particle Analyzer was utilized for drop velocity, size and size distribution characterization. The results of these studies indicated that the shear coaxial geometry configuration was a relatively poor injector in terms of mixing. The oxygen core was observed to extend well downstream of the injector and a significant fraction of the mixing occurred in the near nozzle region where measurements were not possible to obtain Detailed velocity and species measurements were obtained to allow CFD model validation and this set of benchmark data represents the most comprehensive data set available to date As an extension of the investigation, a series of gas/gas injector studies were conducted in support of the X-33 Reusable Launch Vehicle program. A Gas/Gas Injector Technology team was formed consisting of the Marshall Space Flight Center, the NASA Lewis Research Center, Rocketdyne and Penn State. Injector geometries studied under this task included shear and swirl coaxial configurations as well as an impinging jet injector.

Santoro, Robert J.↗

NASA NTRSDate not supplied

Analysis of Ice Mass Growth Over Time on the CRM65 Midspan Hybrid Model

The Aeronautics Research Mission Directorate at NASA is developing and applying tools to enable future technologies towards sustainable flight. Aircraft icing has been identified as a potential barrier to entry into service for innovative designs necessitating improvements to computational ice accretion tools. NASA is developing the Glenn Icing Computational Environment (GlennICE) to address deficiencies in the computational modeling capabilities of previously developed ice accretion solvers. To benchmark and improve the ability to model highly three-dimensional ice accretion, high quality validation data against experimental data is required. The CRM65 Midspan Hybrid geometry was previously tested at the NASA Icing Research Tunnel to generate experimental data for swept wing geometries typical for commercial transport aircraft. As a part of a 2018 icing test campaign, experimental data characterizing the relationship between ice accretion time and ice mass growth was obtained and can be leveraged for use in validation of computational tools. The desire for computational ice accretion solvers to predict ice shapes profiles accreted experimentally has often overshadowed the comparison to the mass and bulk volume of ice accreted. To address this deficiency, an analysis is presented in which GlennICE is applied to simulations of the CRM65 Midspan Hybrid model tested in the NASA Icing Research Tunnel. Results from the computational fluid dynamics simulations compared favorably to the experimental pressure coefficient data, thus validating the modeling setup. The experimental data showed excellent repeatability for the 15.0 minute accretion time. The comparisons between the experimental and computational ice mass over time showed good agreement up to 10.0 minutes after which the ice mass was underpredicted. The experimental ice mass was largely linear with some nonlinear data. The bulk volume of ice accreted experimentally compared well to GlennICE for the scanned ice shapes and mean combined cross section ice shapes, but was underpredicted for the maximum combined cross section ice shapes at longer accretion times. The experimental minimum combined cross section, mean combined cross section, and maximum combined cross section profiles when compared to GlennICE show good agreement for the mean combined cross section up to 15.0 minutes. The analyses show that with a single-shot method, GlennICE currently underpredicts the ice mass for longer accretion times, is not able to match the bulk volume of the maximum combined cross section due to dominating scallop features, and future work is required to generate a more generalized ice bulk density model.

Icing↗

NASA NTRSDate not supplied

Analysis of Ice Mass Growth Over Time on the CRM65 Midspan Hybrid Model

The Aeronautics Research Mission Directorate at NASA is developing and applying tools to enable future technologies towards sustainable flight. Aircraft icing has been identified as a potential barrier to entry into service for innovative designs necessitating improvements to computational ice accretion tools. NASA is developing the Glenn Icing Computational Environment (GlennICE) to address deficiencies in the computational modeling capabilities of previously developed ice accretion solvers. To benchmark and improve the ability to model highly three-dimensional ice accretion, high quality validation data against experimental data is required. The CRM65 Midspan Hybrid geometry was previously tested at the NASA Icing Research Tunnel to generate experimental data for swept wing geometries typical for commercial transport aircraft. As a part of a 2018 icing test campaign, experimental data characterizing the relationship between ice accretion time and ice mass growth was obtained and can be leveraged for use in validation of computational tools. The desire for computational ice accretion solvers to predict ice shapes profiles accreted experimentally has often overshadowed the comparison to the mass and bulk volume of ice accreted. To address this deficiency, an analysis is presented in which GlennICE is applied to simulations of the CRM65 Midspan Hybrid model tested in the NASA Icing Research Tunnel. Results from the computational fluid dynamics simulations compared favorably to the experimental pressure coefficient data, thus validating the modeling setup. The experimental data showed excellent repeatability for the 15.0 minute accretion time. The comparisons between the experimental and computational ice mass over time showed good agreement up to 10.0 minutes after which the ice mass was underpredicted. The experimental ice mass was largely linear with some nonlinear data. The bulk volume of ice accreted experimentally compared well to GlennICE for the scanned ice shapes and mean combined cross section ice shapes, but was underpredicted for the maximum combined cross section ice shapes at longer accretion times. The experimental minimum combined cross section, mean combined cross section, and maximum combined cross section profiles when compared to GlennICE show good agreement for the mean combined cross section up to 15.0 minutes. The analyses show that with a single-shot method, GlennICE currently underpredicts the ice mass for longer accretion times, is not able to match the bulk volume of the maximum combined cross section due to dominating scallop features, and future work is required to generate a more generalized ice bulk density model.

Icing↗

DOE OSTI2024

High-Temperature Gas-Cooled Pebble-Bed Reactors Running In And Transient Modeling Capabilities Demonstration

This study presents a comprehensive benchmarking and verification effort of several thermal-hydraulic and multiphysics capabilities for high-temperature gas-cooled reactor (HTGR) applications. The first part of this effort focuses on the running-in verification of Griffin's multiphysics capabilities, specifically for simulating the evolution of Pebble Bed reactor cores from startup to equilibrium. In the absence of validation data, code-to-code comparisons are conducted with Kugelpy, showing good agreement for key quantities like maximum power density and fresh core k-eigenvalue predictions. However, discrepancies in equilibrium core predictions suggest potential issues with cross sections, underscoring the need for further refinement and evaluation. The HTTF system analysis code benchmark involves RELAP5-3D, SAM, and GAMMA+ to assess their predictive capabilities for HTTF behavior under both normal operation and pressurized conduction cooldown (PCC) transient conditions. While there is good agreement in predicting major parameters such as coolant temperature, solid temperature, and flow distribution, discrepancies in transient behavior highlight differences in modeling approaches, nodalizations, and heat transfer models. The HTTF lower plenum CFD benchmark employs nekRS to simulate flow mixing phenomena, successfully capturing relevant flow physics and demonstrating mesh independence in complex geometries. Preliminary results suggest a relatively uniform temperature field but significant unsteadiness in the flow, requiring time-averaging analyses. The GPBR200 system analysis code benchmark uses SAM's core channel and porous media models, incorporating an RCCS loop for decay heat removal. During steady-state and transient conditions, including protected de-pressurized and pressurized loss of forced cooling (DLOFC and PLOFC), both models show good agreement in predicting temperature profiles and key parameters. Notably, while the core channel model underpredicts convective heat transfer effects, both models maintain temperatures well below the TRISO fuel safety limit. These benchmarking efforts collectively enhance the predictive capabilities of the tools used in HTGR design and safety analysis, guiding developments to improve their accuracy and applicability.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

Benchmark of interfacial area concentration approaches for the two-fluid model in gas-dispersed condensing flow

Accurate predictions of interfacial area concentration (IAC) are required for closure of the condensation phase change term. The interfacial area transport equation (IATE) can dynamically predict interfacial area concentration and is increasingly being used in the benchmarking of phase change flows over static based correlations which require a flow regime map. For higher flow regimes, the two-group two-fluid IATE model can separately model the transport of spherical bubbles and cap/slug bubbles. Recently, a modified formulation of the one-group and two-group two-fluid model with interfacial area transport equation was proposed for gas-dispersed condensing flows. Three datasets have been used for validation consisting of condensing two-phase flow data in the unheated section of a vertical annulus with conditions spanning a range of pressures, inlet subcoolings and mass fluxes for benchmarking the various IAC approaches. For bubbly flows, the coupled void transport - IATE simulation results in good agreement in the predictions of the void fraction and the interfacial area concentration under nearly all sixty conditions. Considering the proposed two-group two-fluid IATE model formulation, the group-2 Nusselt number correlation is investigated to account for the appropriate heat transfer length scale for group-2 bubbles. Validation of the proposed two-group two-fluid model against the new dataset shows good agreement with experimental data with significant improvement over the one-group IATE model for conditions with substantial group-2 void fraction throughout the simulation domain.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2021

Advancing the Predictability of Water Cycle Phenomena via the Application of AI to Model Ensemble Simulations and Observations

AI has the power to identify new pathways to extended predictability of the water cycle via its application to model ensembles together with accompanying observations. We discuss both scientific and technological aspects of this challenge, and address the parts of the MODEX approach involving “Model simulations, evaluation, analysis, and benchmarking” and “Identification of key knowledge gaps”. The widespread incorporation of AI into model analysis will significantly advance Earth system predictability and our predictive capabilities.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2011

Development of Benchmark Examples for Delamination Onset and Fatigue Growth Prediction

An approach for assessing the delamination propagation and growth capabilities in commercial finite element codes was developed and demonstrated for the Virtual Crack Closure Technique (VCCT) implementations in ABAQUS. The Double Cantilever Beam (DCB) specimen was chosen as an example. First, benchmark results to assess delamination propagation capabilities under static loading were created using models simulating specimens with different delamination lengths. For each delamination length modeled, the load and displacement at the load point were monitored. The mixed-mode strain energy release rate components were calculated along the delamination front across the width of the specimen. A failure index was calculated by correlating the results with the mixed-mode failure criterion of the graphite/epoxy material. The calculated critical loads and critical displacements for delamination onset for each delamination length modeled were used as a benchmark. The load/displacement relationship computed during automatic propagation should closely match the benchmark case. Second, starting from an initially straight front, the delamination was allowed to propagate based on the algorithms implemented in the commercial finite element software. The load-displacement relationship obtained from the propagation analysis results and the benchmark results were compared. Good agreements could be achieved by selecting the appropriate input parameters, which were determined in an iterative procedure.

Krueger, Ronald↗

DOE OSTI2020

Benchmark calculations of radiative forcing by greenhouse gases

Changes in concentrations of greenhouse gases lead to changes in radiative fluxes throughout the atmosphere. The value of this change, the instantaneous radiative forcing, varies across climate models, due partly to differences in the distribution of clouds, humidity, and temperature across models, and partly due to errors introduced by approximate treatments of radiative transfer. This paper describes an experiment within the Radiative Forcing Model Intercomparision Project that uses benchmark calculations made with line–by–line models to identify parameterization error in the representation of absorption and emission by greenhouse gases. Clear–sky instantaneous forcing by greenhouse gases is computed using a set of 100 profiles, selected from a re–analysis of present–day conditions, that represent the global annual mean forcing from pre–industrial times to the present–day with sampling errors of less than 0.01 W m –2 . Six contributing line–by–line models agree in their estimate of this forcing to within 0.025 W m –2 while even recently–developed parameterizations have typical errors four or more times larger, suggesting both that the samples reveal true differences among line–by–line models and that parameterization error will be readily identifiable. Agreement among line–by–line models is better in the longwave than in the shortwave where differing treatments of the water vapor vapor continuum affect estimates of forcing by carbon dioxide and methane. The impacts of clouds on instantaneous radiative forcing are estimated from climate model simulations. Here, the adjustment due to stratospheric temperature change by assuming fixed dynamical heating. Adjustments are large only for ozone and for carbon dioxide, for which stratospheric cooling introduces modest non–linearity.

54 ENVIRONMENTAL SCIENCES↗