Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Preliminary Assessment of ATR-C Capabilities to Provide Integral Benchmark Data for Key Structural/Matrix Materials that May be Used for Nuclear Data Testing and Analytical Methods Validation

The purpose of this document is to identify some suggested types of experiments that can be performed in the Advanced Test Reactor Critical (ATR-C) facility. A fundamental computational investigation is provided to demonstrate possible integration of experimental activities in the ATR-C with the development of benchmark experiments. Criticality benchmarks performed in the ATR-C could provide integral data for key matrix and structural materials used in nuclear systems. Results would then be utilized in the improvement of nuclear data libraries and as a means for analytical methods validation. It is proposed that experiments consisting of well-characterized quantities of materials be placed in the Northwest flux trap position of the ATR-C. The reactivity worth of the material could be determined and computationally analyzed through comprehensive benchmark activities including uncertainty analyses. Experiments were modeled in the available benchmark model of the ATR using MCNP5 with the ENDF/B-VII.0 cross section library. A single bar (9.5 cm long, 0.5 cm wide, and 121.92 cm high) of each material could provide sufficient reactivity difference in the core geometry for computational modeling and analysis. However, to provide increased opportunity for the validation of computational models, additional bars of material placed in the flux trap would increase the effective reactivity up to a limit of 1$ insertion. For simplicity in assembly manufacture, approximately four bars of material could provide a means for additional experimental benchmark configurations, except in the case of strong neutron absorbers and many materials providing positive reactivity. Future tasks include the cost analysis and development of the experimental assemblies, including means for the characterization of the neutron flux and spectral indices. Oscillation techniques may also serve to provide additional means for experimentation and validation of computational methods and acquisition of integral data for improving neutron cross sections. Further assessment of oscillation techniques for implementation in the ATR-C may be of additional benefit. The establishment of benchmark experiment capabilities in the ATR-C would allow for the further development of techniques and facility enhancements involving neutronics experimentation in the ATR-C.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Proton Exchange Membrane Fuel Cell Engineering Model Powerplant. Test Report: Benchmark Tests in Three Spatial Orientations

Proton exchange membrane (PEM) fuel cell technology is the leading candidate to replace the aging alkaline fuel cell technology, currently used on the Shuttle, for future space missions. This test effort marks the final phase of a 5-yr development program that began under the Second Generation Reusable Launch Vehicle (RLV) Program, transitioned into the Next Generation Launch Technologies (NGLT) Program, and continued under Constellation Systems in the Exploration Technology Development Program. Initially, the engineering model (EM) powerplant was evaluated with respect to its performance as compared to acceptance tests carried out at the manufacturer. This was to determine the sensitivity of the powerplant performance to changes in test environment. In addition, a series of tests were performed with the powerplant in the original standard orientation. This report details the continuing EM benchmark test results in three spatial orientations as well as extended duration testing in the mission profile test. The results from these tests verify the applicability of PEM fuel cells for future NASA missions. The specifics of these different tests are described in the following sections.

Loyselle, Patricia↗

Development and validation of a gamma-ray detection response model for neutron-diagnosed subcritical experiments

In a neutron-diagnosed subcritical experiment, a highly sensitive and fast detector is required to accurately determine the true fission γ-ray emission rate from an object composed of special nuclear material under interrogation, in addition to a proper detector response model for use in forward modeling. We present the development of a detector response model that is based in GEANT4 and uses post-processing techniques to include photomultiplier tube time and pulse height response effects. We also define a set of detector performance evaluation metrics that emphasized our experimental objectives. A suite of time and pulse height response measurements for several diverse detector assemblies are described. These assemblies were simulated with this response model and benchmarked against the laboratory measurements. This response model reproduces the pulse height curve shapes and performance hierarchy of the measured detectors well. Additionally, the simulated time response curves exhibit reasonable agreement with counterpart measurements. These measurements and simulation results together suggest that a large volume EJ-299-49 plastic scintillator that is mated to an ultraviolet transmitting plastic light guide and relies on total internal reflection for light transport to the photocathode will provide significantly faster timing, increase pulse height by a factor of 3, and require 25% less γ rays to meet experimental needs, compared to the candidate detector design developed prior to the availability of this response model. Application of this response model and associated performance metrics in the context of large-scale design sensitivity studies is also discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Impact of microkinetic modeling assumptions on predicted kinetics and mechanisms over undercoordinated sites

Accurate modeling of catalytic reactions on undercoordinated sites requires accounting for the structural and ensemble-specific nature of the active sites. This study examines how common microkinetic modeling (MKM) assumptions affect predicted kinetics and mechanisms on the stepped Pt(211) facet for the ethane dehydrogenation (EDH) and the ethane hydrogenolysis (EH). Six (211) MKMs were developed, differing in (i) the number of active sites represented, (ii) adsorbate site occupancy treatment, and (iii) inclusion of cross-facet interactions. These models are benchmarked against a particle-based microkinetic model (PB-MKM), which best represents step-edge behavior. MKM assumptions caused deviations in turnover frequencies exceeding ten orders of magnitude and led to contrasting mechanistic and selectivity predictions. Multi-site MKMs overestimate activity by inflating free site availability, single-site models underestimate activity, and uniform occupancy models overpredict coverage of multi-dentate intermediates, leading to reaction-specific artifacts. Overall, the Combined Site Edge Model (CSEM), a single-site MKM accounting for site occupancy and cross-facet interactions, most closely approximates PB-MKM predictions. All models predict similar kinetics when surfaces are clean or primarily occupied by monodentate species. This work provides practical guidance for selecting MKM frameworks for undercoordinated catalytic surfaces and highlights the critical role of modeling assumptions in catalytic predictions.

(211) facet↗

Study of the ion kinetic effects in ICF run-away burn using a quasi-1D hybrid model

Here, the loss of fuel ions in the Gamow peak and other kinetic effects related to the α particles during ignition, run-away burn, and disassembly stages of an inertial confinement fusion D-T capsule are investigated with a quasi-1D hybrid volume ignition model that includes kinetic ions, fluid electrons, Planckian radiation photons, and a metallic pusher. The fuel ion loss due to the Knudsen effect at the fuel-pusher interface is accounted for by a local-loss model by with an albedo model for ions returning from the pusher wall. The tail refilling and relaxation of the fuel ion distribution are captured with a nonlinear Fokker-Planck solver. Alpha heating of the fuel ions is modeled kinetically while simple models for finite alpha range and electron heating are used. This dynamical model is benchmarked with a 3 T hydrodynamic burn model employing similar assumptions. For an energetic pusher (~40 kJ) that compresses the fuel to an areal density of ~1.07g/cm 2 at ignition, the simulation shows that the Knudsen effect can substantially limit ion temperature rise in runaway burn. While the final yield decreases modestly from kinetic effects of the α particles, large reduction of the fuel reactivity during ignition and runaway burn may require a higher Knudsen loss rate compared to the rise time of the temperatures above ~25 keV when the broad D-T Gamow peak merges into the bulk Maxwellian distribution.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Maps of growing season gross primary production and net ecosystem exchange for Council Road Mile Marker 71, Seward Peninsula, Alaska, [2017-2023]

This data archive is in support of the Next-Generation Ecosystem Experiments in the Arctic (NGEE Arctic) publication "Integrating Characteristic Arctic Vegetation in a Land Surface Model Improves Representation of Carbon Dynamics Across a Tundra Landscape", by Murphy et al. (2025a). Murphy et al. (2025a) evaluated whether incorporating observed Arctic vegetation heterogeneity into ELM, the land model of the Department of Energy’s Energy Exascale Earth System Model (E3SM), improved simulations of tundra carbon cycling. The associated model archive can be found at Murphy et al. (2025b). The study focused on the spatial patterns and net landscape-level growing season productivity and carbon uptake. As part of this evaluation, observationally derived maps of average growing season (June–August) net ecosystem exchange (NEE) and gross primary production (GPP) were developed for the same domain. These maps, which form the dataset described here, integrate eddy covariance flux tower, remote sensing, and vegetation community data to provide spatially explicit benchmarks for model evaluation. The maps provide spatially explicit estimates of average growing season NEE and GPP across 13 tundra vegetation communities within the study domain. By combining flux tower observations with Airborne Visible-Infrared Imaging Spectrometer-Next Generation (AVIRIS-NG) hyperspectral imagery and drone-based normalized difference vegetation index (NDVI), these maps capture the heterogeneity of carbon fluxes associated with different Arctic vegetation types. While they represent average seasonal conditions rather than interannual variability, the maps provide a unique dataset for evaluating model performance, comparing vegetation community contributions to landscape-scale carbon cycling, and supporting regional analyses of Arctic carbon dynamics. This data archive contains 5 m resolution maps of vegetation communities, vegetation community average growing season GPP, and vegetation community average growing season NEE (three *.tif files), a User’s Guide (*pdf file), and Table 1 of the User’s Guide displaying vegetation community coverage and average growing season NEE and GPP values (*.csv file).

Murphy, Bailey [ORNL] (ORCID:0000000203995221)↗

Assessment of Sodium Thermal Stratification Models Utilizing the TSTF Benchmark

As a result of certain transient scenarios, a thermally stratified layer of liquid sodium can develop in the bulk coolant volumes of a sodium-cooled fast reactor (SFR). In addition to the effects a stratification layer has on the temperature of the heat transport system, a stratification layer can also influence the transition to and establishment of natural circulation flow, which plays an important role in passive cooling and the inherent safety of a pool-type SFR. Therefore, the ability to accurately capture thermal stratification phenomena is important when demonstrating the safety basis of a pool-type SFR during transient sequences. The present work assesses various computational models with different fidelities in their ability to predict thermal stratification in the upper plenum of an SFR. Each computational model will be assessed using the data generated at the Thermal Stratification Test Facility (TSTF) located at the University of Wisconsin-Madison. Using measured flow rate and inlet temperature data, the measured temperature distributions of the tests are compared to the predictions of the lumped volume-based models in SAS4A/SASSYS-1, a 1D-based model in SAM, and a 3-D computational fluid dynamics (CFD) model using STAR-CCM+. The relative performance of the various computational methods is assessed with respect to key metrics such as bulk coolant temperature distribution and plenum exit temperature. A total of eight tests are analyzed, covering different combinations of flow rates (3 and 10 GPM) and upper internal structure (UIS) configurations (none, solid, porous, and open) The perfect mixing model of SAS4A/SASSYS-1 provides the highest accuracy when the flow rate is high and there is no UIS in the test vessel, as high flow rate injection promotes thermal mixing of the sodium in the test vessel. For most of the analyzed tests, the stratified volume model of SAS4A/SASSYS-1 is able to predict the delay in the outlet temperature drop and temperature distribution in the test vessel by a small number of layers to represent thermal stratification. However, the stratified volume model can only simulate a maximum of three temperature layers within a volume and when a layer approaches the elevation of the outlet, the predicted outlet temperature can demonstrate rapid, non-physical changes. The 1-D axial mixing model of SAM provides results that agree reasonably well with the measured data in the prediction of the temporal evolution of the outlet temperature with the exception of the case with a high flow rate and no UIS. The SAM 1-D model has a similar level of accuracy to CFD results when it comes to predicting the outlet temperature. CFD shows overall good agreement in predicting the temperature distribution in the test vessel and outlet temperature. As CFD can model the test vessel geometry in detail, it performs well in the cases of complex geometries such as tests that included a UIS and internal flow through the UIS resulting in active mixing of the coolant in the test vessel. Each of the models discussed in the present work has the potential to be useful during the various stages of reactor design, analysis, and licensing. The lumped-volume approach can be applied for fast turnaround safety calculations to obtain overall reactor behavior during transients. The 1-D models provide improved accuracy when stratification is expected for a relatively low increase in the computational cost. The CFD model can be utilized for confirmatory analysis of the 1-D model, when experimental measurements are not available.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Resolving femtosecond photoinduced energy flow: capture of nonadiabatic reaction pathway topography and wavepacket dynamics from photoexcitation through the conical intersection seam (Final Technical Report)

The dynamics that take place within just tens to hundreds of femtoseconds following the absorption of light by a molecule can play a critical role in how the absorbed energy is directed, allowing it to be used for a specific function or dissipated harmlessly. The form of chemical change that occurs rapidly in these molecules is called a “nonadiabatic electronic transition.” Such transitions are known to mediate energy flow in natural biological systems such as the ultraviolet photoprotection mechanism of DNA and the first step of the human vision response. Understanding how these mechanisms work precisely may help scientists achieve controlled manipulation of solar energy or optical control of a wide range of energy management functions in artificial systems. Experimental methods, however, have not yet allowed a precisely resolved and complete measurement of nonadiabatic electronic transitions. This constitutes a major obstacle to progress in the field. For progress to occur that would inform a wide body of research aiming to efficiently harness the energy of light for practical purposes, it is especially important to benchmark computational models of the molecules undergoing these rapid changes with experimental measurements, in order to learn which models are accurate. With Dept. of Energy funding, we have made strong progress towards establishing a new optical method for experimentally detecting the full nonadiabatic electronic transition. This requires having coordinated pulses of light covering the visible through the mid-infrared range of the electromagnetic spectrum that last only ten femtoseconds. We have developed a new, relatively simple approach for generating such pulses of laser light, and have incorporated them into a time-resolved spectrometer for measuring rapid changes in molecules. These tools can provide the greater precision and new types of data that are needed to benchmark computational models of molecular change and thus to make progress in the field. Our tools were tested on graphene, an excellent solid-state sample for verifying the capabilities and limitations of our instrumentation. The investment made in these tools by the Dept. of Energy Office of Science will allow new fundamental scientific understanding of energy dynamics in molecules in future studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Study of Whisper Statistics for Criticality Safety Code Validation

Whisper is computational software designed to assist with validation studies with the Monte Carlo particle transport package MCNP. Historical approaches rely on expert based judgment to select benchmarks while Whisper uses sensitivity/uncertainty (S/U) methods to select relevant benchmarks to a particular application model. Whisper will also derive a calculational margin and margin of subcriticality (MOS) that may be used to generate an upper subcritical limit (USL) for a particular application model. Whisper finds benchmark experiments whose isotope sensitivity profiles align best with the MCNP model in question, and assign a correlation coefficient ('ck' in Whisper parlance) to each selected benchmark as a measure of how closely those profiles agree. When ck values are high, there is less uncertainty between model and benchmarks and a higher USL is possible, relative to cases when ck values are low. The default Whisper settings recommends a 100,000 particles per cycle run for 500 active cycles, resulting in 50 M active neutron histories per application run. This is computationally intensive and may not be necessary to produce accurate results. A Whisper statistical study was done varying the neutron histories per cycle from 10,000 to the default 100,000. A lower number of neutron histories will allow Whisper to be used on low memory systems such as laptops. The intent of this paper is to present the changes in the Whisper results as the number of neutrons histories run is varied.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

FluxSat: Long-term Earth Science Data Record (ESDR) for Terrestrial Gross Primary Production (GPP) based on satellite data calibrated with eddy covariance data

Gross primary production (GPP), the amount of carbon dioxide (CO 2 ) assimilated by plants through photosynthesis, is one of the most variable and uncertain components of the global carbon cycle. Global GPP has been estimated with a number of process-based models, data-driven, and hybrid approaches. Dynamic global vegetation models (DGVMs), driven by observed environmental changes, are used for global carbon budget assessments and long-term (climate) prediction. Benchmarking these and other models globally with data-driven GPP estimates is critical for understanding the land sink and ensuring accurate forecasts of the carbon cycle. In addition, global data-driven GPP estimates are crucial for studies of interannual variability, including trends that are linked to mechanisms with large uncertainties, such as the indirect CO 2 fertilization effect related to greening. In response to a community need for a GPP data set that well captures spatio-temporal variability, we developed FluxSat, a data-driven approach that optimizes the use of satellite reflectance data from the NASA MODerate-resolution Imaging Spectroradiometer (MODIS) on the Terra and Aqua satellites, calibrated using ground-based eddy covariance (EC) data. We are enhancing (spatially, higher resolution) and extending FluxSat (in time, with additional sensors) to create a high quality long term GPP Earth System Data Record (ESDR) for use in model benchmarking, carbon cycle modeling, and studies of trends and interannual variability. Our team’s objectives are to: 1. Update and document the current MODIS FluxSat GPP (daily, 0.05o and 0.5o resolutions) products with latest available MODIS and EC data sets; 2. Extend FluxSat GPP record forward in time with the Visible Infrared Imaging Radiometer Suite (VIIRS) on operational weather satellites going forward; 3. Extend FluxSat GPP record backward in time using the Advanced Very High Resolution Radiometer (AVHRR) on weather satellites dating back to 1981; 4. Provide higher spatial resolution MODIS and VIIRS GPP (0.0083o). 5. Thoroughly evaluate all FluxSat products with independent data; and 6. Create a homogenized long-term GPP record spanning 40+ years. We will discuss plans for this long-term data set that is supported through the NASA Making Earth System Data Records for Use in Research Environments (MEaSUREs) program.

gross Primary Production↗

A Practical Probabilistic Benchmark for AI Weather Models

Since the weather is chaotic, it is necessary to forecast an ensemble of future states. Recently, multiple AI weather models have emerged claiming breakthroughs in deterministic skill. Unfortunately, it is hard to fairly compare ensembles of AI forecasts because variations in ensembling methodology become confounding and the baseline data volume is immense. We address this by scoring lagged initial condition ensembles—whereby an ensemble can be constructed from a library of deterministic hindcasts. This allows the first parameter‐free intercomparison of leading AI weather models' probabilistic skill against an operational baseline. Lagged ensembles of the two leading AI weather models, GraphCast and Pangu, perform similarly even though the former outperforms the latter in deterministic scoring. These results are elaborated upon by sensitivity tests showing that commonly used multiple time‐step loss functions damage ensemble calibration.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Energy Performance and Improvement Potential of China Office Buildings in the Hot Humid Climate Against U.S. Reference Buildings: Preprint

This study compares the building code standards for office buildings in hot humid climates of China and the USA. A benchmark office building model is developed for Guangzhou, China that meets China's minimum national and regional building codes with incorporation of common design and construction practices for the area. The Guangzhou office benchmark model is compared to the ASHRAE standard basedUS model for Houston, Texas which has similar climate conditions. The research further uses a building energy optimization tool to optimize the Chinese benchmark with existing US products to identify the primary areas for potential energy savings. The most significant energy-saving options are then presented as recommendations for potential improvements to current China building codes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Preliminary Two-Phase Terry Turbine Nozzle Models for RCIC Off-Design Operation Conditions

This report presents the effort to extend the single-phase analytical Terry turbine model to cover two-phase off-design conditions. The work includes: (1) adding well-established two-phase choking models – the Isentropic Homogenous Equilibrium Model (IHEM) and Moody’s model, and (2) theoretical development and implementation of a two-phase nozzle expansion model. The two choking models provide bounding cases for the two-phase choking mass flow rate. The new two-phase Terry turbine model uses the choking models to calculate the mass flow rate, the critical pressure at the nozzle throat, and steam quality. In the divergent stage, we only consider the vapor phase with a similar model for the single-phase case by assuming that the liquid phase would slip along the wall with a much slower speed and will not contribute the impulse on the rotor. We also modify the stagnation conditions according to two-phase choking conditions at the throat and the cross-section areas for steam flow at the nozzle throat and at the nozzle exit. The new two-phase Terry turbine model was benchmarked with the same steam nozzle test as for the single-phase model. Better agreement with the experimental data is observed than from the single-phase model. We also repeated the Terry turbine nozzle benchmark work against the Sandia CFD simulation results with the two-phase model for the pure steam inlet nozzle case. The RCIC start-up tests were simulated and compared with the single-phase model. Similar results are obtained. Finally, we designed a new RCIC system test case to simulate the self-regulated Terry turbine behavior observed in Fukushima accidents. In this test, a period inlet condition for the steam quality varying from 1 to 0 is applied. For the high quality inlet period, the RCIC system behaves just like the normal operation condition with a high pump injection flow rate and a nominal steam release rate through the turbine, with the net addition of water to the primary system; for the low quality inlet period, the RCIC turbine shaft work dramatically decreases and results in a much reduced pump injection flow rate, and the mixture flow rate through the turbine increases due to the high liquid phase flow rate. The net effect for this period is net removal of coolant from the primary loop. With the periodic addition and removal of coolant to the primary loop, the self-regulation mode of the RCIC system can be maintained for a quite long time. Both the IHEM and Moody’s models generate similar phenomena; however noticeable differences can be observed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Benchmark Energetic Data in a Model System for Grubbs II Metathesis Catalysis and Their Use for the Development, Assessment, and Validation of Electronic Structure Methods

We present benchmark relative energetics in the catalytic cycle of a model system for Grubbs second-generation olefin metathesis catalysts. The benchmark data were determined by a composite approach based on CCSD(T) calculations, and they were used as a training set to develop a new spin-component-scaled MP2 method optimized for catalysis, which is called SCSC-MP2. The SCSC-MP2 method has improved performance for modeling Grubbs II olefin metathesis catalysts as compared to canonical MP2 or SCS-MP2. We also employed the benchmark data to test 17 WFT methods and 39 density functionals. Among the tested density functionals, M06 is the best performing functional. M06/TZQS gives an MUE of only 1.06 kcal/mol, and it is a much more affordable method than the SCSC-MP2 method or any other correlated WFT methods. The best performing meta-GGA is M06-L, and M06-L/DZQ gives an MUE of 1.77 kcal/mol. PBEh is the best performing hybrid GGA, with an MUE of 3.01 kcal/mol; however, it does not perform well for the larger, real Grubbs II catalyst. B3LYP and many other functionals containing the LYP correlation functional perform poorly, and B3LYP underestimates the stability of stationary points for the cis-pathway of the model system by a large margin. From the assessments, we recommend the M06, M06-L, and MPW1B95 functionals for modeling Grubbs II olefin metathesis catalysts. The local M06-L method is especially efficient for calculations on large systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning framework for predicting uranium enrichments from M400 CZT gamma spectra

A machine learning framework was developed for predicting uranium enrichments from M400 CZT gamma spectra. This framework leverages the availability of a large amount of measured M400 gamma spectra and uses a recently updated version of Gamma Detector Response and Analysis Software (GADRAS) for gamma spectrum analysis and generation. It also leverages the existing machine learning modules in Python for gamma spectrum data processing, curation, model training, benchmarking, and optimization of the deep machine learning models. The framework is used to develop a deep learning model to analyze gamma spectra from a set of U 3 O 8 samples with enrichments ranging from 0.31 to 93.17% and UF 6 cylinders with enrichments ranging from 0.2 to 4.95%, and the model performance is tested using a set of measured spectra and the respective declared enrichment values. Results show that the model can correctly classify 99.35% of the U 3 O 8 sample enrichments, and can predict the samples’ enrichments within an average absolute error of 0.099% (in percentage points of enrichment). For the UF 6 cylinders, the average absolute error was approximately 0.03%, with an accuracy of 98% in classifying discrete enrichment values of UF 6 samples. Finally, the results also show that the model has performed significantly better in terms of predicting enrichments in UF 6 cylinders based on measured gamma spectra than the GEM code, with a standard deviation (of the relative errors) of 2.23% (compared with the 11.51% value for the GEM code) based on results from a set of test data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗