Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model comparison.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Remote Sensing-Driven Hydrodynamic Modeling in Data-Scarce Regions: Integrating ICESat-2, Sentinel-2, SWOT and Re-analysis Models for Coastal Monitoring

Hydrodynamic models in coastal and estuarine systems are typically constrained by sparse bathymetry, boundary, and validation data, especially in regions where field campaigns are costly or impractical. Here we develop and test a fully satellite-driven framework for hydrodynamic modeling in South Africa’s Langebaan Lagoon without using any local in situ measurements. Bathymetry is derived by training multispectral Sentinel-2 reflectance against ICESat-2 ATL24 photon-derived depths using an XGBoost model optimized with Bayesian search. The final satellite-derived bathymetry reproduces independent ATL24 points with RMSE = 0.45 m and R 2 = 0.97. This bathymetry was used in a depth-averaged Delft3D Flexible Mesh model driven at the open boundary by TPXO tidal harmonics and by ERA5 winds. We validate modeled water surface elevation against 16 SWOT low-rate (250 m, unsmoothed) passes in 2023. SWOT–model comparisons yield an overall RMSE of 0.11 m and R 2 = 0.61, with typical point differences <0.10 m (∼7% of the 1.5 m tidal range), and showed consistent spatial gradients in water level from the offshore boundary, through Saldanha Bay, and into the lagoon. At the offshore boundary, TPXO and SWOT sea surface heights agree closely (R 2 = 0.86). A simple phase adjustment of ∼26,min between TPXO and SWOT lowers the RMSE from 0.18,m to 0.11,m, showing that phase offset accounts for some of the discrepancy, with additional errors likely linked to non-tidal signals. Our results demonstrate that combining passive optical, photon-counting LiDAR, radar interferometry, and global tidal/atmospheric models enables robust, transferrable hydrodynamic modeling in data-scarce coastal systems, offering a cost-effective pathway for monitoring.

ICESat-2↗

A Benchmarking Framework for Evaluating Large Language Model Capabilities in Nuclear Reactor Safety Applications

Large language models (LLMs) are increasingly capable of answering technical questions, synthesizing domain knowledge, and supporting engineering workflows. For nuclear science and engineering, these capabilities require careful, domain-specific evaluation before they can be credibly incorporated into safety-related activities, regulatory review, or technical decision support. This paper presents preliminary results from benchmarking framework for evaluating LLM capabilities in nuclear contexts. The framework is organized into three evaluation categories: nuclear fundamentals, general dual-use knowledge, and plant specific knowledge. These categories are intended to distinguish general nuclear engineering competence from broader technical reasoning and more context-dependent nuclear knowledge. Initial evaluations focus on nuclear fundamentals using questions representative of the knowledge expected of a nuclear professional engineer. Results indicate that contemporary frontier models perform at a high level and substantially exceed the performance of older model generations, with some models approaching saturation of the current benchmark. These findings suggest both the rapid improvement of LLM capabilities in specialized technical domains and the need for more discriminating evaluation methods. The paper presents the benchmark structure, preliminary model-comparison results, and ongoing work. This work supports development of verifiable, responsible, and safety-conscious methods for assessing AI systems in nuclear engineering applications.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Improved Mars Upper Atmosphere Climatology

The detailed characterization of the Mars upper atmosphere is important for future Mars aerobraking activities. Solar cycle, seasonal, and dust trends (climate) as well as planetary wave activity (weather) are crucial to quantify in order to improve our ability to reasonably depict the state of the Mars upper atmosphere over time. To date, our best information is found in the Mars Global Surveyor (MGS) Accelerometer (ACC) database collected during Phase 1 (Ls = 184 - 300; F10.7 = 70 - 90) and Phase 2 (Ls = 30 - 90; F10.7 = 90 - 150) of aerobraking. This database (100 - 170 km) consists of thermospheric densities, temperatures, and scale heights, providing our best constraints for exercising the coupled Mars General Circulation Model (MGCM) and the Mars Thermospheric General Circulation Model (MTGCM). The Planetary Data System (PDS) contains level 0 and 2 MGS Accelerometer data, corresponding to atmospheric densities along the orbit track. Level 3 products (densities, temperatures, and scale heights at constant altitudes) are also available in the PDS. These datasets provide the primary model constraints for the new MGCM-MTGCM simulations summarized in this report. Our strategy for improving the characterization of the Mars upper atmospheres using these models has been three-fold : (a) to conduct data-model comparisons using the latest MGS data covering limited climatic and weather conditions at Mars, (b) to upgrade the 15-micron cooling and near-IR heating rates in the MGCM and MTGCM codes for ad- dressing climatic variations (solar cycle and seasonal) important in linking the lower and upper atmospheres (including migrating tides), and (c) to exercise the detailed coupled MGCM and MTGCM codes to capture and diagnose the planetary wave (migrating plus non-migrating tidal) features throughout the Mars year. Products from this new suite of MGCM-MTGCM coupled simulations are being used to improve our predictions of the structure of the Mars upper atmosphere for the upcoming MRO aerobraking exercises in 2006. A Michigan website, containing MTGCM output fields from previous climate simulations, is being expanded to include new MGCM-MTGCM simulations addressing planetary wave influences upon thermospheric aerobraking fields (densities and temperatures). In addition, similar MTGCM output fields have been supplied to the MSFC MARSGRAM - 200X empirical model, which will be used in mission operations for conducting aerobraking maneuvers.

Bougher, S. W.↗

Diagnosing the representation of surface and layered soil moisture in Earth system models

Surface soil moisture (mrsos) and vertically integrated soil moisture (mrsol) over the top 10 cm should, by definition, be physically consistent in Earth System Models (ESMs). However, an evaluation of nine CMIP6 models reveals substantial inconsistencies: in some models, mrsos and integrated mrsol agree globally; in others, they align only in specific regions; and in a few, they diverge across all grid cells. These discrepancies arise from a combination of factors, including metadata errors, inconsistent variable definitions, or diagnostic sequencing within the model. We demonstrate how such issues can lead to significant biases, even when both variables are present and seemingly well-defined. As model complexity increases and multi-model comparisons become more common, assumptions about variable equivalence may lead to flawed conclusions. This study highlights the need for routine consistency checks, improved metadata standards, and community-wide practices that ensure reliability of derived variables across ESM outputs, particularly in preparation for CMIP7.

Earth system models↗

Becoming a 10: A Closer Look at the U.S. Department of Energy Home Energy Score's Updates, Improvements, and Expansion

The U.S. Department of Energy (DOE)'s Home Energy Score provides homeowners, buyers, and renters directly comparable and credible information about a home's estimated energy use and costs. Certified Qualified Assessors conduct low-cost assessments to provide each home a 1-10 score alongside a set of cost-effective upgrades to improve the score. As of February 2022, hundreds of assessors have delivered over 175,000 scores to homes across the country. Originally released in 2012 using DOE2.1e as the modeling backend, after years of effort, a new version of Home Energy Score was released in 2021 utilizing DOE's flagship energy modeling software, EnergyPlus. The updated architecture leverages modeling advancements and enables new building technologies to be added to the Scoring Tool. The new release represents a leap forward in harmonizing modeling assumptions across DOE and industry programs. In this paper we discuss the rigorous approach to model comparison with DOE2 undertaken prior to the update, utilizing test homes and real homes from the Home Energy Score database to strike a balance between consistency and more accurate energy predictions. We also discuss additional new capabilities, including improvements made to the upgrade recommendations methodology, the inclusion of an energy cost estimate metric based on ResStock analysis for use in home appraisals, and improved data analysis for quality assurance. Finally, we look at the impact Home Energy Score has had over the last decade and its future potential as its uptake in state energy plans, local ordinances, utility programs, and real estate data continues to grow.

building energy modeling↗

Gravity wave spectra observed by Doppler radar: Comparison of a model with mesospheric observations

It was proposed that mesoscale fluctuations of wind and temperature in the free atmosphere are due to gravity waves. Critical tests of this hypothesis must involve the comparison of models based on the theory of buoyancy waves with suitable measurements. The MST (mesosphere-stratosphere-troposphere) radar technique is particularly attractive for this purpose, because it can measure several independent power spectra simultaneously. Observed spectra are derived from mesospheric data taken by the Poker Flat MST radar during June 1983. The spectra were compared with the model spectra for three days when suitable data were available. It was concluded that the mesoscale fluctuations were dominated by gravity waves, and the contribution of two-dimensional turbulence was small.

Vanzandt, T. E.↗

Comparison of the Nimbus-4 BUV ozone data with the Ames two-dimensional model

A comparison is made of the first two years of Nimbus 4 backscattered ultraviolet (BUV) ozone measurements with the predictions of the Ames two dimensional model. The ozone observations used consist of the mixing ratio on the 1, 2, 5, and 10 mb pressure surfaces. The data are zone and time averaged to obtain seasonal means for 1970 and 1971 and are found to show strong and repeatable meridional and seasonal dependencies. The model used for comparison with the observations extends from 80 N to 80 S latitude and from altitudes of 0 to 60 km with 5 deg horizontal grid spacing and 2.5 km vertical grid spacing. Chemical reaction and photolysis rates are diurnally averaged and the photodissociation rates are corrected for the effects of scattering. The large altitude, latitude, and seasonal changes in the ozone data agree with the model predictions. Model predictions of the sensitivity of the comparisons to changes in the assumed mixing ratios of water vapor, odd nitrogen, and odd chlorine, as well as to changes in the ambient temperature and transport parameters are also shown.

Borucki, W. J.↗

Effective Albedo of Vegetated Terrain at L-Band

This paper derives an explicit expression for an effective albedo of vegetated terrain from the zero- and multiple- order radiative transfer (RT) model comparison. The formulation establishes a direct physical link between the effective vegetation parameterization and the theoretical description of absorption and scattering within the canopy. The paper will present an evaluation of the derived albedo for corn canopies with data taken during an experiment at Alabama A&M Winfield A. Thomas Agricultural Research Station near Huntsville, Alabama in June, 1998. The test site consisted of two 50-m x 60-m plots - one with a bare surface and the other with grass cover - and four 30-m x 50-m plots of corn at different planting densities. One corn field was planted at a full density of 9.5 plants/sq m while the others were planted at 1/3, 1/2 and 2/3 of the full density. The fields were observed with a truck-mounted L-band radiometer at incident angle of 15 degree for the period of two weeks. Soil moisture (SM) changed daily due to irrigation and natural rainfall. Variations in gravimetric SM from 18 % to 34 % were seen during this period. Ground truth data, including careful characterization of the corn size and orientation statistics, and its dielectric, was also collected and used to simulate the effective albedo for the vegetation. The single-scattering albedo is defined as the fractional power scattered from individual vegetation constituents with respect to canopy extinction. It represents single-scattering properties of vegetation elements only, and is independent of ground properties. The values of the albedo get higher when there is dense vegetation (i.e. forest, mature corn, etc.) with scatterers, such as branches and trunks (or stalks in the case of corn), which are large with respect to the wavelength. This large albedo leads to a reduction in brightness temperature in the zero-order RT solution (known as tau-omega model). Higher-order multiple-scattering RT solutions are required for proper representation of scattering within vegetation. In this paper, an expression for an effective albedo for the whole canopy including the ground is derived for use in the zero-order RT model-based SM retrieval. This effective albedo takes into account of all the processes taking place within the canopy, including multiple-scattering. This new formulation will be presented and its importance for microwave SM retrieval will be evaluated for corn canopies in conjunction with the detailed ground truth data obtained during the experiment at Alabama in 1998. Emphasis will be placed on examining how the radiometer response to SM is modified by the corn canopy scattering under different field conditions. A semi-empirical parameterization of the effective albedo will be investigated through analysis of SM and vegetation water content effects on the effective albedo.

Kurum, Mehmet↗

PING Gamma Ray and Neutron Measurements of a Meter-Sized Carbonaceous Asteroid Analog

Determining the elemental composition of carbonaceous (spectral type C) asteroids is still one of the basic problems when studying these objects. The only main source of elemental composition information for asteroids is from their optical, NIR and IR properties, which include their spectral reflectance characteristics, albedo, polarization, and the comparison of optical spectroscopy with meteorite groups corresponding to asteroids of every spectral type. Unfortunately, these sources reflect observations from widely contrasting spatial scales that presently yield a void in the continuum of microscopic and macroscopic evidence, a lack of in situ measurement confirmation, and require deeper sensing techniques to discern the nature of these asteroids. The Probing In situ with Neutrons and Gamma rays (PING) instrument is ideally suited to address this problem because it can be used to determine the bulk elemental composition, H and C content, the average atomic weight and density of the surface and subsurface layers of C-type asteroids, and can provide measurements used to determine the difference between and distinguish between different types of asteroids. We are currently developing the PING instrument that combines gamma ray and neutron detectors with a 14 Me V pulsed neutron generator to determine the in-situ bulk elemental abundances and geochemistry of C-type asteroids with a spatial resolution of 1 m down to depths of tens of cm to 1 m. One aspect of the current work includes experimentally testing and optimizing PING on a known meter-sized Columbia River basalt C-type asteroid analog sample that has a similar composition and the same neutron response as that of a C-type asteroid. An important part of this effort focuses on utilizing timing measurements to isolate gamma rays produced by neutron inelastic scattering, neutron capture and delayed activation processes. Separating the gamma ray spectra by nuclear processes results in higher precision and sensitivity elemental composition measurements. Using gated data acquisition techniques allows for the unambiguous identification of gamma ray lines from different isotopes and nuclear processes, especially in situations when limited detector resolution results in overlapping gamma ray lines that cannot be individually resolved. In this paper, we will present the PING basalt layering experimental data, taken at the test facility at NASA Goddard Space Flight Center using the time tagged event-by-event data analysis technique, compared to our MCNPX computer simulation results for the C-type asteroid and basalt layering simulant models. Comparison of these data will show the advantages, validity, and measurement sensitivity of PING's nuclear interrogation methods to obtain more precise and sensitive in situ bulk elemental composition and density measurements of the subsurface of asteroids.

Bodnarik, J.↗

Environment-sensitivity functions for gross primary productivity in light use efficiency models

The sensitivity of photosynthesis to environmental changes is essential for understanding carbon cycle responses to global climate change and for the development of modeling approaches that explains its spatial and temporal variability. We collected a large variety of published sensitivity functions of gross primary productivity (GPP) to different forcing variables to assess the response of GPP to environmental factors. These include the responses of GPP to temperature; vapor pressure deficit, some of which include the response to atmospheric CO 2 concentrations; soil water availability (W); light intensity; and cloudiness. These functions were combined in a full factorial light use efficiency (LUE) model structure, leading to a collection of 5600 distinct LUE models. Each model was optimized against daily GPP and evapotranspiration fluxes from 196 FLUXNET sites and ranked across sites based on a bootstrap approach. The GPP sensitivity to each environmental factor, including CO 2 fertilization, was shown to be significant, and that none of the previously published model structures performed as well as the best model selected. From daily and weekly to monthly scales, the best model's median Nash-Sutcliffe model efficiency across sites was 0.73, 0.79 and 0.82, respectively, but poorer at annual scales (0.23), emphasizing the common limitation of current models in describing the interannual variability of GPP. Although the best global model did not match the local best model at each site, the selection was robust across ecosystem types. The contribution of light saturation and cloudiness to GPP was observed across all biomes (from 23% to 43%). Temperature and W dominates GPP and LUE but responses of GPP to temperature and W are lagged in cold and arid ecosystems, respectively. The findings of this study provide a foundation towards more robust LUE-based estimates of global GPP and may provide a benchmark for other empirical GPP products.

54 ENVIRONMENTAL SCIENCES↗

Comparison of structurally diverse simulation models for prediction of epidemic outcomes caused by a long-distance dispersed pathogen

Long-distance dispersal (LDD) pathogens pose substantial challenges for epidemic control due to their ability to generate new infection foci at great distances. While various modeling approaches have been developed to understand and manage such outbreaks, little work has compared how models of different structures behave under shared conditions. Here, in this study, we compare four structurally distinct epidemiological models — EPIMUL, GEMF, PoPS, and Warwick — each adapted to simulate the spread of wheat stripe rust (WSR), a wind-dispersed LDD pathogen, under identical epidemiological parameters and dispersal kernel. Using data from a controlled field experiment, we evaluate the ability of each model to replicate disease prevalence under nine intervention scenarios that vary in timing and culling area. While the models differ substantially in design — ranging from spatial grid-based to network-based and raster-based frameworks — the shared dispersal kernel allowed for close alignment in their predictions. All models accurately captured general epidemic trends, particularly the strong effect of early intervention on disease suppression. We qualitatively compared their behavioral responses across scenarios and also evaluated an ensemble prediction by averaging across model outputs. Our findings highlight how integrating shared epidemiological components into distinct modeling frameworks can improve consistency and accuracy, while reinforcing the importance of early culling in managing LDD pathogen outbreaks.

Dispersal kernel↗

Pathways for decarbonization of the buildings sector in Ukraine

The paper focuses on Ukraine’s intention to achieve a two-thirds reduction in buildings’ energy consumption for heating and cooling by 2050, concurrently aiming for net zero greenhouse gas emissions and heightened energy security. Here, the study examines the outcomes of retrofitting existing residential, commercial, and public buildings with highly efficient materials, improving construction standards, and transitioning to advanced heating systems. However, Russia’s invasion in 2022 inflicted substantial damage, prompting a shift from retrofit and decarbonization to reconstruction. The Ukrainian government’s Reconstruction Plan emphasizes clean, sustainable, and resilient energy systems. The study employs energy system and integrated assessment models (TIMES-Ukraine and GCAM-Ukraine) to explore scenarios taking into consideration the war, reconstruction, and a net zero CO 2 pathway. Using two models allowed the inter-model comparison. The analysis addresses vital questions on energy resiliency measures and the compounding effects of decarbonization. Findings indicate that Ukraine’s energy goals can be met through strategic retrofitting and economy-wide decarbonization, emphasizing the importance of low-carbon alternatives like district heating with renewable sources. Electrification with renewables and fuel-switching emerges as crucial for achieving building decarbonization. The study offers valuable insights into navigating energy challenges amidst the war and outlines a pathway for Ukraine’s sustainable energy future.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DECOVALEX-2023: An international collaboration for advancing the understanding and modeling of coupled thermo-hydro-mechanical-chemical (THMC) processes in geological systems

The DECOVALEX initiative is an international research collaboration (www.decovalex.org), initiated in 1992, for advancing the understanding and modeling of coupled thermo-hydro-mechanical-chemical (THMC) processes in geological systems. DECOVALEX stands for “DEvelopment of COupled Models and VALidation against EXperiments”. The creation of this international initiative was motivated by the recognition that prediction of these coupled effects is an essential part of the performance and safety assessment of geologic disposal systems for radioactive waste and spent nuclear fuel. DECOVALEX emphasizes joint analysis and comparative modeling of the complex perturbations and coupled processes in geologic repositories and how these impact long-term performance predictions. The most recent phase of the DECOVALEX Project, here referred to as DECOVALEX-2023, started in early 2020 and ended in late 2023. More than fifty research teams associated with 17 international DECOVALEX partner organizations participated in the comparative evaluation of eight modeling tasks covering a wide range of spatial and temporal scales, geological formations, and coupled processes. This Virtual Special Issue on DECOVALEX-2023 provides an in-depth overview of these collaborative research efforts and how these have advanced the state-of-the-art of understanding and modeling coupled THMC processes. While primarily focused on radioactive waste, much of the work included here has wider application to many geoengineering topics.

Coupled processes↗

Fast resonance decays in nuclear collisions

Here, we present a new method to calculate the final decay spectrum of direct resonance decays directly from hydrodynamic fields on a freeze-out surface. The method is based on identifying components of the final particle spectrum that transform in an irreducible way under rotations in the fluid-restframe. Corresponding distribution functions can be pre-computed including all resonance decays. Just a few of easily tabulated scalar functions then determine the Lorentz invariant decay spectrum from each space-time point, and simple integrals of these scalar functions over the freeze-out surface determine the final decay products. This by-passes numerically costly event-by-event calculations of the intermediate resonances. The method is of considerable practical use for making realistic data to model comparisons of the identified particle yields and flow harmonics, and for studying the viscous corrections to the freeze-out distribution function.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Compression behavior of microcrystalline cellulose spheres: Single particle compression and confined bulk compression across regimes

Particle characteristics can drastically influence the process-structure-property-performance aspects of granular materials in compression. In this study, we aim to computationally simulate the mechanical processes of stress redistribution in compacts including the kinematics of particle rearrangement during densification and particle deformation leading to fragmentation. Confined compression experiments are conducted with three sets of commercial microcrystalline cellulose particles nearly spherical in shape with different mean particle size. Experimentally measured compression curves from tall powder columns are fitted with the Kenkre et al. (J. of American Chemical Society, Vol. 79, No. 12) model. This model provides a basis to derive several common two-parameter literature models and as a framework to incorporate statistical representations of critical particle behaviors. We focus on the low-stress compression data and the model comparisons typically not discussed in the literature. Furthermore, additional single particle compressions report fracture strength with particle size for comparison to the apparent particle strength extracted from bulk compression data.

42 ENGINEERING↗

Climate, Variability, and Climate Sensitivity of “Middle Atmosphere” Chemistry Configurations of the Community Earth System Model Version 2, Whole Atmosphere Community Climate Model Version 6 (CESM2(WACCM6))

Abstract Simulating whole atmosphere dynamics, chemistry, and physics is computationally expensive. It can require high vertical resolution throughout the middle and upper atmosphere, as well as a comprehensive chemistry and aerosol scheme coupled to radiation physics. An unintentional outcome of the development of one of the most sophisticated and hence computationally expensive model configurations is that it often excludes a broad community of users with limited computational resources. Here, we analyze two configurations of the Community Earth System Model Version 2, Whole Atmosphere Community Climate Model Version 6 (CESM2(WACCM6)) with simplified “middle atmosphere” chemistry at nominal 1 and 2° horizontal resolutions. Using observations, a reanalysis, and direct model comparisons, we find that these configurations generally reproduce the climate, variability, and climate sensitivity of the 1° nominal horizontal resolution configuration with comprehensive chemistry. While the background stratospheric aerosol optical depth is elevated in the middle atmosphere configurations as compared to the comprehensive chemistry configuration, it is comparable among all configurations during volcanic eruptions. For any purposes other than those needing an accurate representation of tropospheric organic chemistry and secondary organic aerosols, these simplified chemistry configurations deliver reliable simulations of the whole atmosphere that require 35% and 86% fewer computational resources at nominal 1 and 2° horizontal resolution, respectively.

54 ENVIRONMENTAL SCIENCES↗

The Role of Cloud Radiative Effects in the Propagating Southern Annular Mode

Abstract The Southern Annular Mode (SAM) is the most dominant natural mode of variability in the mid‐latitudes of the Southern Hemisphere (SH). However, both the sign and magnitude of the feedbacks from the diabatic processes, especially those associated with clouds, onto the SAM remain elusive. By applying the cloud locking technique to the Energy Exascale Earth System Model (E3SM) atmosphere model, this study isolates the positive feedback from the cloud radiative effect (CRE) to the SAM. Feedback analysis based on a wave activity‐zonal momentum interaction framework corroborates this weak but positive feedback. While the magnitude of the CRE feedback appears to be secondary compared to the feedbacks from the dry and other diabatic processes, the indirect CRE effects through the interaction with other dynamical and thermodynamical processes appear to play as important a role as the direct CRE in the life cycle of the SAM. The cross‐EOF analysis further reveals the obstructive effect of the interactive CRE on the propagation mode of the SH zonal wind directly through the CRE wave source and/or indirectly through modulating other diabatic processes. As a result, the propagation mode becomes more persistent and the SAM it represents becomes more predictable when the interactive CRE is disabled by cloud locking. Future efforts on inter‐model comparisons of CRE‐denial experiments are important to build consensus on the dynamical feedback of CRE.

58 GEOSCIENCES↗