Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling↗
DOE OSTI2024

Subpolar North Atlantic Mean State Affects the Response of the Atlantic Meridional Overturning Circulation to the North Atlantic Oscillation in CMIP6 Models

Abstract The Atlantic meridional overturning circulation (AMOC) plays an important role in climate, transporting heat and salt to the subpolar North Atlantic. The AMOC’s variability is sensitive to atmospheric forcing, especially the North Atlantic Oscillation (NAO). Because AMOC observations are short, climate models are a valuable tool to study the AMOC’s variability. Yet, there are known issues with climate models, like uncertainties and systematic biases. To investigate this, preindustrial control experiments from models participating in the phase 6 of Coupled Model Intercomparison Project (CMIP6) are evaluated. There is a large, but correlated, spread in the models’ subpolar gyre mean surface temperature and salinity. By splitting models into groups of either a warm–salty or cold–fresh subpolar gyre, it is shown that warm–salty models have a lower sea ice cover in the Labrador Sea and, hence, enable a larger heat loss during a positive NAO. Stratification in the Labrador Sea is also weaker in warm–salty models, such that the larger NAO-related heat loss can also affect greater depths. As a result, subsurface density anomalies are much stronger in the warm–salty models than in those that tend to be cold and fresh. As these anomalies propagate southward along the western boundary, they establish a zonal density gradient anomaly that promotes a stronger delayed AMOC response to the NAO in the warm–salty models. These findings demonstrate how model mean state errors are linked across variables and affect variability, emphasizing the need for improvement of the subpolar North Atlantic mean states in models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Performance of Convection-Permitting and Convection-Parameterized Models in Reproducing the Extreme Precipitation Intensity Relationship with Surface Conditions

Here, this study investigates the warm-season extreme precipitation–temperature scaling relationship in CONUS404, a convection-permitting (4 km) Weather Research and Forecasting (WRF) Model simulation over the conterminous United States for the past four decades, and compares it with the WRF-Thermodynamic Global Warming (WRF-TGW) historical simulation at a coarser resolution (12 km) using parameterized convection. We also analyze the NCEP stage IV and NASA Integrated Multi-satellitE Retrievals for the Global Precipitation Measurement (IMERG) datasets as observational benchmarks. We examine how extreme precipitation intensity (EPI) varies with temperature and saturation deficit over representative regions based on hourly data. The stage IV and IMERG data show a similar pattern of EPI variation with temperature and saturation deficit, except that the EPI peak is lower in IMERG than in stage IV. Under dry and hot conditions, EPI decreases too rapidly with elevated saturation deficit in both CONUS404 and WRF-TGW compared to observations, but the performance of CONUS404 is superior to WRF-TGW. When the near-surface atmosphere is saturated or close to saturated, both CONUS404 and WRF-TGW produce higher peak values of EPI relative to the observational references; IMERG exhibits scaling rates close to the Clausius–Clapeyron (C–C) relationship, while CONUS404, WRF-TGW, and stage IV all demonstrate super-C–C scaling behaviors. Despite marked warming over the past four decades, in both CONUS404 and WRF-TGW, the scaling relationship between EPI and temperature in a saturated atmosphere remains stable and robust. This indicates a strong potential for the EPI–temperature scaling rate under saturation to be used as an emergent constraint in reducing uncertainties of future extreme precipitation projection.

Atmosphere↗
DOE OSTI2024

Salt International Collaborations FY24 Update

This report summarizes the international collaborations conducted by Sandia funded by the US Department of Energy Office (DOE) of Nuclear Energy (DOE-NE) Spent Fuel and Waste Science & Technology (SFWST) as part of the Sandia National Laboratories Salt R&D and Salt International work packages. This report satisfies the level-three milestone M3SF-24SN010303063. Several stand-alone sections make up this summary report, each completed by the participants. The sections discuss granular salt reconsolidation (KOMPASS/MEASURES), engineered barriers (RANGERS), numerical model comparison (DECOVALEX), an NEA Salt Club working group on the development of scenarios as part of the performance assessment development process, and progress on seal percolation experiments with German colleagues at Gesellschaft für Anlagen- und Reaktorsicherheit (GRS). Finally, we summarize events related to the US/German Workshop on Repository Research, Design and Operations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Assessing Cloud and Precipitation Properties on Temporal and Spatial Scales Using LASSO Simulations over ENA

Low clouds and precipitation representation remain a major source of uncertainty in Earth System Models (ESMs), particularly due to challenges in representing their sub-grid variability and scale-dependent sampling. This study evaluates the performance of preliminary simulations from the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) project over the Eastern North Atlantic (ENA), with a focus on liquid water path (LWP), ice water path (IWP), cloud fraction (CF), and surface precipitation simulated across closed-cell, open-cell, and transitional cloud regimes. Using LES (100 m horizontal grid spacing) driven by ERA5 and MERRA-2 reanalyses, we assess the representativeness of ground-based point observations by analyzing their correspondence to model-resolved spatial and temporal means. Results suggest that observational sampling of at least 6 hours is required to achieve consistency with domain-scale averages, in particular for observations that exhibit pronounced sub-grid heterogeneity, such as precipitation. ERA5-forced simulations exhibit improved spatial coherence and agreement with domain-averaged quantities when compared to MERRA-2 runs, with performance discrepancies largest for convective cloud conditions due to differences in forcing fidelity and temporal resolution. These findings highlight the importance of regime-aware model evaluation strategies and potentially demonstrate how LES can inform observation-model comparison practices and the development of cloud and precipitation parameterizations in ESMs.

Liang, Jiakun [University of Hawai'i at Manoa] (OR↗
DOE OSTI2025

Learning from Arctic Microgrids: Cost and Resiliency Projections for Renewable Energy Expansion with Hydrogen and Battery Storage

Electricity in rural Alaska is provided by more than 200 standalone microgrid systems powered predominantly by diesel generators. Incorporating renewable energy generation and storage to these systems can reduce their reliance on costly imported fuel and improve sustainability; however, uncertainty remains about optimal grid architectures to minimize cost, including how and when to incorporate long-duration energy storage. This study implements a novel, multi-pronged approach to assess the techno-economic feasibility of future energy pathways in the community of Kotzebue, which has already successfully deployed solar photovoltaics, wind turbines, and battery storage systems. Using real community load, resource, and generation data, we develop a series of comparison models using the HOMER Pro software tool to evaluate microgrid architectures to meet over 90% of the annual community electricity demand with renewable generation, considering both battery and hydrogen energy storage. We find that near-term planned capacity expansions in the community could enable over 50% renewable generation and reduce the total cost of energy. Additional build-outs to reach 75% renewable generation are shown to be competitive with current costs, but further capacity expansion is not currently economical. We additionally include a cost sensitivity analysis and a storage capacity sizing assessment that suggest hydrogen storage may be economically viable if battery costs increase, but large-scale seasonal storage via hydrogen is currently unlikely to be cost-effective nor practical for the region considered. While these findings are based on data and community priorities in Kotzebue, we expect this approach to be relevant to many communities in the Arctic and Sub-Arctic regions working to improve energy reliability, sustainability, and security.

25 ENERGY STORAGE↗
DOE OSTI2024

Assessment of the Impact of Realistic Sensor Physics and the Integration of Ex-Core Sensors on Reactor Power Synthesis

In the work documented in this report, a weighting function–based core power synthesis method was applied to multiple Monte Carlo N-Particle (MCNP) reactor models, which are informed based on simulated self-powered neutron detector (SPND) responses. The weighting function method used has been coined the point-based iterative (PBI) method. The goal of this application is to assess the impact of considering realistic sensor physics in the generation of the simulated SPND outputs as well as to consider how the synthesis is impacted based on the inclusion of ex-core detectors in the model. The NuScale small modular reactor (SMR) and Westinghouse AP1000 pressurized water reactor (PWR) are the models that served as the testbeds for the assessment of realistic sensor physics; this was achieved by using Geant4 SPND models in comparison with analytical models, such that the effect of electron transport in realistic SPND geometries in the Geant4 model can be understood in terms of synthesis error and convergence time. The comparison was considered for fuel burnup–induced perturbations, for a range of sensor string densities and synthesized power distribution axial fidelities. The Texas A&M Testing, Research, Isotopes, General Atomics Reactor (TAMU TRIGA) reactor MCNP model was used to assess the impact of ex-core sensors; this was done by performing synthesis with and without the ex-core detectors and by quantifying the synthesis error and number of iterations associated with Gaussian-type perturbations in many locations in the core. The TAMU TRIGA model was particularly pertinent for this study because of the interest in future experimental tests with SPNDs in this reactor, as well as the ease of modifying the MCNP model to include ex-core detectors with heterogeneously described response functions. Results from the comparison between the Geant4 and analytical SPND models indicate that similar average and maximum synthesis errors were obtained for burnup-induced perturbations in both the NuScale SMR and the AP1000. This was true for a range of sensor string densities and axial fidelities. However, there were marked differences between both the Geant4 and analytically informed models in terms of the iterations required to converge on the synthesized power distribution. Namely, the Geant4-informed models tended to lead to fewer iterations, except for a few sensor–core configurations that had particularly numerous iterations. Results from the ex-core sensor assessment with the TAMU TRIGA model indicate that the inclusion of ex-core sensors drastically reduces the synthesis error of Gaussian-type perturbations close to the edge of the core, and it slightly reduces synthesis errors for perturbations closer to the center of the core. This was achieved with a minimal increase in computational cost—that is, the number of iterations required for convergence. The errors were identified to be in the same location as the perturbation in the core, indicating that the methodology remains robust for unperturbed regions of the core. A secondary result from this study with the TAMU TRIGA was yielded by analysis of the neutron flux levels in the in-core and ex-core sensor locations of the core; these flux levels indicate that SPNDs could be used as both in-core and ex-core sensors, so long as the emitter material is sensitive to thermal neutrons. The results from these studies provide a quantitative understanding of the importance of considering realistic sensor physics and including ex-core sensors to perform accurate and timely power distribution synthesis of a reactor core.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Advancing Building Air Leakage Measurement and Modeling: Measurement of Interior Air Leaks, Experimental Comparison to Conventional Methods, and Building Modeling Characteristics

This report, Advancing Building Air Leakage Measurement and Modeling: Measurement of Interior Air Leaks, Experimental Comparison to Conventional Methods, and Building Modeling Characteristics, developed two new building air leakage measurement methods, experimentally evaluated the performance in comparison to conventional methods, experimentally evaluated the behavior of leaks for specific crack structures, and identified testing constraints and model implications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Visualization of Hemispherical Post‐Detonation Fireball Internal Structures

Hemispherical charges are initiated above a transparent plate in a half‐plane configuration, allowing optical access to the internal regions of the luminous fireball. High‐speed visualization enables characterization of the internal luminous structure, showing clearly the bright shell and dark core regions. Spectroscopic and pyrometric diagnostics are applied to these flows, generating quantitative information on the spatial distribution of temperature inside the fireball. Both cased and uncased charges can be examined using this methodology, and several different high explosives are tested. This approach can be useful in validation of detailed explosive fireball models. Initial comparisons with such models are presented.

detonation↗
DOE OSTI2024

Side-by-Side Comparison of Subhourly Clipping Models

Over the past several years there have been numerous attempts at quantifying the inherent power clipping of inverters due to subhourly irradiance variability that is not captured in hourly PV performance models. Different models have been proposed to correct for these clipping losses in PV performance estimates, including matrix lookup models, distribution modeling of the PV power performance within a given hour, and machine learning methods. To date, there have been few comprehensive quantitative comparisons of these inverter clipping correction modeling approaches to evaluate the effectiveness of these approaches in predicting the actual behavior of PV system inverter clipping. In this study, we perform such a comparison, evaluating the Allen and Walker correction loss modeling approaches recently implemented in the System Advisor Model (SAM) against clipping losses modeled with 1-minute climate data. These comparisons were performed across a variety of climate locations and inverter loading ratios to thoroughly analyze the effectiveness of these modeling approaches relative to each other. Results from this analysis reveal that both clipping correction approaches improve annual energy accuracy to within 2% of 1-minute modeled energy yield. The two models predict annual clipping loss more accurately than simple hourly power limit clipping, with the Allen method typically being slightly more accurate at typical ILR values and the Walker method often being slightly more accurate at high ILR values The models can improve accuracy over the status quo clipping approach up to 3 percentage points in systems with ILR of 2.0, showing the importance of this modeling factor in energy yield estimates.

accuracy↗
DOE OSTI2026

Intern-Artificial Intelligence Benchmarking

Benchmarks provide a standardized method for evaluating different AI models, enabling reproducibility and comparison between models, and facilitating scientific progress. As AI models continue to develop rapidly, incorporating new datasets, capabilities, and architectures becomes more complicated. Therefore, the current static benchmarks become increasingly irrelevant. The MLCommons team argues that to make AI benchmarks more relevant, it involves making the benchmarks themselves more dynamic, as well as technical innovations that make it easier for scientists and researchers at all levels to use and contribute to the benchmarks. The current progress in technical innovation is a software that allows for a detailed view of a collection of AI benchmarks to be output in various formats that are easily readable and accessible.

Krishnan, Anjay [Fermilab]↗
DOE OSTI2025

Hypothetical Nuclear Reactor Facility Modeling Simulation Data Scenario Comparison

This document evaluates a hypothetical nuclear powerplant and associated protective force personnel using modern modeling and simulation tools. The facility incorporates security early in the design to consider and integrate methods to resolve security issues and vulnerabilities via the facility’s inherent design characteristics before construction. The evaluation in this document is an example only. It is not intended to recommend or evaluate the effectiveness of existing physical security requirements or identify any method that the U.S. Nuclear Regulatory Commission staff may find acceptable for complying with existing requirements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Confronting Large‐Eddy Simulations With Stereo Camera Data by Means of Reconstructed Hemispheric Cloud Size Distributions

High-resolution hemispheric camera images at a meteorological site in western Germany are used to analyze the multi-dimensional spatial characteristics of continental cumulus cloud fields, and to evaluate Large-Eddy Simulations on this aspect. Traditional non-hemispheric cloud-detecting instruments provide additional reference data. The main model-observation comparison focuses on cloud size distributions (CSDs), employing two methods: (a) directly using three-dimensional model fields, direct CSDs, and (b) using rendered hemispheric images of the model fields as produced by a camera simulator based on path-tracing. In the latter method, both the real and rendered images are used to three-dimensionally reconstruct the cloud fields, yielding hemispheric CSDs. Advantages of hemispheric comparisons over more classic approaches include (a) fair comparisons between model and data, and (b) full use of the enhanced resolutions and hemispheric spatial coverage of the camera imagery. Basic evaluation of the simulations demonstrates good agreement on thermodynamic structure and its diurnal cycle. Cloud heights and cloud cover are intercompared between the model, camera data and other instrumentation, providing insight into their structural differences. A consistent alignment is found between the hemispheric CSDs from both the model and the cameras. Power law fits reveal structurally lower exponents in hemispheric CSDs compared to non-hemispheric CSDs, which particularly caution against directly comparing hemispheric CSDs to non-hemispheric distributions. This result is robust for sample size and fitting method. These findings inform future use of hemispheric camera systems for studying cumulus cloud field morphology and model evaluation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A comparison of effective field theory models of redshift space galaxy power spectra for DESI 2024 and future surveys

In preparation for the next generation of galaxy redshift surveys, and in particular the year-one data release from the Dark Energy Spectroscopic Instrument (DESI), we investigate the consistency of a variety of effective field theory models that describe the galaxy-galaxy power spectra in redshift space into the quasi-linear regime using 1-loop perturbation theory. These models are employed in the pipelines velocileptors, PyBird, and Folpsν. While these models have been validated independently, a detailed comparison with consistent choices has not been attempted. After briefly discussing the theoretical differences between the models we describe how to provide a more apples-to-apples comparison between them. We present the results of fitting mock spectra from the AbacusSummit suite of N-body simulations provided in three redshift bins to mimic the types of dark time tracers targeted by the DESI survey. We show that the theories behave similarly and give consistent constraints in both the forward-modeling and ShapeFit compressed fitting approaches. We additionally generate (noiseless) synthetic data from each pipeline to be fit by the others, varying the scale cuts in order to show that the models agree within the range of scales for which we expect 1-loop perturbation theory to be applicable. Finally, this work lays the foundation of Full-Shape analysis with DESI Y1 galaxy samples where in the tests we performed, we found no systematic error associated with the modeling of the galaxy redshift space power spectrum for this volume.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Surrogate model for third-integer resonance extraction at the Fermilab Delivery Ring

We present an ongoing work in which a surrogate model is being developed to reproduce the response dynamics of the third-integer resonant extraction process in the Delivery Ring (DR) at Fermilab. This is in pursuit of smoothly extracting circulating beam to the Mu2e Experiment’s production target, whereby the goal is to extract a uniform slice of the circulating 1e12 protons in the DR over 25,000 turns (43 ms). The DR contains 3 harmonic sextupoles that excite a third-integer resonance and three fast, tune-ramping quadrupole magnets that drive the horizontal tune towards the 29/3 resonance. In our initial work, the surrogate model trains on a semi-analytical simulation provided in the same format as live data. Using Reinforcement Learning (and other potential ML methods), the trained surrogate acts as the “environment” in which a simple ML control agent could learn to dynamically adjust the quadrupole ramp at 430 break points within the 43 microsecond spill window. The controller will be hosted on a dedicated Arria 10 FPGA. In this work, we report the accuracy and fidelity of the surrogate model in comparison to the response dynamics of the physics simulator.

Narayanan, Aakaash [Fermilab]↗
DOE OSTI2024

Synthesis of results for Brine Availability Test in Salt (BATS) DECOVALEX-2023 Task E

In the 2023 phase of the international collaborative DECOVALEX modeling project, Task E focused on understanding thermal, hydrological, and mechanical (THM) processes related to predicting brine migration in the excavation damaged zone around a heated excavation in salt. Salt is attractive as a disposal medium for radioactive waste because it is self-healing and is essentially impermeable and non-porous in the far field. Investigation of the short-term, near-field behavior is important for radioactive waste disposal because this early period strongly controls the amount of inflowing brine. Brine leads to corrosion of waste forms and waste packages, and possible dissolution of radionuclides with brine transport being a potential transport vector to the accessible environment.The Task was divided into steps. Step 0 included matching unheated brine inflow data from boreholes at the Waste Isolation Pilot Plant (WIPP) and matching temperature observations during a Brine Availability Test in Salt (BATS) heater test. Step 1 included validation of models against a thermo-poroelastic analytical solution, and two-phase flow around an excavation. Finally, Step 2 required all the individual components covered in steps 0 and 1 to come together to match observed brine inflow behavior during the same BATS heater test.There were a range of approaches from the teams, from mechanistic to prescriptive. Given the uncertainties in the problem, some teams used one- or two-dimensional models of the processes, while other teams included more geometrical complexity in three-dimensional models. Task E was a learning experience for the teams involved, and feedback from the modeling teams has led to changes in follow-on BATS experiments at WIPP. The primary Task E lessons learned were the impact of hydrologic initialization methods (wetting up vs. drying down), the difference between confined and unconfined thermal expansion, and the large changes in permeability associated with heating and cooling.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

Development of an Amine Oxide Polyzwitterion Brush Martini Model with Polarizable Water and Ions

Abstract In order to accurately simulate the fouling process of proteins onto polyzwitterion brushes, models that accurately capture the hydration properties and chain conformations of such brushes must first be established. We developed a Martini coarse-grained (CG) model for amine oxide polyzwitterion (PNOMA) brushes, a promising class of antifouling materials, in polarizable water and ions by fitting to all-atom bond and angle distributions, monomer hydration free energy, monomer–monomer distance potential of mean force (PMF), and monomer–salt radial distribution functions (RDFs). Martini 2.2P was selected for compatibility with the established polarizable water and ion models. For comparison with PNOMA, we also constructed models for conventional sulfobetaine (PSBMA) and phosphorylcholine (PMPC) polyzwitterions and the polycation PMETAC using established nonbonded bead types from the literature and refitting bond and angle potentials. We simulated each polymer brush chemistry for varying grafting density and chain length, validating brush height scaling relations against experimental data. The CG models captured the relative hydration strengths among different polyzwitterion chemistries, and brush heights extrapolated to higher molecular weights are in agreement with experimental ellipsometry data. We find that chain swelling of the superhydrophilic PNOMA brushes lies between that of the traditional polyzwitterions PSBMA/PMPC and the polycation PMETAC. For PNOMA brushes in NaCl solution, simulated brush height decreases with salt concentration due to the selectively strong interactions between amine oxide and sodium ions.

Walker, Christopher C. [Oak Ridge National Laborat↗