Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Side-by-Side Comparison of Subhourly Clipping Models: Preprint

Over the past several years there have been numerous attempts at quantifying the inherent power clipping of inverters due to inter-hourly irradiance variability that is not captured in hourly PV performance models. Different models have been proposed to correct for these clipping losses in PV performance estimates, including matrix lookup models, distribution modeling of the PV power performance within a given hour, and machine learning methods. To date, there have been few comprehensive quantitative comparisons of these inverter clipping correction modeling approaches to evaluate the effectiveness of said approaches in predicting the actual behavior of PV system inverter clipping. In this study, we perform such a comparison, evaluating two different clipping correction loss modeling approaches recently implemented in the System Advisor Model (SAM) against clipping losses modeled with 1-minute climate data. These comparisons will be performed across a variety of climate locations and inverter loading ratios to thoroughly analyze the effectiveness of these modeling approaches relative to each other. Results from this analysis reveal that both clipping correction approaches improve annual energy accuracy to within 2% of 1-minute modeled energy yield. The models can improve accuracy up to 3% in systems with ILR of 2.0, showing the importance of this modeling factor in energy yield estimates.

clipping↗
DOE OSTI2024

Side-by-Side Comparison of Subhourly Clipping Models

Over the past several years there have been numerous attempts at quantifying the inherent power clipping of inverters due to subhourly irradiance variability that is not captured in hourly PV performance models. Different models have been proposed to correct for these clipping losses in PV performance estimates, including matrix lookup models, distribution modeling of the PV power performance within a given hour, and machine learning methods. To date, there have been few comprehensive quantitative comparisons of these inverter clipping correction modeling approaches to evaluate the effectiveness of these approaches in predicting the actual behavior of PV system inverter clipping. In this study, we perform such a comparison, evaluating the Allen and Walker correction loss modeling approaches recently implemented in the System Advisor Model (SAM) against clipping losses modeled with 1-minute climate data. These comparisons were performed across a variety of climate locations and inverter loading ratios to thoroughly analyze the effectiveness of these modeling approaches relative to each other. Results from this analysis reveal that both clipping correction approaches improve annual energy accuracy to within 2% of 1-minute modeled energy yield. The two models predict annual clipping loss more accurately than simple hourly power limit clipping, with the Allen method typically being slightly more accurate at typical ILR values and the Walker method often being slightly more accurate at high ILR values The models can improve accuracy over the status quo clipping approach up to 3 percentage points in systems with ILR of 2.0, showing the importance of this modeling factor in energy yield estimates.

accuracy↗
DOE OSTI2024

Side-by-Side Comparison of Subhourly Clipping Models

Over the past several years there have been numerous attempts at quantifying the inherent power clipping of inverters due to sub-hourly irradiance variability that is not captured in hourly PV performance models. Different models have been proposed to correct for these clipping losses in PV performance estimates, including matrix lookup models, distribution modeling of the PV power performance within a given hour, and machine learning methods. To date, there have been few comprehensive quantitative comparisons of these inverter clipping correction modeling approaches to evaluate the effectiveness of these approaches in predicting the actual behavior of PV system inverter clipping. In this study, we perform such a comparison, evaluating the Allen and Walker correction loss modeling approaches recently implemented in the System Advisor Model (SAM) against clipping losses modeled with 1-minute climate data. These comparisons were performed across a variety of climate locations and inverter loading ratios to thoroughly analyze the effectiveness of these modeling approaches relative to each other. Results from this analysis reveal that both clipping correction approaches improve annual energy accuracy to within 2% of 1-minute modeled energy yield. The two models predict annual clipping loss more accurately than simple hourly power limit clipping, with the Allen method typically being slightly more accurate at typical ILR values and the Walker method often being slightly more accurate at high ILR values The models can improve accuracy over the status quo clipping approach up to 3 percentage points in systems with ILR of 2.0, showing the importance of this modeling factor in energy yield estimates.

ENERGY PLANNING, POLICY, AND ECONOMY,MATHEMATICS A↗
DOE OSTI2026

Intern-Artificial Intelligence Benchmarking

Benchmarks provide a standardized method for evaluating different AI models, enabling reproducibility and comparison between models, and facilitating scientific progress. As AI models continue to develop rapidly, incorporating new datasets, capabilities, and architectures becomes more complicated. Therefore, the current static benchmarks become increasingly irrelevant. The MLCommons team argues that to make AI benchmarks more relevant, it involves making the benchmarks themselves more dynamic, as well as technical innovations that make it easier for scientists and researchers at all levels to use and contribute to the benchmarks. The current progress in technical innovation is a software that allows for a detailed view of a collection of AI benchmarks to be output in various formats that are easily readable and accessible.

Krishnan, Anjay [Fermilab]↗
DOE OSTI2025

Hypothetical Nuclear Reactor Facility Modeling Simulation Data Scenario Comparison

This document evaluates a hypothetical nuclear powerplant and associated protective force personnel using modern modeling and simulation tools. The facility incorporates security early in the design to consider and integrate methods to resolve security issues and vulnerabilities via the facility’s inherent design characteristics before construction. The evaluation in this document is an example only. It is not intended to recommend or evaluate the effectiveness of existing physical security requirements or identify any method that the U.S. Nuclear Regulatory Commission staff may find acceptable for complying with existing requirements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Confronting Large‐Eddy Simulations With Stereo Camera Data by Means of Reconstructed Hemispheric Cloud Size Distributions

High-resolution hemispheric camera images at a meteorological site in western Germany are used to analyze the multi-dimensional spatial characteristics of continental cumulus cloud fields, and to evaluate Large-Eddy Simulations on this aspect. Traditional non-hemispheric cloud-detecting instruments provide additional reference data. The main model-observation comparison focuses on cloud size distributions (CSDs), employing two methods: (a) directly using three-dimensional model fields, direct CSDs, and (b) using rendered hemispheric images of the model fields as produced by a camera simulator based on path-tracing. In the latter method, both the real and rendered images are used to three-dimensionally reconstruct the cloud fields, yielding hemispheric CSDs. Advantages of hemispheric comparisons over more classic approaches include (a) fair comparisons between model and data, and (b) full use of the enhanced resolutions and hemispheric spatial coverage of the camera imagery. Basic evaluation of the simulations demonstrates good agreement on thermodynamic structure and its diurnal cycle. Cloud heights and cloud cover are intercompared between the model, camera data and other instrumentation, providing insight into their structural differences. A consistent alignment is found between the hemispheric CSDs from both the model and the cameras. Power law fits reveal structurally lower exponents in hemispheric CSDs compared to non-hemispheric CSDs, which particularly caution against directly comparing hemispheric CSDs to non-hemispheric distributions. This result is robust for sample size and fitting method. These findings inform future use of hemispheric camera systems for studying cumulus cloud field morphology and model evaluation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A comparison of effective field theory models of redshift space galaxy power spectra for DESI 2024 and future surveys

In preparation for the next generation of galaxy redshift surveys, and in particular the year-one data release from the Dark Energy Spectroscopic Instrument (DESI), we investigate the consistency of a variety of effective field theory models that describe the galaxy-galaxy power spectra in redshift space into the quasi-linear regime using 1-loop perturbation theory. These models are employed in the pipelines velocileptors, PyBird, and Folpsν. While these models have been validated independently, a detailed comparison with consistent choices has not been attempted. After briefly discussing the theoretical differences between the models we describe how to provide a more apples-to-apples comparison between them. We present the results of fitting mock spectra from the AbacusSummit suite of N-body simulations provided in three redshift bins to mimic the types of dark time tracers targeted by the DESI survey. We show that the theories behave similarly and give consistent constraints in both the forward-modeling and ShapeFit compressed fitting approaches. We additionally generate (noiseless) synthetic data from each pipeline to be fit by the others, varying the scale cuts in order to show that the models agree within the range of scales for which we expect 1-loop perturbation theory to be applicable. Finally, this work lays the foundation of Full-Shape analysis with DESI Y1 galaxy samples where in the tests we performed, we found no systematic error associated with the modeling of the galaxy redshift space power spectrum for this volume.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Surrogate model for third-integer resonance extraction at the Fermilab Delivery Ring

We present an ongoing work in which a surrogate model is being developed to reproduce the response dynamics of the third-integer resonant extraction process in the Delivery Ring (DR) at Fermilab. This is in pursuit of smoothly extracting circulating beam to the Mu2e Experiment’s production target, whereby the goal is to extract a uniform slice of the circulating 1e12 protons in the DR over 25,000 turns (43 ms). The DR contains 3 harmonic sextupoles that excite a third-integer resonance and three fast, tune-ramping quadrupole magnets that drive the horizontal tune towards the 29/3 resonance. In our initial work, the surrogate model trains on a semi-analytical simulation provided in the same format as live data. Using Reinforcement Learning (and other potential ML methods), the trained surrogate acts as the “environment” in which a simple ML control agent could learn to dynamically adjust the quadrupole ramp at 430 break points within the 43 microsecond spill window. The controller will be hosted on a dedicated Arria 10 FPGA. In this work, we report the accuracy and fidelity of the surrogate model in comparison to the response dynamics of the physics simulator.

Narayanan, Aakaash [Fermilab]↗
DOE OSTI2024

Synthesis of results for Brine Availability Test in Salt (BATS) DECOVALEX-2023 Task E

In the 2023 phase of the international collaborative DECOVALEX modeling project, Task E focused on understanding thermal, hydrological, and mechanical (THM) processes related to predicting brine migration in the excavation damaged zone around a heated excavation in salt. Salt is attractive as a disposal medium for radioactive waste because it is self-healing and is essentially impermeable and non-porous in the far field. Investigation of the short-term, near-field behavior is important for radioactive waste disposal because this early period strongly controls the amount of inflowing brine. Brine leads to corrosion of waste forms and waste packages, and possible dissolution of radionuclides with brine transport being a potential transport vector to the accessible environment.The Task was divided into steps. Step 0 included matching unheated brine inflow data from boreholes at the Waste Isolation Pilot Plant (WIPP) and matching temperature observations during a Brine Availability Test in Salt (BATS) heater test. Step 1 included validation of models against a thermo-poroelastic analytical solution, and two-phase flow around an excavation. Finally, Step 2 required all the individual components covered in steps 0 and 1 to come together to match observed brine inflow behavior during the same BATS heater test.There were a range of approaches from the teams, from mechanistic to prescriptive. Given the uncertainties in the problem, some teams used one- or two-dimensional models of the processes, while other teams included more geometrical complexity in three-dimensional models. Task E was a learning experience for the teams involved, and feedback from the modeling teams has led to changes in follow-on BATS experiments at WIPP. The primary Task E lessons learned were the impact of hydrologic initialization methods (wetting up vs. drying down), the difference between confined and unconfined thermal expansion, and the large changes in permeability associated with heating and cooling.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

Development of an Amine Oxide Polyzwitterion Brush Martini Model with Polarizable Water and Ions

Abstract In order to accurately simulate the fouling process of proteins onto polyzwitterion brushes, models that accurately capture the hydration properties and chain conformations of such brushes must first be established. We developed a Martini coarse-grained (CG) model for amine oxide polyzwitterion (PNOMA) brushes, a promising class of antifouling materials, in polarizable water and ions by fitting to all-atom bond and angle distributions, monomer hydration free energy, monomer–monomer distance potential of mean force (PMF), and monomer–salt radial distribution functions (RDFs). Martini 2.2P was selected for compatibility with the established polarizable water and ion models. For comparison with PNOMA, we also constructed models for conventional sulfobetaine (PSBMA) and phosphorylcholine (PMPC) polyzwitterions and the polycation PMETAC using established nonbonded bead types from the literature and refitting bond and angle potentials. We simulated each polymer brush chemistry for varying grafting density and chain length, validating brush height scaling relations against experimental data. The CG models captured the relative hydration strengths among different polyzwitterion chemistries, and brush heights extrapolated to higher molecular weights are in agreement with experimental ellipsometry data. We find that chain swelling of the superhydrophilic PNOMA brushes lies between that of the traditional polyzwitterions PSBMA/PMPC and the polycation PMETAC. For PNOMA brushes in NaCl solution, simulated brush height decreases with salt concentration due to the selectively strong interactions between amine oxide and sodium ions.

Walker, Christopher C. [Oak Ridge National Laborat↗
DOE OSTI2024

Climate Conundrum: A Wet or Dry European and Northern African Climate During the Middle Miocene

Abstract End of 21st‐century hydroclimate projections suggest an expansion of subtropical dry zones, with Mediterranean and Sahel regions becoming much drier. However, paleobotanical assemblage evidence from the middle Miocene (17‐12 Ma), suggests both regions were instead humid environments. Here we show that by modifying regional sea surface temperatures (SST) in an Earth System Model (CESM1.2) simulation of the middle Miocene, the increased ocean evaporation and integrated water vapor flux overrides any drying effects associated with warming‐induced land‐surface evaporation driven by atmospheric CO 2 concentrations. These modifications markedly reduce the bias in the model‐data comparison for this period. A vegetation model (BIOME4) forced with simulated climatologies predicts both regions were dominated by mixed forest, which is largely consistent with the paleobotanical record. This study unveils the potential for wetter subtropical Mediterranean climates associated with warming, presenting an alternative scenario from future drying projections with localized SST warming governing regional climate change.

Acosta, R. P.↗
DOE OSTI2026

Multi-model analysis of the impact of water vapor on the radiative forcing of volcanic aerosols after the 2022 Hunga Eruption

On 15 January 2022, the Hunga volcano eruption released unprecedented amounts of water vapor into the atmosphere alongside a modest amount of SO 2 . In this work we analyse results from multiple Earth system models as part of the Hunga Tonga-Hunga Ha'apai Volcano Impact Model Observation Comparison Project. Our results show a good model agreement over the climatic outcomes of the eruption, overall indicating a significant negative radiative forcing from the Hunga eruption. The multi-model mean of global instantaneous radiative forcing averaged over 2022–2023 is estimated at −0.19 ± 0.06 W m −2 at the top-of-atmosphere (TOA), and −0.16 ± 0.06 W m −2 at the surface. Simulations with free-running meteorology and climatological sea surface temperatures and sea ice yield a global mean TOA forcing of −0.14 ± 0.10 W m −2 across two models for the first 2 years, decreasing to −0.09 ± 0.10 W m −2 on average between 2022 and 2027. However, these global values may be underestimated by about 50 %, considering that recent SO 2 injection retrievals suggest nearly twice the amount than the 0.5 Tg-SO 2 used in the protocol. We also find that the contribution from added stratospheric water vapor is minimal and that the injected SO 2 and the resulting formation of stratospheric sulfate dominate the radiative forcing. However, water vapor played a key role in the initial aerosol growth, leading to a stronger negative radiative forcing during the first 6 months after the eruption compared to simulations without water vapor co-injection.

Geosciences↗
DOE OSTI2024

Super-X and conventional divertor configurations in MAST-U ohmic L-mode; a comparison facilitated by interpretative modelling

Measurements are presented, alongside corresponding interpretative SOLPS-ITER simulations, of the first MAST-U experiments comparing ohmically heated L-mode fuelling scans in Conventional divertor (CD) and Super-X divertor (SXD) configurations. In experiment, at comparable outer mid-plane separatrix electron density, $n_{e,\textrm{sep,OMP}}$, the maximum lower outer target heat load was found to be a factor 16 $\,\pm\,7$ lower in SXD compared to CD. In simulation, a factor 26.8 reduction was found (slightly higher than the experimental range), suggesting an additional reduction in SXD compared to the factor 9.3 expected from geometric considerations alone. According to the simulations, this additional reduction in the SXD is due to a net radial transport of the energy remaining downstream of the $T_e = 5$ eV location. This energy is carried out of the critical (highest heat load) flux tube by deuterium atoms, demonstrating the importance of a longer legged divertor which provides space for this to occur. Importantly, in both simulation and experiment, the SXD has minimal impact on the upstream n e and T e profiles. Spectral inferences of detachment front movement in SXD compare well between simulation and experiment. In regions of high magnetic field gradient, the parallel movement of the front towards the X-point becomes less sensitive to increasing $n_{e,\textrm{sep,OMP}}$, in qualitative agreement with simplified models and previous predictive simulations. Additional aspects, regarding the target ion flux rollover, upstream separatrix temperature and drift effects, are also presented and discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Evolving Electricity Supply and Demand to Achieve Net-Zero Emissions: Insights from the EMF-37 Study

This paper explores the role of electricity in achieving economy-wide net-zero CO2 emissions by 2050 in the United States based on results from 17 models as part of the 37th Stanford Energy Modeling Forum (EMF-37). In the study's Net-Zero scenario, the models use diverse pathways to achieve net-zero emissions by 2050, with gross energy-related residual emissions ranging from 17.2 to 66.6 % of 2020 levels. Electricity consistently emerges as central to achieving net-zero, with models projecting rapid electrification of end-uses and rapidly declining CO2 intensity of electricity. However, the extent of electrification and the technology mix to decarbonize the power sector vary considerably across models. In the Net-Zero scenario, electricity is projected to evolve from ~20 % of final energy in 2020 to 17-63 % in 2050 across the models driven by electrification in all sectors-buildings, industry, and transportation-and, to a lesser extent by direct air capture. By 2050, total electricity consumption increases by 24-176 % (relative to 2020), accompanied by significant expansion in renewable electricity production. Together, solar and wind generation grows by 175-834 %, supplying 45-90 % of total electricity in 2050, with wind achieving slightly higher shares than solar. Electricity storage technologies are deployed at scale to support wind and solar generation. The electricity generation mix varies across models: some project almost complete reliance on renewables, while others see a substantial role for natural gas, often with carbon capture and storage. This paper synthesizes the rich diversity of modeling approaches and results, highlighting differing views on how key drivers of electricity demand and supply might evolve.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

A comparison of surrogate constitutive models for viscoplastic creep simulation of HT-9 steel

Mechanistic microstructure-informed constitutive models for the mechanical response of polycrystals are a cornerstone of computational materials science. However, as these models become increasingly more complex – often involving coupled differential equations describing the effect of specific deformation modes – their associated computational costs can become prohibitive, particularly in optimization or uncertainty quantification tasks that require numerous model evaluations. To address this challenge, surrogate constitutive models that balance accuracy and computational efficiency are highly desirable. Data-driven surrogate models, that learn the constitutive relation directly from data, have emerged as a promising solution. In this work, we develop two local surrogate models for the viscoplastic response of a steel: a piecewise response surface method and a mixture of experts model. These surrogates are designed to adapt to complex material behavior, which may vary with material parameters or operating conditions. The surrogate constitutive models are applied to creep simulations of HT-9 steel, an alloy of considerable interest to the nuclear energy sector due to its high tolerance to radiation damage, using training data generated from viscoplastic self-consistent (VPSC) simulations. In conclusion, we define a set of test metrics to numerically assess the accuracy of our surrogate models for predicting viscoplastic material behavior, and show that the mixture of experts model outperforms the piecewise response surface method in terms of accuracy.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Comparison of interlaminar damage modeling strategies for hybrid composite/aluminum laminates subjected to low-velocity impact

Low-velocity impact of hybrid metal-composite structures was investigated experimentally and computationally. Composite laminates consisting of 2D woven glass fiber reinforced polymer (GFRP) and carbon fiber reinforced polymer (CFRP) were joined with a 6061-T6 aluminum plate using an epoxy adhesive. Two variations of the structure were studied; one consisting of all plies oriented at 0° and one consisting of all plies oriented at 45°. A drop tower was used to impact structures at a range of energies, including energies above and below the threshold at which the aluminum layer was perforated. Numerical simulations were implemented using Sierra/SM, an in-house transient dynamics finite element code developed at Sandia National Laboratories. A Hosford plasticity model was used to describe the response of the aluminum layer. A newly implemented orthotropic continuum damage mechanics (CDM) constitutive model was used to represent the composite laminate. This 3D-CDM model was compared to a cohesive zone model (2D-CDM/CZM) to investigate efficacy of aluminum perforation energy prediction, delamination prediction, and computational cost. Accuracy of each model was evaluated using the experimental results. Each showed good agreement with the tests for both the force and velocity histories, as well as the observed damage mechanisms. The 2D-CDM/CZM model was marginally more accurate in capturing both the composite and aluminum behavior — this model averaged error percentages of -11.2% and 10.8% for residual velocity and peak force, respectively. Meanwhile, the 3D-CDM model predictions yielded average error percentages of -35.5% (velocity) and 22.6% (force). However, the 3D-CDM model generally resulted in a decreased computational cost; the average run time was 14% shorter than the 2D-CDM/CZM model and 3x as many timesteps per hour were computed using the same computational resources. In conclusion, new experimental data on the impact and perforation resistance of metal-composite laminates is presented in addition to numerical predictions of the impact behavior.

Carbon fiber↗
DOE OSTI2025

Demonstrating the impact of ro-vibrationally excited H 2 on divertor detachment via population modelling

EDGE2D-EIRENE profiles characteristic for low recycling, high recycling and detached plasmas are postprocessed applying a vibrationally resolved collisional radiative (CR) model based on the Yacora solver to predict excited state densities and thus the molecular Lyman-, Werner- and Fulcher band emission intensities. These emission intensities are compared to predictions from the AMJUEL database standardly used in EIRENE. Lower Fulcher band and higher Lyman- and Werner band emission is predicted by the Yacora model in comparison to AMJUEL suggesting that inconsistent results from model based evaluation of measured spectra are expected depending on which model and molecular emission band is considered. The implications on detachment rate predictions are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Comparison of plasma response models for RMP effects on the divertor and scrape-off layer in KSTAR

Resonant magnetic perturbations (RMPs) are beneficial for control of edge localized modes (ELMs) in tokamaks. Nevertheless, a side effect of RMPs is the appearance of helical striations in the particle and heat loads onto divertor targets. The extent and field line connection of these striations is significantly altered by the plasma response to external perturbations. For an ELM suppressed high confinement (H-mode) plasma at KSTAR, magnetic footprints are computed by FLARE based on plasma response from GPEC, MARS-F, M3D-C1 and JOREK with substantial differences in the resulting footprints (from 2 cm to 14 cm). This is reflected in EMC3-EIRENE simulations of the resulting heat loads: it is found that either the peak value or the extent of the striations appears to be overestimated compared to infrared camera measurements. Reasonable agreement can only be achieved for the smallest footprint for lower input power and lower cross-field transport, or for higher upstream density and radiative power losses.

Frerichs, H. [Univ. of Wisconsin, Madison, WI (Uni↗