Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Leptonic cascade decays of a heavy Higgs boson through vectorlike leptons at the LHC

We demonstrate the potential of fully leptonic cascade decays of a heavy neutral Higgs boson through vectorlike leptons as a simultaneous probe for extended Higgs sectors and extra matter particles at the LHC. The processes we explore are unique in that their event topologies lead to di-boson-like leptonic final states with a lepton pair which does not reconstruct the mass of a gauge boson. By recasting existing $2\ell$ + $E^{\text{miss}}_{R}$ and $3/4\ell$ searches channels using run2 data from the LHC we obtain model independent bounds on the masses of heavy scalars and vectorlike leptons and use these results to explore future prospects at the HL-LHC. Our results can be directly applied to any kind of new physics scenarios sharing the final states and the event topology. For concreteness, we apply our results to a benchmark scenario: a two Higgs doublet model type-II augmented with vectorlike leptons. Remarkably, even with current data the sensitivity of our analysis shows a reach for masses of a heavy neutral Higgs and vectorlike leptons up to 2 TeV and 1.5 TeV, respectively. Even for low tan β ≳ 1, the analysis retains sensitivity to heavy Higgs masses slightly above 1 TeV. The future sensitivities at the HL-LHC extend the reach for heavy Higgses and new leptons to 2.7 TeV and 2 TeV, respectively.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

System Modeling Frameworks for Wind Turbines and Plants: Review and Requirements Specifications

System modeling frameworks for wind turbines and plants are used by research groups and industry to design wind energy systems that take into account key trade-offs across performance, cost, and reliability at both the turbine and plant level. The frameworks are exercised using a variety of multi-disciplinary design, analysis and optimization (MDAO) methods. To improve inter-operability and foster collaboration, this report proposes a classification system for the frameworks along dimensions of model fidelity and scope. The classification system is first motivated with reviews the state-of-the-art in the development of software frameworks for integrated wind turbine and plant simulation. Within each major wind turbine and power plant subsystem, a matrix is developed for the disciplines used and the fidelity levels with which each discipline can be modeled. The existing frameworks are then classified according to the matrix. Next, an ontology is proposed that will allow for standardizing how data is transferred between the most common discipline-fidelity combinations used in the frameworks. A common representation of data creates the ability to 1) share system descriptions and analysis results, supporting more transparent benchmarks and comparison, and 2) integrate models together into workflows within and across organizations for improving the efficiency and performance of wind turbine and power plant design processes. Ultimately, this integration leads to better overall wind energy system designs with high performance and low costs.

17 WIND ENERGY↗
DOE OSTI2024

Development of a neural network model for peeling–ballooning stability analysis in the KSTAR tokamak pedestals

The neural network model, MISHKA-NN is developed to mitigate the computational burden associated with the linear ideal magnetohydrodynamic (MHD) stability analysis of the pedestal based on the peeling–ballooning (P–B) model. By utilizing both 1D plasma profiles (current density, pressure gradient, and safety factor) and 0D parameters (plasma geometry, total current, and toroidal mode number), the model predicts linear growth rate of edge-localized ideal MHD instability in a given equilibrium state. By enabling the prediction of each instability within a second, the model reduces the time required for plotting a pedestal P–B stability diagram (j - α diagram) from approximately 100 CPU hours to a few CPU minutes. Notably, even with the utilization of parametric pressure and current profiles and plasma boundary shapes for the training dataset, the model shows a satisfactory level of performance in benchmarking the j - α diagram for the reconstructed equilibrium from a KSTAR tokamak experiment. We anticipate the model to serve as a versatile alternative to 2D linear MHD stability codes, alleviating numerical costs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Evaluation of simulated soil carbon dynamics in Arctic-Boreal ecosystems

Given the magnitude of soil carbon stocks in northern ecosystems, and the vulnerability of these stocks to climate warming, land surface models must accurately represent soil carbon dynamics in these regions. We evaluate soil carbon stocks and turnover rates, and the relationship between soil carbon loss with soil temperature and moisture, from an ensemble of eleven global land surface models. We focus on the region of NASA's Arctic-Boreal vulnerability experiment (ABoVE) in North America to inform data collection and model development efforts. Models exhibit an order of magnitude difference in estimates of current total soil carbon stocks, generally under- or overestimating the size of current soil carbon stocks by greater than 50 PgC. We find that a model's soil carbon stock at steady-state in 1901 is the prime driver of its soil carbon stock a hundred years later—overwhelming the effect of environmental forcing factors like climate. The greatest divergence between modeled and observed soil carbon stocks is in regions dominated by peat and permafrost soils, suggesting that models are failing to capture the frozen soil carbon dynamics of permafrost regions. Using a set of functional benchmarks to test the simulated relationship of soil respiration to both soil temperature and moisture, we find that although models capture the observed shape of the soil moisture response of respiration, almost half of the models examined show temperature sensitivities, or Q10 values, that are half of observed. Significantly, models that perform better against observational constraints of respiration or carbon stock size do not necessarily perform well in terms of their functional response to key climatic factors like changing temperature. This suggests that models may be arriving at the right result, but for the wrong reason. The results of this work can help to bridge the gap between data and models by both pointing to the need to constrain initial carbon pool sizes, as well as highlighting the importance of incorporating functional benchmarks into ongoing, mechanistic modeling activities such as those included in ABoVE.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2015

Evaluation of the Snow Simulations from the Community Land Model, Version 4 (CLM4)

This paper evaluates the simulation of snow by the Community Land Model, version 4 (CLM4), the land model component of the Community Earth System Model, version 1.0.4 (CESM1.0.4). CLM4 was run in an offline mode forced with the corrected land-only replay of the Modern-Era Retrospective Analysis for Research and Applications (MERRA-Land) and the output was evaluated for the period from January 2001 to January 2011 over the Northern Hemisphere poleward of 30 deg N. Simulated snow-cover fraction (SCF), snow depth, and snow water equivalent (SWE) were compared against a set of observations including the Moderate Resolution Imaging Spectroradiometer (MODIS) SCF, the Interactive Multisensor Snow and Ice Mapping System (IMS) snow cover, the Canadian Meteorological Centre (CMC) daily snow analysis products, snow depth from the National Weather Service Cooperative Observer (COOP) program, and Snowpack Telemetry (SNOTEL) SWE observations. CLM4 SCF was converted into snow-cover extent (SCE) to compare with MODIS SCE. It showed good agreement, with a correlation coefficient of 0.91 and an average bias of -1.54 x 10(exp 2) sq km. Overall, CLM4 agreed well with IMS snow cover, with the percentage of correctly modeled snow-no snow being 94%. CLM4 snow depth and SWE agreed reasonably well with the CMC product, with the average bias (RMSE) of snow depth and SWE being 0.044m (0.19 m) and -0.010m (0.04 m), respectively. CLM4 underestimated SNOTEL SWE and COOP snow depth. This study demonstrates the need to improve the CLM4 snow estimates and constitutes a benchmark against which improvement of the model through data assimilation can be measured.

northern hemisphere↗
DOE OSTI2021

Evaluation of the Large-Scale and Regional Climatic Response Across North Africa to Natural Variability in Oceanic Modes and Terrestrial Vegetation Among the CMIP5 Models

Hydrologic variability is a serious threat to the poverty-stricken regions of North Africa. Meanwhile, the scientific community struggles to attribute these extreme climatic episodes to specific oceanic and land drivers. Prior modeling studies have not assessed simulated feedbacks over North Africa against an established observational benchmark, so their results are considered as untested, model-specific findings. The Coupled Model Intercomparison Project Phase Five (CMIP5) archive represents the state-of-the-art in climate projections, with most CMIP5 models now containing interactive vegetation phenology; however, there have been no studies to date of their simulated vegetation feedbacks. The capability of CMIP5 models at accurately simulating the forcing of both sea-surface temperature (SST) and regional leaf area index (LAI) anomalies on North African climate needs to be a key consideration in assessing the models’ overall credibility and determining appropriate model weighting for developing climate projections. The Generalized Equilibrium Feedback Assessment (GEFA) is a promising statistical method, which can be applied to either model output or observations, for isolating the local and remote impacts of individual oceanic or terrestrial forcings on regional climate. We performed a combined observational and modeling assessment of land-ocean-atmosphere interactions across the distinct ecological and moisture gradients of North Africa. We evaluated and demonstrated the reliability of the GEFA statistical method over North Africa using the Community Earth System Model (CESM), applied GEFA to observational data to quantify the observed forcing of ocean basin SST anomalies and regional LAI anomalies on North African climate, evaluated the CMIP5 models’ performance in terms of representing these key observed feedbacks, and formulated CMIP5 feedback performance metrics for weighting North African climate projections. Our study represented the first attempt to separate the observed roles of oceanic and vegetation feedbacks across North Africa, the first systematic assessment and intercomparison of land-ocean-atmosphere feedbacks in CMIP5, and the first exploration of vegetation feedbacks among CMIP5 models. The following work was accomplished. (1) The team generated 14 scientific publications and 30 presentations based on the DOE-funded research. (2) A stepwise version of the GEFA statistical method was developed in which unimportant forcings were dropped to increase the reliability of the results. (3) SGEFA was successfully validated through experiments with CESM in terms of its ability to isolate the atmospheric responses to individual oceanic or land forcings. (4) Observational evidence was revealed for the Sahel’s positive vegetation-rainfall feedback on the seasonal to interannual time scale, and it was attributed to a moisture recycling mechanism rather than an albedo mechanism. (5) An approach with SGEFA was developed in which the individual contributions of soil moisture versus vegetation forcings could be separated, revealing that the former forcing outweighed the latter for sub-Saharan Africa. (6) Tropical ocean temperatures were found to be key regulators of pan-tropical vegetation variability, especially for arid and semi-arid regions, including sub-Saharan Africa. (7) The CMIP5 models largely underestimated the importance of land feedbacks across the Sahel. (8) The general consensus among CMIP5 models indicates, for the late 21st century, a diminished seasonal predictability of sub-Saharan African regional climate and an elevated role of the land surface compared to oceanic drivers in regulating regional climate variability. (9) Land-ocean-atmosphere interactions were demonstrated to be key contributors to the seasonal predictability of African wildfire activity. (10) The El Djouf was determined to be of greater importance than the Bodélé depression in terms of providing trans-Atlantic dust transport to the Americas.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2003

Comment on 'Modeling of Convective-Stratiform Precipitation Processes: Sensitivity to Partitioning Methods' by Matthias Steiner

Despite the obvious notion that the presence of hail or graupel is a good indication of convection, the model results show this does not provide an objective benchmark partly due to the unrealistic presence of small amounts of hail or graupel throughout the anvil in the model but mainly because of the significant amounts of hail or graupel, especially in the tropical TOGA COARE simulation, in the transition zone. Without use of a "transition" category, it is open to debate as how this region should best be defined, as stratiform or as convective. So, the presence of significant hail or graupel contents in this zone significantly degrades its use an objective benchmark for convection. The separation algorithm comparison was done in the context of a cloud-resolving model. These models are widely used and serve a variety of purposes especially with regard to retrieving information that cannot be directly measured by providing synthetic data sets that are consistent and complete. Separation algorithms are regularly applied in these models. However, as with any modeling system, these types 'of models are constantly being improved to overcome any known deficiencies and make them more accurate representations of observed systems. The presence of hail and graupel in the anvil and the bias towards heavy rainfall rates are two such examples of areas that need improvement. Since, both of these can effect the perceived performance of the separation algorithms, the Lang et al. (2003) study did not want to overstate the relative performance of any specific algorithms.

Lang, Steve↗
DOE OSTI2021

Surface Atmosphere Integrated Field Laboratory (SAIL) Science Plan

Mountains are the natural water towers of the world, effectively turning water vapor into readily available fresh water through precipitation, snowpack, and runoff. Unfortunately, Earth system models (ESMs) have persistently been unable to predict the timing and availability of water resources from mountains because the source(s) of model error are difficult to isolate in complex terrain with limited atmospheric or land-surface observations. Further complications arise from the gross scale mismatch between ESM grid box sizes and the relevant scales of mountainous hydrological processes. The mountain hydrometeorology community has repeatedly called for integrated atmospheric and land observations of water and energy budgets in complex terrain that span these scales to establish benchmarks against which scale-dependent models can be further developed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

AMVOS: Additive Manufacturing Video Object Segmentation Dataset

This dataset provides labeled video frames from four additive manufacturing (AM) processes for video object segmentation (VOS) tasks. It contains 90 video segments comprising 900 individually annotated frames across five AM datasets: laser hot-wire directed energy deposition (LHW-DED), tungsten inert gas wire arc additive manufacturing (TIG-WAAM), plasma arc welding (PAW), visible-light polymer extrusion (visPolymer), and near-infrared polymer extrusion (irPolymer). Each video segment consists of 10 contiguous frames with corresponding pixel-level object instance annotations. Depending on the process, two of four object classes are labeled per frame: Melt Pool, Feed Wire, Nozzle, or Material. Raw frames are provided as .jpg files and annotations as palettized .png files. The dataset follows the directory structure of established VOS benchmarks (DAVIS, YouTube-VOS, MOSE), enabling direct integration into VOS model training and evaluation pipelines for foundation model fine-tuning, domain adaptation, or zero-shot performance benchmarking. Data was collected at Oak Ridge National Laboratory's Manufacturing Demonstration Facility.

Wetzel, Jon [ORNL]↗
DOE OSTI2021

Benchmarking numerical methods for impact and cratering applications

Large scale computational models are important for studying impact cratering events that are prevalent both on Earth and, more broadly, in this solar system. To address these problems, models must reliably account for both large length scales (e.g., kilometers) and relatively long time scales (hundreds of seconds). This work benchmarks two such approaches, a more traditional hydrodynamics approach and a finite-discrete element method (FDEM), for impact cratering applications. Both 2D and 3D results are discussed for two different impact velocities, 5 km/s and 20 km/s, striking normal to the target and, for 3D simulations, 45° from vertical. In addition, comparisons to previously published data are presented. Finally, differences in how these methods model damage are discussed. Ultimately, both approaches show successful modeling of several different impact scenarios.

58 GEOSCIENCES↗
DOE OSTI2025

Artificial Intelligence Benchmarking

AI benchmarking is a method for evaluating the effectiveness of an AI model using a set of standardized metrics, for example, high school-level math exams. These benchmarks and their results will enable ranking various AI models based on their effectiveness in performing a specific task.

Krishnan, Anjay [Fermilab]↗
DOE OSTI2023

Quantifying uncertainties due to irreducible three-body forces in deuteron-nucleus reactions

Deuteron-induced nuclear reactions are an essential tool for probing the structure of nuclei as well as astrophysical information such as (n, γ) cross sections. The deuteron-nucleus system is typically described within a Faddeev three-body model consisting of a neutron (n), a proton (p), and the target nucleus (A) interacting through pairwise phenomenological potentials. While Faddeev techniques enable the exact description of the three-body dynamics, their predictive power is limited in part by the omission of irreducible neutron-proton-nucleus three-body force (n–p–A 3BF). Here, our goal is to quantify systematic uncertainties stemming from the reduction of deuteron-nucleus (d + A) dynamics to a picture of three pointlike nuclear clusters interacting via pairwise nucleon-nucleus forces, using as testing grounds d + α scattering and the 6 Li ground state. We particularly focus on quantifying uncertainties arising from the full antisymmetrization of the (A + 2)-body system with the target nucleus fixed in its ground state. We adopt the ab initio no-core shell model coupled with the resonating group method (NCSM/RGM) to compute microscopic n–α and p–α interactions, and use them in a three-body description of the d + α system by means of momentum-space Faddeev-type equations. Simultaneously, we also carry out ab initio calculations of d + α scattering and 6 Li ground state by means of six-body NCSM/RGM calculations to serve as a benchmark for the three-body model predictions given by the Faddeev calculations. By comparing the Faddeev and NCSM/RGM results, we show that the irreducible n–p–α 3BF has a non-negligible effect on bound state and scattering observables alike. Specifically, the Faddeev approach yields a 6 Li ground state that is approximately 600 keV shallower than the one obtained with the NCSM/RGM. Additionally, the Faddeev calculations for d + α scattering yield a 3 + resonance that is located approximately 400 keV higher in energy compared to the NCSM/RGM result. The shape of the d + α angular distributions computed using the two approaches also differ, owing to the discrepancy in the predictions of the 3 + resonance energy. The Faddeev three-body model predictions for d + α scattering and 6 Li using microscopic n–α and p–α potentials differ from those computed microscopically with the NCSM/RGM. These discrepancies are due to the n–p–α 3BF, which arises from two-nucleon exchange terms in the microscopic d–α interaction and are not accounted for in the three-body model Faddeev calculations. This study lays the foundation for future parametrizations of the 3BF due to Pauli exclusion principle effects in improved three-body calculations of deuteron-induced reactions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRSDate not supplied

Turbulence Effects on Shaped Booms: Finite Impulse Response Filter Development

Numerical simulations of propagation through turbulent atmospheres can quantify effects on ground waveforms, but such simulations are computationally expensive. To enable quick turnaround analyses as required by NASA’s Quesst Mission, updating the N-wave filtering approach developed by researchers at The Pennsylvania State University to include shaped booms is proposed as an alternative method for estimating turbulence effects on acoustic metrics more quickly. Beginning with a nearfield pressure cylinder modeled after the on-design X-59 configuration, a database of propagation results at 45 turbulence conditions was compiled using nonlinear turbulence propagation modeling code (KZKFourier) and used as input to a process for generating finite impulse response (FIR) filters. Ground waveforms distorted by turbulence were selected to represent mean and mean±standard deviation levels for six metrics, and corresponding FIR filters were generated through a matrix deconvolution process. In order to evaluate how well the FIR filters perform, additional KZKFourier verification cases were devised with different input conditions, and results used as a benchmark. Convolution of shaped boom waveforms modeled using nonturbulent propagation simulations with the new FIR filters showed better agreement on average with KZKFourier statistical results than the N-wave-based FIR filters.

turbulence↗
DOE OSTI2026

ACRRF High-Bay Dose Calculations using MCNP (Part A)

Analytical tools and models have been developed as a starting point for directly assessing dose in the Annular Core Research Reactor Facility (ACRRF) due to reactor operation. Key results include peak dose along the Central Cavity (CC) centerline (beamline) at the cavity level, dose throughout the High-Bay (HB), and dose on the facility roof for partially-shielded reactor operation where the 4” insert is removed from the CC Shield Plug (SP). Model results in the beamline are benchmarked against measured doses from passive dosimetry evaluations. Personnel total (neutron and gamma) dose in the ACRRF HB is calculated using Monte Carlo N-Particle (MCNP). Various CC and SP configurations are analyzed, including unshielded (no SP) and partially shielded (SP installed but 4” insert removed). Novel application of Variance Reduction (VR) techniques, namely the Surface Source Write (SSW) and Surface Source Read (SSR) capabilities in MCNP, enable impressive resolution (in a Monte Carlo modeling sense) of dose throughout much the facility. The VR techniques reduce stochastic error for challenging tallies, with more advanced techniques explored in the companion to this report (Part B) [1]. Supplementary studies (including a verification analysis) and pedagogic evaluations in Part B involve neutron spectra, angular distributions, and the dose impact of facility characteristics. With the SP 4” insert removed and the Lead-Boron (44”) Bucket (LB–44) in the reactor cavity, Total Effective Dose (TED) within the CC beamline is ≈140 rem per 300 MJ of reactor yield (or 3900 rem per hour at 100% Steady-State (SS) power). With no SP (unshielded) and a Free-Field (FF) cavity, TED within the beamline is ≈610 rem per 300 MJ (or 17000 rem per hour at 100% SS power). Due to the predicted collimation of radiation by the reactor pool (and partial SP, if present), beamline dose is much greater than the scattered radiation field surrounding the cavity and reactor tank. Comparisons are made to beamline dosimetry measurements to validate the model. Model predictions agree reasonably well (⪅10%) with measured quantities of neutron fluence, gamma fluence, and spectral metrics. Away from the beamline, comparisons made to previous dose measurements in the HB agreement within an order of magnitude.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture search (NAS) combined with multimodal learning models. We adapt a NAS framework aimed at investigating image classification to the problem of software flaw detection and demonstrate improved results on the Juliet Test Suite, a popular benchmarking data set for measuring performance of machine learning models in this problem domain.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture search (NAS) combined with multimodal learning models. We adapt a NAS framework aimed at investigating image classification to the problem of software flaw detection and demonstrate improved results on the Juliet Test Suite, a popular benchmarking data set for measuring performance of machine learning models in this problem domain.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Estimate long-term impact on battery degradation by considering electric vehicle real-world end-use factors

Many estimates of battery capacity degradation are based on accelerated lab tests that involve charge-discharge cycles or rely on data or electrochemical modeling. These methods are reasonable for technology benchmarking but rarely consider real-world end-use factors. To address this issue, this study develops the Battery Run-down under Electric Vehicle Operation (BREVO) model. It links the driver's travel pattern to physics-based battery degradation and powertrain energy consumption models. The model simulates the impacts of charging behavior, charging rate, driving patterns, and multiple energy management modules on battery capacity degradation. It finds that, over a 10-year timespan, firstly, for a random driver situated in the New England area, daily direct-current fast charging (60 kW) could lead to up to 22% less battery capacity when compared to daily Level-1 charging (1.8 kW). Second, the battery thermal management system can delay battery degradation by approximately 0.5% in the New England area. Third, warmer ambient temperatures enhance BEV battery usage. The model indicates that the battery capacity in the Los Angeles area is 6% higher than that in the New England area. The BREVO model provides crucial information for consumers and BEV manufacturers on range anxiety, BEV battery design, and decision support of battery warranty.

25 ENERGY STORAGE↗