SEARCH · Engineering Papers

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

All sources NASA NTRS DOE OSTI

DOE OSTI2021

A data-driven network optimisation approach to coordinated control of distributed photovoltaic systems and smart buildings in distribution systems

The increasing integration of distributed energy resources, including demand-side resources and distributed photovoltaics (PVs), into distribution systems has resulted in more complicated power system operation. A data-driven network optimisation approach is proposed to coordinate the control of distributed PVs and smart buildings in distribution networks considering the uncertainties of solar power, outdoor temperature and heat gain associated with building thermal dynamics. These uncertain parameters have a significant impact on the operation and control of distributed PVs and smart buildings, bringing challenges to the distribution system operation. In the proposed data-driven distributionally robust optimisation (DRO) approach, the Wasserstein ball is used to construct an ambiguity set for the uncertain parameters, which does not require the probability distributions to be known. Furthermore, a conditional value-at-risk is incorporated into the Wasserstein-based DRO model and converted into a computationally tractable mixed-integer convex optimisation problem. Benchmarked with robust optimisation and chance-constrained programming, the proposed data-driven model can give a less conservative robust solution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1998

Injector Design Tool Improvements: User's manual for FDNS V.4.5

The major emphasis of the current effort is in the development and validation of an efficient parallel machine computational model, based on the FDNS code, to analyze the fluid dynamics of a wide variety of liquid jet configurations for general liquid rocket engine injection system applications. This model includes physical models for droplet atomization, breakup/coalescence, evaporation, turbulence mixing and gas-phase combustion. Benchmark validation cases for liquid rocket engine chamber combustion conditions will be performed for model validation purpose. Test cases may include shear coaxial, swirl coaxial and impinging injection systems with combinations LOXIH2 or LOXISP-1 propellant injector elements used in rocket engine designs. As a final goal of this project, a well tested parallel CFD performance methodology together with a user's operation description in a final technical report will be reported at the end of the proposed research effort.

Chen, Yen-Sen↗

DOE OSTI2026

Improving the Performance of NEML2 with Modern Graph Compilation Backends

NEML2 vectorizes constitutive-model evaluation for large-scale multiphysics simulation, using PyTorch as its tensor backend so that a batch of material-point updates runs on CPU or GPU through a single implementation. In the two prior reports in this series it was a C++-native library, deployed through TorchScript tracing and just-in-time (JIT) compilation; it has since been rewritten from the ground up into a Python-native library deployed through Ahead-of-Time Inductor (AOTInductor), a modern PyTorch graph-compilation backend. The rewrite is driven by a persistent tension, not a language preference: NEML2 composes constitutive models at runtime from a registry of small, independently-authored pieces, and that flexibility is difficult to reconcile with the compile-time knowledge an efficient GPU kernel needs. This report documents the rewrite and the investment that accompanied it: the AOTInductor export pipeline that turns a Python-authored model into a portable, Python-free compiled artifact loadable from pure C++; the eager and compiled runtimes and the new implicit solver layer built on them; a head-to-head benchmark of legacy JIT against AOTInductor; the physics-model catalog and its worked examples; the developer tooling; and the corresponding overhaul of MOOSE’s NEML2 integration that lets MOOSE consume it. A central objective is to examine whether modern PyTorch graph-compilation backends are effective for MOOSE GPU integration. The benchmark answers directly: AOTInductor outperforms legacy JIT on every GPU scenario measured, by 1.0–4.5×. Modern graph-compilation backends are effective for MOOSE GPU integration, and AOTInductor specifically – not compilation in the abstract – is why.

Hu, Gary (Tianchen) [Argonne National Laboratory (↗

NASA NTRS2020

Juncture Flow Computations using kL-Based Turbulence Models

The development and implementation of kL-based Reynolds-Average Navier-Stokes (RANS) two-equation turbulence models are reported in this paper. The kL model is based on Abdol-Hamid's closure and Menter's modification to Rotta's two-equation model. Rotta showed that a reliable transport equation can be formed from the turbulence length scale L, and the turbulence kinetic energy k. Rotta's kL equation is well suited for a term-by-term modeling and displays useful features compared to other scale formulations. One of the important differences is the inclusion of higher-order velocity derivatives in the source terms of the scale equation. This can enhance the ability of RANS solvers to simulate unsteady flows in URANS mode. The k-kL scheme has been modified to include the Algebraic Reynolds Stress Model (ARSM) and the Quadratic Constitutive Relation (QCR) as nonlinear models. These models have gone through extensive validations using two-dimensional benchmark problems. The present study documents the application of the k-kL schemes to simulate flow around the Juncture Flow Model (JFM). The k-kL prediction results show generally good comparisons with measurements. The results from this formulation are similar to, or better than results using the SA-RC-QCR2000 two-equation turbulence model. The ARSM and the QCR formulations of k-kL show promise with a similar level of computational resources as basic two-equation turbulence models.

K S Abdol-Hamid↗

DOE OSTI2020

Data Repository for Power system Open models With Evolving Resources (DR POWER) (Final Scientific/Technical Report)

Pacific Northwest National Laboratory (PNNL) and the National Rural Electric Cooperative Association (NRECA) created a Data Repository for Power system Open models With Evolving Resources (DR POWER) to establish, curate, and evolve open-access power grid models and scenarios, and measurements and observations, collectively referred to as datasets. Existing open-access datasets are inadequate (too small and not representative of the complexity of the modern grid, and scattered all over the world wide web) for the investigation and benchmarking of the advanced optimization methods needed for next-generation grids. Open-access datasets are static and inadequate in other aspects: they do not provide format transformation tools; there is missing information needed for advanced applications; hard to cite; no model evolution history; difficult to update current collections; and little to no community involvement and feedback. Overall, the current landscape is hindering model evolution and benchmarking standards needed for transformational approaches to be developed, tested, and accepted by the power modeling community.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1991

Thermal modeling with solid/liquid phase change of the thermal energy storage experiment

A thermal model which simulates combined conduction and phase change characteristics of thermal energy storage (TES) materials is presented. Both the model and results are presented for the purpose of benchmarking the conduction and phase change capabilities of recently developed and unvalidated microgravity TES computer programs. Specifically, operation of TES-1 is simulated. A two-dimensional SINDA85 model of the TES experiment in cylindrical coordinates was constructed. The phase change model accounts for latent heat stored in, or released from, a node undergoing melting and freezing.

Skarda, J. Raymond Lee↗

NASA NTRS2021

Modeling of Guided Waves for Aerospace Applications

Advancements in computer hardware has led to new possibilities for rapid modeling and simulation capabilities across many scientific fields. Nondestructive evaluation (NDE) can benefit from increased use of simulation tools to guide optimization of inspection and health monitoring methods, enhance understanding of data, aid in development of defect characterization methods, and generate data sets for use with machine learning and model-assisted probability of detection. Recent work at NASA has entailed development and benchmarking of both custom simulation codes and commercial simulation tools for ultrasonic wave propagation. This paper describes recent work at NASA in modeling of guided waves in composites and other aerospace materials. Results and computational speeds for a composite benchmark case are reported for a custom finite difference Rotated Staggered Grid code and for the commercial finite element software package, Pogo. Recent progress in linking NDE models to parametric analysis tools is also discussed.

Nondestructive evaluation↗

DOE OSTI2020

Flexible Reinforcement Learning Framework for Building Control using EnergyPlus-Modelica Energy Models

In recent years, reinforcement learning (RL) methods have been greatly enhanced by leveraging deep learning approaches. RL methods applied to building control have shown potential in many applications due to their ability to complement or replace conventional methods such as model-based or rule-based controls. However, RL-based building control software is likely tailored either to one target building system or to a specific RL method so that significant additional effort would be required to customize the RL-based controller for use in other building systems or with other RL approaches. Also, RL-based building controls usually depend on building energy simulations to train controllers, so emulating building dynamics (i.e., thermal dynamics and control dynamics) and capturing sub-hourly dynamic profiles are crucial to further the development of effective RL-based building control methods. To address these challenges, we present an open source RL-based control software employing a high-fidelity hybrid EnergyPlus-Modelica building energy model which emulates building dynamics at 1-minute resolution. This software consists of decoupled components (environment, building emulator, control agent, and RL algorithm), which allows for quick prototyping and benchmarking of standard RL algorithms in different systems; for example, a single component can be replaced without revising all of the software. To demonstrate this software framework, we conducted a benchmark study using an EnergyPlus-Modelica building energy model for a Chicago office building with an RL-based controller to dynamically control the chilled water temperature setpoint and the air handling unit supply air temperature setpoint on selected floors.

Lee, Joon-Yong↗

DOE OSTI2021

Validation of SAS4A/SASSYS-1 for predicting steady-state single-phase natural circulation

The validation of system analysis codes for nuclear reactor systems is required for the development and application of these computational tools. Designed as a comprehensive system analysis code for advanced nuclear reactors, SAS4A/SASSYS-1 requires validation of its physics model for capturing single-phase natural circulation behavior. To support the validation of SAS4A/SASSYS-1, high-precision experiments are performed capturing steady-state single-phase natural circulation on a scaled facility with comprehensive instrumentation. In this work, dedicated tests are performed quantifying the critical modeling parameters, and a single-phase natural circulation benchmark dataset is obtained with well-documented uncertainty and comprehensive facility description. The validation is then performed against the dataset examining the capability of SAS4A/SASSYS-1 in simulating steady-state single-phase natural circulation. The experimental facility is modeled in the candidate code. Solution verification is performed using Richardson-extrapolation-based estimators which quantify and restrict numerical errors from discretization. Input uncertainty provided by the benchmark dataset is forward propagated through the candidate code, quantifying the output uncertainty in a Monte Carlo approach. The composition of the output uncertainty is also quantified through a variance-based sensitivity analysis. With the uncertainty quantified for each individual condition, a detailed comparison between the simulation results and experimental data is performed covering the whole dataset. The results show consistent agreement for all primary parameters. The current validation activity provides a valuable benchmark dataset for the validation of system analysis codes in capturing single-phase natural circulation and demonstrates satisfactory prediction capability of SAS4A/SASSYS1 for steady-state single-phase natural circulation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS2002

Investigation of Error Patterns in Geographical Databases

The objective of the research conducted in this project is to develop a methodology to investigate the accuracy of Airport Safety Modeling Data (ASMD) using statistical, visualization, and Artificial Neural Network (ANN) techniques. Such a methodology can contribute to answering the following research questions: Over a representative sampling of ASMD databases, can statistical error analysis techniques be accurately learned and replicated by ANN modeling techniques? This representative ASMD sample should include numerous airports and a variety of terrain characterizations. Is it possible to identify and automate the recognition of patterns of error related to geographical features? Do such patterns of error relate to specific geographical features, such as elevation or terrain slope? Is it possible to combine the errors in small regions into an error prediction for a larger region? What are the data density reduction implications of this work? ASMD may be used as the source of terrain data for a synthetic visual system to be used in the cockpit of aircraft when visual reference to ground features is not possible during conditions of marginal weather or reduced visibility. In this research, United States Geologic Survey (USGS) digital elevation model (DEM) data has been selected as the benchmark. Artificial Neural Networks (ANNS) have been used and tested as alternate methods in place of the statistical methods in similar problems. They often perform better in pattern recognition, prediction and classification and categorization problems. Many studies show that when the data is complex and noisy, the accuracy of ANN models is generally higher than those of comparable traditional methods.

Dryer, David↗

DOE OSTI2024

Impedance model for the Fermilab Recycler ring

We present an impedance model of the Fermilab Recycler ring using PyHEADTAIL. The model is constructed by incorporating analytical expressions for the wakefields of beamline components that contribute significantly to impedance. The effects of indirect space charge are included as an inductive impedance. Benchmarking against measured coherent Betatron tune shifts, the impedance model is found to capture 73.4% of observed tune shifts. Our findings serve as a stepping stone for the development of a realistic impedance model crucial for studying impedance-driven instabilities at higher intensity.

43 PARTICLE ACCELERATORS↗

DOE OSTI2023

Implementing and Improving CBMZ-MAM3 Chemistry and Aerosol Modules in the Regional Climate Model WRF-CAM5: An Evaluation over the Western US and Eastern North Pacific

The representation of aerosols in climate-chemistry models is important for air quality and climate change research, but it can require significant computational resources. The objective of this study was to improve the representation of aerosols in climate–chemistry models, specifically in the carbon bond mechanism, version Z (CBMZ), and modal aerosol modules with three lognormal modes (MAM3) in the WRF-CAM5 model. The study aimed to enhance the model’s chemistry capabilities by incorporating biomass burning emissions, establishing a conversion mechanism between volatile organic compounds (VOCs) and secondary organic carbons (SOCs), and evaluating its performance against observational benchmarks. The results of the study demonstrated the effectiveness of the enhanced chemistry capabilities in the WRF-CAM5 model. Six simulations were conducted over the western U.S. and northeastern Pacific region, comparing the model’s performance with observational benchmarks such as reanalysis, ground-based, and satellite data. The findings revealed a significant reduction in root-mean-square errors (RMSE) for surface concentrations of black carbon (BC) and organic carbon (OC). Specifically, the model exhibited a 31% reduction in RMSE for BC concentrations and a 58% reduction in RMSE for OC concentrations. These outcomes underscored the importance of accurate aerosol representation in climate-chemistry models and emphasized the potential for improving simulation accuracy and reducing errors through the incorporation of enhanced chemistry modules in such models.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Anisotropic angular scattering models of elastic electron-neutral collisions for Monte Carlo plasma simulations

Many laboratory and industrial plasma applications require accurate modeling techniques to understand the interplay between microscopic and macroscopic processes. A prime example of this interplay is how particle and Monte Carlo (MC) simulation codes describe angular scattering of electrons following elastic scattering events. The forward peaked nature of high energy electron elastic scattering is relatively trivial to accurately describe in plasma simulations. However, for lower energy collisions, which produce near isotropic or backward peaked differential cross sections, there is not a strong consensus among the plasma modeling community on how to best describe these angular scattering trends. Here, in this study, we propose a systematic method to approximate the aforementioned non-trivial angular scattering behavior with a formula that can be readily implemented in particle-in-cell (PIC) and/or MC plasma simulation codes. The present approach is specifically applied to fusion relevant atomic hydrogen and helium, as well as for molecular hydrogen, and results are also applicable to the atomic isotopes and homonuclear molecular isotopologues of these species. Comparisons between the present angular distribution function and benchmark scattering data were used to validate the proposed models. In addition, two-term Boltzmann calculations and PIC direct simulation MC simulations revealed that the proposed angular distribution function is accurate, agreeing very well with benchmark convergent close-coupling scattering calculations, and electron transport measurements. These studies confirmed that the present angular distribution function model can be utilized without the need of renormalization to the momentum transfer cross section (as opposed to using the elastic scattering integrated cross section), which has been suggested by several studies in order to correct for deficient angular scattering models, and to agree with transport measurements. Hence, the present anisotropic angular scattering model can be utilized to accurately model the momentum transfer as well as the electron trajectories of elastic collisions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

Computational Fluid Dynamic Modeling of Dry Cask Simulator with Crosswind

The purpose of this study is to create a STAR-CCM+ model of a Belowground Vertical Dry Cask Simulator (BVDCS) at Sandia National Laboratories (SNL) and validate the model with SNL’s experimental results. The BVDCS consists of a single boiling water reactor assembly fitted with electric heaters encompassed by a containment vessel and shell to represent a belowground spent nuclear fuel (SNF) dry storage system. Blowers are located near the inlet and outlet of the BVDCS to simulate crosswind conditions. In addition to the experimental results, the STAR-CCM+ model developed for this study is compared with a previous computational fluid dynamics (CFD) model in a different software program, which is used as a software-to-software benchmark. The experimental results provide a dataset to compare the STAR-CCM+ model results for a variety of different conditions. The main objective is to validate and improve STAR-CCM+ CFD models for spent nuclear fuel storage systems with explicitly modeled external environments and “wind driven” crossflows. These CFD models aide in the study of external particle deposition in spent nuclear fuel storage systems, which is important to predicting the significance of chloride induced stress corrosion cracking (CISCC). In addition to experimental comparison, a sensitivity analysis study is performed using the STAR-CCM+ model. The sensitivity analysis provides a quantitative assessment of the sensitivity of various parameters. This helps provide information on various parameters that are of particular importance to constructing a model representative of real life systems. The STAR-CCM+ model compared well to the experimental results showing similar responses to changes in cross wind flow, and a number of parameters are identified for model improvement.

Jensen, Ben J.↗

DOE OSTI2024

Evaluating the Effectiveness of Retrieval-Augmented Large Language Models in Scientific Document Reasoning

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to solve these issues by retrieving relevant information from external data sources and augment the training process. These models helps to trace evidence from an externally provided knowledge base allowing the model predictions to be better interpreted and verified. In this work, we critically evaluate these models in their ability to perform in scientific document reasoning tasks. To this end, we tuned multiple such model variants with science-focused instructions and evaluated them on a scientific document reasoning benchmark for the usefulness of the retrieved document passages. Our findings suggest that models justify predictions in science tasks with fabricated evidence and leveraging scientific corpus as pretraining data does not alleviate the risk of evidence fabrication.

• Artificial intelligence (AI) / machine learning ↗

DOE OSTI2025

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2026

Evapotranspiration partitioning estimates from 8 methods from 47 NEON sites, 2019-2021

This dataset provides daily estimates of evapotranspiration (ET) and the transpiration-to-evapotranspiration ratio (T/ET) across 47 terrestrial National Ecological Observatory Network (NEON) sites spanning diverse environmental and biome conditions in the United States across three years of data (2019-2021). Daily ET is reported in both energy units (MJ m⁻² day⁻¹) and equivalent water depth (mm day⁻¹), assuming a constant latent heat of vaporization of 2.45 MJ/kg. The primary method uses a hybrid recurrent neural network–Penman–Monteith framework (RNN-PM), which integrates physically based surface energy balance constraints with data-driven learning to partition ET into transpiration and evaporation components. Model inputs include in situ meteorological observations (air temperature, vapor pressure deficit, wind speed, and radiation) combined with satellite-derived land surface temperature, leaf area index, and soil moisture. For benchmarking and uncertainty assessment, T/ET estimates from seven additional models are included: Priestley-Taylor Jet Propulsion Laboratory (PT-JPL), Penman-Monteith (P-M), Two-Source Energy Balance (TSEB), Support Vector Regression (SVR), and Categorical Boosting (CatBoost), among others—spanning empirical, machine-learning, and process-based approaches (see methods section or linked publication for detailed descriptions). Data Package Contents: The dataset a csv files containing daily ET and T/ET estimates for each site and model, along with associated metadata files these variables. Data can be accessed using common spreadsheet software (e.g., Microsoft Excel, LibreOffice) or programming environments such as R or Python. Together, these data support cross-site comparisons of ecosystem water use, evaluation of ET partitioning methods, and development of improved land–atmosphere exchange models.

EARTH SCIENCE > ATMOSPHERE↗

NASA NTRS2015

An Enriched Shell Element for Delamination Simulation in Composite Laminates

A formulation is presented for an enriched shell finite element capable of delamination simulation in composite laminates. The element uses an adaptive splitting approach for damage characterization that allows for straightforward low-fidelity model creation and a numerically efficient solution. The Floating Node Method is used in conjunction with the Virtual Crack Closure Technique to predict delamination growth and represent it discretely at an arbitrary ply interface. The enriched element is verified for Mode I delamination simulation using numerical benchmark data. After determining important mesh configuration guidelines for the vicinity of the delamination front in the model, a good correlation was found between the enriched shell element model results and the benchmark data set.

McElroy, Mark↗