Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Comparative Analysis of Rear Irradiance Modeling Methods for Bifacial PV Systems on Single-Axis Trackers Under Varying Albedo Conditions

This study compares three rear-side irradiance modeling methods for bifacial PV systems on single-axis trackers: (i) the 2D View Factor (VF) model in PVsyst(R), (ii) the open-source PVFactors VF model, and (iii) the Ray Tracing (RT) technique using bifacial_radiance. Simulations were benchmarked against field measurements from a pilot PV plant with rear-side sensors at the torque tube height. Results show that all models underestimated the non-uniformity of rear irradiance along the module length and overestimated the total rear irradiance incident on the module. However, since bifacial gain represents only a fraction of the system's total energy, the resulting energy yield differences among methods remained within +- 2 % of measured values, which is typical for such simulations. While the overall energy impact is limited, this study characterizes the specific limitations of each modeling approach, supporting further improvements in bifacial PV performance assessment methods.

14 SOLAR ENERGY↗
DOE OSTI2021

Matrix Graphite Material Models In Pebbles and Compacts For Bison

The cores and reflectors in high-temperature gas-cooled reactors (HTGRs) are made of graphite materials, with the graphite acting as a moderator, a fuel host matrix, or the foundation for various structural components. This study aims to survey the models in the literature for graphite materials being used as host matrices in pebble/fuel compacts and to implement those surveyed models into Bison to conduct an early assessment of graphite's thermo-mechanical response under various reactor conditions. In this study, thermal (e.g., thermal conductivity, and specific heat capacity) and mechanical (e.g., elastic properties, thermal expansion, irradiation-induced dimensional changes, and irradiation-induced creep) material models for various graphite grades (e.g., H-451, IG-110, G-348, 2020, A3-3, and A3-27) are incorporated into Bison. Two benchmark problems are then exercised utilizing these new graphite-related capabilities: (1) modeling an Advanced Gas Reactor (AGR)-2 fuel compact, and (2) modeling the debonding of a particle-matrix interface.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Verification of RESRAD-BUILD Code Version 4

This report documents the verification of the RESRAD-BUILD code, Version 4.0, which was released on December 22, 2022. Two earlier reports verifying Versions 3.0 and 3.1, respectively, were published in 2001 (Kamboj, et al. 2001) and 2003 (Tetra Tech NUS 2003). Version 4.0 of the RESRAD-BUILD code has many new features and modeling enhancements over the earlier versions, including the previously released Version 3.5. Chapter 2 of this report focuses on verifying the external dose and risk modeling for point, line, area, and volume sources, as well as for floor deposition. Besides verification, the external radiation doses calculated by RESRAD-BUILD were also benchmarked with those calculated by the MCNP code (Briemeister 1993). Section J.3 of the RESRAD-BUILD User’s Manual Vol. 1 (Yu et al. 2022) documents the results of that benchmarking effort. Chapter 3 of this report focuses on verifying the ventilation modeling, from checking the remaining source inventory, releases of radionuclides to the air, air concentrations and deposited floor concentrations over time, to the radiation dose and risk associated with inhalation, ingestion, and air submersion, with and without vacuuming. The verification efforts involve designing spreadsheets to perform calculations the same as or like those performed by the RESRAD-BUILD code and then comparing the spreadsheet results with those produced by the code. When the results agree or the differences are within acceptable range, the accuracy of model implementation in the code is verified. In addition to model implementation, the implementation of key functions and features that facilitate the modeling or the use of the code were also verified during the release testing of the code. Appendix A presents the test cases developed for these verification testing, and Appendix B presents the testing results that verify proper implementation of key functions and features.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗
NASA NTRS2011

Simulation of Benchmark Cases with the Terminal Area Simulation System (TASS)

The hydrodynamic core of the Terminal Area Simulation System (TASS) is evaluated against different benchmark cases. In the absence of closed form solutions for the equations governing atmospheric flows, the models are usually evaluated against idealized test cases. Over the years, various authors have suggested a suite of these idealized cases which have become standards for testing and evaluating the dynamics and thermodynamics of atmospheric flow models. In this paper, simulations of three such cases are described. In addition, the TASS model is evaluated against a test case that uses an exact solution of the Navier-Stokes equations. The TASS results are compared against previously reported simulations of these benchmark cases in the literature. It is demonstrated that the TASS model is highly accurate, stable and robust.

Ahmad, Nashat N.↗
DOE OSTI2020

Benchmark of the KGMf with a coupled Boltzmann equation solver

The Kinetic Global Model framework (KGMf) is an open-source general-purpose global model (spatially averaged) simulation code developed to explore the reaction kinetics and pathways in plasma discharge systems. It contains species continuity and electron energy balance equations, with a time-dependent evaluated electron energy distribution function (EEDF) for electron impact reactions. The EEDF is utilized to determine the rate coefficients for electron impact reactions, which can have profound impact on the temporal evolutions of plasma parameters. Previously, the EEDF was commonly assumed as Maxwellian or an analytical function of the effective electron temperature. In this work, the KGMf is coupled with a Boltzmann equation (BE) solver to self-consistently compute the EEDF. The EEDF evolution frequency is determined based on relative changes of the reduced electric field. The KGMf is benchmarked with the ZDPlasKin code based on high-pressure low-temperature argon plasma discharge cases. Additionally, the temporal evolutions of reduced electric field, electron temperature, EEDF, reaction rates, and species densities, are obtained and compared under different discharge conditions, showing good agreement between the KGMf and the ZDPlasKin simulations. The application of the KGMf for predicting breakdown times in high power microwave discharges is also presented, which shows qualitative agreement with particle-in-cell simulations. The KGMf can be further applied for more complicated plasma discharge systems, where the reaction kinetics are more intricate (e.g., plasma-assisted combustion systems).

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

3D simulations of vertical displacement events in tokamaks: A benchmark of M3D-C 1 , NIMROD, and JOREK

In recent years, the nonlinear 3D magnetohydrodynamic codes JOREK, M3D-C1, and NIMROD developed the capability of modeling realistic 3D vertical displacement events (VDEs) including resistive walls. In this paper, a comprehensive 3D VDE benchmark is presented between these state-of-the-art codes. The simulated case is based on an experimental NSTX plasma but with a simplified rectangular wall. There are differences between the physics models and numerical methods, and the VDE evolution leads to sensitivities on the initial conditions that cannot be avoided as can be done in edge localized modes (ELM) and sawtooth simulations (due to the non-cyclical nature of VDEs). Nonetheless, the comparison serves to quantify the level of agreement in the relevant quantities used to characterize disruptions, such as the 3D wall forces and energy decay. The results bring confidence regarding the use of the mentioned codes for disruption studies, and they distinguish aspects that are specific to the models used (e.g., reduced vs full MHD models). Here, the simulations show important 3D fea- tures for a NSTX plasma, such as the self-consistent evolution of the halo current and the origin of the wall forces. In contrast to other reduced MHD models based on an ordering in the aspect ratio, the ansatz-based JOREK reduced MHD model allows capturing many aspects of the 3D dynamics even in the spherical tokamak limit considered here.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Model Assumptions and Data Characteristics: Impacts on Domain Adaptation in Building Segmentation

Studies on domain adaptation (DA) for remote sensing (RS) imagery analysis lack consistency in selection and description of evaluation scenarios. Without properly characterizing datasets, model assumptions, and evaluation scenarios, it is difficult to objectively compare DA methods and reach conclusions about their suitability across different applications. With this motivation, this work seeks to empirically assess to which extent the interaction between data characteristics and model assumptions influences the effectiveness of DA methods. Using the widely explored task of building footprint segmentation as a case study, we perform a large-scale study across over 200 DA scenarios that include variations across view angles, areas observed, and sensors used for data acquisition. Rather than adopting different model architectures or optimization criteria, we contrast the performances of two DA methods based on adversarial learning that differ only in their assumptions about source and target domains. Informed by metadata and data characteristics unveiled using traditional computer vision (CV) techniques as well as pretrained deep models, we provide a detailed meta-analysis of experiments highlighting the importance of accurately considering data assumptions for DA in RS segmentation tasks. As demonstrated by a “cherry-picking” exercise, different claims regarding which model is best could be made by selecting different subsets of evaluation scenarios. While well-calibrated assumptions can be beneficial, mismatching assumptions can lead to negative biases in DA applications. Furthermore, this study intends to motivate the community toward more consistent evaluation protocols while providing recommendations and insights toward creating novel benchmark datasets, documenting data characteristics, application-specific knowledge, and model assumptions.

42 ENGINEERING↗
DOE OSTI2023

Unifying and benchmarking state-of-the-art quantum error mitigation techniques

Error mitigation is an essential component of achieving a practical quantum advantage in the near term, and a number of different approaches have been proposed. In this work, we recognize that many state-of-the-art error mitigation methods share a common feature: they are data-driven, employing classical data obtained from runs of different quantum circuits. For example, Zero-noise extrapolation (ZNE) uses variable noise data and Clifford-data regression (CDR) uses data from near-Clifford circuits. We show that Virtual Distillation (VD) can be viewed in a similar manner by considering classical data produced from different numbers of state preparations. Observing this fact allows us to unify these three methods under a general data-driven error mitigation framework that we call UNIfied Technique for Error mitigation with Data (UNITED). In certain situations, we find that our UNITED method can outperform the individual methods (i.e., the whole is better than the individual parts). Specifically, we employ a realistic noise model obtained from a trapped ion quantum computer to benchmark UNITED, as well as other state-of-the-art methods, in mitigating observables produced from random quantum circuits and the Quantum Alternating Operator Ansatz (QAOA) applied to Max-Cut problems with various numbers of qubits, circuit depths and total numbers of shots. We find that the performance of different techniques depends strongly on shot budgets, with more powerful methods requiring more shots for optimal performance. For our largest considered shot budget (10 10 ), we find that UNITED gives the most accurate mitigation. Hence, our work represents a benchmarking of current error mitigation methods and provides a guide for the regimes when certain methods are most useful.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2019

Recrystallization and Grain Growth Simulations for Multiple-Pass Rolling and Annealing of U-10Mo

A simulation model of recrystallization and grain growth has been developed to investigate grain structure evolution during deformation and heat treatment in polycrystalline U-10wt% Mo (U-10Mo) fuel. Experimentally obtained U-10Mo microstructures were used as input for closed loop simulations of multiple rolling, intermediate heating and final annealing process. FEM calculations of deformation and Potts Model simulations of recrystallization and grain growth were used to iteratively inform each subsequent stage of simulation. Furthermore, the model was then applied to predict the grain structure evolution during multiple-pass hot rolling of U-10Mo, and benchmarked against experimentally observed U-10Mo recrystallization behavior. The results showed that our model was able to capture the coupling between deformation and recrystallization as a function of microstructure, including particle stimulated nucleation and recrystallization nucleation on grain boundaries. Additionally, we have achieved reasonable quantitative agreement with U-10Mo recrystallization and grain growth behavior.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Advancing energy storage through solubility prediction: leveraging the potential of deep learning

Solubility prediction plays a crucial role in energy storage applications, such as redox flow batteries, because it directly affects the efficiency and reliability. Researchers have developed various methods that utilize quantum calculations and descriptors to predict the aqueous solubilities of organic molecules. Notably, machine learning models based on descriptors have shown promise for solubility prediction. As deep learning tools, graph neural networks (GNNs) have emerged to capture complex structure–property relationships for material property prediction. Specifically, MolGAT, a type of GNN model, was designed to incorporate n-dimensional edge attributes, enabling the modeling of intricacies in molecular graphs and enhancing the prediction capabilities. In a previous study, MolGAT successfully screened 23 467 promising redox-active molecules from a database of over 500 000 compounds, based on redox potential predictions. This study focused on applying the MolGAT model to predict the aqueous solubility (log S) of a broad range of organic compounds, including those previously screened for redox activity. The model was trained on a diverse sample of 8494 organic molecules from AqSolDB and benchmarked against literature data, demonstrating superior accuracy compared with other state of the art graph-based and descriptor-based models. Subsequently, the trained MolGAT model was employed to screen redox-active organic compounds identified in the first phase of high-throughput virtual screening, targeting favorable solubility in energy storage applications. The second round of screening, which considered solubility, yielded 12 332 promising redox-active and soluble organic molecules suitable for use in aqueous redox flow batteries. Thus, the two-phase high-throughput virtual screening approach utilizing MolGAT, specifically trained for redox potential and solubility, is an effective strategy for selecting suitable intrinsically soluble redox-active molecules from extensive databases, potentially advancing energy storage through reliable material development. This indicates that the model is reliable for predicting the solubility of various molecules and provides valuable insights for energy storage, pharmaceutical, environmental, and chemical applications.

25 ENERGY STORAGE↗
NASA NTRS1984

A critical review of noise production models for turbulent, gas-fueled burners

The combustion noise literature for the period between 1952 and early 1984 is critically reviewed. Primary emphasis is placed on past theoretical and semi-empirical attempts to predict or explain observed direct combustion noise characteristics of turbulent, gas-fueled burners; works involving liquid-fueled burners are reviewed only when ideas equally applicable to gas-fueled burners are pesented. The historical development of the most important contemporary direct combustion noise theories is traced, and the theories themselves are compared and criticized. While most theories explain combustion noise production by turbulent flames in terms of randomly distributed acoustic monopoles produced by turbulent mixing of products and reactants, none is able to predict the sound pressure in the acoustic farfield of a practical burner because of the lack of a proven model which relates the combustion noise source strenght at a given frequency to the design and operating parameters of the burner. Recommendations are given for establishing a benchmark-quality data base needed to support the development of such a model.

Mahan, J. R.↗
DOE OSTI2021

Protein C-GeM: A Coarse-Grained Electron Model for Fast and Accurate Protein Electrostatics Prediction

The electrostatic potential (ESP) is a powerful property for understanding and predicting electrostatic charge distributions that drive interactions between molecules. In this study, we compare various charge partitioning schemes including fitted charges, density-based quantum mechanical (QM) partitioning schemes, charge equilibration methods, and our recently introduced coarse-grained electron model, C-GeM, to describe the ESP for protein systems. Furthermore, when benchmarked against high quality density functional theory calculations of the ESP for tripeptides and the crambin protein, we find that the C-GeM model is of comparable accuracy to ab initio charge partitioning methods, but with orders of magnitude improvement in computational efficiency since it does not require either the electron density or the electrostatic potential as input.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

MPACT Verification With Magnox Reactor Neutronics Progression Problems

MPACT is a state-of-the-art core simulator designed to perform high-fidelity analysis using whole-core, three-dimensional, pin-resolved neutron transport calculations on modern parallel computing hardware. MPACT was originally developed to model light water reactors, and its capabilities are being extended to simulate gas-cooled, graphite-moderated cores such as Magnox reactors. To verify MPACT’s performance in this new application, the code is being formally benchmarked using representative problems. Progression problems are a series of example models that increase in complexity designed to test a code’s performance. The progression problems include both beginning-of-cycle and depletion calculations. Reference solutions for each progression problem have been generated using Serpent 2, a continuous-energy Monte Carlo reactor physics burnup calculation code.Using the neutron multiplication eigenvalue ke as a metric, MPACT’s performance is assessed on each of the progression problems. Initial results showed that MPACT’s multi-group cross section libraries, originally developed for pressurized water reactor problems, were not sufficient to accurately solve Magnox problems. MPACT’s improved performance on the progression problems is demonstrated using this new optimized cross section library.

Luciano, Nicholas↗
DOE OSTI2022

Evaluating fast methods for static polarizabilities on extended conjugated oligomers

Given the importance of accurate polarizability calculations to many chemical applications, coupled with the need for efficiency when calculating the properties of sets of molecules or large oligomers, we present a benchmark study examining possible calculation methods for polarizable materials. We first investigate the accuracy of the additive model used in GFN2, a highly-efficient semi-empirical tight-binding method, and the D4 dispersion model, comparing its predicted additive polarizabilities to ωB97XD results for a subset of PubChemQC and a compiled benchmark set of molecules spanning polarizabilities from approximately 3 Å 3 to 600 Å 3 , with some compounds in the range of approximately 1200–1400 Å 3 . Although we find additive GFN2 polarizabilities, and thus D4, to have large errors with polarizability calculations on large conjugated oligomers, it would appear an empirical quadratic correction can largely remedy this. We also compare the accuracy of DFT polarizability calculations run using basis sets of varying size and level of augmentation, determining that a non-augmented basis set may be used for large, highly polarizable species in conjunction with a linear correction factor to achieve accuracy extremely close to that of aug-cc-pVTZ.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2020

PIV and Rotational Raman-Based Temperature Measurements for CFD Validation of a Perforated Plate Cooling Flow: Part I

Film cooling is used in a wide variety of engineering applications for protection of surfaces from hot or combusting gases. The design of more efficient film cooling geometries/configurations could be facilitated by an ability to accurately model and predict the effectiveness of current designs using computational fluid dynamics (CFD) code predictions. Hence, a benchmark set of flow field property data was obtained to assess current CFD capabilities and develop better modeling approaches for these turbulent flow fields where accurate calculation of turbulent heat flux is important. Both Particle Image Velocimetry (PIV) and spontaneous rotational Raman scattering (SRS) spectroscopy were used to acquire high quality, spatially-resolved measurements of the mean and root mean square (rms) velocities as well as the mean and rms temperatures in a film cooling flow field. In addition to off-body flow field measurements, infrared thermography (IR) and thermocouple measurements on the plate surface enabled estimates of the film effectiveness. Raman spectra in air were obtained across a matrix of axial locations downstream from a 68.07 mm square nozzle blowing heated air over a range of temperatures (up to TR = 2.7) and Mach numbers (up to Mach 0.9), across a 30.48 cm long plate equipped with three patches of 45 small (~1 mm) diameter cooling holes arranged in a staggered configuration. In addition, both streamwise 2-component PIV (on the plate centerline) and cross-stream 3-component Stereo PIV data at 14 axial stations were collected in the same flows. Only a subset of the data collected in the test program is included in this Part I report. The rest of the data will be published in a future report, Part II, along with planned CFD predictions of the complex cooling film flow. The entire data set of Raman temperature data, PIV velocity data and IR camera data covering the Set Points 23 and 49 in the test matrix in Table 1 is available in an accompanying DVD (available online from www.sti.nasa.gov) for those interested in further analysis.

Nozzle↗
NASA NTRS2020

PIV and Rotational Raman-Based Temperature Measurements for CFD Validation of a Perforated Plate Cooling Flow Part I

Film cooling is used in a wide variety of engineering applications for protection of surfaces from hotor combusting gases. The design of more efficient film cooling geometries/configurations could be facilitated by an ability to accurately model and predict the effectiveness of current designs using computational fluid dynamics (CFD) code predictions. Hence, a benchmark set of flow field property data were obtained to assess current CFD capabilities and develop better modeling approaches for these turbulent flow fields where accurate calculation of turbulent heat flux is important. Both Particle Image Velocimetry (PIV) and spontaneous rotational Raman scattering (SRS) spectroscopy were used to acquire high quality, spatially-resolved measurements of the mean and root mean square (rms) velocities as well as the mean and rms temperatures in a film cooling flow field. In addition to off-body flow field measurements, infrared thermography (IR) and thermocouple measurements on the plate surface enabled estimates of the film effectiveness. Raman spectra in air were obtained across a matrix of axial locations downstream from a 68.07 mm square nozzle blowing heated air over a range of temperatures (up to TR =2.7) and Mach numbers (up to Mach 0.9), across a 30.48 cm long plate equipped with three patches of 45 small (~1 mm) diameter cooling holes arranged in a staggered configuration. In addition, both streamwise 2-component PIV (along the plate centerline) and cross-stream 3-component Stereo PIV data at 14 axial stations were collected in the same flows. Only a subset of the data collected in the test program is included in this Part 1 report. The rest of the data will be published in a future report, Part 2, along with planned CFD predictions of the complex cooling film flow.The entire data set of Raman temperature data, PIV velocity data and IR camera data covering the Set Points 23 and 49 in the test matrix in Table 1 is available in an accompanying DVD (available online from www.sti.nasa.gov) for those interested in further analysis.

Mark P Wernet↗
DOE OSTI2022

U.S. Solar Photovoltaic System and Energy Storage Cost Benchmarks, With Minimum Sustainable Price Analysis: Q1 2022

NREL's bottom-up cost models can be used to assess the minimum sustainable price (MSP) and modeled market price (MMP) of PV and storage systems having various configurations. MSP can be used to estimate future potential cost-reduction opportunities for PV and PV-plus-storage systems, thus helping guide research and development aimed at advancing cost-effective system configurations. MMP can be used to understand the cost of systems under recent market conditions. The MSP data in this annual benchmarking report will be used to inform the formulation of, and track progress toward, the Solar Energy Technologies Office's Government Performance and Reporting Act cost targets.

14 SOLAR ENERGY↗