Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A benchmark dataset for Hydrogen Combustion

The generation of reference data for deep learning models is challenging for reactive systems, and more so for combustion reactions due to the extreme conditions that create radical species and alternative spin states during the combustion process. Here, we extend intrinsic reaction coordinate (IRC) calculations with ab initio MD simulations and normal mode displacement calculations to more extensively cover the potential energy surface for 19 reaction channels for hydrogen combustion. A total of ~290,000 potential energies and ~1,270,000 nuclear force vectors are evaluated with a high quality range-separated hybrid density functional, ωB97X-V, to construct the reference data set, including transition state ensembles, for the deep learning models to study hydrogen combustion reaction.

08 HYDROGEN↗
DOE OSTI2022

Data-Driven PMU Noise Emulation Framework using Gradient-Penalty-Based Wasserstein GAN

Availability of phasor measurement unit (PMUs) data has led to research on data-driven algorithms for event monitoring, control and ensuring stability of the grid. Unavailability of infrequent critical event field PMU data with component failures is driving the need to generate realistic synthetic PMU data for research. The synthetic data from power system simulation software often neglect noise profiles of received phasors, thus creating some discrepancies between real PMU data and synthetic ones. To address this issue, this work presents an initial study on the noise characteristics of PMUs, as well as presenting models for recreating their unique noise signatures. The proposed method, utilizing the Wasserstein generative adversarial network with gradient penalty (WGAN-GP) architecture, provides an excellent benchmark for matching the noise distribution. One can use a well-learned GAN model to draw noise signatures from a distribution that seemingly mirrors the real PMU noise distribution, while also being able to be detached from the PMU data once the training is done. Based on the observed results and employed data-driven methodology, it is expected that the proposed methods can be adapted to replicate the behavior of other sensors, providing research and other applications with a tool for data synthesis and sensor characterization.

PMU↗
DOE OSTI2022

INL Contributions to Draft HTTF Benchmark Specifications

The High-Temperature Test Facility (HTTF) is an integral effects thermal hydraulics test facility at Oregon State University designed as a 1/4 length scale model of the Modular High-Temperature Gas-Cooled Reactor 350 MW core (mHTGR-350). In the spring and summer of 2019, several experiments were conducted at HTTF providing a valuable source of gas-cooled reactor thermal hydraulics data. Idaho National Laboratory (INL), Oregon State University, Argonne National Laboratory, and Canadian Nuclear Laboratories have partnered to use this experimental data to develop a gas-cooled reactor thermal hydraulics benchmark led by INL under the auspices of the Advanced Reactor Technologies (ART) program. This report provides some context on the benchmark, HTTF, and previous Reactor Excursions and Leak Analysis Program (RELAP)5-3D modeling of HTTF. It also provides a draft of the benchmark specifications for the Depressurized Conduction Cooldown problem, which is the INL-led benchmark problem.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS1992

Execution models for mapping programs onto distributed memory parallel computers

The problem of exploiting the parallelism available in a program to efficiently employ the resources of the target machine is addressed. The problem is discussed in the context of building a mapping compiler for a distributed memory parallel machine. The paper describes using execution models to drive the process of mapping a program in the most efficient way onto a particular machine. Through analysis of the execution models for several mapping techniques for one class of programs, we show that the selection of the best technique for a particular program instance can make a significant difference in performance. On the other hand, the results of benchmarks from an implementation of a mapping compiler show that our execution models are accurate enough to select the best mapping technique for a given program.

Sussman, Alan↗
DOE OSTI2024

Visualization of post-detonation fireball flowfields and comparison to CFD modeling

Visualization of flow structures within post-detonation fireballs has been performed for benchmark validation of numerical simulations. Custom pressed PETN explosives with a 12-mm diameter hemispherical form factor were used to produce a spherically symmetric post-detonation flow with low soot yield. Hydroxyl-radical planar laser induce fluorescence (OH-PLIF) was employed to visualize the structure ranging from approximately 10 μs to 35 μs after shock breakout from the explosive pellet. Fireball simulations were performed using the HyBurn Computational Fluid Dynamics (CFD) package. Experimental OH-PLIF results were compared to synthetic OH-PLIF from post-processing of CFD simulations. From the comparison of experimental and synthetic OH-PLIF images, CFD is shown to replicate much of the flow structure observed in the experiments, revealing potential differences in turbulent length scales and OH kinetics. Furthermore, results provide significant advancement in experimental resolution of these harsh turbulent combustion environments and validate physical models thereof.

Detonator↗
DOE OSTI2023

Incorporating Full Elastodynamic Effects and Dipping Fault Geometries in Community Code Verification Exercises for Simulations of Earthquake Sequences and Aseismic Slip (SEAS)

ABSTRACT Numerical modeling of earthquake dynamics and derived insight for seismic hazard relies on credible, reproducible model results. The sequences of earthquakes and aseismic slip (SEAS) initiative has set out to facilitate community code comparisons, and verify and advance the next generation of physics-based earthquake models that reproduce all phases of the seismic cycle. With the goal of advancing SEAS models to robustly incorporate physical and geometrical complexities, here we present code comparison results from two new benchmark problems: BP1-FD considers full elastodynamic effects, and BP3-QD considers dipping fault geometries. Seven and eight modeling groups participated in BP1-FD and BP3-QD, respectively, allowing us to explore these physical ingredients across multiple codes and better understand associated numerical considerations. With new comparison metrics, we find that numerical resolution and computational domain size are critical parameters to obtain matching results. Codes for BP1-FD implement different criteria for switching between quasi-static and dynamic solvers, which require tuning to obtain matching results. In BP3-QD, proper remote boundary conditions consistent with specified rigid body translation are required to obtain matching surface displacements. With these numerical and mathematical issues resolved, we obtain excellent quantitative agreements among codes in earthquake interevent times, event moments, and coseismic slip, with reasonable agreements made in peak slip rates and rupture arrival time. We find that including full inertial effects generates events with larger slip rates and rupture speeds compared to the quasi-dynamic counterpart. For BP3-QD, both dip angle and sense of motion (thrust versus normal faulting) alter ground motion on the hanging and foot walls, and influence event patterns, with some sequences exhibiting similar-size characteristic earthquakes, and others exhibiting different-size events. These findings underscore the importance of considering full elastodynamics and nonvertical dip angles in SEAS models, as both influence short- and long-term earthquake behavior and are relevant to seismic hazard.

Geochemistry & Geophysics↗
DOE OSTI2026

Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials

Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

EQ_phase_detection

The EQ_phase_detection software is designed to scan continuous daily waveforms to detect earthquake phase arrivals from local to regional (150 km) events. The detections are made with a deep learning encoder-decoder model. When the model detects an earthquake in the waveforms, a second model is implemented to classify the first arriving motions. Both deep learning models are trained with the Tensorflow package using publicly available benchmark data sets. The software input is a path to a directory that contains waveforms in mseed format and the associated response files in xml format. The output is a data table of time stamped detections, signal amplitude, signal-to-noise ratio, and softmax probability of the detection in a generic format applicable to post-processing association algorithms for event locations. Additionally, the p-wave and s-wave waveforms are saved in a data table for rapid access when producing improved locations using correlation-based techniques. The software is designed for multiprocessing with multiple GPU’s for rapid processing of large data sets. The configuration file provides flexibility in the trained models implemented and allows access to multiple models trained for different sampling rates or input dimensions. This is particularly useful for regions with multiple networks that do not have the same data parameters.

Johnson, Christopher↗
NASA NTRS1993

Role of secondary instability theory and parabolized stability equations in transition modeling

In modeling the laminar-turbulent transition region, the designer depends largely on benchmark data from experiments and/or direct numerical simulations that are usually extremely expensive. An understanding of the evolution of the Reynolds stresses, turbulent kinetic energy, and quantifies in the transport equations like the dissipation and production is essential in the modeling process. The secondary instability theory and the parabolized stability equations method are used to calculate these quantities, which are then compared with corresponding quantities calculated from available direct numerical simulation data for the incompressible boundary-layer flow of laminar-turbulent transition conditions. The potential of the secondary instability theory and the parabolized stability equations approach in predicting these quantities is discussed; results indicate that inexpensive data that are useful for transition modeling in the early stages of the transition region can be provided by these tools.

El-Hady, Nabil M.↗
DOE OSTI2020

Shocks in the Scrape-off Layer: Hydrodynamical Aspects (Summary) [Slides]

Hydrodynamical model provides a robust description of mass, momentum, and energy transfer. It can be used for benchmarking hydrodynamical modules of SOL codes. It clarifies the role of boundary conditions at the end-plates. It provides a “geometrical” model for partition of power flows between two divertor legs, both for the steady-state and pulsed flows. It indicates possible presence of shocks in the divertor legs. A framework for finding the shock location and strength has been developed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Getting Warmer: IceCube Nears Freeze Out

IceCube has recently detected a diffuse population of high-energy neutrinos arising from the Milky Way. We use this high-significance detection to place new limits on dark matter (DM) annihilation to neutrinos with two complementary approaches. The first method uses the background-subtracted Galactic longitude distribution of shower events to place a conservative bound on the DM annihilation cross section that does not rely on any assumed Galactic cosmic ray emission model; the resulting limits on the velocity-averaged annihilation cross section improve upon existing bounds by factors of a few. The second method uses the template-dependent neutrino energy spectra from the Inner Galaxy, inferred under different Galactic cosmic ray emission models. This complementary approach shows that the inferred Galactic neutrino intensities are already sensitive to DM contributions near the thermal-relic benchmark for a range of TeV-scale DM masses, though this comparison is more model-dependent. Our results demonstrate that measurements of diffuse Galactic neutrino emission can be used as a powerful probe of DM annihilation into neutrinos. Future observations with IceCube-Gen2 and KM3NeT will substantially extend this sensitivity, potentially allowing a decisive test of the thermal freeze-out mechanism with Galactic neutrino observations.

Mukhopadhyay, Mainak [Fermilab; Chicago U., KICP; ↗
DOE OSTI2022

Studsvik R2 materials test reactor Ad Hoc depletion strategy for the derivation of the fuel isotopic composition of the MPCMIV benchmark

The Ad Hoc Depletion Strategy elaborated by the NINE company, developed in support of the organization of the MPCMIV (Multi-physics Pellet Cladding Mechanical Interaction Validation) benchmark input and output specifications, is presented. This work aims at illustrating the strategy itself and then showing the results obtained with its application over the Studsvik R2 Testing Reactor, which is analyzed in the benchmark. The objective of the application of the strategy is to compute the fuel elements isotopic compositions at the beginning of some core loadings of interest for the benchmark. To this objective, it is necessary to implement first the simulation model of the three single assembly types and perform the infinite lattice depletions, then, to build the full core model and to perform the simulation of the core cycle. All the models and simulations were carried out with the use of the Monte Carlo particle transport code Serpent 2. Finally, the simulations results are assessed against Studsvik isotopic compositions of the fuel elements discharged from the R2 Reactor at the end of the core loading. Several assumptions were necessary during all the steps of the strategy, to overcome the lack of information regarding the core management. For this reason, the solution found at the end of the current analysis may not be completely optimized and further improvements regarding the model assumptions will be tested in a future work. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Exocortex Network for AI-Augmented Human-Led Scientific Expedition

AI advances in science can be viewed along two main directions with a fluid boundary: enhancing efficiency through automation and smart tools to accelerate tasks that humans can already perform; and enabling exploration into uncharted territories and potentially toward AGI. These advances manifest in the AI cognitive core through the development and explainability of foundation models; in the physical embodiment of instruments and facilities; and in the integrated agency of AI workflows exemplified by the science exocortex. To address the role of humans in this evolving landscape, in this Perspective, we suggest a third direction: the development of personalized agents that form human-centered networks, supporting both efficiency and exploration while ensuring that AI remains aligned with human vision.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Modeling Global Carbon Costs of Plant Nitrogen and Phosphorus Acquisition

Abstract Most Earth system models (ESMs) do not explicitly represent the carbon (C) costs of plant nutrient acquisition, which leads to uncertainty in predictions of the current and future constraints to the land C sink. We integrate a plant productivity‐optimizing nitrogen (N) and phosphorus (P) acquisition model (fixation & uptake of nutrients, FUN) into the energy exascale Earth system (E3SM) land model (ELM). Global plant N and P uptake are dynamically simulated by ELM‐FUN based on the C costs of nutrient acquisition from mycorrhizae, direct root uptake, retranslocation from senescing leaves, and biological N fixation. We benchmarked ELM‐FUN with three classes of products: ILAMB, a remotely sensed nutrient limitation product, and CMIP6 models; we found significant improvements in C cycle variables, although the lack of more observed nutrient data prevents a comprehensive level of benchmarking. Overall, we found N and P co‐limitation for 80% of land area, with the remaining 20% being either predominantly N or P limited. Globally, the new model predicts that plants invested 4.1 Pg C yr −1 to acquire 841.8 Tg N yr −1 and 48.1 Tg P yr −1 (1994–2005), leading to significant downregulation of global net primary production (NPP). Global NPP is reduced by 20% with C costs of N and 50% with C costs of NP. Modeled and observed nutrient limitation agreement increases when N and P are considered together ( r 2 from 0.73 to 0.83).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Simulation of the High Temperature Test Facility (HTTF) Core Using the 2D Ring Model with SAM

A two-dimensional ring model is developed with SAM to model the core of the High Temperature Test Facility (HTTF) at the system level. The ring model simplifies the complex structure of the HTTF core by converting the hexagonal rows of heaters and flow channels into layers of concentric annular rings. The ring model is first compared against a 3D-1D model where the solid structures are fully resolved in three dimensions while the fluid structures are modeled as one-dimensional flows. Comparison between the 3D-1D and the ring models shows that the latter can predict major parameters reasonably well under steady-state normal operating condition, but the heater temperatures are underpredicted. Adjustment is made to the effective thermal conductivity of the ceramic core of the ring model to improve the heater temperature predictions. Furthermore, the ring model is also used to simulate a transient Pressurized Conduction Cooldown (PCC) condition and is benchmarked with the experimental data from the HTTF Test PG-27. Good agreement is obtained between the experimental data and the predictions by the ring model.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

Systematic Evaluation of Atmospheric Forcing, Surface Datasets, and Mesh Effects on Kilometer-Scale Land Surface and River Modeling

Earth system models are advancing toward kilometer-scale resolution to capture local climate impacts and extremes. High-resolution land and river modeling depends on multiple factors, including mesh, surface datasets, and atmospheric forcing, but their relative effects at kilometer scales remain unquantified. We evaluated five Energy Exascale Earth System Model land and river configurations over the Mid-Atlantic region using two mesh (1/8° structured versus variable-resolution unstructured mesh), two surface datasets (default versus newly developed), and three atmospheric forcings (NLDAS2, MSWX, GSWP). Evaluation against satellite, reanalysis, and in situ benchmarks across water, energy, and carbon cycles quantifies how these factors affect model performance. Forcing selection produces the largest bias reductions (12-99% across variables), followed by surface datasets (7-75%) and mesh (up to 21%). Forcing effects vary by variable, with MSWX reducing biases for snow water equivalent, evapotranspiration, albedo, temperature, and gross primary productivity, GSWP for snow cover and runoff, and NLDAS for soil moisture and streamflow. The use of newly developed surface datasets improves gross primary productivity (58% bias reduction) and evapotranspiration but increase soil moisture and albedo biases due to current modeling limitations. Variable-resolution unstructured mesh improves the simulation of small-basin streamflow through better capturing drainage networks, though mesh minimally affects other land variables. These findings provide important guidance for high-resolution modeling development and actionable science.

Land and River modeling↗
NASA NTRS2019

PIV and Rotational Raman-Based Temperature Measurements for CFD Validation of a Perforated Plate Cooling Flow: Part I

Film cooling is used in a wide variety of engineering applications for protection of surfaces from hot or combusting gases. The design of more efficient film cooling geometries/configurations could be facilitated by an ability to accurately model and predict the effectiveness of current designs using computational fluid dynamics (CFD) code predictions. Hence, a benchmark set of flow field property data were obtained for use in assessing current CFD capabilities and for development of better modeling approaches for these turbulent flow fields where accurate calculation of turbulent heat flux is important. Both Particle Image Velocimetry (PIV) and spontaneous rotational Raman scattering (SRS) spectroscopy were used to acquire high quality, spatially-resolved measurements of the mean velocity, turbulence intensity as well as the mean temperature and root mean square (rms) temperatures in a film cooling flow field. In addition to off-body flow field measurements, infrared thermography (IR) and thermocouple measurements on the plate surface enabled estimates of the film effectiveness. Raman spectra in air were obtained across a matrix of axial locations downstream from a 68.07 mm square nozzle blowing heated air over a range of temperatures (up to TR = 2.7) and Mach numbers (up to M0.9), across a 30.48 cm long plate equipped with three patches of 45 small (~1 mm) diameter cooling holes arranged in a staggered configuration. In addition, both centerline streamwise 2-component PIV and cross-stream 3-component Stereo PIV data at 14 axial stations were collected in the same flows. Only a subset of the data collected in the test program is included in this Part I report and are available from the NASA STI office. The final portion of the data will be published in a future report, Part II, along with CFD predictions of the complex cooling film flow.

IR camera Measurments↗
NASA NTRS2019

PIV and Rotational Raman-Based Temperature Measurements for CFD Validation of a Perforated Plate Cooling Flow: Part 1

Film cooling is used in a wide variety of engineering applications for protection of surfaces from hot or combusting gases. The design of more efficient film cooling geometries/configurations could be facilitated by an ability to accurately model and predict the effectiveness of current designs using computational fluid dynamics (CFD) code predictions. Hence, a benchmark set of flow field property data were obtained for use in assessing current CFD capabilities and for development of better modeling approaches for these turbulent flow fields where accurate calculation of turbulent heat flux is important. Both Particle Image Velocimetry (PIV) and spontaneous rotational Raman scattering (SRS) spectroscopy were used to acquire high quality, spatially-resolved measurements of the mean velocity, turbulence intensity as well as the mean temperature and root mean square (rms) temperatures in a film cooling flow field. In addition to off-body flow field measurements, infrared thermography (IR) and thermocouple measurements on the plate surface enabled estimates of the film effectiveness. Raman spectra in air were obtained across a matrix of axial locations downstream from a 68.07 mm square nozzle blowing heated air over a range of temperatures (up to TR = 2.7) and Mach numbers (up to M0.9), across a 30.48 cm long plate equipped with three patches of 45 small (~1 mm) diameter cooling holes arranged in a staggered configuration. In addition, both centerline streamwise 2-component PIV and cross-stream 3-component Stereo PIV data at 14 axial stations were collected in the same flows. Only a subset of the data collected in the test program is included in this Part I report and are available from the NASA STI office. The final portion of the data will be published in a future report, Part II, along with CFD predictions of the complex cooling film flow.

Raman Scattering↗