Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs

High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as \ptor, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these mini-apps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.

Atif, Mohammad [Brookhaven] (ORCID:000000026889770↗
DOE OSTI2025

Comprehensive assessment of deep reinforcement learning approaches for economic dispatch in nuclear-driven microgrids

As the electrical grid integrates more variable renewable energy sources such as wind and solar, the demand for distributed and flexible systems to address this increased variability becomes critical. Nuclear-driven microgrids provide a promising solution by offering stable generation to complement intermittent renewables, ensuring grid reliability and operating efficiency. This paper proposes a recurrent deep reinforcement learning framework for optimal economic dispatch in a nuclear-powered microgrid integrating renewable energy sources, small modular reactors, battery storage systems, and balance-of-plant dynamics. A three-agent control architecture is developed, where demand and renewable energy agents act as forecasters, and a reinforcement learning-based dispatch agent performs real-time energy allocation. A nonlinear programming formulation is first used to generate an optimal baseline for benchmarking. The proposed dispatch controller, based on Proximal Policy Optimization enhanced with Long Short-Term Memory networks, exploits temporal correlations in system dynamics by taking advantage of the time series used as inputs to improve policy robustness under uncertainty. Comparative analysis against established deep reinforcement learning methods, including Proximal Policy Optimization with a feedforward architecture, Soft Actor-Critic, and Twin Delayed Deep Deterministic Policy Gradient, demonstrates superior performance. Numerical results indicate that the proposed controller achieves a 0.39% cost reduction relative to the nonlinear programming benchmark and outperforms other learning-based methods by generating additional revenue of up to 0.35%. All reinforcement learning controllers compute dispatch actions in less than 0.3 s, resulting in a computational speedup of more than three orders of magnitude over the nonlinear programming baseline. The findings of this paper highlight their applicability for real-time operation and control in nuclear-integrated microgrids under volatile operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Multiphysics analysis of fuel fragmentation, relocation, and dispersal susceptibility–Part 3: Thermal hydraulic evaluation of large break LOCA under high-burnup conditions

Increasing the peak rod average burnup of pressurized water reactor (PWR) fuel beyond 62 GWd/tU may increase fuel fragmentation, relocation, and dispersal (FFRD) susceptibility during a large break loss of coolant accident (LBLOCA). TRACE thermal hydraulic (TH) LBLOCA analyses were performed for a realistic 24-month high-burnup PWR equilibrium cycle, to inform subsequent transient BISON high-burnup FFRD susceptibility evaluations. Realistic LBLOCA systems behavior was first established by configuring to and comparing with the BEMUSE OECD LBLOCA benchmark. Fuel and operating conditions were then applied from high-burnup VERA depletion calculations. LBLOCA simulations were performed for 281 selected high-burnup rods, for which transient TH boundary conditions were collected for later use in BISON. The TRACE results indicated that rod linear heat rate (rather than burnup) is the main predictor of peak cladding temperature (PCT) during the event. PCT typically occurred at a local burnup lower than the rod-average burnup, especially for twice-burned fuel.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS2014

Design and Development of Aerogel-Based Antennas for Aerospace Applications: A Final Report to the NARI Seedling

As highly porous solids possessing low density and low dielectric permittivity combined with good mechanical properties, polyimide (PI) aerogels offer great promise as an enabling technology for lightweight aircraft antenna systems. While they have been aggressively explored for thermal insulation, barely any effort has been made to leverage these materials for antennas or other applications that take advantage of their aforementioned attributes. In Phase I of the NARI Seedling Project, we fabricated PI aerogels with properties tailored to enable new antenna concepts with performance characteristics (wide bandwidth and high gain) and material properties (low density, environmental stability, and robustness) superior to the state of practice (SOP). We characterized electromagnetic properties, including permittivity, reflectivity, and propagation losses for the aerogels. Simple, prototype planar printed circuit patch antennas from down-selected aerogel formulations were fabricated by molding the aerogels to net shapes and by gold-metalizing the pattern onto the templates via electron beam evaporation in a clean room environment. These aerogel based antennas were benchmarked against current antenna SOP, and exhibited both broader bandwidth and comparable or higher gain performance at appreciably lower mass. Phase II focused on the success of the Phase I results pushing the PI aerogel based antenna technology further by exploring alternative antenna design (i.e., slot coupled antennas) and by examining other techniques for fabricating the antennas including ink jet printing with the goal of optimizing antenna performance and simplifying production. We also examined new aerogel formulations with better moisture and solvent resistance to survive processing conditions. In addition, we investigated more complex antenna designs including passive phased arrays such as 2x4 and 4x8 element arrays to assess the scalability of the aerogel antenna concept. Furthermore, we explored the possibility of developing these arrays in thin, flexible form to make conformable antennas.

insulation↗
NASA NTRS2001

Cryogenic Propellant Long-term Storage With Zero Boil-off

Significant boil-off losses of cryogenic propellant storage systems in long-duration space mission applications result in additional propellant and large tanks. The zero boil-off (ZBO) concept consists of an active cryo-cooling system integrated with traditional passive thermal insulation. The potential mass reductions with the ZBO concept are Substantial; therefore, further exploration through technology programs has been initiated within NASA. A large-scale demonstration of the ZBO concept has been devised utilizing the Marshall Space Flight Center (MSFC) Multipurpose Hydrogen Test Bed (MHTB) along with a cryo-cooler unit. The cryo-cooler with the MHTB and spraybar recirculation/mixer system in a manner that enables thermal energy removal at a rate that equals the total tank heat leak. The liquid hydrogen is withdrawn from the tank, passed through a heat exchanger, and then the chilled liquid is sprayed back into the tank through a spraybar. The test series will be performed over a 30-40 day period. Tests will be conducted at multiple fill levels and various mixer operational cycles to demonstrate concept viability and to provide benchmark data to be used in analytical model development. In this paper. analytical models for heat flows through the MHTB tank, cryo-cooler performance. and spraybar performance will be presented.

Hedayat, A.↗
DOE OSTI2021

Benchmarking near-term quantum devices with the variational quantum eigensolver and the Lipkin-Meshkov-Glick model

The variational quantum eigensolver is a promising algorithm for noisy intermediate scale quantum (NISQ) computation. Verification and validation of NISQ algorithms' performance on NISQ devices is an important task. Here, we consider the exactly diagonalizable Lipkin-Meshkov-Glick (LMG) model as a candidate for benchmarking NISQ computers. We use the Bethe Ansatz to construct eigenstates of the trigonometric LMG model using quantum circuits inspired by the LMG's underlying algebraic structure. We construct circuits with depth $\mathcal{O}$(N) and $\mathcal{O}$(log 2 N) that can prepare any trigonometric LMG eigenstate of N particles. The number of gates required for both circuits is $\mathcal{O}$(N). The energies of the eigenstates can then be measured and compared to the exactly known answers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Benchmark Modeling and Simulation of the FFTF LOFWOS Test #13 Using SAM

The Fast Flux Test Facility (FFTF) was a 400 MW thermal powered, oxide-fueled, liquid sodium cooled test reactor, built to assist development and testing of advanced fuels and materials for fast breeder reactors. In July 1986, a series of unprotected Loss of Flow Without Scram (LOFWOS) transients were performed in FFTF as part of the Passive Safety Testing (PST) program. The LOFWOS Test #13, which was initiated at 50% power and 100% flow with the pump pony motors left off, has been chosen as a benchmark case by IAEA to support collaborative efforts within international partnerships on the validation of simulation tools and models in the area of sodium fast reactor passive safety in an IAEA Coordinated Research Project (CRP), launched in October 2018. The System Analysis Module (SAM) is an advanced and modern system analysis tool under development at Argonne National Laboratory for advanced non-LWR safety analysis. It utilizes the object-oriented application framework MOOSE to leverage the modern software environment and advanced numerical methods. The capabilities of SAM are being extended to enable the transient modeling, analysis, and design of various advanced nuclear reactor systems. To participate the IAEA CRP and enhance the SAM validation base for advanced reactor transient safety analysis, benchmark simulations of the FFTF LOFWOS Test #13 are performed using the SAM code. In this first phase of the validation effort, the thermal-hydraulic behavior of the reactor system is the focus and the reactor kinetics is not considered in the SAM FFTF model. Instead, the results of Argonne’s neutronics calculations are directly used, including the power shape of the active core region and the power history during the transient. The simulation results of FFTF at steady state agreed well with the measured data from the test. During the transient, reasonably good agreement were also obtained. Future work to improve the model will focus on introducing the reactivity predictions into the model, as well as better understanding or resolving the current discrepancies with the measured data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS1992

Real Km-synthesis via generalized Popov multipliers

The authors refine their H-infinity control designs presented at the 1990 and 1991 American Control Conference by introducing a new real Km-synthesis technique involving the use of generalized Popov multipliers. This multiplier technique substantially reduces, and in some cases may even eliminate altogether, the conservativeness associated with traditional Km-synthesis solutions in which all uncertainties are treated as complex, even when they arise from real parameters such as the masses and spring constants in the benchmark problem. The design results demonstrate how this approach permits a very precise analysis of the intrinsic tradeoffs between robustness, performance, and control energy requirements. Also included is an open-loop H-infinity prefilter design that makes it possible to address the command response shaping issue. The design concept has been applied to the benchmark problem no. 4 and successfully removes the initial undesired transient and cuts down the percent overshoot.

Chiang, R. Y.↗
DOE OSTI2023

Improving E3SM Land Model Photosynthesis Parameterization via Satellite SIF, Machine Learning, and Surrogate Modeling

The parameterization of key photosynthesis parameters is one of the key uncertain sources in modeling ecosystem gross primary productivity (GPP). Solar-induced chlorophyll fluorescence (SIF) offers a good proxy for GPP since it marks the actual process of photosynthesis; while machine learning (ML) provides a robust approach to model the GPP-SIF relationship. Here, we trained the boosted regressing tree (BRT) and the Random Forest ML models with Greenhouse Gases Observing Satellite SIF data and in situ GPP observations from 49 eddy covariance towers. These trained ML GPP-SIF models were fed into the Energy Exascale Earth System Model (E3SM) Land Model (ELM) to generate ELM-simulated global SIF estimates, which were then benchmarked against satellite SIF observations with a surrogate modeling approach. Our results indicated good modeling performance of the ML-based GPP-SIF relationship. The ELM model when fed with the ML GPP-SIF models also can well predict the spatial-temporal variations in SIF. We also found high model accuracy for the surrogate modeling. Model parameter sensitivity analysis suggested that the fraction of leaf nitrogen in RuBisCO (flnr) is the most sensitive parameter to the SIF; other sensitive parameters include the Ball-Berry stomatal conductance slope (mbbopt) and the vcmax entropy (vcmaxse). The posterior uncertainty in simulated GPP was greatly reduced after benchmarking, and the model produced improved spatial patterns of mean GPP relative to FLUXCOM GPP. Our integrated approach provides a new avenue for improving land models and using remote-sensing SIF, which can be further improved in the future with more ground- and satellite-based observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

HEU Metal Delayed Critical Experiments with 10 to 19 Inch Thick Graphite Reflectors

Approximately 100 graphite-reflected highly enriched uranium (HEU, 93.14 wt % 235 U) metal annular and cylindrical critical experiments were performed in the early 1960s at the Oak Ridge Critical Experiments Facility (ORCEF). This report presents details from experiment logbooks, experimental data sheets and the author's memory for 44 HEU metal (93.14 wt % 235 U) critical assemblies with graphite reflectors varying from 10 to 19 in. thick, outside diameters varying from 7 to 15 in., inside diameters varying from 7 to 13 in. and critical HEU metal masses varying from 20.4 to 69.0 kg. The data from the 44 experiments described in this report are acceptable for use as criticality safety benchmark experiments for the International Criticality Safety Evaluation Program (ICSBEP) once the uncertainty analysis on the measured k eff is completed. Based on previous ICSBEP benchmarks with this HEU metal at ORCEF, the uncertainties in the measured k eff are expected to be as low as ±0.0004. Preparation of this report is part of an effort at Oak Ridge National Laboratory (ORNL) to document more than 15 undocumented series of critical and subcritical experiments enumerated in Critical and Subcritical NEA Benchmark Possibilities for Measurements at ORCEF and Other US DOE Facilities (Mihalzo, ORNL/TM-2019/1188, 2019) and performed by ORNL at ORCEF and other US Department of Energy critical experiments facilities. More than 500 operational days of critical facility time were used, not including setup and dismantlement time. This documentation for a part of one series of graphite reflected highly enriched uranium metal critical experiments, that used 50 operational days of ORCEF time, was performed using funding received from the DOE Office of Nuclear Energy’s Nuclear Energy University Programs at the University of Tennessee Nuclear Engineering Department. This documentation was also supported by the Nuclear Criticality, Radiation Transport, and Safety programs at ORNL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRSDate not supplied

Benchmark Problem Development for Testing Maturity of Intelligent Contingency Management Tools

This paper presents a process used to develop appropriate scenarios and metrics for evaluating the maturity of intelligent contingency management algorithms. A benchmark scenario is a reference point against which something can be measured, compared, or assessed. Creating an accurate benchmark requires considerable research and expertise. The scenario itself is an artificial representation of a real-world event, designed to achieve a set of learning objectives through experiential learning. Designing an effective benchmark simulation scenario requires careful planning, including identification of clear objectives; capability assessment of the algorithm/tool being evaluated; assessment of necessary levels of fidelity; development of a process flow map of events and event interactions; and identification of metrics that map back to objectives. Thus, a benchmark scenarios for contingency management might consist of one or several commonly used functions taken from real world applications, used for evaluation, characterization and performance measurement of a contingency management algorithm. Behavior of the contingency management algorithm under different environmental conditions should then be able to be predicted using a set of benchmark functions. The paper describes the resulting benchmark problem as an illustration of the application of this process.

Jon Holbrook↗
DOE OSTI2022

Setup and verification of a SCALE/KENO platform for generic FHR benchmark calculations

The work presented in this article is preliminary to downstream analysis of a generic fluoride salt-cooled high-temperature reactor (gFHR) core performed by the University of Tennessee in collaboration with Kairos Power (KP). A Monte Carlo transport model of the publicly available gFHR equilibrium core is developed in SCALE/KENO with multigroup energy treatment. Several output quantities of interest are used to verify the simulations against a benchmark model developed by KP using the continuous energy Monte Carlo code Serpent 2. Good agreement is seen in flux and fission rate profiles with a maximum relative difference of 1.4% and 2.8% respectively. Furthermore, an effective multiplication factor bias of 44 pcm was observed between the two simulations. The fuel temperature reactivity coefficient calculated with SCALE is within uncertainty to the reference model. This verification acts as a publicly reproducible benchmark for the gFHR in SCALE/KENO. A simplified depletion model is also presented where a single fuel pebble is depleted to discharge burnup through the equilibrium core while the equilibrium core is assumed to be invariant. This method produces results that intercept the equilibrium core concentrations in every case, however, an interesting artifact of this particular depletion model is uncovered. The phenomenon is shown to be a fundamental feature of the differential rate equations and inspires questions about how this system behaves when the time evolution of the equilibrium core is considered. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Determining the Overpotential of Electrochemical Fuel Synthesis Mediated by Molecular Catalysts: Recommended Practices, Standard Reduction Potentials, and Challenges

Molecular catalysts capable of performing electrochemical transformations are frequently utilized in the synthesis of fuels. A common benchmark for evaluating catalysts for electrochemical reactions is overpotential (η) and minimizing η remains an active goal in catalysis. This Review details approaches for the determination of thermodynamic potentials for common fuel-forming reactions and for the determination of electrochemical overpotential, and underscores the need to employ methods that enable meaningful comparisons between molecular catalysts. Strategies for minimizing overpotential while maintaining high activity are highlighted.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Stable parallel training of Wasserstein conditional generative adversarial neural networks

In this work, we propose a stable, parallel approach to train Wasserstein conditional generative adversarial neural networks (W-CGANs) under the constraint of a fixed computational budget. Differently from previous distributed GANs training techniques, our approach avoids inter-process communications, reduces the risk of mode collapse and enhances scalability by using multiple generators, each one of them concurrently trained on a single data label. The use of the Wasserstein metric also reduces the risk of cycling by stabilizing the training of each generator. We illustrate the approach on the CIFAR10, CIFAR100, and ImageNet1k datasets, three standard benchmark image datasets, maintaining the original resolution of the images for each dataset. Performance is assessed in terms of scalability and final accuracy within a limited fixed computational time and computational resources. To measure accuracy, we use the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks as well as an improvement of image quality of the new images created by the GANs approach. Weak scaling is attained on both datasets using up to 2000 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

An Open Combinatorial Diffraction Dataset Including Consensus Human and Machine Learning Labels with Quantified Uncertainty for Training New Machine Learning Models

Modern machine learning and autonomous experimentation schemes in materials science rely on accurate analysis of the data ingested by these models. Unfortunately, accurate analysis of the underlying data can be difficult, even for domain experts, complicating the training of the models intended to drive experiments. This is especially true when the goal is to identify the presence of weak signatures in diffraction or spectroscopic datasets. In this work, we examine a set of as-obtained diffraction data that track the phase transition from monoclinic to tetragonal in a Nb-doped VO2 film as a function of temperature and dopant concentration. We then task a set of domain experts and a set of machine learning experts with identifying which phase is present in each diffraction pattern manually and algorithmically, respectively; in both cases, the labels can vary dramatically, especially at the phase boundaries. We use the mode of the labels and the Shannon entropy as a method to capture, preserve and propagate consensus labels and their variance. Further we use the expert labels as a benchmark and demonstrate the use of Shannon entropy weighted scoring to test the performance of machine learning generated labels. Finally, we propose a material data challenge centered around generating improved labeling algorithms. This real-world dataset curated with expert labels can act as test bed for new algorithms. The raw data, annotations and code used in this study are all available online at data.gov and the interested reader is encouraged to replicate and improve the existing models

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Convolutional neural networks for intra-hour solar forecasting based on sky image sequences

Accurate and timely solar forecasts play an increasingly critical role in power systems. Compared to longer forecasting timescales, very short-term solar forecasting has lagged behind in both research and practice. In this paper, we propose deep convolutional neural networks (CNNs) to provide operational intra-hour (10-minute-ahead to 60-minute-ahead) solar forecasts. We develop two CNN structures inspired by a widely-used CNN architecture. The CNNs are tailored to our solar forecasting regression tasks and rely solely on sky image sequences. Case studies based on six years of data (over 150,000 data points) demonstrate that the best CNN model has forecast skill scores of 20%-39% over the naive persistence of cloudiness benchmark, even at these very short timescales. The CNNs also have consistently superior performance when compared to shallow machine learning models with meteorological predictors, where the improvement averages around 7%. The sensitivity analyses show that the sky image length, resolution, and weather conditions have impacts on the deep learning model accuracy. In our intra-hour problem with specific setups, two sky images with a 10-minute 128 x 128 resolution yield the most accurate forecasts. Current limitations, future work, and deployment challenges and solutions are also discussed.

14 SOLAR ENERGY↗
DOE OSTI2026

Systematic Evaluation of Atmospheric Forcing, Surface Datasets, and Mesh Effects on Kilometer-Scale Land Surface and River Modeling

Earth system models are advancing toward kilometer-scale resolution to capture local climate impacts and extremes. High-resolution land and river modeling depends on multiple factors, including mesh, surface datasets, and atmospheric forcing, but their relative effects at kilometer scales remain unquantified. We evaluated five Energy Exascale Earth System Model land and river configurations over the Mid-Atlantic region using two mesh (1/8° structured versus variable-resolution unstructured mesh), two surface datasets (default versus newly developed), and three atmospheric forcings (NLDAS2, MSWX, GSWP). Evaluation against satellite, reanalysis, and in situ benchmarks across water, energy, and carbon cycles quantifies how these factors affect model performance. Forcing selection produces the largest bias reductions (12-99% across variables), followed by surface datasets (7-75%) and mesh (up to 21%). Forcing effects vary by variable, with MSWX reducing biases for snow water equivalent, evapotranspiration, albedo, temperature, and gross primary productivity, GSWP for snow cover and runoff, and NLDAS for soil moisture and streamflow. The use of newly developed surface datasets improves gross primary productivity (58% bias reduction) and evapotranspiration but increase soil moisture and albedo biases due to current modeling limitations. Variable-resolution unstructured mesh improves the simulation of small-basin streamflow through better capturing drainage networks, though mesh minimally affects other land variables. These findings provide important guidance for high-resolution modeling development and actionable science.

Land and River modeling↗