Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Development and Validation of a Two-Phase Thermal-Hydraulic CFD Code NEK-2P

A project is underway to develop, verify and validate an advanced two-phase flow modeling capability for the highly-scalable, high-performance Computational Fluid Dynamics (CFD) code NEK5000. The goal of this work is to verify and validate the two-phase version of the NEK5000 code, named NEK-2P, to simulate the two-phase flow and heat transfer phenomena that occur in a Boiling Water Reactor (BWR) fuel bundle under various operating conditions. The NEK-2P two-phase flow models follow the approach used for the Extended Boiling Framework (EBF) previously developed at Argonne but include more fundamental physical models of boiling phenomena and advanced numerical algorithms for improved computational accuracy, robustness, and computational speed. The development of the NEK-2P two-phase solver and the implementation of the Extended Boiling Framework two-phase models were initially supported by Argonne National Laboratory (Argonne) through a Laboratory Directed Research and Development (LDRD) project during FY2014-2016. The development and validation of the two-phase models through analyses of selected two-phase boiling flow experiments was supported by the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program in FY2017-2020. This report focuses on verification and validation of the water-steam boiling model NEK-2P Two-Phase, CFD code. The NEK-2P was validated with Nuclear Power Engineering Corporation (NUPEC) Pressurized Water Reactor (PWR) Sub-channel and Bundle Test (PSBT) void distribution benchmark. Three different simulations were performed and analyzed for various operating conditions such as wall-heat flux and sub-cooled inlet temperatures. Reasonably good agreement with measured data was obtained in predicting the measured void distributions. Simulations were performed for Virginia Tech. (VT) 3x3 rod bundle geometry with and without spacers. The preliminary results were presented for Simplified Spacer Grid (SSG). In addition, the implementation of interface reconstruction model was tested with one of the Becker benchmark Critical Heat Flux (CHF) experiments.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Polymer Hole Transport Material Functional Group Tuning for Improved Perovskite Solar Cell Performance

As lead halide perovskites (LHPs) continue to achieve success as a light-harvesting material in perovskite solar cells (PSCs), exploring and understanding other materials in the device stack become increasingly important. Particularly, selection of suitable hole transport materials (HTMs) that demonstrate high performance and stability is imperative in the design of P-I-N PSCs. Presented here are a family of 12 structurally related polymers based on either fluorene or carbazole main chains with select aromatic side groups that introduce tunable properties for use in PSCs. How properties such as the highest occupied molecular orbital energy level, conductivity, glass-transition temperature, and wettability of the HTM affect the PSC performance is explored. Devices that incorporate the polymer HTMs perform well relative to PTAA in benchmark P-I-N PSC architectures while exhibiting similar or superior stability under accelerated aging studies. The relative synthetic simplicity and resultant performance of the HTMs in PSCs coupled with the ability to customize properties with different functional groups demonstrates the potential of this family of HTMs for a variety of LHP materials.

14 SOLAR ENERGY↗
DOE OSTI2020

National Criticality Experiments Research Center (NCERC) - capabilities and recent measurements

The National Criticality Experiments Research Center (NCERC) located at the Device Assembly Facility (DAF) at the Nevada National Security Site (NNSS) and operated by Los Alamos National Laboratory (LANL) is home to four critical assemblies which are used to support of range of missions, including nuclear criticality safety and nuclear nonproliferation. Additionally, subcritical systems can also be assembled at NCERC. NCERC is providing critical and subcritical experiments valuable to the nuclear data community and experiments performed at NCERC are often published as benchmarks in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook. This manuscript will give a broad overview of recent experiments performed at NCERC, upcoming experiments, and why integral measurements are important and useful to the nuclear data community. The four critical assemblies are GODIVA IV, FLATTOP, COMET, and PLANET. GODIVA IV is a cylindrical metal fast burst reactor, the fourth in the GODIVA series that dates back to the 1950’s. FLATTOP is an highly enriched uranium (HEU) or Pu core reflected by natural uranium. COMET and PLANET are vertical lift assemblies, where one half of the reactor can be lifted to the upper half of the reactor to create a critical system. Some recent experiments include various critical intermediate energy assemblies with lead, and subcritical measurements of plutonium reflected by copper, tungsten, and nickel. Work is also underway to make a better measurement of the critical mass of neptunium, using a neptunium sphere surrounded by nickel shells. Additionally, measurements will be performed next year with HEU shells from Rocky Flats. These HEU shells will be stacked together to make larger systems, allowing for a large range of criticality (from subcritical to delayed critical). Other upcoming measurements include an HEU critical assembly sensitive to intermediate energy neutrons.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2025

IRIS-MASH: Efficient Multi-device Asynchronous Multi-Stream Heterogeneous Computing

In the rapidly evolving field of high-performance computing (HPC), effectively leveraging heterogeneous devices through asynchronous task programming is paramount. This paper presents a robust asynchronous task programming model tailored for a multi-device, multi-stream execution environment that incorporates a diverse array of heterogeneous computing units, including GPUs from various vendors and other accelerators. Current state-of-the-art task programming models provide methodologies to support asynchronous task executions, but they typically handle homogeneous devices using native programming languages, while support for heterogeneous devices is limited to frameworks like OpenCL. This gap presents significant challenges in abstracting heterogeneous devices to harness their true asynchronous capabilities effectively using their native programming languages. By implementing asynchronous task execution, our model significantly boosts the performance of tiled algorithm task graphs through overlapping data transfers with computation and enabling the simultaneous execution of multiple kernels. We integrate this approach into a heterogeneous Intelligent Runtime System (IRIS) and assess its performance using a suite of tiled algorithm benchmarks from the heterogeneous math kernels library (MatRIS) based on IRIS. Experimental results demonstrate a performance improvement ranging from 1.6 × to 2 × over IRIS without asynchronous support, and a notable 22% performance enhancement compared to established runtime systems such as StarPU and PaRSEC. This approach significantly improves computation efficiency of HPC workflows and provides a solid base for future exploration and development in the area of asynchronous task programming in heterogeneous systems.

Miniskar, Narasinga Rao [ORNL] (ORCID:000000018259↗
DOE OSTI2026

Qualifying LaBr3:Ce+Sr detector performance for the Mu2e experiment at Fermilab Using the ELBE Accelerator

A LaBr3:Ce+Sr detector will be used to measure the stopped muon captures at the Mu2e experiment at Fermilab. It has been benchmarked in a test beam experiment performed at the ELBE electron accelerator located at the Helmholtz-Zentrum Dresden-Rossendorf, Germany. ELBE’s pulsed bremsstrahlung beam line was set to deliver an average γ -ray energy of between 4–5 MeV. The detector response was mapped to match Mu2e beam conditions, including rates up to 1 Mcps, energy flux, and time structure. A radioactive calibration source was used to mimic the characteristic 1808.7 keV γ -ray, emitted during the atomic muon nuclear capture in the Mu2e aluminum stopping target. The detector energy resolution was measured as a function of the average energy flux: up to 1 TeV/s for 0.34 s, the steady-operation beam-on time and up to 4 TeV/s for 5 ms to get a conservative estimate of the effect of high intensity Mu2e beam fluctuations. The PMT gain variation as a function of the beam spill length and average intensity has been parametrized and corrected for. When a PMT gain correction corresponding to the average beam-spill intensity is applied, the residual effect of beam intensity fluctuations around the average degrades the energy resolution, σ E γ /E γ , at 1808.7 keV from 0.66% to 0.83%.

Huang, Shihua [Purdue U., West Lafayette]↗
NASA NTRS2009

Multi-Core Processor Memory Contention Benchmark Analysis Case Study

Multi-core processors dominate current mainframe, server, and high performance computing (HPC) systems. This paper provides synthetic kernel and natural benchmark results from an HPC system at the NASA Goddard Space Flight Center that illustrate the performance impacts of multi-core (dual- and quad-core) vs. single core processor systems. Analysis of processor design, application source code, and synthetic and natural test results all indicate that multi-core processors can suffer from significant memory subsystem contention compared to similar single-core processors.

Simon, Tyler↗
NASA NTRS1991

The NAS parallel benchmarks

A new set of benchmarks has been developed for the performance evaluation of highly parallel supercomputers in the framework of the NASA Ames Numerical Aerodynamic Simulation (NAS) Program. These consist of five 'parallel kernel' benchmarks and three 'simulated application' benchmarks. Together they mimic the computation and data movement characteristics of large-scale computational fluid dynamics applications. The principal distinguishing feature of these benchmarks is their 'pencil and paper' specification-all details of these benchmarks are specified only algorithmically. In this way many of the difficulties associated with conventional benchmarking approaches on highly parallel systems are avoided.

Bailey, D. H.↗
DOE OSTI2023

Neural Image Compression: Generalization, Robustness, and Spectral Biases

Recent advances in neural image compression (NIC) have resulted in models which are starting to outperform traditional codecs. While this has led to growing excitement about using these methods in real-world applications, the successful adoption of any machine learning system (including NIC) in the wild requires it to generalize (and be robust) to unseen distribution shifts at deployment time. Unfortunately, current research lacks comprehensive datasets and informative tools to evaluate and understand compression performance in real-world settings. To bridge this crucial gap, first, this paper presents a comprehensive benchmark suite to evaluate the out-of-distribution (OOD) performance of image compression methods. Specifically, we design CLIC-C and Kodak-C by introducing 15 common corruptions to popular CLIC and Kodak benchmarks. Next, we propose spectrally inspired introspection tools to gain a deeper understanding of errors introduced by image compression methods as well as their OOD performance. To this end, we carry out a detailed performance comparison of the classical codec with various variants of NIC (e.g., original, variable rate, pruned), revealing intriguing findings that challenge our current understanding of the strengths and limitations of NIC. Finally, we corroborate our empirical findings with theoretical analysis, providing an in-depth view of the OOD performance of NIC. Our benchmarks, spectral introspection tools, and findings provide a crucial bridge to the real-world adoption of NIC. We hope that our work will propel future efforts in designing more robust and generalizable NIC methods.

neural networks, Variational Autoencoder, robustne↗
DOE OSTI2021

Disjunctive linear separation conditions and mixed-integer formulations for aircraft conflict resolution

In this paper, we address the aircraft conflict resolution problem in air traffic control. We introduce new mixed-integer programming formulations for aircraft conflict resolution with speed, heading and altitude control which are based on disjunctive linear separation conditions. We first examine the two-dimensional aircraft conflict resolution problem with speed and heading control represented as continuous decision variables. We show that the proposed disjunctive linear separation conditions are equivalent to the classical nonlinear conditions for aircraft separation. Further, we characterise conflict-free trajectories based on aircraft velocity bounds and propose a simple pre-processing algorithm to identify aircraft pairs which are either always conflict-free, or which cannot be separated using speed and heading control only. We then incorporate altitude control and propose a lexicographic optimisation formulation that aims to minimise the number of flight level changes before resolving outstanding conflicts via two-dimensional velocity control. The proposed mixed-integer programming formulations are nonconvex, and we propose convex relaxations, decomposition methods and constraint generation algorithms to solve the two-dimensional and lexicographic optimisation formulations to guaranteed optimality. Numerical experiments on four types of conflict resolution benchmarking instances are conducted to test the performance of the proposed mixed-integer formulations. Further, the proposed method is compared against two benchmarks based on state-of-the-art approaches for the aircraft conflict resolution problem. Our numerical results show that the proposed method largely outperforms both benchmarks in terms of runtime and is able to solve significantly more instances to global optimality.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

CO 2 storage site characterization using ensemble-based approaches with deep generative models

Estimating spatially distributed properties such as permeability from available sparse measurements is a great challenge in efficient subsurface CO 2 storage operations. In this paper, a deep generative model that can accurately capture complex subsurface structure is tested with an ensemble-based inversion method for accurate and accelerated characterization of CO 2 storage sites. We chose Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP) for its realistic reservoir property representation and Ensemble Smoother with Multiple Data Assimilation (ES-MDA) for its robust data fitting and uncertainty quantification capability. WGAN-GP are trained to generate high-dimensional permeability fields from a low-dimensional latent space and ES-MDA then updates the latent variables by assimilating available measurements. Several subsurface site characterization examples including Gaussian, channelized, and fractured reservoirs are used to evaluate the accuracy and computational efficiency of the proposed method and the main features of the unknown permeability fields are characterized accurately with reliable uncertainty quantification. Furthermore, the estimation performance is compared with a widely-used variational, i.e., optimization-based, inversion approach, and the proposed approach outperforms the variational inversion method in several benchmark cases. We explain such superior performance by visualizing the objective function in the latent space: because of nonlinear and aggressive dimension reduction via generative modeling, the objective function surface becomes extremely complex while the ensemble approximation can smooth out the multi-modal surface during the minimization. This suggests that the ensemble-based approach works well over the variational approach when combined with deep generative models at the cost of forward model runs unless convergence-ensuring modifications are implemented in the variational inversion.

42 ENGINEERING↗
DOE OSTI2021

Biochemical Conversion of Lignocellulosic Biomass to Hydrocarbon Fuels and Products: 2020 State of Technology and Future Research

The annual State of Technology (SOT) assessment is an essential activity for biochemical platform research. It allows the impact of research progress to be quantified in terms of economic improvements in the overall cellulosic biofuel production process for a particular conversion pathway. As such, initial benchmarks can be established for currently demonstrated performance and progress can be tracked towards out-year goals to ultimately demonstrate cost-competitive cellulosic biofuel technology. The purpose of this report is to benchmark the latest experimental developments across a number of potential bioconversion pathways as quantified by modeled minimum fuel selling prices (MFSPs), as a measure of current status relative to those final targets. For this state of technology, TEA models were run for two separate biological conversion pathways to fuels, based on available data for integrated biomass deconstruction and hydrolysate processing; namely carboxylic acids (primarily butyric acid) and diols (2,3-butanediol [BDO]), reflecting NREL's recently-published 2018 biochemical design report focused on those two pathways. The models were run across three scenarios for lignin utilization, namely combustion, conversion to coproducts based on "base case" performance with biomass hydrolysate, and conversion to coproducts based on "high" performance demonstrated with model lignin monomer components. Relative to prior 2019 benchmarks, the 2020 SOT achieved further MFSP reductions of approximately $1/gallon gasoline equivalent, primarily attributed to improvements in pretreatment that led to both cost reductions and yield improvements.

09 BIOMASS FUELS↗
DOE OSTI2026

A comparison of wrought and powder metallurgical FeCrAl claddings under simulated LWR accident transients

Iron-chromium-aluminum (FeCrAl) alloys are potential accident tolerant fuel (ATF) cladding candidates for light-water reactors but are difficult to fabricate as thin-walled tubes via conventional cast-and-wrought routes. Powder metallurgy (PM) offers a manufacturing alternative with improved compositional control, but its transient accident performance has not been directly benchmarked against wrought variants. This study evaluates the burst behavior of commercially developed PM-processed FeCrAl alloys, PM-C26M (Fe-12Cr-6Al-2Mo) and the high precipitate density FA-SMT (Fe-22Cr-5Al-3Mo), under simulated light-water reactor accident transient conditions. Burst testing was conducted using the Severe Accident Test Station with heating rates of 5 °C/s and 50 °C/s and internal pressures ranging from 25 MPa to 100 MPa. PM-C26M reproduced wrought C26M burst behavior within 7–37 °C across the stress range, indicating that PM processing does not compromise transient strength. FA-SMT exhibited markedly higher burst temperatures and reduced heating-rate sensitivity, consistent with its engineered precipitate strengthening. FA-SMT rupture exhibited axial "unzipping" rather than the lateral tearing characteristic of PM- and wrought C26M. Post-test EBSD and fractography indicate that this behavior is strongly correlated with strain-gated intergranular void nucleation associated with the dense precipitate architecture of FA-SMT, a response absent in the comparatively clean PM-C26M matrix and consistent with rupture morphologies reported for oxide-dispersion strengthened (ODS) FeCrAl of similar base-matrix chemistry to PM-C26M. These findings highlight the potential of powder metallurgy as a viable fabrication route for ATF claddings from an accident performance standpoint.

Bell, Sam [ORNL] (ORCID:0000000251905657)↗
DOE OSTI2025

Artificial intelligence driven laser parameter search: Inverse design of photonic surfaces using greedy surrogate-based optimization

Photonic surfaces designed with specific optical characteristics are becoming increasingly crucial for novel energy harvesting and storage systems. The design of these surfaces can be achieved by texturing materials using lasers. The optimal adjustment of laser fabrication parameters to achieve target surface optical properties is an open challenge. Thus, we develop a surrogate-based optimization approach. Our framework employs the Random Forest algorithm to model the forward relationship between the laser fabrication parameters and the resulting optical characteristics. During the optimization process, we use a greedy, prediction-based exploration strategy that iteratively selects batches of laser parameters to be used in experimentation by minimizing the predicted discrepancy between the surrogate model’s outputs and the user-defined target optical characteristics. This strategy allows for efficient identification of optimal fabrication parameters without the need to model the error landscape directly. We demonstrate the efficiency and effectiveness of our approach on two synthetic benchmarks and two specific experimental applications of photonic surface inverse design targets. By calculating the average performance of our algorithm compared to other state of the art optimization methods, we show that our algorithm performs, on average, twice as well across all benchmarks. Additionally, a warm starting inverse design technique for changed target optical characteristics enhances the performance of the introduced approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A comprehensive and fair comparison of two neural operators (with practical extensions) based on $\mathrm{FAIR}$ data

Neural operators can learn nonlinear mappings between function spaces and offer a new simulation paradigm for real-time prediction of complex dynamics for realistic diverse applications as well as for system identification in science and engineering. Herein, we investigate the performance of two neural operators, which have shown promising results so far, and we develop new practical extensions that will make them more accurate and robust and importantly more suitable for industrial-complexity applications. The first neural operator, DeepONet, was published in 2019 (Lu et al., 2019), and its original architecture was based on the universal approximation theorem of Chen & Chen (1995). The second one, named Fourier Neural Operator or FNO, was published in 2020, and it is based on parameterizing the integral kernel in the Fourier space. DeepONet is represented by a summation of products of neural networks (NNs), corresponding to the branch NN for the input function and the trunk NN for the output function; both NNs are general architectures, e.g., the branch NN can be replaced with a CNN or a ResNet. According to Kovachki et al. (2021), FNO in its continuous form can be viewed conceptually as a DeepONet with a specific architecture of the branch NN and a trunk NN represented by a trigonometric basis. In order to compare FNO with DeepONet computationally for realistic setups, we develop several extensions of FNO that can deal with complex geometric domains as well as mappings where the input and output function spaces are of different dimensions. We also develop an extended DeepONet with special features that provide inductive bias and accelerate training, and we present a faster implementation of DeepONet with cost comparable to the computational cost of FNO, which is based on the Fast Fourier Transform. Here we consider 16 different benchmarks to demonstrate the relative performance of the two neural operators, including instability wave analysis in hypersonic boundary layers, prediction of the vorticity field of a flapping airfoil, porous media simulations in complex-geometry domains, etc. We follow the guiding principles of FAIR (Findability, Accessibility, Interoperability, and Reusability) for scientific data management and stewardship. The performance of DeepONet and FNO is comparable for relatively simple settings, but for complex geometries the performance of FNO deteriorates greatly. We also compare theoretically the two neural operators and obtain similar error estimates for DeepONet and FNO under the same regularity assumptions.

42 ENGINEERING↗
DOE OSTI2022

Climbing the Summit and Pushing the Frontier of Mixed Precision Benchmarks at Extreme Scale

The rise of machine learning (ML) applications and their use of mixed precision to perform interesting science are driving forces behind AI for science on HPC. The convergence of ML and HPC with mixed precision offers the possibility of transformational changes in computational science. The HPL-AI benchmark is designed to measure the performance of mixed precision arithmetic as opposed to the HPL benchmark which measures double precision performance. Pushing the limits of systems at extreme scale is nontrivial -little public literature explores optimization of mixed precision computations at this scale. In this work, we demonstrate how to scale up the HPL-AI benchmark on the pre-exascale Summit and exascale Frontier systems at the Oak Ridge Leadership Computing Facility (OLCF) with a cross-platform design. We present the implementation, performance results, and a guideline of optimization strategies employed for delivering portable performance on both AMD and NVIDIA GPUs at extreme scale.

Lu, Hao↗
NASA NTRS1996

WATCHMAN: A Data Warehouse Intelligent Cache Manager

Data warehouses store large volumes of data which are used frequently by decision support applications. Such applications involve complex queries. Query performance in such an environment is critical because decision support applications often require interactive query response time. Because data warehouses are updated infrequently, it becomes possible to improve query performance by caching sets retrieved by queries in addition to query execution plans. In this paper we report on the design of an intelligent cache manager for sets retrieved by queries called WATCHMAN, which is particularly well suited for data warehousing environment. Our cache manager employs two novel, complementary algorithms for cache replacement and for cache admission. WATCHMAN aims at minimizing query response time and its cache replacement policy swaps out entire retrieved sets of queries instead of individual pages. The cache replacement and admission algorithms make use of a profit metric, which considers for each retrieved set its average rate of reference, its size, and execution cost of the associated query. We report on a performance evaluation based on the TPC-D and Set Query benchmarks. These experiments show that WATCHMAN achieves a substantial performance improvement in a decision support environment when compared to a traditional LRU replacement algorithm.

Scheuermann, Peter↗
DOE OSTI2025

Additively manufacturing high-temperature aluminum alloy for automotive engine pistons

The purpose of the project was to evaluate DuAlumin-3D, an ORNL designed Al alloy, for additive manufacturing of high-performance automotive components. The project consisted of additively manufacturing a cylindrical block of representative material which was then heat treated before machining into test coupons. Testing included tensile tests as a function of temperature, high-cycle fatigue testing as a function of temperature, density and elastic modulus measurements, and thermophysical property measurements. Fractography was also performed on failed high-cycle fatigue specimens. The results were compared against benchmark AM Al alloys and current high-performance conventionally manufactured alloys. Overall, the DuAlumin-3D material outperformed the incumbent materials in mechanical properties, especially at elevated temperatures, while maintaining broadly similar thermophysical properties. The results of this study support further maturation of the material for additive manufacturing of high-performance automotive components.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Machine learning-based jet and event classification at the Electron-Ion Collider with applications to hadron structure and spin physics

We explore machine learning-based jet and event identification at the future Electron-Ion Collider (EIC). We study the effectiveness of machine learning-based classifiers at relatively low EIC energies, focusing on (i) identifying the flavor of the jet and (ii) identifying the underlying hard process of the event. We propose applications of our machine learning-based jet identification in the key research areas at the future EIC and current Relativistic Heavy Ion Collider program, including enhancing constraints on (transverse momentum dependent) parton distribution functions, improving experimental access to transverse spin asymmetries, studying photon structure, and quantifying the modification of hadrons and jets in the cold nuclear matter environment in electron-nucleus collisions. We establish first benchmarks and contrast the estimated performance of flavor tagging at the EIC with that at the Large Hadron Collider. We perform studies relevant to aspects of detector design including particle identification, charge information, and minimum transverse momentum capabilities. Additionally, we study the impact of using full event information instead of using only information associated with the identified jet. These methods can be deployed either on suitably accurate Monte Carlo event generators, or, for several applications, directly on experimental data. We provide an outlook for ultimately connecting these machine learning-based methods with first principles calculations in quantum chromodynamics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗