SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Concurrent Relaxation through Accelerated Deep Learning

CRADL captures performance metrics of machine learning algorithms operating on mesh data from multiphysics codes This proxy application is a tool to explore scalability of inference on HPC platforms, and also gather performance metrics for inference on new machine learning specific hardware. CRADL is designed to give users as fine a control as possible over an inference simulation. Users may select the number of cycles, amount of data, and batch size to pass to the accelerator of choice. Additionally the user may select a number of performance optimization libraries and flags. CRADL comes packaged with a repository of anonymized multi-physics simulation data, as well as a pretrained model for inference. The code allows a user to load their own pre-trained model and data if they wish. The code can operate in multiple parallelization schemes, with performance enhancing options such as half-precision libraries, PyTorch benchmarking, and pinned memory with non-blocking data transfers.

Zieb, KristoferJ.↗

DOE OSTI2021

Attend and Decode: 4D fMRI Task State Decoding Using Attention Models

Source code for Brain Attend and Decode paper. Functional magnetic resonance imaging (fMRI) is a neuroimaging modality that captures the blood oxygen level in a subject's brain while the subject either rests or performs a variety of functional tasks under different conditions. Given fMRI data, the problem of inferring the task, known as task state decoding, is challenging due to the high dimensionality (hundreds of million sampling points per datum) and complex spatio-temporal blood flow patterns inherent in the data. In this work, we propose to tackle the fMRI task state decoding problem by casting it as a 4D spatiotemporal classification problem. We present a novel architecture called Brain Attend and Decode (BAnD), that uses residual convolutional neural networks for spatial feature extraction and self-attention mechanisms for temporal modeling. We achieve significant performance gain compared to previous works on a 7-task benchmark from the large-scale Human Connectome Project-Young Adult (HCP-YA) dataset. We also investigate the transferability of BAnD's extracted features on unseen HCP tasks, either by freezing the spatial feature extraction layers and retraining the temporal model, or finetuning the entire model. The pre-trained features from BAnD are useful on similar tasks while finetuning them yields competitive results on unseen tasks/conditions.

Ng, BrendaM.↗

DOE OSTI2021

NMSBA: Continuous Application Benchmarking & Analysis – CABA

The CABA project is a test of a new tool, Survey,developed by Trenza to be used not only for benchmarking or profiling programs but also to allow incorporation of the information provided by Survey to be utilized in a CI, continuous integration,tool such as GitLab CI.Survey is foremost a means of assessing code performance in terms of time and operations which for computer programmers is known as benchmarking.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Flattop Benchmark CED-2 (IER-423)

The final design for the Flattop HEU Core Benchmark is presented in this report. Physical measurements will be performed on Flattop components using modern instruments and techniques to define uncertainties necessary to meet contemporary ICSBEP standards. A preliminary re-evaluation of ICSBEP HMF-0028 (Flattop HEU Core) led to the development of IER-423 CED-1, wherein total relative uncertainties in $k_{eff}$ were provided based on a new detailed model. The estimated uncertainty on the total uncertainty is +100%/-0%, given a lack of documented uncertainties on mass, dimensions, and densities of predominantly the natural uranium (NU) and highly enriched uranium (HEU) components.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2022

CFD Simulations to Support Pronghorn Modeling of a Molten Salt Fast Reactor

To assist with the deployment of next generation molten salt reactors (MSRs), the DOE NEAMS program is developing advanced simulation capabilities. As part of this work, the high-fidelity CFD tool, Nek5000 was used to inform model development for the engineering scale tool, Pronghorn. The particular case chosen was the EVOL molten salt fast reactor concept. This concept uses an open core design, which is well known to be sensitive to the particular geometry and can have complex flow behavior that varies across a range of conditions. This makes it an idea candidate for demonstration of the Hi2Lo concept of using higher fidelity models to benchmark lower fidelity models. Simulations of the EVOL design were performed using both LES (high-fidelity) and RANS (moderate-fidelity) in Nek5000. The LES results indicated discrepancies in 2-D axisymmetric RANS, indicating that the core is better modeled in RANS with a 3-D wedge representation of a portion of the core, which can accurately account for the effect of the inlet channels. Finally, results from the 3-D RANS were used to modify an existing turbulence model in Pronghorn. Improvement in the calibrated Pronghorn model was demonstrated. Future work is suggested to focus on expanding the LES calculation to provide a more direct point of comparison for both the RANS and Pronghorn models as well as incorporating more of the relevant MSR physics (such as delayed neutron precursor tracking) into the model.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2024

Zero and Finite Temperature Quantum Simulations Powered by Quantum Magic

We introduce a quantum information theory-inspired method to improve the characterization of many-body Hamiltonians on near-term quantum devices. We design a new class of similarity transformations that, when applied as a preprocessing step, can substantially simplify a Hamiltonian for subsequent analysis on quantum hardware. By design, these transformations can be identified and applied efficiently using purely classical resources. In practice, these transformations allow us to shorten requisite physical circuit-depths, overcoming constraints imposed by imperfect near-term hardware. Importantly, the quality of our transformations is t u n a b l e : we define a 'ladder' of transformations that yields increasingly simple Hamiltonians at the cost of more classical computation. Using quantum chemistry as a benchmark application, we demonstrate that our protocol leads to significant performance improvements for zero and finite temperature free energy calculations on both digital and analog quantum hardware. Specifically, our energy estimates not only outperform traditional Hartree-Fock solutions, but this performance gap also consistently widens as we tune up the quality of our transformations. In short, our quantum information-based approach opens promising new pathways to realizing useful and feasible quantum chemistry algorithms on near-term hardware.

Physics↗

DOE OSTI2026

Techno-Economic Evaluation of Electrified Vehicle Options in Drayage Fleets

The electrification of drayage fleets offers potential economic and operational benefits, but the financial viability of electrified vehicles remains sensitive to battery cost, energy price, and fleet usage patterns. While total cost of ownership (TCO) is a useful benchmark, fleet operators and investors are equally concerned with investment performance metrics such as payback period (PB) and Internal Rate of Return (IRR), which better reflect financial risks and investment return timelines. This study develops a unified techno-economic framework that jointly evaluates TCO, PB, and IRR to determine when electrified trucks become cost-effective alternatives to diesel trucks. Building on a previously developed cost modeling tool and using real-world telematics data from a Class 8 drayage fleet at the Port of Savannah, the analysis incorporates projected battery cost trajectories, electricity and diesel price trends, vehicle efficiency improvements, and multiple battery capacities. Parameter ranges reflect widely cited projections and observed drayage-duty-cycle variability. A surrogate-modeling method approximates economic performance across thousands of battery cost–electricity price combinations, enabling high-resolution identification of conditions that achieve TCO parity, acceptable PB thresholds, and target IRR levels. Additionally, the study estimates the evolving share of the fleet that can feasibly electrify over time under multiple economic metrics. This integrated framework offers a novel, data-driven approach to inform risk-aware decision-making for fleet electrification and supports investment planning under evolving cost and operational conditions.

Sun, Ruixiao [ORNL] (ORCID:0000000341768676)↗

NASA NTRS1990

Innovative Long Wavelength Infrared Detector Workshop Proceedings

The focus of the workshop was on innovative long wavelength (lambda less than 17 microns) infrared (LWIR) detectors with the potential of meeting future NASA and DoD long-duration space application needs. Requirements are for focal plane arrays which operate near 65K using active refrigeration with mission lifetimes of five to ten years. The workshop addressed innovative concepts, new material systems, novel device physics, and current progress in relation to benchmark technology. It also provided a forum for discussion of performance characterization, producibility, reliability, and fundamental limitations of device physics. It covered the status of the incumbent HgCdTe technology, which shows encouraging progress towards LWIR arrays, and provided a snapshot of research and development in several new contender technologies.

Grunthaner, Frank J.↗

NASA NTRS1996

I/O-Efficient Scientific Computation Using TPIE

In recent years, input/output (I/O)-efficient algorithms for a wide variety of problems have appeared in the literature. However, systems specifically designed to assist programmers in implementing such algorithms have remained scarce. TPIE is a system designed to support I/O-efficient paradigms for problems from a variety of domains, including computational geometry, graph algorithms, and scientific computation. The TPIE interface frees programmers from having to deal not only with explicit read and write calls, but also the complex memory management that must be performed for I/O-efficient computation. In this paper we discuss applications of TPIE to problems in scientific computation. We discuss algorithmic issues underlying the design and implementation of the relevant components of TPIE and present performance results of programs written to solve a series of benchmark problems using our current TPIE prototype. Some of the benchmarks we present are based on the NAS parallel benchmarks while others are of our own creation. We demonstrate that the central processing unit (CPU) overhead required to manage I/O is small and that even with just a single disk, the I/O overhead of I/O-efficient computation ranges from negligible to the same order of magnitude as CPU time. We conjecture that if we use a number of disks in parallel this overhead can be all but eliminated.

Vengroff, Darren Erik↗

NASA NTRS1999

Benchmarking for Excellence and the Nursing Process

Nursing is a service profession. The services provided are essential to life and welfare. Therefore, setting the benchmark for high quality care is fundamental. Exploring the definition of a benchmark value will help to determine a best practice approach. A benchmark is the descriptive statement of a desired level of performance against which quality can be judged. It must be sufficiently well understood by managers and personnel in order that it may serve as a standard against which to measure value.

Sleboda, Claire↗

NASA NTRS1987

A comparison of the Cray-2 performance before and after the installation of memory pseudo-banking

A suite of 13 large Fortran benchmark codes were run on a Cray-2 configured with memory pseudo-banking circuits, and floating point operation rates were measured for each under a variety of system load configurations. These were compared with similar flop measurements taken on the same system before installation of the pseudo-banking. A useful memory access efficiency parameter was defined and calculated for both sets of performance rates, allowing a crude quantitative measure of the improvement in efficiency due to pseudo-banking. Programs were categorized as either highly scalar (S) or highly vectorized (V) and either memory-intensive or register-intensive, giving 4 categories: S-memory, S-register, V-memory, and V-register. Using flop rates as a simple quantifier of these 4 categories, a scatter plot of efficiency gain vs Mflops roughly illustrates the improvement in floating point processing speed due to pseudo-banking. On the Cray-2 system tested this improvement ranged from 1 percent for S-memory codes to about 12 percent for V-memory codes. No significant gains were made for V-register codes, which was to be expected.

Schmickley, Ronald D.↗

NASA NTRS2022

A Benchmark Example for Delamination Propagation Predictions Based on the Calibrated End-Loaded Split Specimen

A benchmark example based on the Calibrated End-Loaded Split (C-ELS) specimen is developed and used to assess the performance of recently developed delamination propagation capabilities in the Abaqus/Standard finite element code. The C-ELS specimen has the advantage of a longer region of stable delamination propagation compared to the existing mode II benchmark case. The new benchmark example may therefore provide a better assessment tool by enabling more stable crack growth in regions further away from the boundary conditions or load application. First, a benchmark result is created manually using two-dimensional finite element models of the C-ELS specimen with different delamination lengths. Second, the performance of the delamination propagation capabilities in the Abaqus/Standard finite element code are assessed by comparing the results to the benchmark case. Two examples with different starter delamination lengths are studied. A shorter starter length is chosen to create a scenario with unstable delamination propagation. A longer delamination causes stable delamination propagation. Detailed results from three-dimensional analyses with aligned and mis-aligned meshes and two levels of mesh refinement are provided for several permutations of numerical input parameters. In general, good agreement can be achieved between the results obtained from the quasi-static propagation analysis and the benchmark analysis. However, particular non-default settings are found to be most reliable, accurate, and numerically efficient. Numerical artifacts including anomalous unreleased nodes in the crack wake and zig-zag crack fronts occur, and further development of the Abaqus/Standard VCCT propagation may be required. Use of the benchmark case to assess the continuous improvements in one finite element code illustrates the value of establishing benchmark solutions.

delamination↗

DOE OSTI2022

Novel Real- Time EMT- TS Modeling Architecture for Feeder Blackstart Simulations

This paper presents the development and benchmarking of a novel real-time electromagnetic-transient and transient-stability (EMT-TS) modeling architecture for distribution feeder restoration studies. The work presents for the first time in the literature a real-time EMT-TS testbed in which the grid-forming unit is simulated in EMT domain, operating as the slack bus of the phasor domain while including unbalanced voltage conditions. To evaluate the performance and limitations of the proposed model, an equivalent EMT testbed is developed to serve as a benchmark. First, the co-simulation framework and the domain coupling methodology are introduced. Next, the steady state operation of the EMT-TS and EMT models are matched. Then, tests are conducted to analyze the transient performance of the proposed EMT-TS model when compared to its EMT benchmark. Results reveal that when utilizing a battery energy storage system (BESS) as the grid-forming unit, the EMT-TS testbed can maintain high accuracy for typical load steps.

Paduani, Victor↗

DOE OSTI2023

Calibration strategy of the PROSPECT-II detector with external and intrinsic sources

This paper presents an energy calibration scheme for an upgraded reactor antineutrino detector for the Precision Reactor Oscillation and Spectrum Experiment (PROSPECT). The PROSPECT collaboration is preparing an upgraded detector, PROSPECT-II (P-II), to advance capabilities for the investigation of fundamental neutrino physics, fission processes and associated reactor neutrino flux, and nuclear security applications. P-II will expand the statistical power of the original PROSPECT (P-I) dataset by at least an order of magnitude. The new design builds upon previous P-I design and focuses on improving the detector robustness and long-term stability to enable multi-year operation at one or more sites. The new design optimizes the fiducial volume by elimination of dead space previously occupied by internal calibration channels, which in turn necessitates the external deployment. In this paper, we describe a calibration strategy for P-II. Here, the expected performance of externally deployed calibration sources is evaluated using P-I data and a well-benchmarked simulation package by varying detector segmentation configurations in the analysis. The proposed external calibration scheme delivers a compatible energy scale model and achieves comparable performance with the inclusion of an additional AmBe neutron source, in comparison to the previous internal arrangement. Most importantly, the estimated uncertainty contribution from the external energy scale calibration model meets the precision requirements of the P-II experiment.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

CI/CD Efforts for Validation, Verification and Benchmarking OpenMP Implementations

Software developers must adapt to keep up with the changing capabilities of platforms so that they can utilize the power of High-Performance Computers (HPC), including exascale systems. OpenMP, a directive-based parallel programming model, allows developers to include directives to existing C, C++, or Fortran code to allow node level parallelism without compromising performance. This paper describes our CI/CD efforts to provide easy evaluation of the support of OpenMP across different compilers using existing testsuites and benchmark suites on HPC platforms. Our main contributions include (1) the set of a Continuous Integration (CI) and Continuous Development (CD) workflow that captures bugs and provides faster feedback to compiler developers, (2) an evaluation of OpenMP (offloading) implementations supported by AMD, HPE, GNU, LLVM, and Intel, and (3) evaluation of the quality of compilers across different heterogeneous HPC platforms. With the comprehensive testing through the CI/CD workflow, we aim to provide a comprehensive understanding of the current state of OpenMP (offloading) support in different compilers and heterogeneous platforms consisting of CPUs and GPUs from NVIDIA, AMD, and Intel.

Jarmusch, Aaron↗

DOE OSTI2023

Strictly Enforcing Invertibility and Conservation in CNN-Based Super Resolution for Scientific Datasets

Abstract Recently, deep convolutional neural networks (CNNs) have revolutionized image “super resolution” (SR), dramatically outperforming past methods for enhancing image resolution. They could be a boon for the many scientific fields that involve imaging or any regularly gridded datasets: satellite remote sensing, radar meteorology, medical imaging, numerical modeling, and so on. Unfortunately, while SR-CNNs produce visually compelling results, they do not necessarily conserve physical quantities between their low-resolution inputs and high-resolution outputs when applied to scientific datasets. Here, a method for “downsampling enforcement” in SR-CNNs is proposed. A differentiable operator is derived that, when applied as the final transfer function of a CNN, ensures the high-resolution outputs exactly reproduce the low-resolution inputs under 2D-average downsampling while improving performance of the SR schemes. The method is demonstrated across seven modern CNN-based SR schemes on several benchmark image datasets, and applications to weather radar, satellite imager, and climate model data are shown. The approach improves training time and performance while ensuring physical consistency between the super-resolved and low-resolution data. Significance Statement Recent advancements in using deep learning to increase the resolution of images have substantial potential across the many scientific fields that use images and image-like data. Most image super-resolution research has focused on the visual quality of outputs, however, and is not necessarily well suited for use with scientific data where known physics constraints may need to be enforced. Here, we introduce a method to modify existing deep neural network architectures so that they strictly conserve physical quantities in the input field when “super resolving” scientific data and find that the method can improve performance across a wide range of datasets and neural networks. Integration of known physics and adherence to established physical constraints into deep neural networks will be a critical step before their potential can be fully realized in the physical sciences.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Uncertainty Quantification Framework for Predicting Material Response with Large Number of Parameters: Application to Creep Prediction in Ferritic-Martensitic Steels Using Combined Crystal Plasticity and Grain Boundary Models

This paper presents an uncertainty quantification (UQ) framework for the physics-based model prediction of material response with a large number of parameters. The application problem presented in this work is that of predicting creep in Grade 91 steel at 600°C. The material response is defined with a physically based microstructural model with constitutive equations emulating several observed phenomena in Grade 91 and embodied into an explicit geometry mesoscale finite element model for prior austenite grains and grain boundaries. Creep within the grains and in grain boundaries are represented by crystal plasticity for dislocation motion and a physics-based model for cavity growth and nucleation, respectively. The creep behavior of this material is influenced by several parameters, some of which have a wide range of variation based on experimental data. UQ combined with microstructural modeling can discover the core microstructural causes of experimental variability, leading to improved materials with lower variability in critical long-term material properties. In this study, we investigate the model's uncertainty to identify material properties that may be modified during production to increase creep life and analyze different components of the crystal plasticity model for improvements. For this purpose, a quantity of interest is defined as time to minimum creep rate, which correlates well to the creep failure of the material. A deep neural network model was trained and validated to be used as a surrogate for the finite element model. Then, a variance-based sensitivity analysis is performed on the surrogate model to find the Sobol indices of the input parameters in respect to the output quantity of interest. The Sobol indices are used to reduce the dimensionality of the model. Generalized polynomial chaos expansion is used on the reduced basis models to propagate the uncertainty from the input parameters to the quantity of interest using the deep neural network surrogate model. These results are benchmarked against uncertainty propagation using Monte Carlo simulations. In conclusion, the UQ performed through the reduced basis model captures almost all the uncertainty in the model with significantly fewer simulations, making it possible to perform the UQ directly via simulations with the finite element model rather than surrogate machine-learned models.

36 MATERIALS SCIENCE↗

DOE OSTI2025

FAIR Surrogate Benchmarks Supporting AI and Simulation Research (Final Report)

Computational Science is being revolutionized by integrating AI and simulation and, in particular, by deep learning surrogate models that can replace all or part of traditional large‐scale HPC computations. Such surrogates can achieve remarkable performance improvements, as much as several orders of magnitude, and save both compute time and energy. The Surrogate Benchmark Initiative (SBI) project creates a community repository and FAIR (Findable, Accessible, Interoperable, and Reusable) data ecosystem for HPC application surrogate benchmarks. The SBI team comes from Argonne National Laboratory (ANL), Indiana University (IU), Rutgers University, the University of Tennessee, Knoxville (UTK), and the University of Virginia (UVA). SBI repositories include data, code, and all relevant collateral artifacts that the science and engineering community need to use and reuse these data sets and surrogates. SBI repositories generate active research from both the participants in SBI and the broad community of AI and domain scientists. This project develops surrogates that use several different neural nets to learn and quickly infer the results of simulations and data systems and captures them as surrogate benchmarks with a rich set of metadata covering: Data; Model; Metrics specification; Machine specification; and Science, Speed, and Power Results. We research FAIR metadata for these benchmarks. We develop application surrogate examples as benchmarks across many fields (ANL, UTK, IU, UVA). We also study non-Surrogate benchmarks that have many common features and similar issues as regards FAIRness. We work with MLCommons (UVA, UTK), which is a major machine learning benchmarking activity where we get metadata ontologies, software, and benchmarks, Benchmarks have datasets, models, and metadata and they need a technical framework developed by UTK and Rutgers and deployed by UVA. We study features of Surrogates including performance, training set size, and uncertainty quantification (Rutgers, UVA and IU).

97 MATHEMATICS AND COMPUTING↗