SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Failure diagnosis and trend‐based performance losses routines for the detection and classification of incidents in large‐scale photovoltaic systems

Abstract Fault detection and classification in photovoltaic (PV) systems through real‐time monitoring is a fundamental task that ensures quality of operation and significantly improves the performance and reliability of operating systems. Different statistical and comparative approaches have already been proposed in the literature for fault detection; however, accurate classification of fault and loss incidents based on PV performance time series remains a key challenge. Failure diagnosis and trend‐based performance loss routines were developed in this work for detecting PV underperformance and accurately identifying the different fault types and loss mechanisms. The proposed routines focus mainly on the differentiation of failures (e.g., inverter faults) from irreversible (e.g., degradation) and reversible (e.g., snow and soiling) performance loss factors based on statistical analysis. The proposed routines were benchmarked using historical inverter data obtained from a 1.8 MWp PV power plant. The results demonstrated the effectiveness of the routines for detecting failures and loss mechanisms and the capability of the pipeline for distinguishing underperformance issues using anomaly detection and change‐point (CP) models. Finally, a CP model was used to extract significant changes in time series data, to detect soiling and cleaning events and to estimate both the performance loss and degradation rates of fielded PV systems.

14 SOLAR ENERGY↗

NASA NTRS1993

Evaluation Metrics for the Paragon XP/S-15

On February 17th 1993, the Numerical Aerodynamic Simulation (NAS) facility located at the NASA Ames Research Center installed a 224 node Intel Paragon XP/S-15 system. After its installation, the Paragon was found to be in a very immature state and was unable to support a NAS users' workload, composed of a wide range of development and production activities. As a first step towards addressing this problem, we implemented a set of metrics to objectively monitor the system as operating system and hardware upgrades were installed. The metrics were designed to measure four aspects of the system that we consider essential to support our workload: availability, utilization, functionality, and performance. This report presents the metrics collected from February 1993 to August 1993. Since its installation, the Paragon availability has improved from a low of 15% uptime to a high of 80%, while its utilization has remained low. Functionality and performance have improved from merely running one of the NAS Parallel Benchmarks to running all of them faster (between 1 and 2 times) than on the iPSC/860. In spite of the progress accomplished, fundamental limitations of the Paragon operating system are restricting the Paragon from supporting the NAS workload. The maximum operating system message passing (NORMA IPC) bandwidth was measured at 11 Mbytes/s, well below the peak hardware bandwidth (175 Mbytes/s), limiting overall virtual memory and Unix services (i.e. Disk and HiPPI I/O) performance. The high NX application message passing latency (184 microns), three times than on the iPSC/860, was found to significantly degrade performance of applications relying on small message sizes. The amount of memory available for an application was found to be approximately 10 Mbytes per node, indicating that the OS is taking more space than anticipated (6 Mbytes per node).

Traversat, Bernard↗

DOE OSTI2022

Dynamically robust coordinated set point tracking of distributed DERs at point of common coupling

Low-inertia operation of small-scale power systems, such as a microgrid or a portion of a long feeder, requires careful coordination of the controller performance of the constituting devices. This challenge is exacerbated in microgrids serving the functionalities of a conventional synchronous-based generation unit while comprised of smaller DERs operating mainly interfaced through power electronics converters. This paper builds on the idea of set point modulation and proposes a two-level control strategy that aims to achieve superior performance at the point of common coupling (PCC) of microgrids by combining a local control level with a distributed and coordinated level. Several case studies on both AC and DC systems, the CIGRE low-voltage benchmark system as the AC system and a test DC microgrid, validate the performance of the proposed approach. The real-world applicability of the approach is established via a high-fidelity power hardware-in-the-loop (PHIL) experimental setup and an application case study on grid frequency regulation. The proposed approach enables a microgrid to participate in ancillary service provisions where speed and quality of regulation are critical.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Expanding Scientific Horizons Through High Field Dynamic Nuclear Polarization with Advanced Organic BiRadicals

This project aimed to advance the capabilities of high-field Dynamic Nuclear Polarization (DNP) Nuclear Magnetic Resonance (NMR) spectroscopy at 800 MHz through the synthesis and evaluation of novel biradicals. While the targeted HyTEK biradical synthesis faced significant challenges, alternative efforts focused on synthesizing intermediate compounds and exploring alternative biradicals. A portion of the BDPA precursor was successfully converted into BDPA-TEMPO, though further DNP testing could not be completed within the project timeline. Benchmarking experiments with existing biradicals, including TEKPol and M-TinyPol, were conducted to evaluate their performance under high-field conditions. These efforts provided valuable insights into DNP enhancements, refined operational protocols for high-field experiments, and established benchmarks for future polarizing agent development.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Battery Life Prediction Using Reduced-Order Physics Models and Machine Learning (CRADA Final Report)

Phase 1 (Original CRADA, plus no-cost extension modifications #1-3, 6/1/2017 to 3/13/2021): The Australian Department of Defence (AUDoD) is performing accelerated aging tests of Li-ion batteries to benchmark their reliability and degradation characteristics. Using its previously developed battery lifetime predictive model framework, the National Laboratory of the Rockies (NLR) will develop analytical models based the AUDoD data to predict lifetime of the multiple Li-ion battery chemistries under real-world use scenarios of interest to AUDoD. The NLR model is based on physical degradation mechanisms encountered by Li-ion batteries and has been previously validated. Phase 2 (CRADA modification #4, plus no-cost extension modification #5, 2/22/2021 to 3/30/2025): Train and support Australian Department of Defence personnel to use NLR software for model-based estimation of Li-ion battery lifetime using accelerated battery aging data collected by the Australian Department of Defence. Under separate DOE funding from 2019 to 2021, NLR enhanced its battery life-prediction software using machine learning algorithms to automate portions of the model-fitting process, requiring significantly less labor and expert judgment and also adding uncertainty quantification, increasing statistical rigor. Under Phase 2, NLR will customize NLR Software and provide it to AuDoD. NLR will enhance its NLR Model to capture aging modes of AuDoD's multi-cell modules, including cell-balancing effects. NLR will develop example single-cell and multi-cell models based on one AuDoD battery aging dataset. NLR will train AuDoD personnel on NLR Software. By the conclusion of the project, NLR will have provided AuDoD the training materials, a user manual and software needed to perform their own analysis of additional and/or future battery aging datasets.

33 ADVANCED PROPULSION SYSTEMS↗

NASA NTRS2002

Initial Mechanical Testing of Superalloy Lattice Block Structures Conducted

The first mechanical tests of superalloy lattice block structures produced promising results for this exciting new lightweight material system. The testing was performed in-house at NASA Glenn Research Center's Structural Benchmark Test Facility, where small subelement-sized compression and beam specimens were loaded to observe elastic and plastic behavior, component strength levels, and fatigue resistance for hundreds of thousands of load cycles. Current lattice block construction produces a flat panel composed of thin ligaments arranged in a three-dimensional triangulated trusslike structure. Investment casting of lattice block panels has been developed and greatly expands opportunities for using this unique architecture in today's high-performance structures. In addition, advances made in NASA's Ultra-Efficient Engine Technology Program have extended the lattice block concept to superalloy materials. After a series of casting iterations, the nickel-based superalloy Inconel 718 (IN 718, Inco Alloys International, Inc., Huntington, WV) was successfully cast into lattice block panels; this combination offers light weight combined with high strength, high stiffness, and elevated-temperature durability. For tests to evaluate casting quality and configuration merit, small structural compression and bend test specimens were machined from the 5- by 12- by 0.5-in. panels. Linear elastic finite element analyses were completed for several specimen layouts to predict material stresses and deflections under proposed test conditions. The structural specimens were then subjected to room-temperature static and cyclic loads in Glenn's Life Prediction Branch's material test machine. Surprisingly, the test results exceeded analytical predictions: plastic strains greater than 5 percent were obtained, and fatigue lives did not depreciate relative to the base material. These assets were due to the formation of plastic hinges and the redundancies inherent in lattice block construction, which were not considered in the simplified computer models. The fatigue testing proved the value of redundancies since specimen strength was maintained even after the fracture of one or two ligaments. This ongoing test program is planned to continue through high-temperature testing. Also scheduled for testing are IN 718 lattice block panels with integral face sheets, as well as specimens cast from a higher temperature alloy. The initial testing suggests the value of this technology for large panels under low and moderate pressure loadings and for high-risk, damage-tolerant structures. Potential aeropropulsion uses for lattice blocks include turbine-engine actuated panels, exhaust nozzle flaps, and side panel structures.

Krause, David L.↗

DOE OSTI2020

Goldsim Modeling of Vadose Zone Transport for E-Area Naval Reactor Component Disposal Areas: Model Description and Benchmarking

This report documents the development of a GoldSim® model of flow and radionuclide transport to the water table through the Naval Reactor Components Disposal Area (NRCDA) waste disposal sites and underlying vadose zones. The model is designed to be used for Monte Carlo uncertainty analysis in support of the E-Area Performance Assessment (PA). This report describes the model and shows results obtained from benchmarking the model to best-estimate deterministic results obtained using a PORFLOW model of NRCDA vadose zone transport. The PORFLOW model is three-dimensional while the GoldSim model is a simplified one-dimensional treatment. Nevertheless, the GoldSim model was able to accurately reproduce PORFLOW results with some adjustment to the nominal dispersion coefficient and vadose zone flow area used as “tuning” parameters. An example of the results obtained comparing GoldSim and PORFLOW calculation of releases of I-129, Tc-99, C-14 and Ni-59 from waste disposal containers at the 643-26E site is shown in Figure 1 below. For all of the test cases evaluated, GoldSim predicted peak concentrations within 6% of the PORFLOW values and peak times agreed within 8% with the majority of the results in better agreement. The close agreement between the two models provides confidence that GoldSim will give results accurately reflecting the behavior of releases from the NRCDA under off-normal operating conditions for sensitivity and uncertainty analysis

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

NASA NTRS2014

Benchmarking a Soil Moisture Data Assimilation System for Agricultural Drought Monitoring

Despite considerable interest in the application of land surface data assimilation systems (LDAS) for agricultural drought applications, relatively little is known about the large-scale performance of such systems and, thus, the optimal methodological approach for implementing them. To address this need, this paper evaluates an LDAS for agricultural drought monitoring by benchmarking individual components of the system (i.e., a satellite soil moisture retrieval algorithm, a soil water balance model and a sequential data assimilation filter) against a series of linear models which perform the same function (i.e., have the same basic inputoutput structure) as the full system component. Benchmarking is based on the calculation of the lagged rank cross-correlation between the normalized difference vegetation index (NDVI) and soil moisture estimates acquired for various components of the system. Lagged soil moistureNDVI correlations obtained using individual LDAS components versus their linear analogs reveal the degree to which non-linearities andor complexities contained within each component actually contribute to the performance of the LDAS system as a whole. Here, a particular system based on surface soil moisture retrievals from the Land Parameter Retrieval Model (LPRM), a two-layer Palmer soil water balance model and an Ensemble Kalman filter (EnKF) is benchmarked. Results suggest significant room for improvement in each component of the system.

soil moisture↗

DOE OSTI2025

Gamma and Neutron Measurement and Modeling of Irradiated TRISO Fuel

Given the unique characteristics of the PBR fuel cycle, both gamma and neutron measurements are expected to play important roles in performing and maintaining nuclear material control and accounting for spent pebbles to safeguard the fuel cycle. Given the lack of irradiated pebbles in the US, a variety of irradiated TRISO fuel samples with wide ranges of burnups and cooling times available at ORNL were used in this work. A large number of gamma and neutron measurements have been performed on these samples to collect data to test the various detectors and to benchmark the computer models to simulate the depletion and decay of the fuel and the measurements themselves. Two neutron detectors, including a custom-made detector and the Very High-Performance Neutron Multiplicity Counting, were used to measure the neutrons emitted by these TRISO samples. Three gamma spectrometry detectors, including an HPGe and the M400 CZT detector, were used to measure gamma-ray emissions from these samples. The M400 was recently adopted by the IAEA for fresh uranium measurements, but it was tested for spent fuel measurements prior to this project. Detailed MCNP models were developed to simulate these neutron and gamma measurements. Some GADRAS models were also developed to cross check the MCNP models for the gamma measurements. It was found challenging to perform neutron measurements in the hot cell due to the high background counts. Close agreements were observed between the simulated and measured neutron count rates in both detectors’ measurements of californium calibration sources. Both the HPGe and M400 detectors were able to measure the 604 and 662 keV peaks from these samples, which are the two most important peaks used to infer fuel burnup. Although the M400 detector did not have nearly good energy resolution and did not detect some of the minor peaks as the HPGe detector, it was found to be capable of handling significantly higher dose rates than HPGe. Given the complexities in the TRISO samples (e.g., different samples sizes) and uncertainties in the alignments between the detector and the TRISO fuel inside the containers, large scatters were found between the peak area rates and the samples’ burnups. However, the 604/662 peak ratios were found to trend well with the samples’ burnups among most samples in both measured and simulated results.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

Jas4pp — A data-analysis framework for physics and detector studies

This paper describes the Jas4pp framework for exploring physics cases and for detector-performance studies of future particle collision experiments. Jas4pp is a multi-platform Java program for numeric calculations, scientific visualization in 2D and 3D, storing data in various file formats and displaying collision events and detector geometries. It also includes complex data-analysis algorithms for function minimization, regression analysis, event reconstruction (such as jet reconstruction), limit settings and other libraries widely used in particle physics. The framework can be used with several scripting languages, such as Python/Jython, Groovy and JShell. Several benchmark tests discussed in the paper illustrate significant improvements in the performance of the Groovy and JShell scripting languages compared to the standard Python implementation in C. Furthermore, the improvements for numeric computations in Java are attributed to recent enhancements in the Java Virtual Machine.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Toward a Holistic Performance Evaluation of Large Language Models Across Diverse AI Accelerators

Artificial intelligence (AI) methods have become critical in scientific applications to help accelerate scientific discovery. Large language models (LLMs) are being considered a promising approach to address some challenging problems because of their superior generalization capabilities across domains. The effectiveness of the models and the accuracy of the applications are contingent upon their efficient execution on the underlying hardware infrastructure. Specialized Al accelerator hardware systems have recently become available for accelerating Al applications. However, the comparative performance of these AI accelerators on large language models has not been previously studied. In this paper, we systematically study LLMs on multiple AI accelerators and GPUs and evaluate their performance characteristics for these models. We evaluate these systems with (i) a micro-benchmark using a core transformer block, (ii) a GPT-2 model, and (iii) an 1,I,M-driven science use case, GenSLM. We present our findings and analyses of the models' performance to better understand the intrinsic capabilities of AI accelerators. Furthermore, our analysis takes into account key factors such as sequence lengths, scaling behavior, and sensitivity to gradient accumulation steps.

Emani, Murali↗

DOE OSTI2023

Multipole Expansion of Atomic Electron Density Fluctuation Interactions in the Density-Functional Tight-Binding Method

The accuracy of the density-functional tight-binding (DFTB) method in describing noncovalent interactions is limited due to its reliance on monopole-based spherical charge densities. In this study, we present a multipole-extended second-order DFTB (mDFTB2) method that takes into account atomic dipole and quadrupole interactions. Furthermore, we combine the multipole expansion with the monopole-based third-order contribution, resulting in the mDFTB3 method. To assess the accuracy of mDFTB2 and mDFTB3, we evaluate their performance in describing noncovalent interactions, proton transfer barriers, and dipole moments. Here, our benchmark results show promising improvements even when using the existing electronic parameters optimized for the original DFTB3 model. Both mDFTB2 and mDFTB3 outperform their monopole-based counterparts, DFTB2 and DFTB3, in terms of accuracy. While mDFTB2 and mDFTB3 perform comparably for neutral and positively charged systems, mDFTB3 exhibits superior performance over mDFTB2 when dealing with negatively charged systems and proton transfers. Overall, the incorporation of the multipole expansion significantly enhances the accuracy of the DFTB method in describing noncovalent interactions and proton transfers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

IRIS-DMEM: Efficient Memory Management for Heterogeneous Computing

This paper proposes an efficient data memory management approach for the Intelligent RuntIme System (IRIS) heterogeneous computing framework along with new data transfer policies. IRIS provides a task-based programming model for extreme heterogeneous computing (e.g., CPU, GPU, DSP, FPGA) with support for today's most important programming languages (e.g., OpenMP, OpenCL, CUDA, HIP, OpenACC). However, the IRIS framework either forces the programmer to introduce data transfer commands for each task or relies on suboptimal memory management for automatic and transparent data transfers. The work described here extends IRIS with novel heterogeneous memory handling and introduces novel data transfer policies by employing the Distributed data MEMory handler (DMEM) for efficient and optimal movement of data among the various computing resources. The proposed approach achieves performance gains of up to 7× for tiled LU factorization and tiled DGEMM (i.e., matrix multiplication) benchmarks. Moreover, this approach also reduces data transfers by up to 71% when compared to previous IRIS heterogeneous memory management handlers. This work compares the performance results of the IRIS framework's novel DMEM with the StarPU runtime and MAGMA math library for GPUs. Experiments show a performance gain of up to 1.95× over StarPU and 2.1× over MAGMA.

Miniskar, Narasinga Rao↗

NASA NTRS1998

Parallelization of NAS Benchmarks for Shared Memory Multiprocessors

This paper presents our experiences of parallelizing the sequential implementation of NAS benchmarks using compiler directives on SGI Origin2000 distributed shared memory (DSM) system. Porting existing applications to new high performance parallel and distributed computing platforms is a challenging task. Ideally, a user develops a sequential version of the application, leaving the task of porting to new generations of high performance computing systems to parallelization tools and compilers. Due to the simplicity of programming shared-memory multiprocessors, compiler developers have provided various facilities to allow the users to exploit parallelism. Native compilers on SGI Origin2000 support multiprocessing directives to allow users to exploit loop-level parallelism in their programs. Additionally, supporting tools can accomplish this process automatically and present the results of parallelization to the users. We experimented with these compiler directives and supporting tools by parallelizing sequential implementation of NAS benchmarks. Results reported in this paper indicate that with minimal effort, the performance gain is comparable with the hand-parallelized, carefully optimized, message-passing implementations of the same benchmarks.

Waheed, Abdul↗

DOE OSTI2024

CommBench: Micro-Benchmarking Hierarchical Networks with Multi-GPU, Multi-NIC Nodes

Modern high-performance computing systems have multiple GPUs and network interface cards (NICs) per node. The resulting network architectures have multilevel hierarchies of subnetworks with different interconnect and software technologies. These systems offer multiple vendor-provided communication capabilities and library implementations (IPC, MPI, NCCL, RCCL, OneCCL) with APIs providing varying levels of performance across the different levels. Understanding this performance is currently difficult because of the wide range of architectures and programming models (CUDA, HIP, OneAPI). We present CommBench, a library with cross-system portability and a high-level API that enables developers to easily build microbenchmarks relevant to their use cases and gain insight into the performance (bandwidth & latency) of multiple implementation libraries on different networks. We demonstrate CommBench with three sets of microbenchmarks that profile the performance of six systems. Our experimental results reveal the effect of multiple NICs on optimizing the bandwidth across nodes and also present the performance characteristics of four available communication libraries within and across nodes of NVIDIA, AMD, and Intel GPU networks.

Hidayetoglu, Mert↗

DOE OSTI2020

MELCOR 2.2 Benchmarks of Peach Bottom NUREG/CR 7155 Uncertainty Analysis

The U.S. Nuclear Regulatory Commission (NRC) performed a first-of-a-kind uncertainty analysis (UA) of the accident progression, radiological releases, and offsite consequences for the State-of- the-Art Reactor Consequence Analyses (SOARCA) of an unmitigated long-term station blackout (LTSBO) severe accident scenario at the Peach Bottom Atomic Power Station. The objective of the UA was to evaluate the robustness of the SOARCA deterministic "best estimate results and conclusions documented in NUREG-1935, and to develop insight into the overall sensitivity of the SOARCA results to uncertainty in key modeling inputs. The study was completed in 2015 and documented in NUREG/CR-7155. Since 2015, two other SOARCA UAs were completed for two pressurized water reactor (PWR) plants. The PWR UAs incrementally updated the approach and methodology, including using the latest release of the MELCOR 2.2 computer code. There were also advances made in the state-of-the-art modeling related to NRC efforts using the Peach Bottom model in NUREG-2206, which provided the technical basis for the containment protection and release reduction rulemaking for boiling water reactors with Mark I and Mark II containments. This report documents the input model changes from the NUREG/CR-7155 study and performs a small number of reference calculations to assess the changes of the new computer code and the model input updates. The objective of the work is to verify whether the updated Peach Bottom MELCOR model and updated version of MELCOR support the conclusions formed in the Peach Bottom SOARCA UA by performing these representative calculations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2025

Performance Evaluation of LPBF Manufactured 316H Components

This work represents the continuation of a benchmark study that includes modeling, fabrication and characterization as demonstration to support industry’s adoption of advanced manufacturing processes in a variety of structures. This comprehensive study investigated the feasibility of using additive manufacturing (AM) technologies, specifically Laser Powder Direct Energy Deposition (LP-DED) and Laser Powder Bed Fusion (LPBF), to produce complex nuclear microreactor components using 316H stainless steel. The research focused on manufacturing an expanded elbow pipe component with transitioning sections, which are traditionally difficult and costly to produce through conventional manufacturing methods. The overall study’s primary objectives are therefore demonstrating AM viability for nuclear applications, optimizing process parameters, developing comprehensive material characterization protocols, validating computational modeling approaches, and establishing manufacturing guidelines for complex geometries. Although the initial work included the phased approach of cubical, upscaled cylindrical components, it is to enable to obtain more knowledge for the printing of the expanded elbow structure. The project achieved significant progress in process development by successfully optimizing LP-DED parameters to achieve 99.16-99.97% relative density in 316H stainless steel components. Through systematic evaluation of sixteen cube samples with varied laser powers (400-700W) and scan speeds (600-900 mm/min), optimal processing windows were identified at 500-550W with 600-700 mm/min or 650-700W with 650-900 mm/min scan speeds. The DED manufactured 316H demonstrated mechanical properties comparable or superior to wrought materials, with Young's modulus ranging from 153-208 GPa and controlled microstructural characteristics including greater than 95% face-centered cubic (FCC) phases and engineered cellular structures with sizes between 3.23-6.17 µm.

36 MATERIALS SCIENCE↗

DOE OSTI2024

JACC: Leveraging HPC Meta-Programming and Performance Portability with the Just-in-Time and LLVM-based Julia Language

We present JACC (Julia for Accelerators), the first high-level, and performance-portable model for the just-in-time and LLVM-based Julia language. JACC provides a unified and lightweight front end across different back ends available in Julia, enabling the same Julia code to run efficiently on many HPC CPU and GPU targets. We evaluated the performance of JACC for common HPC kernels as well as for the most computationally demanding kernels used in applications, HPCCG, a supercomputing benchmark test for sparse domains, and HARVEY, a blood flow simulator to assist in the diagnosis and treatment of patients suffering from vascular diseases. We carried out the performance analysis on the most advanced US DOE supercomputers: Aurora, Frontier, and Perlmutter. Overall, we show that JACC has a negligible overhead versus vendor-specific solutions, reporting GPU speedups with no extra cost to programmability.

Valero-Lara, Pedro↗