Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Power Outage Data Informed Resilience Assessment Framework

Catastrophic impacts to power systems due to disruptive events have increased significantly during the last decade. These events highlight the need to develop approaches to assess the resilience of power systems against extreme events. However, the availability of data that capture power system performance during and after disruptive events is scarce. This paper proposes an assessment framework to evaluate the performance aspects of the grid system during extreme outage events using the Environment for Analysis of Geo-Located Energy Information (EAGLE-I) data. EAGLE-I includes information related to the number of impacted customers, duration, and location of power outages in the United States. Statistical analyses were conducted to extract resilient-based outage data and derive probability distribution functions of their impact and recovery characteristics. A list of extreme events is identified based on few predetermined threshold values. Metrics from other power outage assessments were used to measure the characteristics of each event, including impact rate and duration, recovery rate and duration, and impact level. A probability distribution function is obtained for each metric. The obtained results provide a representation of national grid performance during extreme events, which can be applied as a framework to evaluate various resilience enhancement techniques.

EAGLE-I↗
DOE OSTI2023

Battery Energy Storage System Evaluation Method

This report describes development of an effort to assess Battery Energy Storage System (BESS) performance that the US DOE Federal Energy Management Program (FEMP) and others can employ to evaluate performance of deployed BESS or solar photovoltaic (PV) +BESS systems. The proposed method is based on actual battery charge and discharge metered data to be collected from BESS systems provided by federal agencies participating in the FEMP's performance assessment initiatives. Long-term (e.g., at least one year) time series (e.g., hourly) charge and discharge data are analyzed to provide approximate estimates of key performance indicators (KPIs).

25 ENERGY STORAGE↗
DOE OSTI2025

Swept-Lookback Deflectometry for High Performance Concentrating Solar Power Optical Metrology

This report describes an initial investigation into a proposed solution to the important problem of performing a detailed evaluation of heliostat optical performance, in situ in a heliostat field. Our approach is to place digital cameras in a position near the receiver where they look back toward the heliostat mirrors. The pixels of each camera sensor identify a set of small cells on the mirror surface, each corresponding to a “mixel.” By either passing reflected sunbeam over the camera or passing the camera through the reflected sunbeam, the cameras intercept sunlight reflected from each mixel. We then analyze the recorded video data to determine times when each mixel transitions from dark to light, and then back to dark. We then use these transitions to construct vectors from the camera to the mixel, and then from the mixel to the edge of the Sun at that moment. We then compute the surface normal at the mixel, which bisects the angle between these vectors. Performing this analysis for all mixels in the mirror yields a high-resolution map of slope across the mirror surface. We have implemented most of this process, successfully collecting data for an example heliostat facet and computing a preliminary estimated slope map. However, more work remains to complete this calculation, since certain factors and transformations are not yet included. Our observations so far support our hypothesis that such a system is possible, but we have not yet completed our quantitative evaluation of the concept.

14 SOLAR ENERGY↗
DOE OSTI2025

Quantum Approximate Optimization Algorithm on Different Qubit Systems

Solving optimization problems is critical across many research domains, but the high dimensionality of parameter spaces often poses significant challenges. The Quantum Approximate Optimization Algorithm (QAOA) has emerged as a promising approach for accelerating optimization in the Noisy Intermediate-Scale Quantum (NISQ) era by leveraging both classical and quantum computational resources. However, its performance can vary depending on the underlying quantum hardware architecture. In this work, we evaluate the performance of QAOA on different quantum hardware platforms, specifically, superconducting transmon qubits and trapped-ion qubits, targetting real-world optimization problems formulated as fully connected Quadratic Unconstrained Binary Optimization (QUBO) instances. We evaluate both the solution quality and time-to-solution using dense QUBO matrices. Furthermore, we show that large-scale problems, such as a 100-bit QUBO instance, can be effectively tackled by integrating quantum computing with high-performance computing (HPC) resources. This study provides practical insights into the strengths and limitations of different qubit technologies and advances the application of quantum computing in solving real-world optimization problems.

Kim, Seongmin [ORNL] (ORCID:0000000159063004)↗
DOE OSTI2024

Long-Term Statistical Process Monitoring of an Ultrafiltration Water Treatment Process

As water treatment technology has improved, the amount of available process data has substantially increased, making real-time, data-driven fault detection a reality. One shortcoming of the fault detection literature is that methods are usually evaluated by comparing their performance on hand-picked, short-term case studies, which yields no insight into long-term performance. In this work, we first evaluate multiple statistical and machine learning approaches for detrending process data. Then, we evaluate the performance of a PCA-based fault detection approach, applied to the detrended data, to monitor influent water quality, filtrate quality, and membrane fouling of an ultrafiltration membrane system for indirect potable reuse. Based on two short case studies, the adaptive lasso detrending method is selected, and the performance of the multivariate approach is evaluated over more than a year. The method is tested for different sets of three critical tuning parameters, and we find that for long-term, autonomous monitoring to be successful, these parameters should be carefully evaluated. However, in comparison with industry standards of simpler, univariate monitoring or daily pressure decay tests, multivariate monitoring produces substantial benefits in long-term testing.

ammonia↗
DOE OSTI2024

Using convolutional neural networks to detect edge localized modes in DIII-D from Doppler backscattering measurements

In H-mode tokamak plasmas, the plasma is sometimes ejected beyond the edge transport barrier. These events are known as edge localized modes (ELMs). ELMs cause a loss of energy and damage the vessel walls. Understanding the physics of ELMs, and by extension, how to detect and mitigate them, is an important challenge. In this paper, we focus on two diagnostic methods—deuterium-alpha (D α ) spectroscopy and Doppler backscattering (DBS). The former detects ELMs by measuring Balmer alpha emission, while the latter uses microwave radiation to probe the plasma. DBS has the advantages of having a higher temporal resolution and robustness to damage. These advantages of DBS diagnostic may be beneficial for future operational tokamaks, and thus, data processing techniques for DBS should be developed in preparation. In sight of this, we explore the training of neural networks to detect ELMs from DBS data, using D α data as the ground truth. With shots found in the DIII-D database, the model is trained to classify each time step based on the occurrence of an ELM event. The results are promising. When tested on shots similar to those used for training, the model is capable of consistently achieving a high f1-score of 0.93. Furthermore, this score is a performance metric for imbalanced datasets that ranges between 0 and 1. We evaluate the performance of our neural network on a variety of ELMs in different high confinement regimes (grassy ELM, RMP mitigated, and wide-pedestal), finding broad applicability. Beyond ELMs, our work demonstrates the wider feasibility of applying neural networks to data from DBS diagnostic.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Analysis of Building Model Forecasts using Autonomous HVAC Optimization System for Residential Neighborhood

Heating, ventilation, and air conditioning (HVAC) systems account for the highest share of home energy consumption in the United States. Optimized HVAC control can provide thermal improved comfort to the occupants, improve energy efficiency, reduce energy cost, and support grid services. In this paper, we discuss a multi-agent and cloud-based software framework that has been deployed in occupied residential neighborhood. This system enables automatic data collection, learning, optimization, and dispatches signals to neighborhood devices. HVAC optimization is based on model predictive control (MPC). Since the operational performance of MPC depends on model forecasting accuracy, it is crucial to evaluate the model continuously and modify or retrain it as necessary. In this research, we developed an automated workflow to evaluate the performance of temperature and power forecasts based on measured data in the real world. This will provide researchers with a deeper understanding of the model and how it can be improved.

Lebakula, Viswadeep↗
DOE OSTI2020

OpenStudio Occupant-centric KPIs Reporting Measure v1.0

This is an OpenStudio measure that calculates and reports the occupant-centric key performance indicators (KPIs) for evaluating building energy performance from occupant-centric perspectives. The measure automatically calculate the KPIs in the following categories: (1) visual & lighting, (2) thermal (3) air quality, and (4) others.

Hong, Tianzhen↗
DOE OSTI2020

OpenStudio System-level KPI Reporting Measure v1.0

This is a OpenStudio measure that calculates and reports the system-level key performance indicators (KPIs) for evaluating building energy performance at the system level. The systems are defined by the service it provides in commercial buildings, which include (1) lighting, (2) Miscellaneous Electric Loads (MELs), (3) Heating, Ventilation and Air Conditioning (HVAC), and (4) Service Water Heating (SWH).

Li, Han↗
DOE OSTI2020

High temperature water electrolysis testing of gold-based electrodes for H 2 production

The Hybrid Sulfur (HyS) process is a promising thermochemical water-splitting cycle with global scale hydrogen production potential. The SO 2 -depolarized electrolyzer (SDE) is a critical component of the cycle. At the core of the SDE is the membrane-electrode assembly (MEA), which consists of a polymer electrolyte membrane (PEM) sandwiched between two electrocatalyst layers. New electrocatalyst and membrane materials are being developed with the goals of improving the electrolyzer performance and extending the lifetime of the MEA. In this work, we evaluated the performance of three different membranes and optimized operating conditions, resulting is one of the highest performances in the literature.

08 HYDROGEN↗
DOE OSTI2021

Low-Cost, Accessible Vaccine Cooler Options

In response to cold chain management requirements for COVID-19 vaccines, Los Alamos National Laboratory has investigated, built, and demonstrated viability for different cryogenic storage options. With ease-of-access and affordability in mind, these cooler units have been built using commercial off-the-shelf (COTS) components. The team was also able to design a testing method for evaluating the performance of the different vaccine cooler options as part of the Technology Evaluation and Demonstration program. The tested cooler units demonstrated compatibility with either dry ice or liquid nitrogen as the cryogen, along with several commercial solvents. This compatibility demonstration would potentially offer sufficient flexibility for temperature control continuity. Next steps are to investigate industry interest in supporting field testing of the cooler units.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Integrated Computational Materials and Mechanical Modeling for Additive Manufacturing of Alloys with Graded Structure Used in Fossil Fuel Power Plants

Wire-arc additive manufacturing (WAAM) has demonstrated its unique capability of producing large-size alloy components with a significantly reduced fabrication time and enhanced geometry design freedom. In this project, the team has developed an ICME (Integrated Computational Materials Engineering) modeling framework, which supports the WAAM of the AUSC (Advanced Ultra-Supercritical) power plant components. The manufacturing design has been applied to Inconel 740H, steel P91, as well as the dissimilar alloy components between steel P91 and Inconel 740H. The ICME model framework is developed by considering two types of modeling. First, mechanistic modeling has been applied to control the printing quality and understand the sequence of the dissimilar printing of the wall structure. The following models have been included in the developed ICME framework: finite element thermal model, grain structure model, residual stress simulation, crystal plasticity model, CALPHAD-based precipitation kinetic model, phase stability prediction, thermal expansion predictive model, and heuristic creep model. Secondary, a physics-based machine learning model has also been developed based on the ICME model structure. The machine learning model development is based on the ICME model prediction with calibration of the experiments. In addition, the WAAM has been utilized as a high-throughput experimental tool rapidly generating a gradient of alloy composition to facilitate experimental database generation for process-structure-property relationships. Such a database directly supported the ICME-enhanced machine learning, which further assisted in intermediate composition block design between P91 and 740H. A high-throughput screening study of the oxidation resistance has been performed based on such high-throughput experimentation. Based on the computational design, several dissimilar alloy manufacturing with post-heat treatment have been performed with a comprehensive evaluation of mechanical performance, including hardness mapping, yield strength, creep resistance. In this project, the single component of P91 and 740H processed by WAAM after heat treatment designed by ICME has demonstrated higher performance in yield strength and creep resistance than the wrought materials. The P91 sample prepared by WAAM with ICME-designed heat treatment performs better than P92 in creep resistance. The designed graded alloy printing with intermediate block shows a promising performance that exceeds the traditional welding. Moreover, the current research indicates the high need for location-specific design analysis with uncertainty quantification, an important topic that deserves more dedicated research. The achievement of this project demonstrated the promising future of WAAM in structural alloy manufacturing for energy power plant development. Successful printing requires synergetic efforts made by manufacturing, mechanical, and materials sciences.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2024

Graph Neural Networks for Parameterized Quantum Circuits Expressibility Estimation (Rev.1)

Parameterized quantum circuits (PQCs) are fundamental to quantum machine learning (QML), quantum optimization, and variational quantum algorithms (VQAs). The expressibility of PQCs is a measure that determines their capability to harness the full potential of the quantum state space. It is thus a crucial guidepost to know when selecting a particular PQC ansatz. However, the existing technique for expressibility computation through statistical estimation requires a large number of samples, which poses significant challenges due to time and computational resource constraints. This paper introduces a novel approach for expressibility estimation of PQCs using Graph Neural Networks (GNNs). We demonstrate the predictive power of our GNN model with a dataset consisting of 25,000 samples from the noiseless IBM QASM Simulator and 12,000 samples from three distinct noisy quantum backends. The model accurately estimates expressibility, with root mean square errors (RMSE) of 0.05 and 0.06 for the noiseless and noisy backends, respectively. We compare our model’s predictions with reference circuits from Sim et al. and IBM Qiskit’s hardwareefficient ansatz sets to further evaluate our model’s performance. Our experimental evaluation in noiseless and noisy scenarios reveals a close alignment with ground truth expressibility values, highlighting the model’s efficacy. Moreover, our model exhibits promising extrapolation capabilities, predicting expressibility values with low RMSE for out-of-range qubit circuits trained solely on only up to 5-qubit circuit sets. This work thus provides a reliable means of efficiently evaluating the expressibility of diverse PQCs on noiseless simulators and hardware.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Methanol mixing controlled combustion process enabled by methanol dehydration to dimethyl ether

This work demonstrates an initial proof-of-concept approach for operating a compression ignition off-road and marine relevant engine using neat methanol. The approach utilizes mixing controlled compression ignition (MCCI) of methanol that is enabled by a homogeneous charge compression ignition (HCCI) pre-burn of premixed dimethyl ether (DME). Although two fuels are used, this work explores and evaluates the opportunity and performance to generate the premixed fuel via. methanol catalytic dehydration over an alumina catalyst at engine relevant temperatures, pressures, and space velocities. Conversion purity and species output results from catalytic dehydration bench flow reactor studies were coupled with single cylinder experiments of the characterized output species for pre-burn HCCI performance. Subsequent initial methanol MCCI performance is also evaluated and compared relative to conventional diesel combustion. The detailed flow reactor results show that the catalytic dehydration conversion efficiency of methanol to DME is a function of system pressure, temperature, and space velocity. The engine results demonstrate that a 100% conversion of methanol to DME is not required for successful pre-burn HCCI, and the water formed during the dehydration process does not need to be removed to achieve the desired HCCI event from this pre-burn mixture. Subsequent methanol MCCI combustion results show that the level of methanol slip in the dehydration process affects the pre-burn HCCI phasing, low temperature heat release process, and magnitude of energy released, all of which can dictate the available window for direct injection of methanol for MCCI combustion.

Jatana, Gurneesh [ORNL] (ORCID:0000000288903225)↗
DOE OSTI2020

Understanding and Explicitly Measuring Linguistic and Stylistic Properties of Deception via Generation and Translation

Massive digital disinformation is one of the main risks of modern society. Hundreds of models and linguistic analyses have been done to compare and contrast misleading and credible content online. However, most models do not remove the confounding factor of a topic or narrative when training, so the resulting models learn a clear topical separation for misleading versus credible content. We study the feasibility of using two strategies to disentangle the topic bias from the models to understand and explicitly measure linguistic and stylistic properties of content from misleading versus credible content. First, we develop conditional generative models to create news content that is characteristic of different credibility levels. We perform multi-dimensional evaluation of model performance on mimicking both the style and linguistic differences that distinguish news of different credibility using machine translation metrics and classification models. We show that even though generative models are able to imitate both the style and language of the original content, additional conditioning on both the news category and the topic leads to reduced performance. In a second approach, we perform deception style ``transfer" by translating deceptive content into the style of credible content and vice versa. Extending earlier studies, we demonstrate that, when conditioned on a topic, deceptive content is shorter, less readable, more biased, and more subjective than credible content, and transferring the style from deceptive to credible content is more challenging than the opposite direction.

Saldanha, Emily G.↗
DOE OSTI2024

chatHPC: Empowering HPC users with large language models

The ever-growing number of pre-trained large language models (LLMs) across scientific domains presents a challenge for application developers. While these models offer vast potential, fine-tuning them with custom data, aligning them for specific tasks, and evaluating their performance remain crucial steps for effective utilization. However, applying these techniques to models with tens of billions of parameters can take days or even weeks on modern workstations, making the cumulative cost of model comparison and evaluation a significant barrier to LLM-based application development. To address this challenge, we introduce an end-to-end pipeline specifically designed for building conversational and programmable AI agents on high performance computing (HPC) platforms. Our comprehensive pipeline encompasses: model pre-training, fine-tuning, web and API service deployment, along with crucial evaluations for lexical coherence, semantic accuracy, hallucination detection, and privacy considerations. Here, we demonstrate our pipeline through the development of chatHPC, a chatbot for HPC question answering and script generation. Leveraging our scalable pipeline, we achieve end-to-end LLM alignment in under an hour on the Frontier supercomputer. We propose a novel self-improved, self-instruction method for instruction set generation, investigate scaling and fine-tuning strategies, and conduct a systematic evaluation of model performance. The established practices within chatHPC will serve as a valuable guidance for future LLM-based application development on HPC platforms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Mechanical Properties of Additively Manufactured 316L Stainless Steel Before and After Neutron Irradiation (FY21)

This report presents the materials property data of additively manufactured (AM) 316L stainless steel (SS) accumulated for the assessment of core materials in the Transformational Challenge Reactor (TCR) program. The TCR manufacturing approach includes using the laser powder bed fusion (LPBF) method for metallic (316L and Inconel 718) components. To assess the mechanical performance of printed components in reactor-relevant conditions and build a property database for the AM materials, mechanical tests and evaluations were performed before and after neutron irradiation. Miniature tensile specimens were irradiated in the High Flux Isotope Reactor to 0.2, 2, 8, and 10 dpa at target temperatures of 300 and 600°C. Postirradiation evaluation for the 0.2 and 2 dpa specimens was performed during FY20 and FY21, and the results are presented and discussed in this document.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

A Benchmark Suite for Evaluating Scientific AI Workloads on GPUs

AI applications have been steadily increasing in the allocation portfolio among leadership computing facilities. These applications depend on deep learning frameworks with hardware acceleration and underlying software systems. With the rapid development of applications, software stacks, and hardware devices, it is essential to evaluate the performance of core operations in AI workloads for direction of optimizations and procurement of next-generation high-performance computing (HPC) infrastructures. Currently, most benchmarks lack scientific AI workloads. So, we present DeepKernelBench and the experimental results of evaluating the benchmark suite for early observations and performance comparisons on datacenter GPUs using representative workloads for scientific AI, including Attentions, General matrix multiplications, Geometrics and Fourier neural operations.

Jin, Zheming [Advanced Micro Devices (AMD)]↗