Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Performance Evaluation of an Advanced Distributed Energy Resource Management Algorithm

This paper presents performance evaluation of a new distributed energy resource management system (DERMS) algorithm via an advanced hardware-in-the-loop (HIL) platform. The HIL platform provides realistic testing in a laboratory environment, including the accurate modeling of sub-transmission and distribution networks, the DERMS software controller, and 84 power hardware solar photovoltaic (PV) inverters, standard communication protocols, and a capacitor bank controller. The DERMS algorithm is also called, Grid-Optimization of Solar (GO-Solar) platform which includes predictive state estimation (PSE) and online multiple objective optimization (OMOO) to dispatch the legacy devices and distributed energy resources (e.g., PV). The voltage regulation performance is evaluated under three scenarios, volt-var smart inverter (baseline), and DERMS control for 100% and 30% of PV. The results show that controlling 30% of PV systems with the GO-Solar platform may provide the best balance of control performance and implementation cost.

distributed energy resource management system (DER↗
DOE OSTI2021

Simulation-based Performance Evaluation of Model Predictive Control for Building Energy Systems

The performance of model predictive control (MPC) can be significantly affected by different choices of controller parameters such as the time intervals for model discretization and control sampling. Due to the lack of a systematic understanding on how these parameters affect control performance, they are usually selected arbitrarily in practice.In this paper, the combined impacts of selected time intervals for model discretization and control sampling on the performance of MPC are comprehensively investigated for the first time through detailed simulations. Specifically, a typical MPC strategy is first designed to improve building operations based on a reduced-order model of building dynamics. Then, the performance of the designed MPC is evaluated against different choices of time intervals for model discretization and control sampling on a simulated office building. The detailed simulation results reveal that the time interval for model discretization has a much greater influence on the performance of MPC than the time interval for control sampling. Although the time interval for control sampling usually receives more attentions in practice, it turns out that the time interval for model discretization affects the prediction performance, cost saving, and computation time simultaneously and more significantly. Therefore, the simulation-based performance evaluation presented here sheds light on the impacts of different time intervals and facilitates their selection for practical applications of MPC to building operations

Huang, Sen↗
DOE OSTI2025

Performance Evaluation of Vertical Federated Machine Learning Against Adversarial Threats on Wide-Area Control System: Preprint

Federated machine learning (FL) is gaining significant popularity to develop cybersecurity solutions in power grids because of its advanced capability to support decentralized data handing at local devices, its privacy preservation, and its low-bandwidth requirement. However, the evolving adversarial machine learning (AML) threats raise significant concerns for the cybersecurity of FL architectures. The FL-based split neural network (SplitNN) achieves high performance through the decentralized training of local neural network models while preserving data privacy across multiple entities. In this paper, we propose a methodology for evaluating the performance of a vertical FLbased anomaly detector against different types of AML attacks, including denial-of-service attacks, adversarial data injection attacks, and replay attacks on the trained local models deployed in the grid network. For a case study, we consider the modified IEEE 13-bus system, and we develop SplitNN-based binary and multiclass classification models to detect, locate, and identify different types of data integrity attacks on the volt-watt control with two pooling layers: maximum pooling and AvgPool. Our experimental results, computed through performance metrics, reveal that the severity of these AML attacks varies with the integrated pooling mechanism, the type of classification model, and the nature of the cyberattack. Further, the AML attacks negatively impacted the prediction time per sample for the pretrained SplitNN during the online testing.

adversarial threats↗
DOE OSTI2023

TRISO Fuel Performance Evaluation

TRISO Fuel Performance Evaluation outlining design and radionuclide source term, fuel performance during normal operation, fuel performance during core heatup accidents, other accident scenarios, and GenIV VHTR Fuel and Fuel Cycle PMB.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Modeling Single-Crystal Battery Materials: From Fundamental Understanding to Performance Evaluation

The performance of rechargeable batteries is fundamentally influenced by the physicochemical properties and microstructural features of their key material components. Recent experimental advancements have highlighted the potential of single-crystal (SC) morphologies to address inherent limitations of polycrystalline (PC) electrodes and solid-state electrolytes, offering tunable charge transport kinetics and improved cell cycling performance. Here, this review examines how state-of-the-art computational modeling, from atomistic and mesoscale to continuum-level approaches, including machine learning methodologies, has been utilized to investigate the critical factors governing the electrochemical behavior of SC battery materials. We explore how predictive modeling can elucidate the processing–structure–property–performance relationships of SC cathodes, anodes, and solid-state electrolytes, with a focus on unique SC characteristics such as crystallographic anisotropy, size effects, and facet-dependent properties. Additionally, we identify limitations in commonly used modeling techniques and discuss strategies to address these challenges. By integrating high-fidelity simulations with experimental insights, this review aims to outline a clear path for the rational design and optimization of SC battery components, paving the way for accelerated advancements in energy storage technologies.

Materials science↗
DOE OSTI2024

Performance evaluation of the USGS velocity model for the San Francisco Bay Area

In this study, we evaluated the performance of the United States Geological Survey velocity model developed for the San Francisco Bay Area (SFBA), version 21.1. The evaluation was performed through high-resolution three-dimensional physics-based ground motion simulations of seven small-magnitude earthquakes (ranging from magnitude 3.8 to 4.4) that occurred on the eastern side of the San Francisco Bay. The simulations were performed in the frequency range from 0 to 5 Hz with a minimum shear-wave velocity of 250 m/s, which allowed the capture of wave propagation effects of the near-surface soft materials that characterize local basins. Based on the direct comparison of Fourier amplitude spectra between recorded and simulated ground motions for more than 250 stations, we found that the velocity model generally performs well in the frequency range of 0.2–5 Hz. The median value of the Fourier amplitude residuals was found to be near zero for all seven earthquakes. The slight over-prediction of 0.2 log-natural units at frequencies above 3 Hz in our simulations was attributed to the potentially inaccurate representation of the source radiation pattern by a double-couple point source model, and simple representation of shallow small-scale underground structural complexity in the velocity model. Maps of spectral amplitude differences between the simulated and recorded data were used to identify areas responsible for systematic ground motion over-predictions or under-predictions. For example, while some sub-domains over soft sediments show over-prediction patterns, the block east of the Hayward fault is prone to exhibit patterns of under-prediction. These maps can be used to guide future refinements of the SFBA velocity model. Since our simulation methodology allows for the decoupling of the source and wave propagation effects, the ground motion data generated by our simulations can also be used to quantify the epistemic uncertainty due to the velocity model, in empirically based ground motion estimates for the SFBA.

58 GEOSCIENCES↗
DOE OSTI2026

Seasonal performance evaluation of zero-superheat active refrigerant charge control for variable-speed heat pumps

Heat pumps account for a significant portion of electricity consumption in buildings, making their energy efficiency a critical area of research. Control optimization is recognized as an effective approach for enhancing the efficiency of building HVAC systems. Specifically, since the efficiency of heat pumps increases with reduced superheat and the optimal refrigerant charge level varies with operating conditions, zero-superheat active charge control is a promising strategy to maximize the system’s COP. However, due to its complexity, this control strategy remains in the research phase and has only been tested under limited operating conditions. This paper proposes a methodology to evaluate the seasonal performance improvement of zero-superheat active charge control across a full range of heating conditions in buildings. The methodology includes the development of an optimal controller that utilizes an accumulator to store excess refrigerant and manages the active charge level at zero superheat through subcooling control, as well as the creation of a detailed physics-based heat pump model. Targeted a 3-ton variable-speed heat pump with R410A refrigerant, we selected ten U.S. cities representing different climate regions for seasonal performance evaluation. Our simulations indicate that, depending on the climate conditions, the optimal control strategy could achieve energy savings ranging from 5.8 % to 8.0 % over the entire heating season. These results suggest that zero-superheat active charge control, combined with coordinated compressor and fan speeds, could substantially improve the energy efficiency of heat pump systems while maintaining the required heating capacity.

Guo, Fangzhou↗
DOE OSTI2023

Performance Evaluation of Next-Generation Grid Automation and Controls with High PV Penetration

This paper presents a hardware-in-the-loop (BIL) simulation to evaluate the performance of an advanced grid automation architecture, referred to as data-enhanced hierarchical control (DEHC), in achieving voltage regulation and conservation voltage reduction (CVR) in distribution networks with very high photovoltaic (PV) generation. This architecture comprises an advanced distribution management system (ADMS), a distributed energy resource management system (DERMS), and grid-edge devices working synergistically to provide the grid benefits. The HIL setup used for the evaluation includes ADMS, DERMS, and grid-edge devices. The DEHC performance is evaluated in two representative scenarios considering loose and tight constraints of the power factor at the substation. The results show that the DEHC architecture is effective in achieving voltage regulation and CVR and thus enables the grid integration of high levels of PV generation.

ADMS↗
DOE OSTI2021

Voltage Regulation Performance Evaluation of Distributed Energy Resource Management via Advanced Hardware-in-the-Loop Simulation

This paper evaluates the performance of coordinated control across advanced distribution management systems (ADMS), distributed energy resources (DERs), and distributed energy resource management systems (DERMS) using an advanced hardware-in-the-loop (HIL) platform. This platform provides a realistic laboratory testing environment, including accurate dynamic modeling of a real-world distribution system from a utility partner, real controllers (ADMS and DERMS), physical power hardware (DERs), and standard communications protocols. One grid service—voltage regulation—is evaluated to show the performance of the coordinated grid automation system. The testing results demonstrate that the coordinated DERMS and ADMS system can effectively regulate system voltages within target operation limits using DERs. The realistic laboratory HIL testing results give utilities confidence in adopting the grid automation systems to manage DERs to achieve system-level control and operation objectives (e.g., voltage regulation). This helps utilities mitigate potential risks (e.g., instability) prior to field deployment.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Design and Performance Evaluation of a Resistive Control Using a Hydraulic PTO System for the TALOS Wave Energy Converter

This study is focused on developing a numerical model to evaluate the performance of a hydraulic PTO system for the TALOS Wave Energy Converter. The WEC device is described and the architecture of the hydraulic PTO system is presented with detail. The WEC is modeled using WEC-Sim, and the PTO is modeled using the Simscape Fluids library from Simulink. The hydraulic PTO is based on a constant pressure configuration that is suitable for WEC passive control. The hydraulic system is composed by a set of rectifying valves and two hydraulic accumulators that reduce the stiffness of the system and also serve as energy storage devices. One of the advantages of this hydraulic PTO architecture is the possibility of controlling the electric generator to operate around the optimal efficiency operating point. The main components of the hydraulic PTO are off-the-shelf devices that are commercially available, which will facility a future deployment of the designed system. The design variables used for this study are the accumulator size, the maximum pressure in the accumulators, the hydraulic motor maximum displacement, and the shaft speed in the electric generator. The performance of the system is evaluated individually, using sinusoidal inputs that replicates regular wave conditions. In addition to this, the numerical model of the PTO is coupled to a WEC-Sim simulation of the TALOS Wave Energy Converter with six PTOs to generate a wave-to-wire model. The main objective of this work is to present a comprehensive design methodology that could serve as a guideline for future research efforts focused on implementing control algorithms on multi degree of freedom WECs.

hydraulic systems↗
DOE OSTI2025

MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models

Mixture of Experts (MoE) models have enabled the scaling of Large Language Models (LLMs) and Vision Language Models (VLMs) by achieving massive parameter counts while maintaining computational efficiency. However, MoEs introduce several inference-time challenges, including load imbalance across experts and the additional routing computational overhead. To address these challenges and fully harness the benefits of MoE, a systematic evaluation of hardware acceleration techniques is essential. We present MoE-Inference-Bench, a comprehensive study to evaluate MoE performance across diverse scenarios. We analyze the impact of batch size, sequence length, and critical MoE hyperparameters such as FFN dimensions and number of experts on throughput. We evaluate several optimization techniques on Nvidia H100 GPUs, including pruning, Fused MoE operations, speculative decoding, quantization, and various parallelization strategies. Our evaluation includes MoEs from the Mixtral, DeepSeek, OLMoE and Qwen families. The results reveal performance differences across configurations and provide insights for the efficient deployment of MoEs.

Chitty-Venkata, Krishna Teja↗
DOE OSTI2023

Aviation Mission Profile Performance Evaluation in a High Specific Power Surface Permanent Magnet Machine with Additively Manufactured Coils and Integrated Heat Pipes

The purpose of this paper is to accurately evaluate the performance and overall efficiency of an electrical machine driving a propeller (as a part of a hybrid or electric propulsion system) during the flight mission profile using electromagnetic-thermal simulations. The study focuses on a 250 kW, 5000 rpm, 1.25 kHz, 36/30 slot/pole surface permanent magnet (SPM) machine with additively manufactured (AM) hollow conductors and integrated heat pipes (HP). The machine drive parameters (frequency, and current) are tuned to maximize the efficiency for a given flight cycle, while providing the highest specific power (SP) during takeoff. Afterward using Multiphysics simulations, the transient thermal behavior of the machine is studied and temperature profile for different parts of the machine is extracted. Finally, steady-state temperatures during cruising are estimated and overall efficiency is re-evaluated.

additive manufacturing↗
DOE OSTI2025

Comparative Performance Evaluation of Large Language Models for Extracting Molecular Interactions and Pathway Knowledge

Understanding the interactions and regulatory relationships among biomolecules is essential for deciphering complex biological systems and elucidating the mechanisms behind diverse biological functions. Traditionally, the collection of such molecular interaction data has relied on expert curation, a process that is both time-consuming and labor-intensive. To address these limitations, this study explores the use of large language models (LLMs) to automate the genome-scale extraction of molecular interaction knowledge. Here, we evaluate the performance of various LLMs on key biological tasks, including the identification of protein-protein interactions, detection of genes associated with pathways influenced by low-dose radiation, and inference of gene regulatory relationships. Our findings demonstrate that larger LLMs tend to perform better, particularly in extracting intricate gene and protein interactions. Despite their strengths, these models face challenges in recognizing functionally diverse gene groups and highly correlated regulatory relationships. Through a comprehensive analysis using established molecular interaction and pathway databases, we show that LLMs possess the potential to identify relevant biomolecules and predict their interactions, offering valuable insights and marking a significant step toward AI-driven biological knowledge discovery.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
DOE OSTI2020

Performance Evaluation of Data-Enhanced Hierarchical Control for Grid Operations

This paper presents a hardware-in-the-loop (HIL) simulation to evaluate the performance of voltage regulation of Data-Enhanced Hierarchical Control (DEHC). This DEHC uses an advanced distribution management system (ADMS) for grid operations to control legacy and grid-edge devices and coordinate with distributed energy management systems (DERMS) to manage high penetrations of photovoltaics (PV) on a utility distribution system. The HIL platform provides realistic laboratory testing, including accurate modeling (legacy devices, grid-edge devices, and PV) of the real-world distribution system from a utility partner, a real controller (ADMS), software controller DERMS, hardware grid-edge devices, and standard communications protocols. The test results demonstrate functionalities of the integrated platform and the performance of voltage regulation of the coordinated control systems. Based on laboratory testing, the utility can set up the same grid-automation system to manage DERs, legacy devices, and grid-edge devices to achieve their system-level control and operation objectives (e.g., voltage regulation), thus de-risking potential issues such as instability for field deployment.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2024

Development and performance evaluation of active insulation systems using solid-state thermal switches

Traditional building envelopes have passive insulation systems that cannot respond to dynamic changes in the environment. An Active Insulation System (AIS) consists of Active Insulation Materials (AIMs) that dynamically vary the thermal conductivity of the insulation system. Several researchers have evaluated the impact of AIS on building thermal and energy performance by using simulation tools. Up to 70% savings in annual heating and cooling energy and significant reductions in peak demand have been predicted for some climates with wall systems employing AIS. However, materials and assembly development still need a cost-effective product that achieves the required performance. Here, in this study, we present the process of developing an AIS that we will install in a test hut for its performance evaluation. Minimum performance criteria of the AIS system are developed based on R-low/R-high ratio, required time and efficiency to switch states, and cost estimates. The following steps during this study are creating the concept to meet the requirements, predicting the performance via simulations, developing the experimental setup for bench-scale testing, and finally, constructing a full-scale wall assembly and monitoring the performance when exposed to environmental chamber tests. The selected approach uses off-the-shelf products to create an AIS that can switch R-value between 0.98 ft 2 ·°F·h/BTU (0.173 m 2 ·K/W) and 5.81 ft 2 ·°F·h/BTU (1.02 m 2 ·K/W) and have a switching time of less than one minute between R-high and R-low.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Development and Performance Evaluation of of Active Insulation Systems using Solid-State Thermal Switches

Traditional building envelopes have passive insulation systems that cannot respond to dynamic changes in the environment. An Active Insulation System (AIS) consists of Active Insulation Materials (AIMs), which dynamically vary the thermal conductivity of the insulation system. Several researchers have evaluated the impact of AIS on building thermal and energy performance by using simulation tools. Up to 70% savings in annual heating and cooling energy and significant reductions in peak demand have been predicted for some climates with wall systems employing AIS. Sensitivity studies have provided requirements for the AIS properties and control schemes that can lead to those savings. However, materials and assembly development have not yet achieved a cost-effective product that achieves the required performance. In this study, we present the process to develop an AIS that we will install in a test hut for their performance evaluation. Minimum performance criteria of the AIS system are developed based on Rmin/Rmax ratio, required time and efficiency to switch states and cost estimate. The next step carried out during this study is creating the concept to meet the requirements, predicting the performance by simulations, developing the experimental setup for bench-scale testing, and finally, constructing a full-scale wall assembly and monitoring the performance when exposed to natural weather conditions. The selected approach uses off-the-shelf products to create a materials system that can switch R-value between R~=1 ft2·°F·h/BTU (0.18 m2·K/W) and R~=7 ft2·°F·h/BTU (1.23 m2·K/W and have a switching time of less than one minute between R-high and R-low.

Iffa, Emishaw↗
DOE OSTI2025

Benchmark of numerical modeling approaches on the systematic performance evaluation of wave energy converters

Different numerical modeling methods have been developed and applied to evaluate a variety of performance indicators of wave energy converters (WECs), including the power performance, structural loads, levelized cost of energy, etc. Based on the modeling fidelity, the commonly used numerical modeling approaches can be classified as linear modeling, weakly nonlinear modeling and fully nonlinear modeling approaches. Each method differs in accuracy and computational efficiency, making them suitable for different stages of WEC design. However, the selection of modeling approach could significantly impact evaluation outcomes. For instance, simplified linear models may underestimate structural loads or overestimate energy production in some operational conditions, potentially leading to less cost-effective designs. Given the widespread utilization of these models, it is essential to understand the uncertainties brought by them in performance evaluations. This work is dedicated to benchmarking different linear-potential-flow-based numerical models for evaluating the systematic performance of WECs. Three representative numerical modeling approaches are considered in this work, including linear frequency-domain modeling, statistically linearized spectral-domain modeling and Cummins equation-based nonlinear time-domain modeling. A generic point absorber WEC is considered as the research reference in this work, and different sea sites are taken into account. The numerical models are utilized to predict critical performance indicators, including power performance, the annual energy production, the capacity factor, the levelized cost of energy and the PTO fatigue loads. By comparing the results, this work identifies the uncertainties associated with different modeling approaches in evaluating WEC performance.

Fatigue↗