Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Entanglement Throughput Measurements and Capacity Estimates for Aerial-Inground Fiber

The throughput of entangled qubit pairs per second (eqps) is a basic performance metric of quantum networks that provide the entanglement distribution capability. Over fiber connections, it is measured using specialized instruments, including photonic entanglement sources and single-photon detectors. Extensive theory has been developed to estimate the capacity of a generic quantum channel, which in turn is applied to estimate the maximum achievable eqps over a fiber connection. However, there is a gap in relating these two performance metrics, in part due to their disparate nature, namely, mathematical formulae of the channel capacity and specialized instrumentation for eqps measurements. We describe eqps measurements collected over testbed connections composed of aerial and inground fiber of lengths up to 45 km. We estimate the normalized capacity using the transmissivity parameter derived from single photon detector measurements. These estimates are then converted to capacity bounds on the connection's eqps using the source eqps rate derived from co-located detector measurements. The results indicate a consistency between eqps measurements and their capacity estimates, and provide insights into relating the parameters of analytic capacity estimates to physical measurements.

Rao, Nageswara [ORNL] (ORCID:0000000234085941)↗
DOE OSTI2026

Examples of State and Utility Actions on Proactive Planning and Investments

As states across the U.S. confront rising electricity demand, clean energy deployment, grid modernization imperatives, and the integration of large new loads, some regulators and utilities are shifting away from reactive, “just-in-time” investment approaches toward more proactive planning and investment frameworks. This report compiles examples of jurisdictional and utility actions that reshape planning processes, cost recovery mechanisms, and performance oversight to anticipate—rather than simply respond to—future grid needs. Several themes emerge from state actions examined in this report. First, legislatures and commissions are increasingly directing utilities to proactively upgrade their distribution and transmission systems, reflecting a shift toward a forward-looking system that aligns planning with state policy goals. Second, states are establishing long-term, iterative planning frameworks that often feature multi-year horizons, biannual or annual compliance reporting, structured opportunities for stakeholder engagement, and emphasis on collaboration among utilities, regulators, and stakeholders. Third, states are actively investigating innovative cost recovery mechanisms designed to support accelerated electrification and grid modernization, while balancing consumer advocates’ concerns regarding the ratepayer financial risks of premature investments. Fourth, performance metrics and reporting requirements are being developed to ensure transparency and accountability for proactive investments. Fifth, methodological improvements in planning—such as aligning load forecasting assumptions, incorporating sensitivities, and considering load management potential across building, vehicles, storage, and demand response—are recurring areas of stakeholder focus across jurisdictions. Overall, these developments signify a growing recognition among state regulators, utilities, and stakeholders that proactive planning—supported by clear definitions, consistent and transparent methodologies, robust performance metrics, and innovative cost recovery mechanisms—is a tool that can be used to address the scale and urgency of contemporary grid needs.

electricity market↗
DOE OSTI2024

Degradation of performance in ICF implosions due to Rayleigh–Taylor instabilities: A Hamiltonian perspective

The Rayleigh–Taylor instability (RTI) is an ubiquitous phenomenon that occurs in inertial-confinement-fusion (ICF) implosions and is recognized as an important limiting factor of ICF performance. To analytically understand the RTI dynamics and its impact on ICF capsule implosions, we develop a first-principle variational theory that describes an imploding spherical shell undergoing RTI. The model is based on a thin-shell approximation and includes the dynamical coupling between the imploding spherical shell and an adiabatically compressed fluid within its interior. Using a quasilinear analysis, we study the degradation trends of key ICF performance metrics (e.g., stagnation pressure, residual kinetic energy, and areal density) as functions of initial RTI parameters (e.g., the initial amplitude and Legendre mode), as well as the 1D implosion characteristics (e.g., the convergence ratio). We compare analytical results from the theory against nonlinear results obtained by numerically integrating the governing equations of this reduced model. Our findings emphasize the need to incorporate polar flows in the calculation of residual kinetic energy and demonstrate that higher convergence ratios in ICF implosions lead to significantly greater degradation of key performance metrics.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Performance Evaluation of Vertical Federated Machine Learning Against Adversarial Threats on Wide-Area Control System: Preprint

Federated machine learning (FL) is gaining significant popularity to develop cybersecurity solutions in power grids because of its advanced capability to support decentralized data handing at local devices, its privacy preservation, and its low-bandwidth requirement. However, the evolving adversarial machine learning (AML) threats raise significant concerns for the cybersecurity of FL architectures. The FL-based split neural network (SplitNN) achieves high performance through the decentralized training of local neural network models while preserving data privacy across multiple entities. In this paper, we propose a methodology for evaluating the performance of a vertical FLbased anomaly detector against different types of AML attacks, including denial-of-service attacks, adversarial data injection attacks, and replay attacks on the trained local models deployed in the grid network. For a case study, we consider the modified IEEE 13-bus system, and we develop SplitNN-based binary and multiclass classification models to detect, locate, and identify different types of data integrity attacks on the volt-watt control with two pooling layers: maximum pooling and AvgPool. Our experimental results, computed through performance metrics, reveal that the severity of these AML attacks varies with the integrated pooling mechanism, the type of classification model, and the nature of the cyberattack. Further, the AML attacks negatively impacted the prediction time per sample for the pretrained SplitNN during the online testing.

adversarial threats↗
DOE OSTI2025

IBPSA Project 2 BOPTEST: An update on the test cases available in the framework for testing advanced control strategies in buildings

Project 2 develops software infrastructure, test cases, and extensions for the Building Optimization Testing Framework (BOPTEST) to address the expanding needs of building and urban energy system controls through open international collaboration. This paper provides an overview of the new test cases available as of BOPTEST version 0.7.1. Each test case is developed using open-source Modelica libraries and Spawn of EnergyPlus, enabling the creation of high-fidelity building models that incorporate envelope dynamics, Heating Ventilation and Air Conditioning (HVAC) systems, and explicit control representations. Currently, eight test cases are available, with five additional cases under development. These test cases cover a wide range of climates, building types, and HVAC systems. This paper compiles and summarizes test case descriptions, cites original manuscripts that developed them for a more detailed description, and reports baseline control performance metrics. Furthermore, two example applications are presented: one illustrating different levels of control, from supervisory to low-level, and another demonstrating how Model Predictive Control (MPC) solutions must be adapted from continuous to integer to control some building actuators.

Zanetti, Ettore↗
DOE OSTI2024

DOE BSSD Performance Management Metrics Report Q3

Microbiome data is complex, spanning information from microbial genomes within diverse communities, protein and metabolite readouts, and contextual information (metadata) captured from the environments from which these samples were collected. While the variety and scale of microbiome data generation has dramatically expanded over the past twenty years, infrastructure to support data management, sharing, and access has lagged. New ways to improve interoperability across existing resources and advancing community standards are necessary to support how researchers create, use, and reuse data. The National Microbiome Data Collaborative (NMDC) aims to advance a microbiome data sharing network through infrastructure, data standards, and community building.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Techno-Economic Assessments of Second-Life Batteries for Electric Vehicle Charging Stations

When electric vehicle (EV) batteries degrade below a certain capacity, they may no longer be suitable for automotive use but can be repurposed as second-life batteries (SLBs) for other applications, such as EV charging stations. When integrated with photovoltaic (PV) systems, SLB can store surplus solar energy, reducing reliance on the grid and lowering operational costs. This paper presents a novel techno-economic assessment framework for deploying SLBs in combination with PV in grid-connected EV charging stations. The proposed framework integrates the value proposition, charging station operation, optimal dispatch strategies, battery degradation modeling, input data requirements, and detailed procedures for generating key economic performance metrics. Insightful analyses are performed to assess the performance of SLBs in comparison to new batteries across various cost scenarios. The results indicate that SLBs become financially attractive when their cost is 40% or lower than new batteries.

energy storage↗
DOE OSTI2025

Factorization Machine‐Based Active Learning for Functional Materials Design with Optimal Initial Data

The optimization of functional materials is important to enhance their properties, but their complex geometries pose great challenges to optimization. Data-driven algorithms efficiently navigate such complex design spaces by learning relationships between material structures and performance metrics to discover high-performance functional materials. Surrogate-based active learning, continually improving its surrogate model by iteratively including high-quality data points, has emerged as a cost-effective data-driven approach. Furthermore, it can be coupled with quantum computing to enhance optimization processes, especially when paired with a special form of surrogate model (i.e., quadratic unconstrained binary optimization), formulated by factorization machine (FM). However, current practices often overlook the variability in design space sizes when determining the initial data size for optimization. In this work, we investigate the optimal initial data sizes required for efficient convergence across various design space sizes. By employing averaged piecewise linear regression, we identify initiation points where convergence begins, highlighting the crucial role of employing adequate initial data in achieving efficient optimization. These results contribute to the efficient optimization of functional materials by ensuring faster convergence and reducing computational costs in FM-based active learning.

active learning↗
DOE OSTI2025

Aging matrix visualizes complexity of battery aging across hundreds of cycling protocols

To reliably deploy lithium-ion batteries, a fundamental understanding of cycling aging behavior is critical. Battery aging consists of complex and highly coupled phenomena, making it challenging to develop a holistic interpretation. In this work, we generate a diverse battery cycling dataset with a broad range of degradation trajectories, consisting of 359 high energy density commercial Li(Ni,Co,Al)O 2 /graphite + SiO x cylindrical 21 700 cells cycled across 207 unique cycling protocols. We consolidate aging via 16 mechanistic state-of-health (SOH) metrics, including cell-level performance metrics, electrode-specific capacities/state-of-charges (SOCs), and aging trajectory metrics. We develop a framework using interpretable machine learning and explainable features to generate an aging matrix that visually deconvolutes the complex battery degradation behavior. This generalizable data-driven mechanistic framework simplifies the complex interplay between cycling conditions, degradation modes, and SOH, acting as a hypothesis-generation tool to aid battery users in identifying key degradation regimes for further study and experimentation.

25 ENERGY STORAGE↗
DOE OSTI2024

Investigating resource-efficient neutron/gamma classification ML models targeting eFPGAs

There has been considerable interest and resulting progress in implementing machine learning (ML) models in hardware over the last several years from the particle and nuclear physics communities. A big driver has been the release of the Python package, hls4ml, which has enabled porting models specified and trained using Python ML libraries to register transfer level (RTL) code. So far, the primary end targets have been commercial field-programmable gate arrays (FPGAs) or synthesized custom blocks on application specific integrated circuits (ASICs). However, recent developments in open-source embedded FPGA (eFPGA) frameworks now provide an alternate, more flexible pathway for implementing ML models in hardware. These customized eFPGA fabrics can be integrated as part of an overall chip design. In general, the decision between a fully custom, eFPGA, or commercial FPGA ML implementation will depend on the details of the end-use application. In this work, we explored the parameter space for eFPGA implementations of fully-connected neural network (fcNN) and boosted decision tree (BDT) models using the task of neutron/gamma classification with a specific focus on resource efficiency. We used data collected using an AmBe sealed source incident on Stilbene, which was optically coupled to an OnSemi J-series silicon photomultiplier (SiPM) to generate training and test data for this study. We investigated relevant input features and the effects of bit-resolution and sampling rate as well as trade-offs in hyperparameters for both ML architectures while tracking total resource usage. The performance metric used to track model performance was the calculated neutron efficiency at a gamma leakage of 10 -3 . The results of the study will be used to aid the specification of an eFPGA fabric, which will be integrated as part of a test chip.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

SITCOMTN-154: Initial studies of photometric redshifts with LSSTComCam from DP1

This technote holds reports based on the first analyses of the Data Preview 1 (DP1) data by the Science Unit for photometric redshifts. Although photometric redshifts are not an official DP1 data product, the "Photo-z Science Unit" generated photo-z estimates for every galaxy in DP1 using the available multi-band imaging on a best-effort basis. This work included developing training and test datasets by matching DP1 data to high-quality reference redshifts obtained with spectroscopy, Grism data, and multi-band photometry. The Science Unit used the RAIL software package to make photometric redshift estimates using eight different algorithms, developed simple scientific performance metrics, used those metrics to explore how the performance of the algorithms varied with configuration changes, derived more optimized configurations of the algorithms and tested the performance of those configurations. This work, the resulting data products and expected data distribution mechanism are all described there.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Resilience Metrics Framework for Solar Photovoltaics

This presentation was given at the Photovoltaic Specialist Conference (PVSC) 54 in New Orleans, Louisiana. Photovoltaic (PV) systems are routinely exposed to extreme weather, including wind and hail storms. Historically, most systems have proven to be resilient to such events, but some storms have damaged PV systems, leading to physical and financial loss. Storm hardening measures and specific system attributes can reduce this risk. This work introduces a set of resilience metrics and a framework for quantifying, comparing, and predicting PV system resilience. The framework is divided into two parts: 1) predictive, attribute metrics based on site and component characteristics, and 2) impact metrics that assess post-storm performance. Metrics are weighted and aggregated, producing hazard-specific resilience scores. We derive damage functions from storm-impacted PV systems, establishing a baseline against which post-storm performance can be compared. This damage was widely variable across hail and wind intensities, and field hail damage was less than predicted by laboratory tests, suggesting that system features - in addition to storm conditions - influence damage likelihood. Finally, the metrics framework is demonstrated using three case studies of storm damaged PV systems. Although additional data are needed to create attribute specific damage functions and establish metric weights, this study presents a methodology for evaluating PV resilience and contributes new damage functions to the literature.

14 SOLAR ENERGY↗
DOE OSTI2025

Electrolyte Immersion Increases Photoconductivity in a Model Polymer Photocathode

Immersing polymer solar cells in aqueous electrolyte for photoelectrochemical (PEC) hydrogen production is likely to cause photophysical changes that could present both challenges and opportunities for engineering functional and durable devices. Herein we study the bulk heterojunction blend poly(4,8-bis(5-(2-ethylhexyl)thiophen-2-yl)benzo[1,2-b:4,5-b']dithiophene-2,6-diyl)-alt-(2-(((2-ethylhexyl)oxy)carbonyl)-3-fluorothieno[3,4-b]thiophene-4,6-diyl):poly(N,N'-di(2-octyldodecyl)naphthalene-1,8:4,5-bis(dicarboximide)-2,6-diyl)-alt-(2,2-bithiophene-5,5'-diyl) (PTB7-Th:N2200) excited-state dynamics in electrolyte from femtosecond to millisecond time scales using pump-probe microwave conductivity and absorption spectroscopy. While the blend swells very little, electrolyte exposure increases the microwave-frequency mobility and possibly the yield of photogenerated charges while also decreasing crystallinity. These results indicate an enhancement in key performance metrics, implying that any limitations on the performance of PEC test devices do not arise from active layer-electrolyte interactions. For the PTB7-Th:N2200 blend or similar photocathode systems, our results indicate that improving the interfacial kinetics and/or the carrier lifetime should be prioritized, not protecting the active layer from the electrolyte. Since this observation may not be universal to all polymer systems, future research should focus on identifying their limiting photophysical processes. electrolyte.

14 SOLAR ENERGY↗
DOE OSTI2026

ARM Data-Oriented Metrics and Diagnostics Package for Climate Model Evaluation

A Python-based metrics and diagnostics package is currently being developed by the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Infrastructure Team at Lawrence Livermore National Laboratory (LLNL) to facilitate the use of long-term, high-frequency measurements from the ARM Facility in evaluating the regional climate simulation of clouds, radiation, and precipitation. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data. The Coupled Model Intercomparison Project (CMIP) model data sets are also included in the package to enable model intercomparison as demonstrated in Zhang et al. (2017). The mean of the CMIP model can serve as a reference for individual models. Basic performance metrics are computed to measure the accuracy of mean state and variability of climate models. The evaluated physical quantities include cloud fraction, temperature, relative humidity, cloud liquid water path, total column water vapor, precipitation, sensible and latent heat fluxes, and radiative fluxes, with plan to extend to more fields, such as aerosol and microphysics properties. Process-oriented diagnostics focusing on individual cloud- and precipitation-related phenomena are also being developed for the evaluation and development of specific model physical parameterizations. The version 1.0 package is designed based on data collected at ARM’s Southern Great Plains (SGP) Research Facility, with the plan to extend to other ARM sites. The metrics and diagnostics package is currently built upon standard Python libraries and additional Python packages developed by DOE (such as CDMS and CDAT). The ARM metrics and diagnostic package is available publicly with the hope that it can serve as an easy entry point for climate modelers to compare their models with ARM data. In this report, we first present the input data, which constitutes the core content of the metrics and diagnostics package in section 2, and a user's guide documenting the workflow/structure of the version 1.0 codes, and including step-by-step instruction for running the package in section 3.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Power-Capping Metric Evaluation for Improving Energy Efficiency in HPC Applications

With high-performance computing systems now running at exascale, optimizing power-scaling management and resource utilization has become more critical than ever. This paper explores runtime power-capping optimizations that leverage integrated CPU-GPU power management on architectures like the NVIDIA GH200 superchip. We evaluate energy-performance metrics that account for simultaneous CPU and GPU power-capping effects by using two complementary approaches: speedup-energy-delay and a Euclidean distance-based multi-objective optimization method. By targeting a mostly compute-bound exascale science application, the Locally Self-Consistent Multiple Scattering (LSMS), we explore challenging scenarios to identify potential opportunities for energy savings in exascale applications, and we recognize that even modest reductions in energy consumption can have significant overall impacts. Our results highlight how GPU task-specific dynamic power-cap adjustments combined with integrated CPU-GPU power steering can improve the energy utilization of certain GPU tasks, thereby laying the groundwork for future adaptive optimization strategies.

Patrou, Maria [ORNL] (ORCID:0000000339754638)↗
DOE OSTI2024

Performance Evaluation of a Single-Phase Grid-Forming Inverter Through Hardware Experiments: Preprint

Existing state-of-the-art of single-phase grid-forming (GFM) inverter are primarily focused on electromagnetic transient simulation, and there are very few works performing hardware test, and there is no clear understanding how the single-phase GFM inverter should behave from a hardware perspective. Therefore, this paper addresses the gap by performing hardware experiment to evaluate the performance of a single-phase GFM hardware inverter. We enrich the existing GFM testing protocols by investigating transient performance of GFM inverters under different grid dynamic events, and quantifiable performance metrics are made to have a common understanding of expected performance of single-phase GFM inverters. A commercial single-phase GFM inverter is used to verify the test protocols and understand the inverter's performance and functionalities.

dynamic events↗
DOE OSTI2025

EVs@Scale Next-Gen Profiles - Fleet Utilization 2024

As part of the U.S. Department of Energy’s EVs@Scale initiative, the Next-Gen Profiles (NGP) project provides a comprehensive, data-driven analysis of electric vehicle (EV) and electric vehicle supply equipment (EVSE) operations across real-world fleet deployments. This paper presents findings from the NGP’s Fleet Utilization study, which investigates operational behavior and asset usage across seventeen EV fleets and two EVSE fleets, encompassing a wide range of vehicle types and use cases. Data collected from diverse sources—varying in format and temporal resolution—are first reformatted into a unified structure. From this harmonized dataset, a suite of rigorously defined performance metrics is calculated at an hourly cadence, enabling consistent cross-comparison of charging, routing, and other key operational behaviors. Amid rapidly increasing EV adoption and growing demands for energy-efficient fleet operations, the analysis reveals clear utilization trends—including diurnal and weekly activity cycles, differences in short versus long charging session dependencies, and route-specific energy usage patterns. These findings highlight the need for tailored infrastructure strategies and the deployment of advanced energy management systems, such as Distributed Energy Resource Management Systems (DERMS) and Site Energy Management Systems (SEMS), which can optimize charging schedules and mitigate peak loads. By leveraging anonymized, harmonized datasets and standardized metrics, this study offers critical insights into fleet behavior and performance, providing a foundation to improve operational efficiency, reduce costs, and enable the scalable deployment of electrified transportation.

Wells, Landon↗
DOE OSTI2026

Membranes for Lithium Recovery From Conventional and Unconventional Sources

Lithium has been deemed a critical mineral of national importance that finds uses in a wide range of applications, and its demand has been rising significantly in recent years. The urgency of meeting this demand requires lithium extraction from various aqueous sources such as continental brines, geothermal brines, seawater, produced water, and battery waste. While direct lithium extraction (DLE) technologies such as adsorption, ion exchange, and solvent extraction have emerged as possible solutions, membrane technologies are also being investigated for various sources and at different stages of the recovery process. Here, we analyze the application of membranes for pretreatment of lithium source waters, bring management, lithium/magnesium separation, lithium/sodium separation, and lithium hydroxide conversion, and evaluate performance metrics for critical lithium separations from the literature. We explore the potential of membranes at every stage of the recovery process and describe their current status and future prospects. We describe hypothetical process trains with integrated membrane technologies for each source type and address their feasibility and challenges. The potential energy and water impacts of membrane-integrated and conventional DLE processes are also critically considered alongside performance and selectivity metrics, and this is illustrated using examples and calculated from published technical reports. This paper thus provides a comprehensive overview of the application of membranes along every stage of the lithium recovery process, emphasizing the versatility and potential of membrane technologies for critical mineral recovery.

36 MATERIALS SCIENCE↗