Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Integrated Metrics for County-Level Resilience Ranking Using Entropy and TOPSIS

In the face of atypical weather events, power infrastructure failures, and limited resources for resilience investment, energy decision-makers need data-driven metrics to allocate resilience investments and maximize the reduction of power outage impacts. For state-level planning, for instance, ranking the resilience of each county is key to ensuring effective distribution of resources. In such cases, resilience for each spatial unit is multifaceted and is captured by a set of indicators (i.e., metrics) that can be combined into an overall score that reduces the complexity of power outage dynamics to a single decision metric. However, weighting of these indicators is often addressed by simplifying assumptions (i.e., equal weights) or semi-subjective methods that rely on user-defined weights that can introduce biases (e.g., weighted average score). Within the disaster risk reduction and resilience engineering community, a recurring challenge in multicriteria decision-making is the objective weighting of indicators for composite indices. To address this issue, we have leveraged a Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) combined with an entropy-based weighting approach to calculated the integrated scores. This method objectively determines the importance of each metric, better discerns between spatial units (i.e., counties), and offers a more reliable ranking of counties according to their relative resilience attributes. By improving methods for integrating resilience indicators, our approach helps planners and decision-makers prioritize resources more effectively for more efficient resilience investments.

Bhusal, Narayan [Oak Ridge National Laboratory (OR↗
DOE OSTI2025

Bridging the Gap on Data, Metrics, and Analyses for Grid Resilience to Weather Events: Information that utilities can provide regulators, state energy offices, and other stakeholders

A growing number of states require regulated utilities to file resilience plans to improve the electric grid’s ability to anticipate, withstand, adapt to and recover from increasingly severe weather events. This report aims to help state regulators identify and request data, metrics, and analyses from utilities and use it in decisions on utility resilience plans and investments. The report reviews state requirements and utility plans focused on overall grid resilience, climate change resilience and vulnerabilities, infrastructure modernization, storm protection, and wildfire mitigation. It details types of data, metrics, and analyses across five categories--and provides examples of each from the utility plans. The first category is vulnerability assessments, or evaluations of the susceptibility of systems, communities, or assets to potential harm from identified hazards. The second is data on hazards and the exposure of utility assets and customers to these hazards. The third is attribute metrics, or system characteristics that contribute to or describe the resilience of a system. The fourth is performance metrics, which are impacts of resilience investments on system performance--typically a reduction of negative impacts from hazard events. Finally, evaluation and prioritization are analyses that utilities conduct to estimate impacts from resilience measures (evaluation) and prioritize measures based on costs and estimated impacts (prioritization). The report concludes with examples of key trends and emerging best practices for states and utilities, and identifies areas for further research.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Near Term Reliability and Resilience: Revisiting Resilience Metrics for the Electric Grid

This report presents the metrics employed in the Near-Term Reliability and Resilience (NTRR) project to study the inter-dependencies between electric and natural gas infrastructures, particularly under challenging conditions. These metrics were developed and applied to evaluate the reliability and resilience of the electric grid and natural gas systems in near-term scenarios (within the next 10 years) involving extreme weather events and major supply disruptions. The report defines the metrics, explains how they are calculated, and describes the process by which they are used to evaluate reliability and resilience across simulated scenarios. It also demonstrates how the resilience metrics integrate with other project activities and summarizes the software tools deployed to calculate and visualize the results.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

ARM-IRL: Adaptive Resilience Metric Quantification Using Inverse Reinforcement Learning

The resilience of safety-critical systems is gaining importance due to the rise in cyber and physical threats, especially within critical infrastructure. Traditional static resilience metrics may not capture dynamic system states, leading to inaccurate assessments and ineffective responses to cyber threats. This work aims to develop a data-driven, adaptive method for resilience metric learning. We propose a data-driven approach using inverse reinforcement learning (IRL) to learn a single, adaptive resilience metric. The method infers a reward function from expert control actions. Unlike previous approaches using static weights or fuzzy logic, this work applies adversarial inverse reinforcement learning (AIRL), training a generator and discriminator in parallel to learn the reward structure and derive an optimal policy. The proposed approach is evaluated on multiple scenarios: optimal communication network rerouting, power distribution network reconfiguration, and cyber–physical restoration of critical loads using the IEEE 123-bus system. The adaptive, learned resilience metric enables faster critical load restoration in comparison to conventional RL approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models

We present a new atmospheric river (AR) analysis and benchmarking tool, namely Atmospheric River Metrics Package (ARMP). It includes a suite of new AR metrics that are designed for quick analysis of AR characteristics via statistics in gridded climate datasets such as model output and reanalysis. This package can be used for climate model evaluation in comparison with reanalysis and observational products. Integrated metrics such as mean bias and spatial pattern correlation are efficient for diagnosing systematic AR biases in climate models. For example, the package identifies the fact that, in CMIP5 and CMIP6 (Coupled Model Intercomparison Project Phases 5 and 6) models, AR tracks in the South Atlantic are positioned farther poleward compared to ERA5 reanalysis, while in the South Pacific, tracks are generally biased towards the Equator. For the landfalling AR peak season, we find that most climate models simulate a completely opposite seasonal cycle over western Africa. This tool can also be used for identifying and characterizing structural differences among different AR detectors (ARDTs). For example, ARs detected with the Mundhenk algorithm exhibit systematically larger size, width, and length compared to the TempestExtremes (TE) method. The AR metrics developed from this work can be routinely applied for model benchmarking and during the development cycle to trace performance evolution across model versions or generations and set objective targets for the improvement of models. They can also be used by operational centers to perform near-real-time climate and extreme event impact assessments as part of their forecast cycle.

58 GEOSCIENCES↗
DOE OSTI2026

A review of energy storage for power system resilience: Functions, metrics, and applications

Aging infrastructure, increasing operational complexity, and surging electricity demand from artificial intelligence and electrification are straining the grid and heightening the risks of disruptions, making resilience a critical priority. Energy storage is increasingly deployed to provide critical power supply, fast grid support, and rapid restoration. However, current practice lacks consistent metrics and systematic methodologies to rigorously quantify the resilience benefits of storage. This paper provides a comprehensive review of energy storage in resilience enhancement, focusing on functional roles, quantification metrics, and integration strategies. A structured resilience metrics library is compiled and categorized to encompass both technical and economic performance aspects. Existing methodologies for resilience-oriented storage planning and operations are critically examined. Key technical and practical challenges are identified, and future research directions are outlined to strengthen storage contributions to grid resilience.

Benefit quantification↗
DOE OSTI2025

Refining seasonal performance metrics for room air-conditioning in emerging markets: Integrating building simulations with real-world equipment performance data

Buildings significantly impact worldwide energy consumption, emphasizing the need to reduce the cooling energy demand, especially in warm climates. Minimum energy performance standards (MEPS) and seasonal performance metrics such as the Cooling Seasonal Performance Factor (CSPF) are crucial for improving room air conditioning (RAC) efficiency. However, challenges remain, particularly in emerging markets like Brazil, where seasonal performance metrics have recently been introduced. This study assesses the factors influencing country-level seasonal efficiency metrics and proposes a framework to refine these calculations by considering local climates and expected RAC usage in real-world households via building simulations. Key considerations include outdoor air temperature binning for different climates, RAC usage patterns (i.e., daytime and nighttime usages), envelope thermal performance of households, and urban heat island (UHI) effects. The results reveal that CSPF values can vary significantly based on climate conditions, with observed CSPF ranging from 4.10 to 11.59 Wh/Wh across 577 Brazilian climates. The inclusion of UHI effects led to a reduction in CSPF values by up to 29% during nighttime operations in hot urban areas. Additionally, building envelope efficiency showed contrasting impacts on RAC performance, with CSPFs reaching up to 15.35 Wh/Wh under specific optimized conditions. These findings highlight the need for transparent policymaking in RAC performance databases, facilitating the application of approaches like those proposed in this study and supporting diverse stakeholders in decision-making.

Bavaresco, Mateus↗
DOE OSTI2026

Inferring performance metrics for laser direct drive experiments on OMEGA

Quantifying performance improvements on the OMEGA laser facility requires robust inference of established no-alpha performance metrics, which requires, at minimum, a model to infer the shocked fuel mass and pressure of the confined fusion plasma. In this work, we describe the methodology used to infer performance metrics on OMEGA and present the current state-of-the art model used to infer these metrics from OMEGA experiments. In particular, since neutron images of cryogenic implosions are not available on OMEGA at present, we present how x-ray sizes are determined on OMEGA using a Gaussian Process regression model and how the neutron production region's size is inferred from them. As a result, we end by benchmarking the model using synthetic data and 1-D LILAC simulations and test its experimental self-consistency across available x-ray diagnostic channels.

Gopalaswamy, V. [Laboratory for Laser Energetics, ↗
DOE OSTI2024

Quantum-metric-induced quantum Hall conductance inversion and reentrant transition in fractional Chern insulators

The quantum metric of single-particle wave functions in topological flat bands plays a crucial role in determining the stability of fractional Chern insulating (FCI) states. Here, we unravel that the quantum metric causes the many-body Chern number of the FCI states to deviate sharply from the expected value associated with partial filling of the single-particle topological flat band. Furthermore, the variation of the quantum metric in momentum space induces band dispersion through interactions, affecting the stability of the FCI states. This causes a reentrant transition into the Fermi liquid from the FCI phase as the interaction strength increases. Published by the American Physical Society 2024

Wu, Ang-Kun (ORCID:0000000270181674)↗
DOE OSTI2025

Direct measurement of the quantum metric tensor in solids

The quantum metric tensor is a central geometric quantity in modern physics that is defined as the distance between nearby quantum states. Despite numerous studies highlighting its relevance to fundamental physical phenomena in solids, measuring the complete quantum metric tensors in real solid-state materials is challenging. In this work, we report a direct measurement of the full quantum metric tensors of Bloch electrons in solids using black phosphorus as a representative material. We extracted the momentum space distribution of the pseudospin texture of the valence band from the polarization dependence of angle-resolved photoemission spectroscopy measurement. Our approach is poised to advance our understanding of quantum geometric responses in a wide class of crystalline systems.

Kim, Sunje↗
DOE OSTI2025

Meta‐Analysis and Regression Modeling of the Impacts of Four Indoor Environmental Quality Metrics on Office Performance

Awareness of how buildings interact with the occupant experience—especially human performance—is becoming more prevalent, as seen by increasing interest and investment in healthy built environments. However, there is a need to synthesize the wide array of existing indoor environmental assessment and performance research in a way that can translate directly to building design and operation. Existing research in this area typically focuses on a single isolated metric and has not focused on making the results utilizable by building practitioners. The aim of this research is to investigate existing office performance literature through meta‐analyses and produce regression models for four indoor environmental quality (IEQ) metrics to support critical decision‐making for building operation and renovation. To reach this aim, a literature review was conducted to identify studies that measure the impact of changing ventilation rate, temperature, horizontal illuminance, and noise level in offices on occupant task performance. This repository of field and laboratory studies was analyzed to visualize the trends between the selected IEQ metrics and task performance. The temperature, ventilation rate, and horizontal illuminance regression models showed clear improvement potential when modifying indoor conditions toward the defined high‐performance range, while the regression model for noise level was inconclusive. The discussion notes the importance of designing holistically for all components of these IEQ categories to utilize the results, for example, good filtration on outdoor air for quantifying ventilation impact and uniform overhead lighting with low contrast for quantifying horizontal illuminance impact. The novelty of this work is in considering multiple facets of the indoor environment under a single, unified analysis schema and producing IEQ‐based performance gains that can directly inform cost‐benefit analyses of building design and renovation.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

NERSC_Lightweight Distributed Metric Service (NERSC_LDMS) v4.4.2

Miscellany This LDMS Loftsman/Helm Chart horizontally scales LDMS daemons in order to achieve a 1Hz sample rate from over 5,000 nodes, collecting 38k metrics per minute on Perlmutter. This LMDS Configuration relies on already running `ldmsd` producers running on nodes, which produce metrics via sampler plugins. The Helm chart distributes the collection of metrics from producer acrross many aggregator and storage `ldmsd` daemons, ensuring no damon is overloaded and data loss is avoided.

Stile, John [Lawrence Berkeley National Laboratory↗
DOE OSTI2025

Dense Image Matching Uncertainty Estimation and Confidence Metrics

Dense stereo matching takes overlapping image pairs as input and outputs a disparity map which encodes pixel-by-pixel matches between the images. Recently, there has been an interest in ranking the quality, or even quantifying the accuracy, of disparity estimates. The proposed methods can be described as either uncertainty estimators or confidence metrics. Uncertainty estimators are a small minority of the research. However, they have the potential to be the most useful because they estimate disparity accuracy (in pixel units) that can be used to threshold matches or carried forward using error propagation. The majority of the research deals with confidence metrics which give an ordinal (or binary) ranking of a match’s quality relative to other matches. Confidence metrics do not have units and thus are useful primarily for thresholding matches from mismatches. The methods could also be described as handcrafted or deep-learning based. The majority of the research focused on outdoor driving scenes. Hence, our interest–application to a satellite semi-global matching pipeline–is a domain shift that may challenge deep-learning based methods. We conclude by recommending five handcrafted and two deep-learning based methods for evaluation in our pipeline.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Review of Grey Box/Black Box Data Contamination Metrics on Open and Commercial Models

Dataset contamination is a problem where benchmarks and tasks used to evaluate the capabilities of Large Language Models (LLMs) have been incorporated into the training dataset of the models. This gives a false sense of performance that can overestimate how these models will function on truly unseen data. This problem becomes worse with commercial LLMs with larger and non-accessible training data, so techniques have been developed to try to measure the degree to which a model is contaminated with a benchmark’s data. To understand the effectiveness of these techniques, particularly when evaluating contamination on coding tasks, we review trends and categorize techniques by the degree of access to the model that is required. The research literature on this topic has reported mixed effectiveness of these techniques, so we select a set of black box (text access only) and grey box (access to model loss/probabilities required) techniques and apply them to both commercial and non-commercial models. We implement these metrics as part of a framework to test the contamination of Python code in LLMs to see to what extent we can replicate the effectiveness (or ineffectiveness) of these contamination detection techniques. Though we find mixed results in the capabilities of these metrics to identify contamination, we do observe evidence that they can identify contamination (broadly) in fine-tuned models when both a baseline and fine-tuned model is present. Additionally, similarity metrics were able to identify between contaminated and uncontaminated data even in situations where the data is distributionally similar (e.g., drawn from the same set of code projects).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Demonstration of Optimal Benchmark Selection Website and Validation of the q c Coverage Metric Using HEU-SOL-THERM-013-003 Experiment

In the work documented in this interim report, the experiment selection toolkit web site was demonstrated and q C coverage metric methodology was validated for IEU-MET-FAST-002-001, MIX-COMP-THERM 004-004, and HEU-SOL-THERM-013-003 experiments. 𝑞 𝐶 is an information-theoretic measure based on mutual information that quantifies the ability of candidate benchmark experiments to reduce the bias and uncertainty of a target criticality safety application. The metric and an accompanying open-source Python toolkit with a web-based interface were tested against a benchmark set of 425 experiments drawn from the International Criticality Safety Benchmark Evaluation Project Handbook. The interface is hosted at https://edim.covdef.com. It accepts sensitivity data files produced by the TSUNAMI-IP module of the SCALE code system and supports both (i) deterministic analysis using the ENDF/B-VII.0 covariance library and (ii) stochastic analysis based on user-supplied keff samples. Demonstrations on representative applications across a range of material composition, spectrum, and form show that q C -guided benchmark selection achieves greater uncertainty reduction with fewer experiments and yields more stable posterior bias and uncertainty estimates than traditional similarity coefficient ( c k )–based selection, while also capturing valuable low-ck experiments that one-to-one metrics overlook.

Abdel-khalik, Hany S. [Indiana Univ.-Purdue Univ. ↗
DOE OSTI2025

Monitoring Fracture Hydromechanical Evolution in the Lab and Field Using Unsupervised Metric Learning

Fractures evolve in time through thermal‐hydraulic‐mechanical‐chemical (THMC) processes that alter their long‐range hydraulic transport properties and modify subsurface behavior and activities. The location of subsurface fractures makes it necessary to use remote sensing techniques such as passive or active seismic monitoring for fracture characterization. In this paper, we develop a machine learning approach to monitor the evolution of fracture properties using passive seismic sources in a laboratory setting and using active seismic monitoring from the Sanford Underground Research Facility in Lead, South Dakota, at a depth of 1.25 km in amphibolite rock during stimulation of natural fractures as well as during induced fracturing. The unsupervised metric learning technique applies tandem neural networks (twin (Siamese) or triplet) with contrastive loss and adaptive margins to track slowly varying systems for which class or similarity labels are not available. The approach adopts locality‐sensitive hashing to divide time‐ordered contiguous data into an arbitrary number of pseudo‐classes. Contrastive‐loss training with many hash bins generates an evolving latent‐space trajectory. This approach enables unsupervised metric learning for seismic data stacks under the condition of contiguous state sampling and slowly varying fracture properties. The displacement discontinuity theory provides a mechanistic foundation for the fracture‐dependent trajectories that are related to relaxation of fractures with time‐dependent specific stiffness responding to changes in stress or fluid saturation.

02 PETROLEUM↗
DOE OSTI2025

Logarithmic Resilience Risk Metrics That Address the Huge Variations in Blackout Cost

Resilience risk metrics must address the customer cost of the largest blackouts of greatest impact. However, there are huge variations in blackout cost in observed distribution utility data that make it impractical to properly estimate the mean large blackout cost and the corresponding risk. These problems are caused by the heavy tail observed in the distribution of customer costs. To solve these problems, we propose resilience metrics that describe large blackout risk using the mean of the logarithm of the cost of large-cost blackouts, the slope index of the heavy tail, and the frequency of large-cost blackouts.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

The Next Stage for Smart Cities: Metrics to Spur an Evolution from Technology for Efficiency to Technology for People's Needs

The Smart Cities movement is about a decade old, energized by the USDOT Smart Cities grant that sparked cities to dream big. Now, 10 years later, and multitudes of conferences and papers later, the biggest question regarding Smart Cities is whether any progress has been made? Smart Cities forums are typically led by the technology sector, either telecommunications, internet access, or most recently artificial intelligence (AI) concerns. Each of these areas have grown and found new applications in the context of Smart Cities, however, these technology applications are just tools toward ends. Do digital communications and assistance enable or foster improved access to real, tactile, non-virtual goods and services such as transportation, food, housing, trash removal, health care, education, social interaction? These and other topics are not 'big tech', but are each critical to quality of life outcomes and are day-to-day necessities, comprising many of the touch points through which citizens interact with municipal agencies. Regarding Smart Cities, relationships have not been fully refined as to how best to merge the emerging generation of technology and related trends with more mundane but essential requirements of tactile services. How should municipal managers and operators bring the range of new technology tools (e.g. on-demand transit, automated vehicles, digital connectivity) to bear to improve functions serving real- physical- non-virtual needs? How do we make cities more efficient in providing access to services and opportunities for improved quality of life? This paper examines the current Smart City movement, emerging trends, and the need to put metrics with respect to the delivery, access, and provision of real-life needs. Using a few case studies of past, present, and projected future scenarios, this paper attempts to bring Smart Cities into the real cities domain, perhaps pushing the moniker away from 'Smart' to 'Efficient' - something that can be measured, counted, and assessed. Through the consideration of the next stage of the evolution of cities from 'Smart' to 'Efficient', the combined efforts and experience of multiple researchers at the NREL and their network of collaborators highlights the need for updates metrics that can be used to start guiding efforts toward productive initiatives to improve quality of life.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗