SEARCH · Engineering Papers

Results for “Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Deep-Learning-Derived Evaluation Metrics Enable Effective Benchmarking of Computational Tools for Phosphopeptide Identification

Tandem mass spectrometry (MS/MS)-based phosphoproteomics is a powerful technology for global phosphorylation analysis. However, applying four computational pipelines to a typical mass spectrometry (MS)-based phosphoproteomic dataset from a human cancer study, we observed a large discrepancy among the reported phosphopeptide identification and phosphosite localization results, underscoring a critical need for benchmarking. While efforts have been made to compare performance of computational pipelines using data from synthetic phosphopeptides, evaluations involving real application data have been largely limited to comparing the numbers of phosphopeptide identifications due to the lack of appropriate evaluation metrics. We investigated three deep learning-derived features as potential evaluation metrics: phosphosite probability, Delta RT and spectral similarity. Predicted phosphosite probability is computed by MusiteDeep, which provides high accuracy as previously reported; Delta RT is defined as the absolute retention time (RT) difference between RTs observed and predicted by AutoRT; and spectral similarity is defined as the Pearson’s correlation coefficient between spectra observed and predicted by pDeep2. Using a synthetic peptide dataset, we found that both Delta RT and spectral similarity provided excellent discrimination between correct and incorrect peptide-spectrum matches (PSMs) both when incorrect PSMs involved wrong peptide sequences and even when incorrect PSMs were caused by only incorrect phosphosite localization. Based on these results, we used all the three deep learning-derived features as evaluation metrics to compare different computational pipelines on diverse set of phosphoproteomic datasets and showed their utility in benchmarking performance of the pipelines. The benchmark metrics demonstrated in this study will enable users to select computational pipelines and parameters for routine analysis of phosphoproteomics data and will offer guidance for developers to improve computational methods.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2019

Review and categorization of existing studies on the estimation of probabilistic failure metrics for Reactor Coolant Pressure Boundary piping and steam generator tubes in Nuclear Power Plants

This article presents the first output of the International Atomic Energy Agency (IAEA) Coordinated Research Project (CRP), titled Methodology for Assessing Pipe Failure Rates in Advanced Water-Cooled Reactors (AWCRs), launched in 2018. This IAEA CRP is aimed at developing a good-practices document for estimating the probabilistic failure metrics of piping in AWCRs. The reliability of piping that comprise the Reactor Coolant Pressure Boundary (RCPB) is important for maintaining safe and stable operations of Nuclear Power Plants (NPPs) because failure of those piping components could lead to undesirable consequences, such as plant shutdown, costly repair, the occurrence of Loss-of-Coolant Accidents (LOCAs) and, possibly, subsequent core damage or large release events. Probabilistic failure metrics (e.g., failure rate, failure frequency, or failure probability) of RCPB components are the key inputs to the Probabilistic Safety/Risk Assessment (PSA/PRA) and risk management of NPPs. The estimation of probabilistic failure metrics, however, is challenging, especially for AWCRs, due to the lack of operating experience. Therefore, as the first step of the IAEA CRP activities, this paper is developed to provide a literature review of the existing studies (from 2000 to April 2019) on the estimation of probabilistic failure metrics for RCPB piping and Steam Generator (SG) tubes of NPPs and to categorize them based on four criteria: (1) explicitness of incorporation of physical failure mechanisms; (2) types of failure characterization; (3) types of physical models for degradation; and (4) explicitness of consideration of maintenance. The existing studies are also analyzed from the viewpoint of the following key aspects: (i) uncertainty analysis, (ii) sensitivity analysis, (iii) validation strategies, and (iv) the areas of applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2018

Methods and Challenges in the Determination of Molecular Weight Metrics of Bio-oils

The analyses of thermochemically-derived bio-oil properties and composition are challenging due to the diversity of compounds present and the reactivity of the oils. There are currently a variety of techniques used and no standard method established for the analysis of the molecular weight distribution, weight average molecular weight (Mw) and other molecular weight metrics of bio-oils. This review focuses on the challenges and variation in methodologies employed for the analysis of bio-oils on the basis of molecular weight, particularly by gel permeation chromatography (GPC). GPC is the most practical means for determination of molecular weight metrics of bio-oils but needs to be refined using appropriate standards and/or detectors to ensure consistency and accurate quantification of molecular weight metrics. Future method development for a robust technique with accurate and comparable molecular weight data should focus on GPC with multiple detection methodology on whole bio-oils, verified relative to another technique such as mass spectrometry (MS). MS techniques, such as Fourier transform-ion cyclotron resonance (FT-ICR MS), have also been utilized for the determination of molecular weight distribution of bio-oils and are briefly addressed in this review. Many MS methods can provide extensive characterization and structural speciation of components in bio-oils, and while accurate molecular weight metrics can be obtained with the appropriate use of ionization techniques and optimized parameters to ensure appropriate range of m/z and signals representative of abundance, MS is not a robust or an economically practical method for routine molecular weight analyses. Physical separation techniques such as preparative scale GPC, distillation, and liquid-liquid extraction methods are also briefly addressed in this review in the context of molecular weight analyses.

09 BIOMASS FUELS↗

DOE OSTI2023

Earth Mover’s Distance as a Metric to Evaluate the Extent of Charge Transfer in Excitations Using Discretized Real-Space Densities

This paper presents a novel theoretical measure, μ EMD , based on the earth mover's distance (EMD), for quantifying the density shift caused by electronic excitations in molecules. As input, the EMD metric uses only the discretized ground- and excited-state electron densities in real space, rendering it compatible with almost all electronic structure methods used to calculate excited states. The EMD metric is compared against other popular theoretical metrics for describing the extent of electron-hole separation in a wide range of excited states (valence, Rydberg, charge transfer, etc.). Further, the results showcase the EMD metric's effectiveness across all excitation types and suggest that it is useful as an additional tool to characterize electronic excitations. The study also reveals that μ EMD can function as a promising diagnostic tool for predicting the failure of pure exchange-correlation functionals. Specifically, we show statistical relationships among the functional-driven errors, the exact exchange content within the functional, and the magnitude of μ EMD values.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Assessing Radiative Feedbacks and Their Contribution to the Arctic Amplification Measured by Various Metrics

Arctic amplification (AA), characterized by a more rapid surface air temperature (SAT) warming in the Arctic than the global average, is a major feature of global climate warming. Various metrics have been used to quantify AA based on SAT anomalies, trends, or variability, and they can yield quite different conclusions regarding the magnitude and temporal patterns of AA. This study examines and compares various AA metrics for their temporal consistency in the region north of 70°N from the early twentieth to the early 21st century using observational data and reanalysis products. We also quantify contributions of different radiative feedback mechanisms to AA based on short-term climate variability in reanalysis and model data using the Kernel-Gregory approach. Albedo and lapse rate feedbacks are positive and comparable, with albedo feedback being the leading contributor for all AA metrics. The net cloud feedback, which has large uncertainties, depends strongly on the data sets and AA metrics used. By quantifying the influence of internal variability on AA and related feedbacks based on global climate model ensemble simulations, we find that water vapor and cloud feedbacks are most heavily affected by internal variability.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

The efficacy of Lewis affinity scale metrics to represent solvent interactions with reagent salts in all-inorganic metal halide perovskite solutions

Solvents employed in the solution processing of metal halide perovskites are known to play a key role in defining the morphology and properties of the resulting thin film, and thus the performance of perovskite solar cell devices. Accurate metrics are needed that are capable of differentiating among candidates, finding solvents that adequately solubilize the various precursor species in solution and facilitate the nucleation and growth of these materials. Existing metrics such as the unsaturated Mayer bond order (UMBO) and the Gutmann donor number (DN) have been tested for lead iodide perovskite systems; but there has yet to be a comprehensive study on their transferability to lead-free perovskite solutions. Here, we use ab initio methods (density functional theory) and regression analysis tools to study the usefulness of DN and BF 3 affinity scales in this regard. We compared the relative effectiveness of these scales to describe interactions between solvents and BXn perovskite salts of lead (Pb 2+ ), tin (Sn 2+ and Sn 4+ ), germanium (Ge 2+ ), bismuth (Bi 3+ ), and antimony (Sb 3+ and Sb 5+ ). The DN proved to be a better representation than the BF 3 of such interactions, reflecting the closer similarity of these species to the “parent” SbCl 5 Lewis acid than to BF 3 . In addition, we have uncovered the usefulness of the lithium cation affinity metric (LCA) to describe the strength of interactions between solvents and A-site cations (e.g. Na + , K + , Rb + and Cs + ) in all-inorganic metal halide perovskite solutions. We find that the coordination strengths of solvents towards species in all-inorganic metal halide perovskite solutions are best described by two different metrics with distinct modes of action: DN differentiates among BX n salt complexes, and LCA among A-site cation species. This revelation can help guide the choice of solvent to optimize processing conditions. It also emphasizes the importance of selecting solvents whose DN and LCA optimize coordination to key Lewis acid species in all-inorganic perovskite solutions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Operational resilience metrics for power systems with penetration of renewable resources

Abstract Modern power grid is evolving towards carbon neutrality by deploying increasing amount of renewable energy resources. However, the impact of renewable generation on power system planning and operation is not sufficiently investigated, especially the capability of renewable penetrated power systems to resist and recover from major disturbances, which is a critical concern for system operators. Novel metrics and evaluation methodologies are needed to depict systems’ ability in response to events caused by natural disasters, and quantitatively evaluate system performance in various time scales. In this paper, operational resilience metrics are proposed for power systems with penetration of renewable energy resources based on transient stability principles. A systematic methodology is proposed to quantitatively assess the evolution of system performance during various stages of the disaster process. Based on the proposed metrics, a resilience‐oriented disaster management strategy is designed and validated using the modified IEEE 39‐bus test system. The simulation results demonstrate the validity of the proposed metrics and strategy, and show that the system resilience is enhanced during the mitigation of fault conditions.

Gui, Jianzhong↗

DOE OSTI2019

Towards bulk metric reconstruction from extremal area variations

The Ryu–Takayanagi and Hubeny–Rangamani–Takayanagi formulae suggest that bulk geometry emerges from the entanglement structure of the boundary theory. Using these formulae, we build on a result of Alexakis, Balehowsky, and Nachman to show that in four bulk dimensions, the entanglement entropies of boundary regions of disk topology uniquely fix the bulk metric in any region foliated by the corresponding HRT surfaces. More generally, for a bulk of any dimension , knowledge of the (variations of the) areas of two-dimensional boundary-anchored extremal surfaces of disk topology uniquely fixes the bulk metric wherever these surfaces reach. This result is covariant and not reliant on any symmetry assumptions; its applicability thus includes regions of strong dynamical gravity such as the early-time interior of black holes formed from collapse. While we only show uniqueness of the metric, the approach we present provides a clear path towards an explicit spacetime metric reconstruction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2025

Metrics and extrapolation of resonant magnetic perturbation thresholds for ELM suppression

This large database study of resonant magnetic perturbation (RMP) edge localized mode (ELM) suppression thresholds in the AUG, DIII-D, EAST, and KSTAR tokamaks details the key strengths and weaknesses of RMP metrics. The RMP ELM suppression database used for this work contains plasma information at the time of transition from ELMing to ELM suppressed states where a clear experimental threshold is identified. The experimental threshold distributions are compared for five metrics: (1) the island overlap width, (2) pedestal top Chirikov overlap, (3) peeling edge displacement, (4) pedestal top resonant drive, and (5) edge dominant mode overlap. The distributions, the regularity of the dependence on RMP coil currents, and the sensitivities of a given metric to equilibrium reconstruction details are compared. The overlap metric proves to be a good compromise between including the appropriate plasma response physics and maintaining a numerical robustness. This quantity does not exhibit clear power-law scalings for projection, but machine learning can assist in predicting thresholds within the existing parameter ranges and providing uncertainty quantification of those predictions. Two new first-principles models, one utilizing a threshold from the non-linear Modified Rutherford equation evaluated at the pedestal top and one utilizing the SLAYER code to calculate the linear tearing threshold from torque balance, offer possible paths to extrapolation beyond the existing database parameter space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2026

Heat metrics and thresholds reshape population exposure and inequality signals

Extreme heat is intensifying worldwide, yet estimates of heat hazard and exposure inequality depend on both the heat metric and how extreme days are defined. Using summer 2022 across the Mediterranean, we quantify population heat exposure with four metrics—land surface temperature (LST), air temperature (Ta), heat index (HI), and wet-bulb globe temperature (WBGT)—under absolute (fixed-value) and relative (anomaly-based) thresholds. Under absolute thresholds, total heat exposure differs by more than two orders of magnitude across metrics (31.3 billion person-days for Ta vs 0.3 billion for HI). Geographic hotspots also diverge: WBGT concentrates in humid coastal North Africa (e.g. the Nile Delta), whereas Ta and LST are more widespread. Under relative thresholds, exposure totals converge and cross-metric hotspot agreement increases (e.g. Ta–WBGT top-tercile overlap increases from 10.7% to 29.0%), shifting hotspots toward densely populated southern Europe. Crucially, the exposure–deprivation relationship also reverses across threshold frameworks: absolute thresholds concentrate exposure in more deprived North Africa and the Middle East, whereas relative thresholds shift the burden toward less-deprived European cities. This sensitivity is decision-relevant: city rankings based on WBGT exposure duration are almost completely reordered when switching threshold frameworks. Threshold choice therefore systematically reshapes hotspot patterns and inequality signals. Reporting both absolute and relative exposures can reveal hidden hotspots and support more targeted heat-risk monitoring and intervention planning.

Mediterranean↗

DOE OSTI2025

Single Kerr-Schild metric for Taub-NUT instanton

It is shown that a complex coordinate transformation maps the Taub-Newman-Unti-Tamburino instanton metric to a Kerr-Schild metric. This metric involves a semi-infinite line defect as the gravitational analog of the Dirac string, much like the original metric. Moreover, it facilitates three versions of classical double copy correspondence with the self-dual dyon in electromagnetism, one of which involves a nonlocal operator. The relevance to the Newman-Janis algorithm is briefly noted. Published by the American Physical Society 2025

Kim, Joon-Hwi (ORCID:000000025474123X)↗

DOE OSTI2017

Bragg coherent diffraction imaging and metrics for radiation damage in protein micro-crystallography

The proliferation of extremely intense synchrotron sources has enabled ever higher-resolution structures to be obtained using data collected from smaller and often more imperfect biological crystals. Synchrotron beamlines now exist that are capable of measuring data from single crystals that are just a few micrometres in size. This provides renewed motivation to study and understand the radiation damage behaviour of small protein crystals. Reciprocal-space mapping and Bragg coherent diffractive imaging experiments have been performed on cryo-cooled microcrystals of hen egg-white lysozyme as they undergo radiation damage. Several well established metrics, such as intensity-loss and lattice expansion, are applied to the diffraction data and the results are compared with several new metrics that can be extracted from the coherent imaging experiments. Individually some of these metrics are inconclusive. However, combining metrics, the results suggest that radiation damage behaviour in protein micro-crystals differs from that of larger protein crystals and may allow them to continue to diffract for longer. As a result, a possible mechanism to account for these observations is proposed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2025

Integrated Metrics for County-Level Resilience Ranking Using Entropy and TOPSIS

In the face of atypical weather events, power infrastructure failures, and limited resources for resilience investment, energy decision-makers need data-driven metrics to allocate resilience investments and maximize the reduction of power outage impacts. For state-level planning, for instance, ranking the resilience of each county is key to ensuring effective distribution of resources. In such cases, resilience for each spatial unit is multifaceted and is captured by a set of indicators (i.e., metrics) that can be combined into an overall score that reduces the complexity of power outage dynamics to a single decision metric. However, weighting of these indicators is often addressed by simplifying assumptions (i.e., equal weights) or semi-subjective methods that rely on user-defined weights that can introduce biases (e.g., weighted average score). Within the disaster risk reduction and resilience engineering community, a recurring challenge in multicriteria decision-making is the objective weighting of indicators for composite indices. To address this issue, we have leveraged a Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) combined with an entropy-based weighting approach to calculated the integrated scores. This method objectively determines the importance of each metric, better discerns between spatial units (i.e., counties), and offers a more reliable ranking of counties according to their relative resilience attributes. By improving methods for integrating resilience indicators, our approach helps planners and decision-makers prioritize resources more effectively for more efficient resilience investments.

Bhusal, Narayan [Oak Ridge National Laboratory (OR↗

DOE OSTI2013

A Graph Analytic Metric for Mitigating Advanced Persistent Threat

This paper introduces a novel graph analytic metric that can be used to measure the potential vulnerability of a cyber network to specific types of attacks that use lateral movement and privilege escalation such as the well known Pass The Hash, (PTH). The metric is computed from an oriented subgraph of the underlying cyber network induced by selecting only those edges for which a given property holds between the two vertices of the edge. The metric with respect to a select node on the subgraph is defined as the likelihood that the select node is reachable from another arbitrary node in the graph. This metric can be calculated dynamically from the authorization and auditing layers during the network security authorization phase and will potentially enable predictive deterrence against attacks such as PTH.

cybersecurity↗

DOE OSTI2020

Development and Clustering of Rate-Oriented Load Metrics for Customer Price-Plan Analysis

One of the few methods electric utilities can use to motivate and change customer energy consumption is through retail rate structures. Utilities are increasingly moving toward more dynamic rate plans to encourage energy conservation, utilization of onsite renewable generation, peak demand reduction and flattening of demand profiles. This paper creates a set of rate-oriented load metrics that are the determinants of customers' bills under four unique rate plans. These metrics are not only indicative of which rate structure can provide customer bill reductions based on their load profile characteristics, but also convey useful information about load consumption behavior. With these metrics, utilities can analyze their customers and identify classes that are rewarded under each rate plan. This can help inform utilities whether the customers rewarded under each rate plans are meeting their original objectives. To develop these customer classes, we calculate these rate-oriented load metrics for each customer and perform k-means clustering. The analysis is conducted on a set of 300 customer profiles, examining four different rate plans, different numbers of clusters, customer bills and cluster load profile characteristics.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Metrics for Evaluating Grid Service Provision from Communities of Grid-interactive and Efficient Buildings and other DER

Tapping into the flexibility of aggregations of Grid-interactive and Efficiency Buildings (GEBs) represent a large opportunity to cost-effectively improve operations in future low-carbon power grids. The US Department of Energy's Connected Communities program seeks to demonstrate collections of these GEBs at 10 different sites across the country. However, consistent metrics for evaluation across all projects are needed to build confidence in the approach. This paper presents the metrics relating to Grid Service Provision that will be computed at the 10 demonstrations. The metrics proposed quantity the magnitude of service offers, the consistency and quality of services provided by the community, and the individual DER contributions to the community-level service. The goal of this work is to present these metrics and describe some of their intended insights. The hope is that these insights will be useful and build confidence for grid operators, regulators, and aggregators and practitioners as they look to deploy these resources in grids of the future.

MacDonald, Jason S↗

DOE OSTI2019

In‐depth comparative analysis of Illumina ® MiSeq run metrics: Development of a wet‐lab quality assessment tool

Abstract Whole genome sequencing of bacterial isolates has become a daily task in many laboratories, generating incredible amounts of data. However, data acquisition is not an end in itself; the goal is to acquire high‐quality data useful for understanding genetic relationships. Having a method that could rapidly determine which of the many available run metrics are the most important indicators of overall run quality and having a way to monitor these during a given sequencing run would be extremely helpful to this effect. Therefore, we compared various run metrics across 486 MiSeq runs, from five different machines. By performing a statistical analysis using principal components analysis and a K ‐means clustering algorithm of the metrics, we were able to validate metric comparisons among instruments, allowing for the development of a predictive algorithm, which permits one to observe whether a given MiSeq run has performed adequately. This algorithm is available in an Excel spreadsheet: that is, MiSeq Instrument & Run (In‐Run) Forecast. Our tool can help verify that the quantity/quality of the generated sequencing data consistently meets or exceeds recommended manufacturer expectations. Patterns of deviation from those expectations can be used to assess potential run problems and plan preventative maintenance, which can save valuable time and funding resources.

Kastanis, George John↗

DOE OSTI2014

Analysis of Daily Peaking and Run-of-River Operations with Flow Variability Metrics, Considering Subdaily to Seasonal Time Scales

Environmental flows are an important consideration in licensing hydropower projects because operational flow releases can result in adverse conditions to downstream ecological communities. Flow variability assessments have typically focused on pre- and post-dam conditions using metrics based on daily-averaged flow values. This study used subdaily and daily flow data to assess environmental flow response to changes in hydropower operations from daily-peaking to run-of-river. An analysis tool was developed to quantify subdaily to seasonal flow variability metrics and was applied to four hydropower projects that underwent operational changes based on regulatory requirements. Results indicate that the distribution of flows is significantly different between daily-peaking and run-of- river operations and that daily-peaking operations are flashier than run-of-river operations; these differences are seen using hourly-averaged flow datasets and are less pronounced or not noticeable using daily-averaged flow datasets. Of all variability metrics analyzed, hydrograph rise and fall rates were the most sensitive to using daily versus subdaily flow data. This outcome has implications for the development of flow-ecology relationships that quantify effects of rate of change on processes such as fish stranding and displacement, along with habitat stability. The quantification of flow variability statistics should be done using subdaily datasets and metric to accurately represent the nature of hydropower operations , especially for facilities that utilize daily-peaking operations.

54 ENVIRONMENTAL SCIENCES↗