Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Metrics for Decision-Making in Energy Justice

Energy equity and justice have become priority considerations for policymakers, practitioners, and scholars alike. To ensure that energy equity is incorporated into actual decisions and analysis, it is necessary to design, use, and continually improve energy equity metrics. In this article, we review the literature and practices surrounding such metrics. We present a working definition for energy justice and equity, and connect them to both criteria for and frameworks of metrics. We then present a large sampling of energy equity metrics, including those focused on vulnerability, wealth creation, energy poverty, life cycle, and comparative country-level dynamics. We conclude with a discussion of the limitations, gaps, and trade-offs associated with these various metrics and their interactions thereof.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Applying energy justice metrics to photovoltaic materials research

Abstract Achieving the energy transition sustainably requires addressing how new technologies may impact justice in the energy system. The Justice Underpinning Science and Technology Research (JUST-R) metrics framework was recently proposed to aid researchers in considering justice in early-stage research on energy technologies; however, case study evaluations of the framework revealed a desire from researchers to see metrics specialized to particular fields of study. Here, we refine metrics from the JUST-R framework to enhance its applicability to photovoltaic (PV) materials research. Metrics are reorganized to align with aspects of the research process (e.g., research team or source materials). For most metrics, baseline values are suggested to enable researchers to compare their project to competing technologies or standards at their institutions. These refinements are integrated into a tool to facilitate easier understanding and evaluation of justice considerations in early-stage PV research, which can serve as a template for evaluating other energy technologies. Graphical abstract

14 SOLAR ENERGY↗
NASA NTRS2016

Performance Metrics, Error Modeling, and Uncertainty Quantification

A common set of statistical metrics has been used to summarize the performance of models or measurements-­ the most widely used ones being bias, mean square error, and linear correlation coefficient. They assume linear, additive, Gaussian errors, and they are interdependent, incomplete, and incapable of directly quantifying un­certainty. The authors demonstrate that these metrics can be directly derived from the parameters of the simple linear error model. Since a correct error model captures the full error information, it is argued that the specification of a parametric error model should be an alternative to the metrics-based approach. The error-modeling meth­odology is applicable to both linear and nonlinear errors, while the metrics are only meaningful for linear errors. In addition, the error model expresses the error structure more naturally, and directly quantifies uncertainty. This argument is further explained by highlighting the intrinsic connections between the performance metrics, the error model, and the joint distribution between the data and the reference.

Quantification↗
DOE OSTI2020

Machine Learning Calabi–Yau Metrics

We apply machine learning to the problem of finding numerical Calabi–Yau metrics. Building on Donaldson's algorithm for calculating balanced metrics on Kähler manifolds, we combine conventional curve fitting and machine-learning techniques to numerically approximate Ricci-flat metrics. We show that machine learning is able to predict the Calabi–Yau metric and quantities associated with it, such as its determinant, having seen only a small sample of training data. Using this in conjunction with a straightforward curve fitting routine, we demonstrate that it is possible to find highly accurate numerical metrics much more quickly than by using Donaldson's algorithm alone, with our new machine-learning algorithm decreasing the time required by between one and two orders of magnitude.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

A ductility metric for refractory-based multi-principal-element alloys

We propose a quantum-mechanical dimensionless metric, the local-lattice distortion (LLD), as a reliable predictor of ductility in refractory multi-principal-element alloys (RMPEAs). The LLD metric is based on electronegativity differences in localized chemical environments and combines atomic-scale displacements due to local lattice distortions with a weighted average of valence-electron count. To evaluate the effectiveness of this metric, we examined body-centered cubic (bcc) refractory alloys that exhibit ductile-to-brittle behavior. Our findings demonstrate that local-charge behavior can be tuned via composition to enhance ductility in RMPEAs. With finite-sized cell effects eliminated, the LLD metric accurately predicted the ductility of arbitrary alloys, which compares well with existing tensile-elongation experiments. To validate further, we qualitatively evaluated the ductility of two refractory RMPEAs, i.e., NbTaMoW and Mo 72 W 13 Ta 10 Ti 2.5 Zr 2.5 , through the observation of crack formation under indentation, again showing excellent agreement with LLD predictions. Additionally, a comparative study of three refractory alloys provides further insights into the electronic-structure origin of ductility in refractory RMPEAs. This proposed metric enables rapid and accurate assessment of ductility behavior in the vast RMPEA composition space.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Are grid cells used for navigation? On local metrics, subjective spaces, and black holes

The symmetric, lattice-like spatial pattern of grid-cell activity is thought to provide a neuronal global metric for space. This view is compatible with grid cells recorded in empty boxes but inconsistent with data from more naturalistic settings. Here, we review evidence arguing against the global-metric notion, including the distortion and disintegration of the grid pattern in complex and three-dimensional environments. We argue that deviations from lattice symmetry are key for understanding grid-cell function. We propose three possible functions for grid cells, which treat real-world grid distortions as a feature rather than a bug. First, grid cells may constitute a local metric for proximal space rather than a global metric for all space. Second, grid cells could form a metric for subjective action-relevant space rather than physical space. Third, distortions may represent salient locations. Finally, we discuss mechanisms that can underlie these functions. These ideas may transform our thinking about grid cells.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Assessing tension metrics with dark energy survey and Planck data

ABSTRACT Quantifying tensions – inconsistencies amongst measurements of cosmological parameters by different experiments – has emerged as a crucial part of modern cosmological data analysis. Statistically significant tensions between two experiments or cosmological probes may indicate new physics extending beyond the standard cosmological model and need to be promptly identified. We apply several tension estimators proposed in the literature to the dark energy survey (DES) large-scale structure measurement and Planck cosmic microwave background data. We first evaluate the responsiveness of these metrics to an input tension artificially introduced between the two, using synthetic DES data. We then apply the metrics to the comparison of Planck and actual DES Year 1 data. We find that the parameter differences, Eigentension, and Suspiciousness metrics all yield similar results on both simulated and real data, while the Bayes ratio is inconsistent with the rest due to its dependence on the prior volume. Using these metrics, we calculate the tension between DES Year 1 3 × 2pt and Planck, finding the surveys to be in ∼2.3σ tension under the ΛCDM paradigm. This suite of metrics provides a toolset for robustly testing tensions in the DES Year 3 data and beyond.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Superposed metric for spinning black hole binaries approaching merger

Here, we construct an approximate metric that represents the spacetime of spinning binary black holes (BBH) approaching merger. We build the metric as an analytical superposition of two Kerr metrics in harmonic coordinates, where we transform each black hole term with time-dependent boosts describing an inspiral trajectory. The velocities and trajectories of the boost are obtained by solving the post-Newtonian (PN) equations of motion at 3.5 PN order. We analyze the spacetime scalars of the new metric and we show that it is an accurate approximation of Einstein’s field equations in vacuum for a BBH system in the inspiral regime. Furthermore, to prove the effectiveness of our approach, we test the metric in the context of a 3D general relativistic magnetohydrodynamical (GRMHD) simulation of accreting minidisks around the black holes. We compare our results with a previous well-tested spacetime construction based on the asymptotic matching method. We conclude that our new spacetime is well-suited for long-term GRMHD simulations of spinning binary black holes on their way to the merger.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Metric Learning to Accelerate Convergence of Operator Splitting Methods

Recent developments in machine learning have led to promising advances in accelerating the solution of constrained optimization problems. Increasing demand for real-time decision-making capabilities in applications such as artificial intelligence and optimal control has led to a variety of proposed strategies for learning to produce fast solutions to optimization problems. For example, recent works have shown that it is possible to accelerate the convergence of optimization algorithms by learning to select their parameters, such as gradient descent stepsizes. This work proposes a new approach, in which the underlying metric spaces of proximal operator splitting algorithms are learned to maximize convergence rate. While prior works in optimization theory have derived optimal metrics in simple cases, no such result exists for many practical problem forms including general Quadratic Programming (QP). This paper shows how differentiable optimization can enable the end-to-end learning of proximal metrics, enhancing the convergence of proximal algorithms for QP problems beyond what is possible based on known theory. Additionally, the results illustrate a strong connection between the learned proximal metrics and active constraints at the optima, leading to an interpretation in which the predicted proximal metrics can be viewed as a form of active set prediction.

King, Ethan [BATTELLE (PACIFIC NW LAB)]↗
DOE OSTI2021

Validation Metrics for Fixed Effects and Mixed-Effects Calibration

The modern scientific process often involves the development of a predictive computational model. To improve its accuracy, a computational model can be calibrated to a set of experimental data. A variety of validation metrics can be used to quantify this process. Some of these metrics have direct physical interpretations and a history of use, while others, especially those for probabilistic data, are more difficult to interpret. In this work, a variety of validation metrics are used to quantify the accuracy of different calibration methods. Frequentist and Bayesian perspectives are used with both fixed effects and mixed-effects statistical models. Through a quantitative comparison of the resulting distributions, the most accurate calibration method can be selected. Two examples are included which compare the results of various validation metrics for different calibration methods. It is quantitatively shown that, in the presence of significant laboratory biases, a fixed effects calibration is significantly less accurate than a mixed-effects calibration. This is because the mixed-effects statistical model better characterizes the underlying parameter distributions than the fixed effects model. The results suggest that validation metrics can be used to select the most accurate calibration model for a particular empirical model with corresponding experimental data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Quantum metric nonlinear Hall effect in a topological antiferromagnetic heterostructure

Quantum geometry in condensed matter physics has two components: the real part quantum metric and the imaginary part Berry curvature. Whereas the effects of Berry curvature have been observed through phenomena such as the quantum Hall effect in 2D electron gases and the anomalous Hall effect (AHE) in ferromagnets, quantum metric has rarely been explored. Here, in this paper, we report a nonlinear Hall effect induced by quantum metric dipole by interfacing even-layered MnBi 2 Te 4 with black phosphorus. The quantum metric nonlinear Hall effect switches direction upon reversing the AFM spins and exhibits distinct scaling that is independent of the scattering time. Our results open the door to discovering quantum metric responses predicted theoretically and pave the way for applications that bridge nonlinear electronics with AFM spintronics.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Evaluating Climate Models with the CLIVAR 2020 ENSO Metrics Package

El Niño–Southern Oscillation (ENSO) is the dominant mode of interannual climate variability on the planet, with far-reaching global impacts. It is therefore key to evaluate ENSO simulations in state-of-the-art numerical models used to study past, present, and future climate. Recently, the Pacific Region Panel of the International Climate and Ocean: Variability, Predictability and Change (CLIVAR) Project, as a part of the World Climate Research Programme (WCRP), led a community-wide effort to evaluate the simulation of ENSO variability, teleconnections, and processes in climate models. The new CLIVAR 2020 ENSO metrics package enables model diagnosis, comparison, and evaluation to 1) highlight aspects that need improvement; 2) monitor progress across model generations; 3) help in selecting models that are well suited for particular analyses; 4) reveal links between various model biases, illuminating the impacts of those biases on ENSO and its sensitivity to climate change; and to 5) advance ENSO literacy. By interfacing with existing model evaluation tools, the ENSO metrics package enables rapid analysis of multipetabyte databases of simulations, such as those generated by the Coupled Model Intercomparison Project phases 5 (CMIP5) and 6 (CMIP6). The CMIP6 models are found to significantly outperform those from CMIP5 for 8 out of 24 ENSO-relevant metrics, with most CMIP6 models showing improved tropical Pacific seasonality and ENSO teleconnections. Only one ENSO metric is significantly degraded in CMIP6, namely, the coupling between the ocean surface and subsurface temperature anomalies, while the majority of metrics remain unchanged.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Evaluation of a land-atmosphere coupling metric computed from a ground-based infrared interferometer

Land-atmosphere feedbacks are a critical component of the hydrologic cycle. Vertical profiles of boundary layer temperature and moisture, together with information about the land surface, are used to compute land-atmosphere coupling metrics. Ground based remote sensing platforms, such as the Atmospheric Emitted Radiance Interferometer (AERI), can provide high temporal resolution vertical profiles of temperature and moisture. When co-located with soil moisture, surface flux, and surface meteorological observations, such as at the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site, it is possible to observe both the terrestrial and atmospheric legs of land-atmosphere feedbacks. In this study, we compare a commonly used coupling metric computed from radiosonde-based data to that obtained from the AERI to characterize the accuracy and uncertainty in the metric derived from the two distinct platforms. This approach demonstrates the AERI’s utility where radiosonde observations are absent in time and/or space. Radiosonde and AERI based observations of the Convective Triggering Potential and Low-Level Humidity Index (CTP-HI low ) were computed during the 1200 UTC observation time and displayed good agreement during both 2017 and 2019 warm seasons. Furthermore, radiosonde and AERI derived metrics diagnosed the same atmospheric preconditioning based upon the CTP-HI low framework a majority of the time. When retrieval uncertainty was considered, even greater agreement was found between radiosonde and AERI derived classification. The AERI’s ability to represent this coupling metric well enabled novel exploration of temporal variability within the overnight period in CTP and HI low . Observations of CTP-HI low computed within a few hours of 1200 UTC were essentially equivalent, however with greater differences in time arose greater differences in CTP and HI low .

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Uncertain of uncertainties? A comparison of uncertainty quantification metrics for chemical data sets

Abstract With the increasingly more important role of machine learning (ML) models in chemical research, the need for putting a level of confidence to the model predictions naturally arises. Several methods for obtaining uncertainty estimates have been proposed in recent years but consensus on the evaluation of these have yet to be established and different studies on uncertainties generally uses different metrics to evaluate them. We compare three of the most popular validation metrics (Spearman’s rank correlation coefficient, the negative log likelihood (NLL) and the miscalibration area) to the error-based calibration introduced by Levi et al. ( Sensors 2022 , 22 , 5540). Importantly, metrics such as the negative log likelihood (NLL) and Spearman’s rank correlation coefficient bear little information in themselves. We therefore introduce reference values obtained through errors simulated directly from the uncertainty distribution. The different metrics target different properties and we show how to interpret them, but we generally find the best overall validation to be done based on the error-based calibration plot introduced by Levi et al. Finally, we illustrate the sensitivity of ranking-based methods (e.g. Spearman’s rank correlation coefficient) towards test set design by using the same toy model ferent test sets and obtaining vastly different metrics (0.05 vs. 0.65).

Rasmussen, Maria H.↗
DOE OSTI2021

Sensitivity-based Similarity Metrics for New Experiment Design Optimization

The nuclear data used in advanced reactor simulations requires validation. Data from nuclear criticality experiments can provide this validation. New nuclear criticality experiment design requires extensive knowledge and expert judgement such that the experimental design parameters are selected in such a way to keep the experiment subcritical. To aide in this experimental design process, professionals can utilize sensitivity and uncertainty analysis. Sensitivity and uncertainty analysis relies on matching new application experiments with currently existing benchmark experiments. Currently, there is functionality in the Whisper 1.1 software package to calculate a similarity metric based on neutron multiplication factor sensitivity coefficients between a new application designed by the user and existing International Criticality Safety Benchmark Experiment Project (ICSBEP) benchmarks. The Whisper 1.1 software package is included in Monte Carlo N-Particle ® Code Version 6.21 (MCNP ® 6.2). This work is geared toward expanding this capability to new similarity metrics based on beta-effective sensitivity coefficients and reactivity coefficient sensitivity coefficients. While the investigation of these sensitivity coefficients is presented in detail in separate works at this same conference, this work will be primarily focused on studying the similarity metrics in more detail. These similarity metrics will then be incorporated into the optimization algorithms used for experiment design in EUCLID (Experiments Underpinned by Computational Learning for Improvements in nuclear Data), which is a Los Alamos National Laboratory (LANL) project designed to constrain nuclear data of interest, such that adjustments can be made to possible inaccuracies. A more detailed optimization can be subsequently performed by breaking down these similarity metrics by isotope, reaction, and energy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Gaussian Process Optimization of Sensitivity-Based Similarity Metrics between New Nuclear Applications and New/Existing Benchmarks [Slides]

This presentation discusses Nuclear Criticality Safety (NCS) and how designing safe, new nuclear criticality experiments requires expert judgement, which could take years of experience. Sensitivity/uncertainty (S/U) analysis can be utilized by less experienced individuals to conservatively estimate uncertainties in important parameters, such as k eff , in newly proposed nuclear experiments. The presentation poses the question of how this analysis can be performed and states that the answer lies in matching new nuclear experiments with existing benchmark experiments using similarity metrics. By increasing the criticality safety of the application in this work, higher mass limits could be used in PF-4 operations. Additionally, the presentation discusses MCNP6.2®, Whisper-1.1, the software that can be used in this analysis. Also discussed is the fact that International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmarks rarely match new nuclear applications and that there are significant differences in given set of materials and/or geometry. If there are no benchmarks that match the application, the presentation discusses the possibility of creating new benchmarks. In conclusion, this work presents a Gaussian process (GP) optimization scheme that was used to generate new benchmarks with the highest sensitivity-based similarity metrics to user-defined nuclear applications. The Gaussian process optimization successfully designed 3 new experimental benchmarks that were highly correlated to the application of interest and had k eff values near critical. Optimization over c k,i-r has shown that investigating specific isotope reactions for different applications is crucial to designing benchmark experiments. Partial contribution from Pu dominates c k similarity metric. Future work includes testing new stand-alone similarity metrics or new combinations of similarity metrics as the design criterion of this optimization – design criterion is application dependent.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Power System Resilience Metrics Augmentation for Critical Load Prioritization

One of the major goals of new grid operation regimes, such as transactive energy systems (TESs), is to make the power grid more resilient to withstand natural or man-made disasters and potential reliability events, and to continue to serve the maximum number of its customers. But it is a well-known fact to system operators that not all customers are the same. This implies that any discussion of TESs’ impacts on the resilience of the power system should consider the needs of its critical customers (such as the power system operation centers, fire and police stations, and hospitals) over those of other customers. When evaluating the resilience of the system, bonus points must be awarded to any system that could maintain its power supply to critical customers during a disturbance that may cause an outage. This report discusses critical infrastructure (CI) as found in the literature and then categorizes it based on the field to which the operations belong (such as human life/safety-related, operations management, necessary city operation, industrial customers, etc.). Each of these CI categories is further divided into types of critical customers (e.g., the human life/safety-related category has different types of customers like hospitals, fire and police stations, etc.). The entire demand of each of the critical customer types is not categorized as critical load (CL); instead, only a portion of the total load of these critical customers is characterized as critical load. This is done based on the categories of equipment, the function of which is crucial in the operation of the overall facility. CL categorization is performed to provide the ratio of the critical load portion to the overall load , so that it can serve as a parameter in the resilience evaluation of the grid through a metrics-based approach. Such categorization is important as it helps to augment the existing quantifiable resilience metrics with CL categorization. The metrics for a power system need to not only consider how well a system performed during a disturbance event, but also how it reduced strain and supplied power to its CLs. The first step in this process is characterize CLs in the system. After CL characterization, the next step is the inclusion of these loads in the resilience metrics. To that end, in this report weight-based augmentation of resilience metrics is proposed, where certain customers (the ones that are categorized as critical) are assigned higher weights than others. Though an overview of assigning weights to customers is discussed, there is no one-size-fits-all approach for every power system. The decisions made about assigning such weights to customers vary greatly from one operator to another, based on their unique systems and the current and predicted states of critical customers. This decision-making can include the type of disturbance event, which might only affect certain parts of the system. In general, analyzing critical customers before an event helps understand system vulnerabilities. It also helps in planning and conducting operations during the event, evaluating system performance after the event, and supporting better planning for future events. An alternative to the current practices of managing the grid for outages is an innovative TES, which has the potential to provide a platform for including distributed energy resources for managing CLs. This report also describes how TES qualities can help (1) to maintain power supply to critical customers for uninterrupted operations and (2) to restore lost power supply to the critical customers rapidly.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Power System Wildfire Risks and Potential Solutions: A Literature Review & Proposed Metric

Several fire risk evaluation, fire tracking, and fire response resources are available. The risk metrics and fire response programs are sometimes modified to include a power system context. The risk metrics often evaluate the risk of fires causing power system faults or outages, especially on transmission systems. The response programs are modified to ensure the safety of power system equipment and first responders as well as to coordinate power system outages to both ensure safety during an active fire and prevent fire ignition during high risk periods. Although some aspects of wildfire responses have been adapted to include power system concerns, adaptations to power system operations and maintenance to include wildfire risks and responses are still nascent. In particular, a risk metric that evaluates the potential for power system components to ignite wildfires is needed to help guide power system upgrade efforts and power system fire safety measures. This document serves as a brief literature review of wildfire risk metrics and response programs and how they relate to power systems. It also includes a proposed risk metric and structure for describing the risk of a power system component igniting a fire.

24 POWER TRANSMISSION AND DISTRIBUTION↗