Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Urban Traveler - Changes and Impacts: Mobility Energy Productivity (MEP) Metric

For nearly a century, the automobile has been the primary mode of personal transportation in American life. This remains true today as millions of people rely heavily on cars to connect suburbs with cities or to travel long distances—often out of routine or convenience. However, advances in technology are fueling an era of transportation transformation, with the potential to transform a system that has remained virtually unchanged for decades. Aspiring smart cities are wrestling with questions such as: How does mobility impact a person’s quality of life? Would people make different travel choices if they were presented with better information about their mobility options? The ability to quantify the mobility potential of a given location is the first step toward answering these questions. In response, an interdisciplinary team at the National Renewable Energy Laboratory (NREL) has developed the Mobility-Energy Productivity (MEP) metric. The MEP metric provides an avenue to not only measure the mobility potential at a specific location in its current configuration, but also to test how various technological advances (e.g., connected and automated vehicles, plug-in electric vehicles, shared mobility) and infrastructure investments (e.g., building an additional highway lane, constructing a new shopping mall, implementing a transit-oriented development) impact the mobility of that location over time. This presentation details the FY19 progress on the MEP metric project funded through DOE VTO's SMART Mobility Consortium.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Beyond Expected Values Evolving Metrics for Resource Adequacy Assessment

Resource adequacy analysis quantifies the likelihood of capacity shortfall on a power system in a probabilistic manner. Using a combination of statistical techniques and power system fundamentals, the analysis typically evaluates hundreds or thousands of stochastic random samples (replications) of varying load, generator outages, variable renewable energy availability, and other aspects of power system uncertainty. In this range of uncertainty, there are - at times - periods where the power system's available resources are insufficient to meet system demand, referred to as a shortfall event. Today's power systems' rapidly evolving generation mix is changing the types of data needed by system planners and regulators, which can often render traditional resource adequacy metrics insufficient for ensuring resource adequacy for tomorrow's grid. In this paper we provide a critical assessment of traditional measures of shortfall risk in power systems, discussing their shortcomings and how they compare to metrics used in other domains. From this analysis we propose four steps forward for improving power system resource adequacy risk metrics in the future.

ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Standardizing Performance Metrics for Building-Level Electrical Distribution Systems

Building-level electrical distribution systems comprise a myriad of current-carrying equipment, conversion devices, and protection devices that deliver power from the utility or local distributed energy resources to end-use building loads. Electric power has traditionally been generated, transmitted, and distributed in alternating current (AC). However, the last decade has seen a significant increase in the integration of native direct current (DC) equipment that has elevated the importance of DC distribution systems. Numerous studies have comparatively examined the performance of various electrical distribution systems in buildings but have failed to achieve uniform conclusions, primarily because of a lack of consistent and analogous performance evaluation methods. This paper aims to fill this gap by providing a standard set of metrics and measurement boundaries to consistently evaluate the performance of AC, DC, or hybrid AC/DC electrical distribution systems. The efficacy of the proposed approach is evaluated on a representative medium-sized commercial office building model with AC distribution and an equivalent hybrid AC/DC and DC distribution model, wherein the AC distribution model is concluded to be the most efficient. The simulation results show variation in computed metrics with different selected boundaries that verify the effectiveness of the proposed approach in ensuring consistent computation of the performance of building-level electrical distribution systems. This paper provides an initial set of guidelines for building energy system stakeholders to adopt appropriate solutions, thus leading to more efficient energy systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Improving magnitude and phase comparison metrics for frequency response functions using cross-correlation and log-frequency shifting

This paper provides a new method for matching dominant features of Frequency Response Functions (FRFs). In particular, this paper proposes a slicing and shifting method where the key features (in this case, resonant amplitudes) of a baseline FRF are compared with a similar FRF using cross-correlation and a Log-Frequency Shift (LFS). Here, the goal is to provide an alternative to classic point-to-point methods for FRF comparison and instead to match the dominant features of two FRFs in a way similar to visual inspection. This enables existing FRF comparison metrics to then be applied with greater fidelity. Additionally, this paper introduces the Phase Similarity Metric (PSM) for comparing phases of two FRFs and illustrates the improvement of using LFS for phase comparisons as well. This paper uses a cantilever beam experiment in multiple configurations to provide a benchmark case for FRF comparison improvements.

42 ENGINEERING↗
DOE OSTI2025

Monitoring Fracture Hydromechanical Evolution in the Lab and Field Using Unsupervised Metric Learning

Fractures evolve in time through thermal‐hydraulic‐mechanical‐chemical (THMC) processes that alter their long‐range hydraulic transport properties and modify subsurface behavior and activities. The location of subsurface fractures makes it necessary to use remote sensing techniques such as passive or active seismic monitoring for fracture characterization. In this paper, we develop a machine learning approach to monitor the evolution of fracture properties using passive seismic sources in a laboratory setting and using active seismic monitoring from the Sanford Underground Research Facility in Lead, South Dakota, at a depth of 1.25 km in amphibolite rock during stimulation of natural fractures as well as during induced fracturing. The unsupervised metric learning technique applies tandem neural networks (twin (Siamese) or triplet) with contrastive loss and adaptive margins to track slowly varying systems for which class or similarity labels are not available. The approach adopts locality‐sensitive hashing to divide time‐ordered contiguous data into an arbitrary number of pseudo‐classes. Contrastive‐loss training with many hash bins generates an evolving latent‐space trajectory. This approach enables unsupervised metric learning for seismic data stacks under the condition of contiguous state sampling and slowly varying fracture properties. The displacement discontinuity theory provides a mechanistic foundation for the fracture‐dependent trajectories that are related to relaxation of fractures with time‐dependent specific stiffness responding to changes in stress or fluid saturation.

02 PETROLEUM↗
DOE OSTI2022

Power System Resilience Evaluation Framework and Metric Review

Power system resilience has been an emerging hot topic in recent years to investigate the increasing threats of extreme events, such as natural disasters, severe weather, and cyberattacks. Although much research has been done to define, model, and quantify resilience from different aspects, the lack of universally accepted evaluation methods and resilience metrics makes it difficult to assess and compare resilience across different power systems, such as what is typically done in power system reliability studies. In this paper, first, we review the definitions of resilience, and we summarize two core concepts shared by most of the literature. Then, we develop a new framework to assess power system resilience from two perspectives - i.e., pre-event estimation and post-event evaluation - to capture system resilience performance in both general and specific fashions. We conduct a thorough review of existing resilience metrics and categorize them using the proposed framework, where recommendations are also proposed to capture core concepts of resilience.

power system resilience↗
DOE OSTI2025

Logarithmic Resilience Risk Metrics That Address the Huge Variations in Blackout Cost

Resilience risk metrics must address the customer cost of the largest blackouts of greatest impact. However, there are huge variations in blackout cost in observed distribution utility data that make it impractical to properly estimate the mean large blackout cost and the corresponding risk. These problems are caused by the heavy tail observed in the distribution of customer costs. To solve these problems, we propose resilience metrics that describe large blackout risk using the mean of the logarithm of the cost of large-cost blackouts, the slope index of the heavy tail, and the frequency of large-cost blackouts.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

The Next Stage for Smart Cities: Metrics to Spur an Evolution from Technology for Efficiency to Technology for People's Needs

The Smart Cities movement is about a decade old, energized by the USDOT Smart Cities grant that sparked cities to dream big. Now, 10 years later, and multitudes of conferences and papers later, the biggest question regarding Smart Cities is whether any progress has been made? Smart Cities forums are typically led by the technology sector, either telecommunications, internet access, or most recently artificial intelligence (AI) concerns. Each of these areas have grown and found new applications in the context of Smart Cities, however, these technology applications are just tools toward ends. Do digital communications and assistance enable or foster improved access to real, tactile, non-virtual goods and services such as transportation, food, housing, trash removal, health care, education, social interaction? These and other topics are not 'big tech', but are each critical to quality of life outcomes and are day-to-day necessities, comprising many of the touch points through which citizens interact with municipal agencies. Regarding Smart Cities, relationships have not been fully refined as to how best to merge the emerging generation of technology and related trends with more mundane but essential requirements of tactile services. How should municipal managers and operators bring the range of new technology tools (e.g. on-demand transit, automated vehicles, digital connectivity) to bear to improve functions serving real- physical- non-virtual needs? How do we make cities more efficient in providing access to services and opportunities for improved quality of life? This paper examines the current Smart City movement, emerging trends, and the need to put metrics with respect to the delivery, access, and provision of real-life needs. Using a few case studies of past, present, and projected future scenarios, this paper attempts to bring Smart Cities into the real cities domain, perhaps pushing the moniker away from 'Smart' to 'Efficient' - something that can be measured, counted, and assessed. Through the consideration of the next stage of the evolution of cities from 'Smart' to 'Efficient', the combined efforts and experience of multiple researchers at the NREL and their network of collaborators highlights the need for updates metrics that can be used to start guiding efforts toward productive initiatives to improve quality of life.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Equitable Employment Access Assessed Through the Mobility Energy Productivity (MEP) Metric

This paper examines commuting options for an underserved neighborhood in Columbus, Ohio to a major employment center. The analysis is based on an emerging metric called the Mobility Energy Productivity (MEP) metric developed by the National Renewable Energy Laboratory (NREL) on behalf the Department of Energy (DOE). The purpose of the analysis is twofold. The first is to quantify relative attractiveness of commute modes between the two locations, using a perspective that includes travel time, energy and cost, while providing an equity lens to compare commute options between privately owned vehicles and pooled transportation options. The second objective is to apply MEP in a specific origin-destination (O-D) scenario, whereas previously it has been used primarily as an aggregate metropolitan-wide statistical measure. In so doing, parameters in MEP are further customized and the methodology is refined to account for unique aspects of this case study. Four commute options between the neighborhood and the industry employment based are analyzed: drive alone option, public transit express bus (historical), public transit normal route (current), and a proposed shuttle specific to the O-D pair. This analysis identified issues applying MEP that required further customization: (1) deprecation functions customized to modes other than driving, (2) accounting for first-mile last-mile travel times with transit, (3) accounting for transit frequency without resorting to full simulation. The results provide quantitative insights on the employment accessibility between these two locations, both across modes, and as equity of job accessibility for those who can and cannot operate a personal vehicle.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Developing Metrics to Assess Justice and Equity Implications of Early-Stage Research

Physics is a central component of early-stage research and development of virtually all technologies. But as much as scientific breakthroughs often hold the key to high efficiencies, long lifetimes, and high stability in devices for countless applications, early-stage choices research choices, such as those around materials or processing, can also serve to lock in long-term social and equity impacts of deployed technologies. This talk will explore how scientists can start to consider these impacts, with a focus on the energy sector and achieving a just and sustainable energy transition. We discuss development of the Justice Underpinning Science and Technology Research (JUST-R) metrics framework - a suite of metrics targeted at early-stage researchers to assess justice considerations in their work. The framework is evaluated for its appeal to researchers and effectiveness at promoting integration of justice considerations into research through case studies, which reveal its ability to broaden researcher perspectives and key avenues for future improvement.

energy equity↗
DOE OSTI2024

Developing and Evaluating Energy Justice Metrics for Early-Stage Materials Research

Materials science is a central component of early-stage research and development of virtually all clean energy technologies. But as much as material breakthroughs often hold the key to high efficiencies, long lifetimes, and high stability in eventual devices, early-stage choices about material types, structures, and processing can also serve to lock in long-term social and equity impacts of deployed energy technologies. Thus, to achieve a just and sustainable energy transition, tools to assess the energy justice impacts of early-stage materials research are critical. Here, we discuss development of the Justice Underpinning Science and Technology Research (JUST-R) metrics framework - a suite of metrics targeted at early-stage researchers to assess energy justice considerations in their work. The framework is evaluated for its appeal to researchers and effectiveness at promoting integration of energy justice into research through case studies, which reveal its ability to broaden researcher perspectives and key avenues for future improvement.

energy justice↗
DOE OSTI2025

Environmental Metrics of Ethanol Production Improve with Increased Biomass Yield and Carbohydrate Content in Populus Trichocarpa

When selecting economically and environmentally advantageous genotypes for domestication in a biofuel supply chain, variability of cell-wall composition within a feedstock population and its impact on biorefinery metrics must be understood. We performed a life cycle assessment (LCA) on a poplar-to-ethanol supply chain to quantify global warming potential and cumulative energy demand as affected by variable carbohydrate content in a large representative natural variant population of Populus trichocarpa. The results showed that both environmental metrics decrease with increasing tree size and with increasing biomass carbohydrate content. These trends parallel prior economic results and provide clear direction to breeders or genetic engineers when improving poplar cultivars.

09 BIOMASS FUELS↗
DOE OSTI2024

Establishing performance metrics for quantitative non-targeted analysis: a demonstration using per- and polyfluoroalkyl substances

Abstract Non-targeted analysis (NTA) is an increasingly popular technique for characterizing undefined chemical analytes. Generating quantitative NTA (qNTA) concentration estimates requires the use of training data from calibration “surrogates,” which can yield diminished predictive performance relative to targeted analysis. To evaluate performance differences between targeted and qNTA approaches, we defined new metrics that convey predictive accuracy, uncertainty (using 95% inverse confidence intervals), and reliability (the extent to which confidence intervals contain true values). We calculated and examined these newly defined metrics across five quantitative approaches applied to a mixture of 29 per- and polyfluoroalkyl substances (PFAS). The quantitative approaches spanned a traditional targeted design using chemical-specific calibration curves to a generalizable qNTA design using bootstrap-sampled calibration values from “global” chemical surrogates. As expected, the targeted approaches performed best, with major benefits realized from matched calibration curves and internal standard correction. In comparison to the benchmark targeted approach, the most generalizable qNTA approach (using “global” surrogates) showed a decrease in accuracy by a factor of ~4, an increase in uncertainty by a factor of ~1000, and a decrease in reliability by ~5%, on average. Using “expert-selected” surrogates ( n = 3) instead of “global” surrogates ( n = 25) for qNTA yielded improvements in predictive accuracy (by ~1.5×) and uncertainty (by ~70×) but at the cost of further-reduced reliability (by ~5%). Overall, our results illustrate the utility of qNTA approaches for a subclass of emerging contaminants and present a framework on which to develop new approaches for more complex use cases. Graphical Abstract

Pu, Shirley (ORCID:0000000201223797)↗
DOE OSTI2020

Regional patterns in hydrologic response, a new three-component metric for hydrograph analysis and implications for ecohydrology, Northwest Volcanic Aquifer Study Area, USA

Spatial patterns of hydrologic response were examined for the Northwest Volcanic Aquifer Study Area (NVASA). The utility of established hydrograph-separation methods for assessing hydrologic response in permeable volcanic terranes was assessed and a new three-component metric for hydrograph analysis was developed. The new metric, which partitions streamflow into subcomponents defined by the timescales of hydrologic response (e.g., fast-runoff, intermediate-interflow and slow-baseflow), was used to gain a fundamental understanding of the regional hydrology, investigate sub-regional differences, influencing factors, and ecohydrological implications. The combined effects of NVASA’s physiography, climate and geology create a strongly coupled surface-groundwater system that produces copious baseflow and limited quantities of runoff and interflow. Patterns of hydrologic response are influenced by the type and rate of precipitation and permeability of the underlying geology. Under variable precipitation conditions the hydrologic response of volcanic terranes with similar permeability and subsurface-storage capacity can be significantly different. From a water management and ecohydrology perspective, understanding regional patterns of hydrologic response and sub-regional differences is fundamental. Results indicate that minimum-flow methods provide the most conservative estimate of baseflow and may be the most robust for filtering out snowmelt bias in baseflow estimates. Baseflow contributes ~75% of the perennial streamflow across the NVASA and represents a critical component of the regional water supply that provides critical cold-water habitat.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Establishing metrics to quantify spatial similarity in spherical and red blood cell distributions

As computational power increases and systems with millions of red blood cells can be simulated, it is important to note that varying spatial distributions of cells may affect simulation outcomes. Since a single simulation may not represent the ensemble behavior, many different configurations may need to be sampled to adequately assess the entire collection of potential cell arrangements. In order to determine both the number of distributions needed and which ones to run, we must first establish methods to identify well-generated, randomly placed cell distributions and to quantify distinct cell configurations. We utilize metrics to assess (1) the presence of any underlying structure to the initial cell distribution and (2) similarity between cell configurations. We propose the use of the radial distribution function to identify long-range structure in a cell configuration and apply it to a randomly distributed and structured set of red blood cells. To quantify spatial similarity between two configurations, we make use of the Jaccard index, and characterize sets of red blood cell and sphere initializations. As an extension to our work submitted to the International Conference on Computational Science, we significantly increase our data set size from 72 to 1048 cells, include a similar set of studies using spheres, compare the effects of varying sphere size, and utilize the Jaccard index distribution to probe sets of extremely similar configurations. Our results show that the radial distribution function can be used as a metric to determine long-range structure in both distributions of spheres and RBCs. We determine that the ideal case of spheres within a cube versus bi-concave shaped cells within a cylinder affects the shape of the Jaccard index distributions, as well as the range of Jaccard values, showing that both the shape of particle and the domain may play a role. Furthermore, we also find that the distribution is able to capture very similar configurations through Jaccard index values greater than 95% when appending several nearly identical configurations into the data set.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Multiple Metrics Informed Projections of Future Precipitation in China

Predicting how regional precipitation will respond to future warming is among the most challenging undertaking in climate change projection. Despite sustained efforts to improve modeling and understanding of precipitation, the overall uncertainty in projecting regional precipitation has not been reduced substantially. In this work, the potential for more robust precipitation projections is demonstrated through the use of discriminating metrics to subsample the multimodel ensemble. Using a two-dimensional metric of precipitation and its relationship with large-scale circulation indices in East Asia, 31 models in the Coupled Model Intercomparison Project Phase 5 (CMIP5) are classified into three groups. Models in the top performing group projected statistically significant increasing trends in precipitation and the regional precipitation patterns are more similar to each other than to the patterns in the bottom performing group. In contrast, models in the bottom performing group projected diverse responses, with overall small drying or no significant trends in precipitation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Electrochemical metrics for corrosion resistant alloys

Abstract Corrosion is an electrochemical phenomenon. It can occur via different modes of attack, each having its own mechanisms, and therefore there are multiple metrics for evaluating corrosion resistance. In corrosion resistant alloys (CRAs), the rate of localized corrosion can exceed that of uniform corrosion by orders of magnitude. Therefore, instead of uniform corrosion rate, more complex electrochemical parameters are required to capture the salient features of corrosion phenomena. Here, we collect a database with an emphasis on metrics related to localized corrosion. The six sections of the database include data on various metal alloys with measurements of (1) pitting potential, E pit , (2) repassivation potential, E rp , (3) crevice corrosion potential, E crev , (4) pitting temperature, T pit , (5) crevice corrosion temperature, T crev , and (6) corrosion potential, E corr , corrosion current density, i corr , passivation current density, i pass , and corrosion rate. The experimental data were collected from 85 publications and include Al- and Fe-based alloys, high entropy alloys (HEAs), and a Ni-Cr-Mo ternary system. This dataset could be used in the design of highly corrosion resistant alloys.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Exploring Hilbert space on a budget: Novel benchmark set and performance metric for testing electronic structure methods in the regime of strong correlation

This work explores the ability of classical electronic structure methods to efficiently represent (compress) the information content of full configuration interaction (FCI) wave functions. We introduce a benchmark set of four hydrogen model systems of different dimensionalities and distinctive electronic structures: a 1D chain, a 1D ring, a 2D triangular lattice, and a 3D close-packed pyramid. To assess the ability of a computational method to produce accurate and compact wave functions, we introduce the accuracy volume, a metric that measures the number of variational parameters necessary to achieve a target energy error. Using this metric and the hydrogen models, we examine the performance of three classical deterministic methods: (i) selected configuration interaction (sCI) realized both via an a posteriori (ap-sCI) and variational selection of the most important determinants, (ii) an a posteriori singular value decomposition (SVD) of the FCI tensor (SVD-FCI), and (iii) the matrix product state representation obtained via the density matrix renormalization group (DMRG). We find that the DMRG generally gives the most efficient wave function representation for all systems, particularly in the 1D chain with a localized basis. For the 2D and 3D systems, all methods (except DMRG) perform best with a delocalized basis, and the efficiency of sCI and SVD-FCI is closer to that of DMRG. For larger analogs of the models, the DMRG consistently requires the fewest parameters but still scales exponentially in 2D and 3D systems, and the performance of SVD-FCI is essentially equivalent to that of ap-sCI.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗