Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Deep Energy Retrofit Performance Metric Comparison: Eight California Case Studies

In this paper we will present the results of monitored annual energy use data from eight residential Deep Energy Retrofit (DER) case studies using a variety of performance metrics. For each home, the details of the retrofits were analyzed, diagnostic tests to characterize the home were performed and the homes were monitored for total and individual end-use energy consumption for approximately one year. Annual performance in site and source energy, as well as carbon dioxide equivalent (CO 2 e) emissions were determined on a per house, per person and per square foot basis to examine the sensitivity to these different metrics. All eight DERs showed consistent success in achieving substantial site energy and CO 2 e reductions, but some projects achieved very little, if any source energy reduction. This problem emerged in those homes that switched from natural gas to electricity for heating and hot water, resulting in energy consumption dominated by electricity use. This demonstrates the crucial importance of selecting an appropriate metric to be used in guiding retrofit decisions. Also, due to the dynamic nature of DERs, with changes in occupancy, size, layout, and comfort, several performance metrics might be necessary to understand a project’s success.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Key metrics for HFIR HEU and LEU models

This report compares key metrics for two fuel design models of the High Flux Isotope Reactor (HFIR). The first model represents the highly enriched uranium (HEU) fuel currently in use at HFIR, and the second model considers a low-enriched uranium (LEU) interim design fuel. Except for the fuel region, the two models are consistent, and both include an experiment loading that is representative of HFIR's current operation. The considered key metrics are the neutron flux at the cold source moderator vessel, the mass of 252 Cf produced in the flux trap target region as function of cycle time, the fast neutron flux at locations of interest for material irradiation experiments, and the reactor cycle length. These key metrics are a small subset of the overall HFIR performance and safety metrics. They were defined as a means of capturing data essential for HFIR's primary missions, for use in optimization studies assessing the impact of HFIR's conversion from HEU fuel to different types of LEU fuel designs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Methodology to Calculate the ACE and HPQ Metrics Used in the Wave Energy Prize

The U.S. Department of Energy's Wave Energy Prize Competition encouraged the development of innovative deep-water wave energy conversion technologies that at least doubled device performance above the 2014 state of the art. Because levelized cost of energy (LCOE) metrics are challenging to apply equitably to new technologies where significant uncertainty exists in design and operation, the prize technical team developed a reduced metric as proxy for LCOE, which provides an equitable comparison of low technology readiness level wave energy converter (WEC) concepts. The metric is called 'ACE' which is short for the ratio of the average climate capture width to the characteristic capital expenditure. The methodology and application of the ACE metric used to evaluate the performance of the technologies that competed in the Wave Energy Prize are explained in this report.

17 WIND ENERGY↗

Implementing Snowball Metrics in the Battelle-Affiliated DOE National Laboratories

The purpose of the Battelle Snowball Metric Working Group is to use the Snowball Metrics framework to build and employ a method to calculate metrics that will enable Battelle-affiliated National Laboratories to better understand their strengths and weaknesses in a few representative areas. This effort supports the overall aim of these Laboratories to use data-driven and evidence-based metrics to build and monitor effective strategies for evaluating science and technology (S&T) as individual laboratories, and as a Battelle institution. Battelle-affiliated National Laboratories include Brookhaven National Laboratory, Idaho National Laboratory, National Renewable Energy Laboratory, Oak Ridge National Laboratory, and Pacific Northwest National Laboratory.

99 GENERAL AND MISCELLANEOUS↗

Metrics and Benchmarks for Quantum Processors: State of Play

A compelling narrative has taken hold as quantum computing explodes into the commercial sector: Quantum computing in 2018 is like classical computing in 1965. In 1965 Gordon Moore wrote his famous paper about integrated circuits, saying: "At present, [minimum cost] is reached when 50 components are used per circuit. But... the complexity for minimum component costs has increased at a rate of roughly a factor of two per year... by 1975, the number of components per integrated circuit for minimum cost will be 65,000." This narrative is both appealing (we want to believe that quantum computing will follow the incredibly successful path of classical computing!) and plausible (2018 saw IBM, Intel, and Google announce 50-qubit integrated chips). But it is also deeply misleading. Here is an alternative: Quantum computing in 2018 is like classical computing in 1938. In 1938, John Atanasoff and Clifford Berry built the very first electronic digital computer. It had no program, and was not Turing-complete. Vacuum tubes — the standard "bit" for 20 years — were still 5 years in the future. ENIAC and the achievement of "computational supremacy" (over hand calculation) wouldn't arrive for 8 years, despite the accelerative effect of WWII. Integrated circuits and the information age were more than 20 years away. Neither of these analogies is perfect. Quantum computing technology is more like 1938, while the level of funding and excitement suggest 1965 (or later!). But the point of the cautionary analogy to 1938 is simple: Quantum computing in 2018 is a research field. It is far too early to establish metrics or benchmarks for performance. The best role for neutral organizations like IEEE is to encourage and shape research into metrics and benchmarks, so as to be ready when they become necessary. This white paper presents the evidence and reasoning for this claim. We explain what it means to say that quantum computing is a "research field", and why metrics and benchmarks for quantum processors also constitute a research field. We discuss the potential for harmful consequences of prematurely establishing standards or frameworks. We conclude by suggesting specific actions that IEEE or similar organizations can take to accelerate the development of good metrics and benchmarks for quantum computing.

97 MATHEMATICS AND COMPUTING↗

Evaluation of Machine Learning Approaches to Estimate Aerosol Mixing State Metrics in Atmospheric Models

Aerosol mixing state describes how aerosol compositions are distributed among atmospheric aerosol particles in a population. Oversimplified assumptions of aerosol mixing state in atmospheric modeling can introduce errors in estimations of weather and climate-relevant aerosol microphysical properties. A more comprehensive representation of the aerosol mixing state can be achieved in principle with a Particle-resolved Monte Carlo (PartMC) model but at added computational cost that may be prohibitive for direct invocation in operational numerical weather prediction or multi-year climate simulations. The aim of our research is to explore the machine learning (ML) methodologies for estimating aerosol mixing state metrics, which we define here in three different ways: with respect to (a) hygroscopicity; (b) optical properties; and (c) chemical species abundance. We adopted a data-driven approach, leveraging deep learning and statistical learning techniques, to take advantage of massive PartMC model simulations. First, we performed particle-resolved simulations by PartMC to create a series of scenarios considering a range of global environmental conditions. Each scenario consists of aerosol populations and corresponding mixing state metrics. The gas concentration, aerosol mass concentration, environmental variables and mixing state metrics of each population constitute the datasets for machine learning implementations. We have adopted and evaluated various configurations of machine learning methodologies in this investigation, embracing deep learning, Extreme Gradient Boosting (XGBoost) algorithm, and the ensemble approaches. After a rigorous model selection process, we identified an appropriate model to derive estimates of aerosol mixing state metrics. We used the computational and data resources of the Oak Ridge Leadership Computing Facility (OLCF) and the ORNL Compute and Data Environment for Science (CADES). The NVIDIA DGX-1 hardware was used for the prototyping of the ML models. Our approach has allowed us to gain a new understanding of how machine learning methodologies can be applied to improve the representation of aerosol mixing state in atmospheric models and benefit the atmospheric research community. Next, we plan to extend our research and methodology to quantify some of the aerosol-related uncertainties in the E3SM Atmospheric Model (EAM) Version 1.

54 ENVIRONMENTAL SCIENCES↗

National Hurricane Program Metrics Framework

The need for metrics for planning and response measures was identified as key gap to be addressed in the National Hurricane Program's (NHP) Technology Modernization effort. This document proposes a framework for defining a set of metrics for planning and response that will be implemented in the NHP products of hurricane evacuation studies (HES) and post-storm assessments (PSA). To determine the feasibility of this framework, a survey of current HES and PSAs was carried out followed by and then used to determine if the proposed metrics are currently captured. While there is a wide variety in data availability and detail, the implementation of these metrics is not only feasible but presents an opportunity to improve on current practices. The final implementation of this framework shall require the ongoing feedback from local, state, tribal, and federal stakeholders.

54 ENVIRONMENTAL SCIENCES↗

Applying Image Clutter Metrics to Domain-Specific Expert Visual Search

Visual clutter metrics play an important role in both the design of information visualizations and in the continued theoretical development of visual search models. In visualization design, clutter metrics provide a mathematical prediction of the complexity of the display and the difficulty associated with locating and identifying key pieces of information. In visual search models, they offer a proxy to set size, which represents the number of objects in the search scene, but is difficult to estimate in real-world imagery. In this article, we first briefly review the literature on clutter metrics and then contribute our own results drawn from studies in two security-oriented visual search domains: airport X-ray imagery and radar imagery. We analyze our results with an eye toward bridging the gap between the scene features evaluated by current clutter metrics and the features that are relevant to our security tasks. The article concludes with a brief discussion of possible research steps to close this gap.

97 MATHEMATICS AND COMPUTING↗

Grid Modernization: Metrics Analysis (GMLC1.1) - Affordability (Reference Document, Volume 6)

The GMLC Metric Team: 1) Identified important, but often overlooked, affordability metrics that measure the impacts of electricity costs on residential customers (customer cost burden, affordability gap, and affordability headcount gap); 2) Created a public-facing website for the residential sector that compiles publicly available data and displays affordability metrics at both the state and county level; and 3) demonstrated the use of the metrics and website for three remote village utilities in Alaska and a major electricity utility in California, Southern California Edison (SCE).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Review of Energy Equity Metrics

A literature review of energy equity and energy justice metrics was performed to support efforts to develop an energy equity metrics framework. Pacific Northwest National Laboratory (PNNL) reviewed the available literature, surveyed work in progress on the topic, and solicited expert feedback to lay the groundwork for metrics development and provide reference material for equity research and development applications. The literature review identified three distinct equity metric types: target population identification, investment decision making, and program impact assessment.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Technical Report on Waveform Fit Metrics for Global Models

The new WAVEFORMS Initiative in the Ground-based Nuclear Detonation Detection (GNDD) program includes an increased emphasis on the development of Earth models and methods to predict entire seismic and acoustic waveforms more accurately. In general, this increased emphasis is predicated on the need to better characterize seismic events and provide improved model-based discrimination between event types including earthquakes and explosions. More specifically, while current moment tensor inversion methods tend to work well for larger events (M>~4) using tuned 1-D Earth models, the development of state-of-the-art 3-D models and methods is required for the prediction of shorter period waves over large areas for discrimination of smaller events. There is no standard metric for model-based waveform prediction accuracy used in the waveform modeling/inversion community. However, there are several popular waveform misfit definitions; and minimizing the corresponding objective functions is the goal of waveform inversion. Some example misfit definitions employed for adjoint waveform tomography include measures of simple travel time differences (e.g. Tape et al., 2010), cross-correlation travel time differences (e.g. Luo and Schuster, 1991), multi-taper frequency dependent methods (e.g. Lei et al., 2020), time-frequency phase misfit functions (e.g. Fichtner 2010; Rodgers et al., 2022), normalized cross-correlation methods (e.g. Tao et al., 2018), and others. In some cases, these misfit definitions also involve complicated weighting schemes and summations over multiple frequency bands making it difficult to duplicate the misfit measurement with alternative models and datasets. Although each of the misfit definitions mentioned above are useful for developing waveform models, the actual misfit values are not usually meaningful outside of a given project, model, and/or dataset. Therefore, it is difficult to understand and communicate model performance for predicting waveforms and comparing to other models and/or new model iterations with a different dataset. Therefore, there is a need for a generalized method for evaluating overall model performance that is independent from the specific misfit chosen to develop the waveform models that is also intuitive and meaningful. In this report, we describe a new metric we refer to as ‘Percent of Correlated Signal’. The following sections describe and demonstrate the metric with a case study event and a more rigorous test using a random selection of globally distributed events. While the focus here is on global tomography models, the metric is meant to applicable to regional ‘wiggle-for-wiggle’ waveform models/studies as well.

58 GEOSCIENCES↗

Species Extrapolation of Propyl Acetate Dose Metrics

We demonstrate the ability of the propyl PBPK model to predict dose metrics of propyl acetate, propanol, and propionic acid from a standard 90-day subchronic inhalation study of propyl acetate in male and female rats. The model was used to predict the same dose metrics in “reference” male and female humans using the same exposure conditions. Finally, we used reverse dosimetry with the model to predict what exposure conditions would lead to the same dose metrics measured in rats. These extrapolations of internal dose metrics based on known species differences in physiology and measured differences in metabolism offer a more scientific species extrapolation than conventional uncertainty approaches, potentially of interest for risk assessment.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

Bridging the Gap on Data, Metrics, and Analyses for Grid Resilience to Weather Events: Information that utilities can provide regulators, state energy offices, and other stakeholders

A growing number of states require regulated utilities to file resilience plans to improve the electric grid’s ability to anticipate, withstand, adapt to and recover from increasingly severe weather events. This report aims to help state regulators identify and request data, metrics, and analyses from utilities and use it in decisions on utility resilience plans and investments. The report reviews state requirements and utility plans focused on overall grid resilience, climate change resilience and vulnerabilities, infrastructure modernization, storm protection, and wildfire mitigation. It details types of data, metrics, and analyses across five categories--and provides examples of each from the utility plans. The first category is vulnerability assessments, or evaluations of the susceptibility of systems, communities, or assets to potential harm from identified hazards. The second is data on hazards and the exposure of utility assets and customers to these hazards. The third is attribute metrics, or system characteristics that contribute to or describe the resilience of a system. The fourth is performance metrics, which are impacts of resilience investments on system performance--typically a reduction of negative impacts from hazard events. Finally, evaluation and prioritization are analyses that utilities conduct to estimate impacts from resilience measures (evaluation) and prioritize measures based on costs and estimated impacts (prioritization). The report concludes with examples of key trends and emerging best practices for states and utilities, and identifies areas for further research.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Near Term Reliability and Resilience: Revisiting Resilience Metrics for the Electric Grid

This report presents the metrics employed in the Near-Term Reliability and Resilience (NTRR) project to study the inter-dependencies between electric and natural gas infrastructures, particularly under challenging conditions. These metrics were developed and applied to evaluate the reliability and resilience of the electric grid and natural gas systems in near-term scenarios (within the next 10 years) involving extreme weather events and major supply disruptions. The report defines the metrics, explains how they are calculated, and describes the process by which they are used to evaluate reliability and resilience across simulated scenarios. It also demonstrates how the resilience metrics integrate with other project activities and summarizes the software tools deployed to calculate and visualize the results.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Sustainability metrics for assessing water resource recovery facilities of the future

Abstract The recovery of water, energy, and nutrients from water resource recovery facilities ( WRRF s) is needed to address significant global challenges, such as increasing water demand and decreasing availability of nonrenewable resources. To meet these challenges, innovative technological developments must lead to increased adoption of water and resource recovery processes, while addressing stakeholder needs (e.g., innovators, practitioners, regulators). A test bed network of over 90 partner facilities within the United States and abroad will help accelerate innovation and widespread adoption of novel processes through multiscale testing and demonstration of technologies. In this paper, we define a common set of environmental, economic, technical, and social performance metrics for innovative technologies, that will meet the needs of multiple stakeholders in the decision‐making process. These triple bottom line performance metrics can be used to track the sustainability of technologies in a consistent and transparent manner, while aiding the decision‐making process for WRRF s. Practitioner points The Facilities Accelerating Science and Technology (FAST) Water Network includes over 90 test bed facilities dedicated to accelerating innovation and adoption of water energy, and nutrient recovery systems. A common set of environmental, economic, technical, and social performance metrics should be measured and reported when a new technology is evaluated in the FAST Water Network. Performance metrics can aid sustainable decision‐making at WRRF, while meeting the needs of multiple stakeholders.

Cornejo, Pablo K.↗

Multidimensional metrics for estimating phage abundance, distribution, gene density, and sequence coverage in metagenomes

Phages are the most abundant biological entities on Earth and play major ecological roles, yet the current sequenced phage genomes do not adequately represent their diversity, and little is known about the abundance and distribution of these sequenced genomes in nature. Although the study of phage ecology has benefited tremendously from the emergence of metagenomic sequencing, a systematic survey of phage genes and genomes in various ecosystems is still lacking, and fundamental questions about phage biology, lifestyle, and ecology remain unanswered. To address these questions and improve comparative analysis of phages in different metagenomes, we screened a core set of publicly available metagenomic samples for sequences related to completely sequenced phages using the web tool, Phage Eco-Locator. We then adopted and deployed an array of mathematical and statistical metrics for a multidimensional estimation of the abundance and distribution of phage genes and genomes in various ecosystems. Experiments using those metrics individually showed their usefulness in emphasizing the pervasive, yet uneven, distribution of known phage sequences in environmental metagenomes. Using these metrics in combination allowed us to resolve phage genomes into clusters that correlated with their genotypes and taxonomic classes as well as their ecological properties. By adding this set of metrics to current metaviromic analysis pipelines, where they can provide insight regarding phage mosaicism, habitat specificity, and evolution.

59 BASIC BIOLOGICAL SCIENCES↗

ARM-IRL: Adaptive Resilience Metric Quantification Using Inverse Reinforcement Learning

The resilience of safety-critical systems is gaining importance due to the rise in cyber and physical threats, especially within critical infrastructure. Traditional static resilience metrics may not capture dynamic system states, leading to inaccurate assessments and ineffective responses to cyber threats. This work aims to develop a data-driven, adaptive method for resilience metric learning. We propose a data-driven approach using inverse reinforcement learning (IRL) to learn a single, adaptive resilience metric. The method infers a reward function from expert control actions. Unlike previous approaches using static weights or fuzzy logic, this work applies adversarial inverse reinforcement learning (AIRL), training a generator and discriminator in parallel to learn the reward structure and derive an optimal policy. The proposed approach is evaluated on multiple scenarios: optimal communication network rerouting, power distribution network reconfiguration, and cyber–physical restoration of critical loads using the IEEE 123-bus system. The adaptive, learned resilience metric enables faster critical load restoration in comparison to conventional RL approaches.

97 MATHEMATICS AND COMPUTING↗

Optimal Traffic Signal Control Using Priority Metric Based on Real-Time Measured Traffic Information

Optimizing traffic control systems at traffic intersections can reduce network-wide fuel consumption as well as improve traffic flow. While traffic signals have conventionally been controlled based on predetermined schedules, various adaptive control systems have been developed recently using advanced sensors such as cameras, radars, and LiDARs. By utilizing rich traffic information enabled by the advanced sensors, more efficient or optimal traffic signal control is possible in response to varying traffic conditions. This paper proposes an optimal traffic signal control method to minimize network-wide fuel consumption utilizing real-time traffic information provided by advanced sensors. This new method employs a priority metric calculated by a weighted sum of various factors, including the total number of vehicles, total vehicle speed, vehicle waiting time, and road preference. Genetic Algorithm (GA) is used as a global optimization method to determine the optimal weights in the priority metric. In order to evaluate the effectiveness of the proposed method, a traffic simulation model is developed in a high-fidelity traffic simulation environment called SUMO, based on a real-world traffic network. The traffic flow within this model is simulated using actual measured traffic data from the traffic network, enabling a comprehensive assessment of the novel optimal traffic signal control method in realistic conditions. The simulation results show that the proposed priority metric-based real-time traffic signal control algorithm can significantly reduce network-wide fuel consumption compared to the conventional fixed-time control and coordinated actuated control methods that are currently used in the modeled network. Additionally, incorporating truck priority in the priority metric leads to further improvements in fuel consumption reduction.

47 OTHER INSTRUMENTATION↗