Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Spatiotemporal Variability of Electric System Reliability Metrics

As urbanization continues to grow, urban density also rises, placing significant stress on critical infrastructure. Cities often face challenges in investing in new infrastructure or upgrading existing ones. One area of infrastructure that has come under strain is the electric grid, leading to prolonged power outages. According to data from the U.S. Energy Information Administration, the average duration of power outages has steadily doubled from 2013 to 2021, primarily due to extreme weather events. The IEEE has developed a series of reliability metrics to assess the reliability of the electric system. However, these metrics are only applied at the utility level, making it challenging to comprehend the variations in these indices at finer spatial resolutions and, consequently, evaluate reliability at the non-utility level. In this study, we leveraged electric outage data collected at 15-minute intervals at the county level to estimate electric system reliability over a six-year period using a novel data analysis approach. Our findings reveal a gradual decline in reliability in the U.S. Southwest compared to national averages. Furthermore, the duration of outages per customer per event has significantly decreased in large portions of California and Florida. These discoveries can be valuable for utility companies as they seek to pinpoint regional anomalies and plan for prioritized remediation efforts.

Singh, Nagendra↗

Thermal Resilience of Buildings and Communities: A Multistakeholder Review of Metrics and Approaches

Increasing temperature-related hazards require a collective effort to assess and enhance the thermal resilience of buildings and communities to protect occupants’ safety and minimize property or infrastructure damage. However, limited coordination across stakeholders and lack of standardized procedures for resilience assessment undermine the effectiveness of extreme temperature mitigation and adaptation strategies across the building life cycle. This review examines the current literature on resilience metrics to address thermal stress and risk due to extreme indoor environments. Stakeholders of thermal resilience include architects and engineers, occupants, property owners, real estate developers, urban planners, and policymakers. Additionally, motivations for measuring thermal resilience are emphasized, such as safeguarding occupant health and survivability, protecting property, and ensuring business continuity during extreme weather events. This review provides actionable insights and identifies future research needs for enhancing resilience through tailored metrics for stakeholders during the planning, design, construction, operation, and retrofitting phases of buildings and communities.

building life cycle↗

Defining Electrode-Level Metrics for Enabling Earth-Abundant, Mn-Rich Cathodes: A Technoeconomic Analysis of Experimental Materials

Manganese-rich oxides are attractive options as next-generation, earth-abundant cathodes and significant efforts are being directed toward commercial implementation. We report here an updated techno-economic analysis of the lithium- and manganese-rich (LMR) class of earth-abundant cathodes for electric vehicle applications. BatPaC modeling was used to define the cell-level metrics that must be met for these materials to be cost and energy competitive with the current commercial earth-abundant benchmark, LiFePO 4 , as well as anticipated variations such as LiMn 0.8 Fe 0.2 PO 4 . The model was used to evaluate a high-performance material from the literature and subsequently define R&D targets as the likely limits of practical performance for similar LMR systems. Experimental validation and BatPaC evaluation of an advanced, cobalt-free LMR cell system was also conducted. Results show that the advanced LMR cells come within ∼5% of the defined limits and exceed the energy of LiFe(Mn)PO 4 cells at a similar cost. Excellent cycle-life, low impedance, and low impedance rise were also achieved under the conditions tested and reveal that cobalt is not necessary to achieve high-performance LMR oxides. Although the analysis conducted herein reports on LMR cell systems, the methodology and target values defined for performance metrics easily extend to the evaluation of other systems under consideration as earth-abundant options.

Chen, Jiajun [Argonne National Laboratory (ANL), A↗

Assessing the Effects of Data Compression in Simulations Using Physically Motivated Metrics

This paper examines whether lossy compression can be used effectively in physics simulations as a possible strategy to combat the expected data-movement bottleneck in future high performance computing architectures. We show that, for the codes and simulations we tested, compression levels of 3–5X can be applied without causing significant changes to important physical quantities. Rather than applying signal processing error metrics, we utilize physics-based metrics appropriate for each code to assess the impact of compression. We evaluate three different simulation codes: a Lagrangian shock-hydrodynamics code, an Eulerian higher-order hydrodynamics turbulence modeling code, and an Eulerian coupled laser-plasma interaction code. We compress relevant quantities after each time-step to approximate the effects of tightly coupled compression and study the compression rates to estimate memory and disk-bandwidth reduction. We find that the error characteristics of compression algorithms must be carefully considered in the context of the underlying physics being modeled.

Laney, Daniel↗

The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Inter-comparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.

54 ENVIRONMENTAL SCIENCES↗

Metrics for evaluating tropical cyclones in climate data

This manuscript describes a software suite that can be used for objective evaluation of tropical cyclones (TCs) in gridded climate data. Using cyclone trajectories derived from 6-hourly data, a comprehensive set of metrics is defined to systematically compare and contrast products to one another. In addition to annual TC climatologies, attention is paid to spatial and temporal patterns of storm occurrence and intensity. Assessment can be performed either on the global scale or regional domains. Simple to visualize ‘scorecards’ allow for rapid credibility assessment. We showcase three key findings enabled by this suite. First, we compare the representation of TCs in seven current-generation global reanalyses and conclude that higher resolution models and those with TC-specific assimilation contain more accurate storm climatologies. Second, using a free-running Earth system model (ESM) we find that full basin refinement is required in variable-resolution configurations to adequately simulate North Atlantic TC frequency. Furthermore, upstream refinement over northern Africa offers little benefit in simulating storm occurrence but spatial genesis patterns are improved. Finally, we show that TCs simulated by ESMs can be highly sensitive to individual parameterizations in climate models, with North Atlantic TC metrics varying greatly depending on version of the Morrison-Gettelman microphysics package.

54 ENVIRONMENTAL SCIENCES↗

Error metrics for partially coherent wave fields

Lensless imaging methods that account for partial coherence have become very common in the past decade. However, there are no metrics in use for comparing partially coherent light fields, despite the widespread use of such metrics to compare fully coherent objects and wave fields. Here, we show how reformulating the mean squared error and Fourier ring correlation in terms of quantum state fidelity naturally generalizes them to partially coherent wave fields. We report these results fill an important gap in the lensless imaging literature and will enable quantitative assessments of the reliability and resolution of reconstructed partially coherent wave fields.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Distance Walked and Run as Improved Metrics over Time-Based Energy Estimation in Epidemiological Studies and Prevention; Evidence from Medication Use

The guideline physical activity levels are prescribed in terms of time, frequency, and intensity (e.g., 30 minutes brisk walking, five days a week or its energy equivalence) and assume that different activities may be combined to meet targeted goals (exchangeability premise). Habitual runners and walkers may quantify exercise in terms of distance (km/day), and for them, the relationship between activity dose and health benefits may be better assessed in terms of distance rather than time. Analyses were therefore performed to test: 1) whether time-based or distance-based estimates of energy expenditure provide the best metric for relating running and walking to hypertensive, high cholesterol, and diabetes medication use (conditions known to be diminished by exercise), and 2) the exchangeability premise. Logistic regression analyses of medication use (dependent variable) vs. metabolic equivalent hours per day (METhr/d) of running, walking and other exercise (independent variables) using cross-sectional data from the National Runners’ (17,201 male, 16,173 female) and Walkers’ Health Studies (3,434 male, 12,384 female). Estimated METhr/d of running and walking activity were 38% and 31% greater, respectively, when calculated from self-reported time than distance in men, and 43% and 37% greater in women, respectively. Percent reductions in the odds for hypertension and high cholesterol medication use per METhr/d run or per METhr/d walked were ≥2-fold greater when estimated from reported distance (km/wk) than from time (hr/wk). The per METhr/d odds reduction was significantly greater for the distance- than the time-based estimate for hypertension (runners: P<10 -5 for males and P = 0.003 for females; walkers: P = 0.03 for males and P<10 -4 for females), high cholesterol medication use in runners (P<10 -4 for males and P = 0.02 for females) and male walkers (P = 0.01 for males and P = 0.08 for females) and for diabetes medication use in male runners (P<10 -3 ). Although causality between greater exercise and lower prevalence of hypertension, high cholesterol and diabetes cannot be inferred from these cross-sectional data, the results do suggest that distance-based estimates of METhr/ d run or walked provide superior metrics for epidemiological analyses to their traditional time-based estimates.

59 BASIC BIOLOGICAL SCIENCES↗

Developing and Evaluating Metrics for Demand Flexibility in Buildings: Comparing Simulations and Field Data

Building demand flexibility (DF) has attracted significant attention in recent years among researchers, technology developers and control companies, aggregators, utilities, and many others. There are numerous challenges with today’s electricity systems such as managing peak demand capacity and integrating variable renewables into the grid. Flexible building loads can provide various grid services to help reduce electricity costs, smooth out renewables intermittency and balance supply and demand. Recognizing this, the US DOE is leading the Grid-interactive Efficient Buildings (GEB) initiative which includes research to evaluate the potential, availability and timing of flexible loads. In this paper we present load shed metrics for three building types – medium office, large office and retail store – and compare prototype simulation results with measured data from 12 actual buildings that participated in hot summertime utility demand response (DR) events. The DR strategies included varying zone temperature and reducing light levels. The magnitude of a key DF metric, “demand decrease intensity” (or “shed intensity”) (W/ft2), between the simulation results and field data are similar (14-32% differences) for both mean and median values, though the field data show much larger variation among DR events. The coefficient p-values from linear regression model tests showed that outside air temperature is a significant variable for the whole building shed intensity when the resetting zone temperature strategy is deployed. These findings support the concept of using prototype building simulation to estimate building DF and expanding future simulation research to additional building types and climate zones.

Liu, Jingjing↗

Relating Quantitative Soil Structure Metrics to Saturated Hydraulic Conductivity

Core Ideas Soil structure quantified in the field using a 3D laser scanning technique (MLT). MLT data and coefficient of linear extensibility combined into a structure metric. Soil water contents recorded at four depths in a field lysimeter and used in HYDRUS‐1D. Saturated conductivity ( K s ) estimated with a Markov chain Monte Carlo approach. New metric better correlated to K s in horizons with strong soil structure. Soil structure affects saturated hydraulic conductivity ( K s ) by creating highly conductive macropores that preferentially transmit soil water. In this study, we explored the relationship between K s and macropores in an Oxyaquic Vertic Argiudoll in northeastern Kansas. Macropores were quantified from an excavation wall using multistripe laser triangulation (MLT) scanning. Soil water contents were measured at four depths within a soil lysimeter installed within 2 m of the MLT‐scanned soil profile and adjacent to an Ameriflux tower monitoring precipitation, air temperature, and solar radiation. Selected hydraulic properties of soil horizons within the lysimeter were optimized to water content data using a Markov chain Monte Carlo technique in combination with the mobile–immobile water (MIM) model in HYDRUS‐1D. Estimates of K s varied between 4198 cm d −1 in the A horizon and 0.6 cm d −1 in a 2Btss2 horizon with strongly expressed wedge structure. Approximately 87% of the variation in K s was explained by the geometric mean of the widths of pores quantified with the MLT technique and modified by the coefficient of linear extensibility (COLE). The use of the COLE allows the widths of the macropores obtained under dry conditions to be approximated at saturation. Two models that predict K s from either texture or water retention data resulted in K s estimates that were similar to each other but significantly lower than K s values predicted with MIM in horizons where structural pores dominate water flow. This technique shows a great deal of promise in better understanding and predicting the relationship of soil structure to water flow.

Eck, Dennis V.↗

Simulation information regarding Sandia National Laboratories trinity capability improvement metric.

Sandia National Laboratories, Los Alamos National Laboratory, and Lawrence Livermore National Laboratory each selected a representative simulation code to be used as a performance benchmark for the Trinity Capability Improvement Metric. Sandia selected SIERRA Low Mach Module: Nalu, which is a uid dynamics code that solves many variable-density, acoustically incompressible problems of interest spanning from laminar to turbulent ow regimes, since it is fairly representative of implicit codes that have been developed under ASC. The simulations for this metric were performed on the Cielo Cray XE6 platform during dedicated application time and the chosen case utilized 131,072 Cielo cores to perform a canonical turbulent open jet simulation within an approximately 9-billion-elementunstructured- hexahedral computational mesh. This report will document some of the results from these simulations as well as provide instructions to perform these simulations for comparison.

Agelastos, Anthony Michael↗

Advanced Fuels Campaign Light Water Reactor Accident Tolerant Fuel Performance Metrics Executive Summary

Research and development (R&D) activities on advanced, higher performance Light Water Reactor (LWR) fuels have been ongoing for the last few years. Following the unfortunate March 2011 events at the Fukushima Nuclear Power Plant in Japan, the R&D shifted toward enhancing the accident tolerance of LWRs. Qualitative attributes for fuels with enhanced accident tolerance, such as improved reaction kinetics with steam resulting in slower hydrogen generation rate, provide guidance for the design and development of fuels and cladding with enhanced accident tolerance. A common set of technical metrics should be established to aid in the optimization and down selection of candidate designs on a more quantitative basis. “Metrics” describe a set of technical bases by which multiple concepts can be fairly evaluated against a common baseline and against one another. This report describes a proposed technical evaluation methodology that can be applied to evaluate the ability of each concept to meet performance and safety goals relative to the current UO2 – zirconium alloy system and relative to one another. The resultant ranked evaluation can then inform concept down-selection, such that the most promising accident tolerant fuel design option(s) can continue to be developed toward qualification.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Energy Efficiency Program Typology and Data Metrics: Enabling Multi-State Analyses Through the Use of Common Terminology

In order to compile and analyze information about energy efficiency programs across the country, it is necessary to have a common categorization of program types as well as definitions of the metrics that define program performance and characteristics. As part of an effort to analyze the cost per unit of savings for utility-customer funded, end-use energy efficiency programs, LBNL developed a program typology with standardized program categories, as well as metrics and associated definitions that describe program characteristics, costs and impacts. These definitions and naming conventions facilitate meta-analysis of program results and could simplify the analyses and use of such information by a wide range of entities engaged in reporting and assessing the impacts of energy efficiency.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Projections of Full-Fuel-Cycle Energy and Emissions Metrics

To accurately represent how conservation and efficiency policies affect energy demand, both direct and indirect impacts need to be included in the accounting. The indirect impacts are defined here as the resource savings that accrue over the fuel production chain, which when added to the energy consumed at the point of use, constitute the full-fuel- cycle (FFC) energy. This paper uses the accounting framework developed in (Coughlin 2012) to calculate FFC energy metrics as time series for the period 2010-2040. The approach is extended to define FFC metrics for the emissions of greenhouse gases (GHGs) and other air-borne pollutants. The primary focus is the types of energy used in buildings and industrial processes, mainly natural gas and electricity. The analysis includes a discussion of the fuel production chain for coal, which is used extensively for electric power generation, and for diesel and fuel oil, which are used in mining, oil and gas operations, and fuel distribution. Estimates of the energy intensity parameters make use of data and projections from the Energy Information Agency’s National Energy Modeling System, with calculations based on information from the Annual Energy Outlook 2012.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Conceptual Framework for Developing Resilience Metrics for the Electricity, Oil, and Gas Sectors in the United States

This report has been written for the Department of Energy’s Energy Policy and Systems Analysis Office to inform their writing of the Quadrennial Energy Review in the area of energy resilience. The topics of measuring and increasing energy resilience are addressed, including definitions, means of measuring, and analytic methodologies that can be used to make decisions for policy, infrastructure planning, and operations. A risk-based framework is presented which provides a standard definition of a resilience metric. Additionally, a process is identified which explains how the metrics can be applied. Research and development is articulated that will further accelerate the resilience of energy infrastructures.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Transactive System: Part II: Analysis of Two Pilot Transactive Systems using Foundational Theory and Metrics

This document is the second of a two-part report. Part 1 reviewed several demonstrations of transactive control and compared them in terms of their payoff functions, control decisions, information privacy, and mathematical solution concepts. It was suggested in Part 1 that these four listed components should be adopted for meaningful comparison and design of future transactive systems. Part 2 proposes qualitative and quantitative metrics that will be needed to compare alternative transactive systems. It then uses the analysis and design principles from Part 1 while conducting more in-depth analysis of two transactive demonstrations: the American Electric Power (AEP) gridSMART Demonstration, which used a double –auction market mechanism, and a consensus method like that used in the Pacific Northwest Smart Grid Demonstration. Ultimately, metrics must be devised and used to meaningfully compare alternative transactive systems. One significant contribution of this report is an observation that the decision function used for thermostat control in the AEP gridSMART Demonstration has superior performance if its decision function is recast to more accurately reflect the power that will be used under for thermostatic control under alternative market outcomes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

High Performance Computing Metrics to Enable Application-Platform Communication

Sandia has invested heavily in scientific/engineering application development and in the research, development, and deployment of large scale HPC platforms to support the computational needs of these applications. As application developers continually expand the capabilities of their software and spend more time on performance tuning of applications for these platforms, HPC platform resources are at a premium as they are a heavily shared resource serving the varied needs of many users. To ensure that the HPC platform resources are being used effciently and perform as designed, it is necessary to obtain reliable data on resource utilization that will allow us to investigate the occurrence, severity, and causes of performance-affecting contention between applications. The work presented in this paper was an initial step to determine if resource contention can be understood and minimized through monitoring, modeling, planning and infrastructure. This paper describes the set of metric definitions, identified in this research, that can be used as meaningful and potentially actionable indicators of performance-affecting contention between applications. These metrics were verified using the observed slowdown of IOR, IMB, and CTH in operating scenarios that forced contention. This paper also describes system/application monitoring activities that are critical to distilling vast amounts of data into quantities that hold the key to understanding for an application's performance under production conditions and that will ultimately aid in Sandia's efforts to succeed in extreme-scale computing.

97 MATHEMATICS AND COMPUTING↗

Performance Metric for Cementitious Waste Form Inventory Release in the Integrated Disposal Facility

This report describes work supporting Phase 1 of the 2018 Department of Energy (DOE) Office of River Protection’s (ORP) Grand Challenge recipient proposal “Cementitious Immobilization of Treated LAW and Ancillary Benefits to Risk Reduction in Cross Site Transfer”. Phase 1 was to establish a performance metric for grout leachability against which laboratory leach data (as observed diffusivities) can be assed, followed by a comparison of historical test data against this metric. Historically, advancements in the cementitious (grout) waste form performance have been made over the last 40 years, with the majority of progress achieved within the past 8 years as part of the Washington River Protection Solutions, LLC testing program. This report presents a summary of that effort relevant to the Hanford Site.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗