Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Reference data, predictors, and probability grids for forest degradation classes in three sites in the Brazilian Amazon

Forest degradation by fires and selective logging is widespread in the Amazon region. We implemented a gradient boosted classification modeling framework to classify intact, logged, and burned forests at three Amazonian sites: Feliz Natal Municipality and Xingu Indigenous Territory in Mato Grosso State, and Saracá-Taquera National Forest in Pará State. We used forest degradation history from Landsat time-series as reference data and textural metrics derived from PlanetScope images as predictors. Textural metrics were computed using the Gray-Level Co-Occurrence Matrix (GLCM) textural technique. Included in the attached zip file are ten files: - a shapefile containing the reference data (fire and selective logging polygons and year of event) for each site; - a multiband tif file containing the 8 GLCM metrics used as predictors (Mean, Variance, Homogeneity, Contrast, Dissimilarity, Entropy, Angular Second Moment, Correlation) at the original PlanetScope resolution (3.125m) for each site; - a multiband tif file containing the 72 aggregated GLCM metrics used as predictors (Mean, Variance, Homogeneity, Contrast, Dissimilarity, Entropy, Angular Second Moment, and Correlation aggregated using the mean, first quartile, third quartile, maximum, median, minimum, root mean square, standard deviation, and skewness statistics) at 562m resolution for each site; - a multiband tif file containing the 3 probability grids for either intact, logged, or burned forests at the aggregation resolution (562m) for each site.

54 ENVIRONMENTAL SCIENCES↗

Machine learning enhanced characterization and optimization of photonic cured MAPbI 3 for efficient perovskite solar cells

Photonic curing (PC) can facilitate high-speed perovskite solar cell (PSC) manufacturing because it uses high-intensity light pulses to crystallize perovskite films in milliseconds. However, optimizing PC conditions is challenging due to its many variables, and using power conversion efficiency (PCE) as the optimization metric is both time-consuming and labor-intensive. This work presents a machine learning (ML) approach to optimize PC conditions for fabricating methylammonium lead iodide (MAPbI 3 ) films by quantitatively comparing their ultraviolet-visible (UV-vis) absorbance spectra to thermal annealed (TA) films using four similarity metrics. We perform Bayesian optimization coupled with Gaussian process regression (BO-GP) to minimize the similarity metrics. Refining PC conditions using active learning based on BO-GP models, we achieve a PC MAPbI3 film with an absorbance spectrum closely matching a TA reference film, which is further verified by its crystalline and morphological properties. Thus, we demonstrate that the UV-vis absorption spectrum can accurately proxy film quality. Additionally, we use an AI-based segmentation model for a more efficient grain size analysis. However, when we use the optimized PC condition to fabricate PSCs, we find that interaction between MAPbI 3 and the hole transport layer (HTL) during PC critically degrades the PSC performance. By adding a buffer layer between the HTL and MAPbI 3 , the optimized PC PSCs produce a champion PCE of 11.8%, comparable to the TA reference of 11.7%. Using UV-vis similarity metrics instead of device PCE as the objective in our BO-GP method accelerates the optimization of PC processing conditions for MAPbI 3 films.

14 SOLAR ENERGY↗

A Comparative Study of Deep Learning Models for Fracture and Pore Space Segmentation in Synthetic Fractured Digital Rocks

This study focuses on the comparative study of deep learning (DL) models for pore space and discrete fracture networks (DFNs) segmentation in synthetic fractured digital rocks, specifically targeting low-permeability rock formations, such as shale and tight sandstones. Accurate characterization of pore space and DFNs is critical for subsequent property analysis and fluid flow modeling. Four DL models, SegNet, U-Net, U-Net-wide, and nested U-Net (i.e., U-Net++), were trained, validated, and tested using synthetic datasets, including input and label image pairs with varying properties. The model performance was assessed regarding pixel-wise metrics, including the F1 score and pixel-wise difference maps. In addition, the physics-based metrics were considered for further analysis, including sample porosity and absolute permeability. Particularly, We first simulated the permeability of porous media containing only pore space and then simulated the permeability of porous media with DFNs added. The difference between these two values is used to quantify the connectivity of segmented DFNs, which is an important parameter for low-permeability rocks. The pixel-wise metrics showed that the nested U-Net model outperformed the rest of the DL models in pore space and DFNs segmentation, with the SegNet model exhibiting the second-best performance. Particularly, nested U-Net enhanced segmentation accuracy for challenging boundary pixels affected by partial volume effects. The U-Net-wide model achieved improved accuracy compared to the U-Net model, which indicated the influence of parameter numbers. Similarly, nested U-Net has the closest match to the ground truth of physics-based metrics, including the porosity of pore space and DFNs, and the permeability difference quantifying the connectivity of DFNs. The findings highlight the effectiveness of DL models, especially the U-Net++ model with nested architecture and redesigned skip connections, in accurately segmenting pore spaces and DFNs, which are crucial for pore-scale fluid flow and transport simulation in low-permeability rocks.

Wang, Hongsheng↗

Blind Modeling Validation Exercises Using the Horizontal Dry Cask Simulator

The U.S. Department of Energy (DOE) established a need to understand the thermal-hydraulic properties of dry storage systems for commercial spent nuclear fuel (SNF) in response to a shift towards the storage of high-burnup (HBU) fuel (> 45 gigawatt days per metric ton of uranium, or GWd/MTU). This shift raises concerns regarding cladding integrity, which faces increased risk at the higher temperatures within spent fuel assemblies present within HBU fuel compared to low-burnup fuel (≤ 45 GWd/MTU). A dry cask simulator (DCS) was built at Sandia National Laboratories (SNL) in Albuquerque, New Mexico to produce validation-quality data that can be used to test the accuracy of the modeling used to predict cladding temperatures. These temperatures are critical to evaluating cladding integrity throughout the storage cycle of commercial spent nuclear fuel. A model validation exercise was previously carried out for the DCS in a vertical configuration. Lessons learned during the previous validation exercise have been applied to a new, blind study using a horizontal dry cask simulator (HDCS). Three modeling institutions – the Nuclear Regulatory Commission (NRC), Pacific Northwest National Laboratory (PNNL), and Empresa Nacional del Uranio, S.A., S.M.E. (ENUSA) – were granted access to the input parameters from the DCS Handbook, SAND2017-13058R, and results from a limited data set from the horizontal BWR dry cask simulator tests reported in the HDCS update report, SAND2019-11688R. With this information, each institution was tasked to calculate peak cladding temperatures and air mass flow rates for ten HDCS test cases. Axial as well as vertical and horizontal transverse temperature profiles were also calculated. These calculations were done using modeling codes (ANSYS/Fluent, STAR-CCM+, or COBRA-SFS), each with their own unique combination of modeling assumptions and boundary conditions. For this validation study, the ten test cases of the horizontal dry cask simulator were defined by three independent variables – fuel assembly decay heat (0.5 kW, 1 kW, 2.5 W, and 5 kW), internal backfill pressure (100 kPa and 800 kPa), and backfill gas (helium and air). The plots provided in Chapter 3 of this report show the axial, vertical, and horizontal temperature profiles obtained from the dry cask simulator experiments in the horizontal configuration and the corresponding models used to describe the thermal-hydraulic behavior of this system. The tables provided in Chapter 3 illustrate the closeness of fit of the model data to the experiment data through root mean square (RMS) calculations of the error in peak cladding temperatures (PCTs), PCT axial locations, axial temperature profiles, vertical and horizontal temperature profiles at two different axial locations, and air mass flow rates for the ten test cases, normalized by the experimental results. The model results are assigned arbitrary model numbers to retain anonymity. Due to the relatively flat axial temperature profiles, small temperature gradients resulted in large deviations of all models’ PCT axial location from the experimental PCT axial location. When the PCT axial location error is excluded in the calculation of the combined RMS of the normalized errors that considers PCT, the temperature profiles, and the air mass flow rates, the model data fits the experimental data to within 5%. When the vault information is excluded, the model data fits the experimental data to within 2.5%. An error analysis was developed further for one model, using the model and experimental uncertainties in each validation parameter to calculate validation uncertainties. The uncertainties for each parameter were used to define quantifiable validation criteria. For this analysis, the model was considered validated for a given comparison metric if the normalized error in that metric divided by the validation uncertainty was less than or equal to 1. When considering the combined RMS of the normalized errors of all metrics divided by their validation uncertainties, the model was found to have satisfied the criterion for model validation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

High Flux Isotope Reactor Low-Enriched Uranium Low Density Silicide Fuel Design Parameters

High Flux Isotope Reactor (HFIR) highly enriched uranium (HEU) to low-enriched uranium (LEU) conversion activities are ongoing as part of the Department of Energy (DOE) National Nuclear Security Administration (NNSA)’s nuclear nonproliferation mission. Design activities studying the conversion of HFIR from HEU to LEU fuel explored different fuel design features and shapes with a low density uranium-silicide dispersion (U 3 Si 2 -Al) fuel, which has a uranium density of 4.8 gU/cm 3 . The goal of these studies is to generate several HFIR LEU fuel designs of varying fuel fabrication complexity that meet the current HEU performance metrics and safety requirements. The documented designs will serve as references for fuel fabrication and qualification activities. Recent advancements in modeling and simulation tools enable quick prototyping of fuel designs. Shift, a Monte Carlo neutron transport and depletion tool optimized for high-performance computing (HPC) architectures, is used for efficient fuel cycle and performance metrics calculations. The HFIR Steady State Heat Transfer Code (HSSHTC) is used to vet the thermal safety margin. Also, a new automation tool that connects all fuel design analysis steps, named Python HFIR Analysis and Measurement Engine (PHAME), has been developed to expedite the design study in an efficient and reproducible manner. Leveraging these tools, several candidate fuel designs were selected for varying fabrication complexity. This report provides design feature details for four selected HFIR LEU low density U 3 Si 2 -Al fuel designs and their corresponding performance and safety metrics. Nominal, best-estimate design parameters and irradiation conditions, including fission rate densities, power densities, heat fluxes, and cumulative fission densities are provided for candidate fuel designs relevant to framing irradiation experiments to support fuel qualification efforts. Simulations show that the low density U 3 Si 2 -Al, with design features to enhance safety, can meet HEU core performance metrics and safety requirements if the reactor power is increased from 85 MW (HEU) to 95 MW (LEU) and if the active fuel length is increased from 50.80 cm (HEU) to 55.88 cm (LEU).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Cambium Documentation: Version 2021

Cambium is a tool that assembles structured data sets of simulated hourly emission, cost, and operational data for modeled futures of the U.S. electric sector with metrics designed to be useful for long-term decision-making. It was built to expand the metrics reported in the National Renewable Energy Laboratory's (NREL's) Standard Scenarios - an annually released set of projections of how the U.S. electric sector could evolve across a suite of different potential futures, looking forward through 2050 (Cole et al. 2021) Information about Cambium and related publications can be found at https://nrel.gov/analysis/cambium.html, and the Cambium data sets for the Standard Scenarios can be viewed and downloaded at https://cambium.nrel.gov/. In this documentation, we define the metrics reported in Cambium databases (Section 4) and document the Cambium-specific methods for calculating those metrics (Section 5). As this document is intended to cover multiple Cambium data releases, we do not document specific scenarios here - for individual data releases, readers should look for an accompanying report that describes the assumptions and data that underlie that specific release. For Cambium databases that are built on NREL's Standard Scenarios, for example, reports describing the scenarios can be found on the Standard Scenarios web site (https://www.nrel.gov/analysis/standard-scenarios.html).

24 POWER TRANSMISSION AND DISTRIBUTION↗

Regional Variation in Light-Duty Plug-in Electric Vehicle Emissions

Automobile electrification is viewed as one of the key requirements for deep decarbonization of transportation. However, the exact magnitude of decarbonization from switching from a combustion of petroleum-based fuels to grid-derived electricity is a complex issue. Variations in local grid mixes lead to differing carbon intensities of electricity in different regions. This complexity is compounded by geographical differences in vehicle characteristics. This analysis considers these geographic differences to produce a historical assessment of the fuel-cycle carbon emissions of plug-in electric vehicles (PEVs) in the United States from 2011 to 2021. We find that PEVs in the United States decreased in electricity-derived carbon intensity, from 187 grams per mile to 110 grams per mile from 2011 to 2021 due to improvements in the electric grid and vehicle efficiency. Through 2021, PEVs emitted a total of 13.6 million metric tons of greenhouse gas (GHG) emissions in the United States, including both emissions from electricity and gasoline, while driving a total of 100 billion miles. Of this total, 8.39 million metric tons was due to electricity consumption. Over the same distance, comparable gasoline vehicles would have emitted between 29 and 41 million metric tons of GHG, leading to a reduction of 15 to 27 million metric tons. Relative to national-level assessments that do not factor in this regional difference, these electric vehicles resulted in 13% greater reductions in GHG emissions than previously calculated. In the future, announced goals to further decarbonize the electricity sector will continue to reduce the emissions of PEVs, including reducing emissions rates for vehicles already on the road, further improving the benefits relative to the unchanging emissions of contemporaneous gasoline vehicles.

02 PETROLEUM↗

Assessment of Seasonal Energy Performance for Room Air Conditioners in Multiple Climates

This report provides a general approach for adopting a seasonal energy efficiency metric by examining the climate-specific temperature bin distribution for air conditioner use, the seasonal energy efficiency results according to International Standards Organization (ISO) 16358 by climate region, and the relationships in seasonal energy efficiency across regional metrics. This approach could make the seasonal efficiency metric values comparable with those from other countries with standards consistent with ISO 16358. Policy action and market transformation can be accelerated and effectively harmonized with other regional or international efforts by adopting a seasonal energy efficiency metric. The framework and methodology described in this report have been applied in the following publications: Shaffie et al. 2022, Park et al. 2021, Park et al. 2019, and UNEP 2019a.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Developing a simulator-based satellite dataset for using machine learning techniques to derive aerosol-cloud-precipitation interactions in models and observations in a consistent framework

Aerosol-cloud-precipitation interactions (ACPI) remain a major uncertainty in understanding the Earth’s radiation budget and water cycle (including extremes). After decades of active research, various observationally based metrics have been developed to constrain ACPI in Earth System Models (ESMs), but direct comparison of model and data estimates can confound scientific understanding because limitations and uncertainties in sampling and retrieval procedures may combine with model deficiencies in process representations of ACPI to obstruct understanding. Furthermore, conventional ACPI metrics often vary from one regime to another, and the ACPI process representation in ESMs is also typically derived based on only a limited area/regime (even though the parameterization applies globally). To bridge the gap between models and data and to correctly describe ACPI in all regimes, we propose to construct a new CALIPSO-CloudSat merged dataset that is produced by the same algorithms used in satellite simulators in ESMs, and to use machine learning techniques to derive new ACPI metrics that can be accurately estimated by satellites and can provide meaningful constraints on cloud microphysical process representations in ESMs. The dataset will include measured and retrieved variables for aerosol, cloud, and precipitation from CALIPSO and CloudSat, and environmental variables from meteorological reanalysis. The data will be used to train a neural network to construct the ACPI metrics as a function of environmental conditions. The new ACPI formula will be used to constrain the ACPI in the Energy Exascale Earth System Model (E3SM), and to augment/reformulate the ACPI process representation in the E3SM to improve the simulation of the evolution of the atmosphere under different environmental conditions.

54 ENVIRONMENTAL SCIENCES↗

Reservoir Thermal Energy Storage Benchmarking (Rev. 3)

A benchmarking analysis of RTES research funded by GTO through the Beyond Batteries projects was conducted against the ESGC to see where they fit within the identified ESGC Use Cases. The projects were found to advance knowledge in multiple ESGC use cases, either directly or in some cases, indirectly as enabling technologies. This analysis is helpful to understand where RTES and associated research fits into the larger discussion around energy storage technologies. Also, a retrospective analysis of the Beyond Batteries projects was conducted to evaluate what the projects learned and how the results can be applied to advance the value of RTES. Major results of each of the studies are summarized in Table 2. Additionally, a comparative metrics analysis for RTES was completed to understand where RTES lies within the energy storage industry. Metrics for evaluation of RTES and its comparison to other storage technologies were selected and ranges of their values compiled. The selected metrics – LCOE (levelized cost of energy), capital costs, roundtrip efficiency, energy storage capacity, and storage time – were chosen based on data availability and have a particularly strong influence on the potential deployment of a storage technology. Charts which compare the metrics are presented in section 4.3 and show ranges for each of the 10 selected technologies. However, due to a lack of domestic operational facilities, values for RTES and for portions of the remaining technologies are based on theoretical modeling and studies of best-case scenarios. LCOE estimates for RTES fall within the lower reaches of Figure 15, but nevertheless amount to 2 – 5 times the ESGC Roadmap goal for LCOE, for example in the Facilitating and Evolving Grid Use Case. Capital costs for RTES sit on the higher end (Figure 16) but are expected to decrease as new projects are developed and the technology is refined. The theoretical roundtrip efficiency reported for RTES varies from mid to high percentages (Figure 17) with efficiencies upwards of 93% in modeled scenarios in the Portland Basin (Bershaw et al.,2020). RTES is also expected to have the largest energy storage capacities and longest storage times, likely matched only by lower efficiency hydrogen storage. To better assess the role that RTES could play in energy storage we examined it’s potential in the U.S. The potential depends on many factors. Recently, many researchers have started looking at deep sedimentary basins, depleted oil and gas fields, and basalt formations as potential targets for RTES development. The United States Geological Survey (USGS) has analyzed various cities and shown substantial RTES potential in the cooling sector (Pepin et al., 2021). By modeling RTES in low-quality groundwater (e.g., brackish), it is shown to be favorable across the U.S. with particular suitability in the Illinois Basin, Coastal Plains, and Basin and Range regions. Seasonal RTES operations have also been modeled in the Portland Basin by those at the USGS and Portland State University to simulate an RTES system supplying heating loads needed for the Oregon Health and Science University. Simulations suggest that high conductive heat loss in the initial years exists but tends to decrease with increasing time and development of the resource due to self-insulating nature of the basalts (Burns et al., 2020). Other national laboratory efforts are taking a close look at many of the technical issues involved with RTES (McLing et al., 2019, McLing et al., 2022). These include difficulties in understanding geochemical, hydrogeological, mechanical, and microbiological changes at such elevated temperatures and operational scenarios. Major gaps in research are identified and suggested for future work. With this increased focus to understand how to make RTES successful in the U.S., this technology could be a potential solution to many of the nation’s energy storage problems. For the energy independence of this country, the DOE should prioritize de-risking this technology by making future investments in pilot-scale demonstrations to attract potential investors.

15 GEOTHERMAL ENERGY↗

Coal-based Bricks & Blocks (CBBs): Process Development to Prototype Fabrication Coupled with Techno-Economic Analysis and Market Survey

Coal-based bricks and blocks (CBBs) were formulated using anthracite and thermoplastic binder. Lab scale test composites were formed by hot-press molding and commercial extrusion for test articles and for a full-scale prototype. Formulations and test matrices followed a systematic experimental design to examine the effects of and interactions among three primary independent variables: a) thermoplastic type, b) weight fractions of binder relative to the total anthracite weight, and c) relative proportions of large versus small (milled) anthracite size fractions. Technical performance metrics include compressive strength, modulus, porosity/permeability and density. These DoE studies establish composition-property relations and identify the best combination for any desired property of interest – in particular, strength. Based on CBB composition and fabrication process, validated against technical performance metrics, a techno-economic analysis was constructed which incorporated a process flow model, engineering design (with scaling), and calculated capital plus operating costs. Based on measured property metrics and estimated process economics and a projected price by TEA (techno-economic analysis), building and construction target markets were identified by a market survey assessment. With known cost, price, performance metrics and competitive advantages for CBBs matched with commercial applications/uses, a technical gap analysis was performed to identify further development required for scale-up and commercialization.

01 COAL, LIGNITE, AND PEAT↗

Power Supply Options for the Marpi Landfill, Saipan: Feasibility Study

The Marpi Landfill, located on the northern end of the island of Saipan in the Commonwealth of the Northern Mariana Islands (CNMI), is powered by an on-site diesel generator that only operates when the landfill is open and staffed. The CNMI Office of Planning and Development (OPD) aspires to provide the Marpi Landfill with 24-hour power availability despite its remote location and to increase the use of sustainable energy within the CNMI. CNMI has a 20% target for renewable energy consumption, as documented in Sustainable Development Goal #7 in the Comprehensive Sustainable Development Plan (OPD 2021) and the renewable portfolio standard (GPO 2014). To accomplish these goals, the U.S. Department of Energy, through its Interagency Reimbursable Work Agreement with the Federal Emergency Management Agency, funded this feasibility study to assess and prioritize power supply options for the landfill. The availability of solar and wind resources varies seasonally, as does the load. A BESS can help to balance mismatches between generation and load on short (hourly or daily) timescales, but not across seasons. The microgrid scenarios evaluated for Marpi consider options for technology combinations that will both meet the load and utilize available resources, despite the challenge presented by higher loads and lower solar and wind availability during the rainy season, depicted in Figure ES-2. The seven scenarios evaluated are summarized in Table ES-1. Each scenario’s configuration was optimized to include component capacities that reduce capital and operating costs, meet the load, and minimize carbon emissions, as feasible. The costs and levelized cost of energy (LCOE) shown do not assume the use of any grant funding or incentives, although these options were also evaluated. To assist with decision-making, a prioritization matrix (Table ES-3) was created to compare the microgrid scenarios evaluated in this feasibility study according to various stakeholder priorities. The prioritization metrics were chosen based on discussions with OPD and will be finalized through stakeholder feedback. The scenarios were given a score between 1 and 7 for each prioritization metric (the lower the score, the higher the priority), and total scores were calculated using assigned weights based on the relative priority of each metric. The total scores were then ranked to produce a prioritized list of microgrid scenarios based on the metrics most important to the project stakeholders. As shown, scenario 4 (100 kW of solar PV, a 75 kW/300 kWh BESS, and 160 kW of diesel generation) ranks highest.

14 SOLAR ENERGY↗

Customer-Focused Key Performance Indicators for Electric Vehicle Charging

To systematically improve the public charging experience, EV charging industry stakeholders need to define and measure it precisely. Many stakeholders currently measure aspects of the charging experience, but they typically employ metrics that are either operational in nature, such as charger uptime and mean time between failures, or composite customer satisfaction indices. To improve the customer experience most effectively, the industry needs metrics that define the charging experience from the perspective of the customer, not business operations. Furthermore, industry practitioners need granular metrics to know what specific aspects of the charging experience need improvement. This report defines such customer-focused metrics, called key performance indicators (KPIs).

33 ADVANCED PROPULSION SYSTEMS↗

Evaluating large scale aqueous organic redox flow battery performance with a hybrid numerical and machine learning framework

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low-capacity degradation in 10 cm$^2$ cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier to commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm$^2$ DHP-based AORFB by combining a physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. Such combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE↗

Circularity Futures Workshop Series: Summary Report

The aim of this report is to synthesize key feedback received from the three-part Circularity Futures workshop series held in Spring 2024. The workshop series was conducted by the National Renewable Energy Laboratory (NREL) on behalf of U.S. Department of Energy, Office Energy Efficiency and Renewable Energy (EERE), and was broken into three workshops: Workshop 1 - Circularity Analysis Needs and Priorities; Workshop 2 - Circularity Metrics and Indicators; and Workshop 3 - Circularity Data. Together, the workshops focused on identifying the existing priorities and gaps in the circularity modeling space, understanding different stakeholders' use and interpretation of circularity metrics and indicators, identifying common data gaps and data quality challenges, and assessing the robustness of available solutions. The workshop series brought a diverse group of stakeholders - including representatives from U.S. government offices, national labs, nonprofit organizations, industry, and academia - to collect first-hand feedback on needs, priorities, challenges and opportunities in the circularity modeling and analysis space. The workshop discussions highlighted numerous common needs, priorities and challenges among the interviewed groups. Several topics were frequently discussed, including: 1) Circularity as a pathway for sustainable economic growth: While circularity is generally defined in terms of resource conservation and reducing wasteful disposal of materials, participants agreed that circular strategies should serve broader economic, environmental, and social goals. It is therefore crucial for circularity analysis to look beyond waste reduction and instead evaluate a variety of impact metrics such as cost savings, job creation, air quality, and pollutant emissions. Mutli-criteria decision-making frameworks may be useful for making sense of disparate metrics and evaluating tradeoffs between impact categories.; 2) Economic and social factors are not well understood: Underdevelopment of existing end-of-life (EOL) management infrastructure, inconsistent standardization codes and policy space in reusing recycled content, and suboptimal collection and sorting strategies collectively contribute to uncertainty about the economic potential of circular pathways. The latter observation is consistent among all technologies but more emphasized for renewable energy systems. Social impacts of circularity practices are less understood and less researched than other sustainability aspects.; 3) Inconsistent methods for assessing emerging technologies: LCA and TEA results vary widely depending on the assumptions made with regards to market adoption of new technologies. Emerging technologies suffer limited availability of data needed to conduct a robust circularity analysis. Yet, understanding projected impacts of proposed nascent technology is a key need for different stakeholder groups.; and 4) Lack of temporally and geospatially explicit data: There is a need for open data that represents variations in circularity technologies over time and location. The lack thereof leads to aggregated and potentially misrepresented results in circularity analysis. Sensitivity analyses should be included to verify whether options perceived as more sustainable align with real-world practices.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Customer-Focused Key Performance Indicators for Electric Vehicle Charging

To systematically improve the public charging experience, EV charging industry stakeholders need to define and measure it precisely. Many stakeholders currently measure aspects of the charging experience, but they typically employ metrics that are either operational in nature, such as charger uptime and mean time between failures, or composite customer satisfaction indices. To improve the customer experience most effectively, the industry needs metrics that define the charging experience from the perspective of the customer, not business operations. Furthermore, industry practitioners need granular metrics to know what specific aspects of the charging experience need improvement. This report defines such customer-focused metrics, called key performance indicators (KPIs).

33 - ADVANCED PROPULSION SYSTEMS↗

Taming the Wild West: Assessing Impacts-Relevant Climate Data Products (Abbreviated Report)

Impacts-relevant Earth system data refers to observational and ESM data that are downscaled, debiased, validated, and provisioned for use by decision-makers. Impacts-relevant Earth system data is essential for mitigation and adaptation planning across a variety of regions and sectors. A vast number of these data products have emerged in recent years, which has led to confusion among stakeholders and scientists as to the best product to use. With no standard evaluation protocol available for these products, the decision on which product to use was sometimes made because it was pragmatic rather than the best product to use. This project sought to develop foundational capabilities around impacts-relevant data products that would support more informed selection and application of these products. This work has been immensely successful, driving several academic publications and supported the development of a community of practice around impacts-relevant data products. Over the project’s three years we have addressed six tasks: First, the development of standard evaluation metrics for impacts-relevant climate data; second, the development of a novel suite of atmospheric river metrics; third, the development of novel metrics for precipitation feature analysis; fourth, the development of novel metrics for assessing co-variances between temperature and precipitation; fifth, the development of a dashboard for interactive examination of impacts-relevant climate data; and sixth, the establishment of a community of practice around impacts-relevant climate data that will continue beyond the conclusion of this project.

54 ENVIRONMENTAL SCIENCES↗

Modernizing GlideinWMS Factory Monitoring with Prometheus & Grafana

Large-scale scientific experiments like CMS and DUNE rely on the distributed workload management system GlideinWMS to efficiently utilize computing resources across heterogeneous computing environments. GlideinWMS currently records Factory statistics using Round Robin Databases (RRDBs), XML, and JSON files, and these statistics are displayed via custom monitoring Web pages, thereby limiting integration with modern observability platforms. This project investigates the use of Prometheus-based instrumentation to expose Factory metrics using OpenTelemetry principles. Factory statistics related to Glidein submission and job execution are exported as Prometheus metrics through the Prometheus Python Client Library and are served via an HTTP metrics endpoint. The collected metrics are inspected using the Prometheus web-based interface and are visualized through Grafana dashboards within the Landscape monitoring infrastructure at Fermilab. This project significantly streamlines the integration of modern monitoring technologies into GlideinWMS and establishes a framework for extending observability across additional system components.

Appiah, Gideon [Grambling State U.]↗