Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A Framework for Identifying Building Energy Models of Localized Utility Service Areas Using Smart Meter Data

Bottom-up load modeling of buildings offers a versatile approach to simulating baseline demand and scenarios of future technology evolution and adoption at the individual building level. This capability is essential to understanding how future load shapes may change with the adoption of electric equipment and vehicles, particularly as it relates to grid planning and infrastructure investments. Traditionally, grid planning techniques have used historical load data to predict future load and infrastructure needs. However, with the anticipated rise in adoption of electrification technologies such as heat pumps and electric vehicles, historical data become less reliable predictors of the future. By employing ResStock, a high-fidelity building stock modeling tool, we can fine-tune electrification scenarios and aggregate models to represent varying geographic resolutions of the grid system, while considering the underlying features of homes. This may enable a more accurate and responsive approach to anticipate and plan for the evolving landscape of energy demands. We present a new framework that leverages building stock energy modeling to identify building models that align with the load shapes and housing attributes of buildings with AMI data. This approach applies two model layers: (1) a classification step that identifies the presence of air conditioning, electric heating, and electric water heating, and (2) an optimization routine that identifies building energy models aligning with load profile data from advanced metering infrastructure meters. This report demonstrates one approach to deploying this framework, and presents results for three test cases that use both modeled and AMI data to assess performance. For a test case using AMI data in Fort Collins, Colorado, we observed a median monthly electricity load CV-RMSE of 16.6%, and a top ten daily heating and cooling median absolute percent error of 7.7% and 8.3%, respectively. For each AMI meter, we identify a set of potential energy models so that downstream use-cases can account for uncertainty driven by variability of baseline technologies and occupant behavior, which impact the response to electrification and energy efficiency scenarios. Our results indicate that ResStock has potential as a scalable solution for modeling residential energy demand at local grid resolutions. Its performance depends on location-specific factors, underlying building characteristics, and the level of aggregation, offering a path towards more precise and adaptive distribution grid planning for the evolving energy landscape.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Ocpp 2.0.1. Interim Kpi Calculator

The project is split into four pieces. The first is a raw OCPP log parser. The second is a file splitter. The third is a message parser. The final piece is the Interim KPI calculator. The OCPP log parser was created from two different formats of raw OCPP 2.0.1 data. Its intended purpose is to extract device IDs and OCPP event messages from nontabular text logs. The parser looks for specific substrings in the logs to identify which of the two "standards" it should select from. The KPI generator does not perform any of its calculations in parallel. Instead, we opt for a naive batching approach. The splitter takes the file generated from the parser and creates many smaller files for each of the device IDs in the dataset. This allows the pandas queries in the log formatter to be iterate over a significantly smaller slice of data, increasing performance significantly. The message parser step takes messages from each of the files (containing distinct device IDs) and breaks the message out into pieces. The final result is a file with different columns specifying different attributes of the JSON message. The file is an aggregation of all different devices. This is the most complex portion of the code. The KPI calculator takes the parsed messages, as a single file, and calculates the KPI from that data. An excel file is produced with four sheets. These contain the metrics for Session Success, Charge Start Success, Charge End Success, and Charge Start Time. It includes the metrics for the different equations in the Interim KPI Implementation Guide as well as a weighted sum of the different equations for each KPI (excluding Charge End Success and Charge Start Time).

Quinn, Casey↗
DOE OSTI2022

Electricity consumption variation versus economic structure during COVID-19 on metropolitan statistical areas in the US

The outbreak of novel coronavirus disease (COVID-19) has resulted in changes in productivity and daily life patterns, and as a result electricity consumption (EC) has also shifted. In this paper, we construct estimates of EC changes at the metropolitan level across the continental U.S., including total EC and residential EC during the initial two months of the pandemic. The total and residential data on the state level were broken down into the county level, and then metropolitan level EC estimates were aggregated from the counties included in each metropolitan statistical area (MSA). This work shows that the reduction in total EC is related to the shares of certain industries in an MSA, whereas regardless of the incidence level or economic structure, the residential sector shows a trend of increasing EC across the continental U.S. Since the MSAs account for 86% of the total population and 87% of the total EC of the continental U.S., the analytical result in this paper can provide important guidelines for future social-economic crises.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Materials representation and transfer learning for multi-property prediction

The adoption of machine learning in materials science has rapidly transformed materials property prediction. Hurdles limiting full capitalization of recent advancements in machine learning include the limited development of methods to learn the underlying interactions of multiple elements as well as the relationships among multiple properties to facilitate property prediction in new composition spaces. To address these issues, we introduce the Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP) framework that seamlessly integrates: (i) prediction using only a material's composition, (ii) learning and exploitation of correlations among target properties in multi-target regression, and (iii) leveraging training data from tangential domains via generative transfer learning. The model is demonstrated for prediction of spectral optical absorption of complex metal oxides spanning 69 three-cation metal oxide composition spaces. H-CLMP accurately predicts non-linear composition-property relationships in composition spaces for which no training data are available, which broadens the purview of machine learning to the discovery of materials with exceptional properties. This achievement results from the principled integration of latent embedding learning, property correlation learning, generative transfer learning, and attention models. The best performance is obtained using H-CLMP with transfer learning [H-CLMP(T)] wherein a generative adversarial network is trained on computational density of states data and deployed in the target domain to augment prediction of optical absorption from composition. H-CLMP(T) aggregates multiple knowledge sources with a framework that is well suited for multi-target regression across the physical sciences.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Multi Time-scale Imputation aided State Estimation in Distribution System

With the transition to a smart grid, we are witnessing a significant growth in sensor deployments and smart metering infrastructure in the distribution system. However, information from these sensors and meters are typically unevenly sampled at different time-scales and are incomplete. It is critical to effectively aggregate these information sources for situational awareness. In order to reconcile the heterogeneous multi-scale time-series data, we present a multi-task Gaussian process framework. This framework exploits the spatio-temporal correlation across the time-series data to impute data at any desired timescale while providing confidence bounds on the imputations. The value of the imputed data for distribution system operation is illustrated via a matrix completion based state estimation strategy. Results on the IEEE 37 bus distribution system reveals the superior performance of the proposed approach relative to linear interpolation approaches.

Dahale, Shweta↗
DOE OSTI2023

Is Nematicity in Cuprates Real?

In La 2-x Sr x CuO 4 (LSCO), a prototype high-temperature superconductor (HTS) cuprate, a nonzero transverse voltage is observed in zero magnetic fields. This is important since it points to the breaking of the rotational symmetry in the electron fluid, the so-called electronic nematicity, presumably intrinsic to LSCO (and other cuprates). An alternative explanation is that it arises from extrinsic factors such as the film’s inhomogeneity or some experimental artifacts. We confront this hypothesis with published and new experimental data, focusing on the most direct and sensitive probe—the angle-resolved measurements of transverse resistivity (ARTR). The aggregate experimental evidence overwhelmingly refutes the extrinsic scenarios and points to an exciting new effect—intrinsic electronic nematicity.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

A global anthropogenic emission inventory of atmospheric pollutants from sector- and fuel-specific sources (1970–2017): an application of the Community Emissions Data System (CEDS)

Global anthropogenic emission inventories remain vital for understanding the sources of atmospheric pollution and the associated impacts on the environment, human health, and society. Rapid changes in today's society require that these inventories provide contemporary estimates of multiple atmospheric pollutants with both source sector and fuel type information to understand and effectively mitigate future impacts. To fill this need, we have updated the open-source Community Emissions Data System (CEDS) (Hoesly et al., 2019) to develop a new global emission inventory, CEDSGBD-MAPS. This inventory includes emissions of seven key atmospheric pollutants (NOx; CO; SO2; NH3; non-methane volatile organic compounds, NMVOCs; black carbon, BC; organic carbon, OC) over the time period from 1970–2017 and reports annual country-total emissions as a function of 11 anthropogenic sectors (agriculture; energy generation; industrial processes; on-road and non-road transportation; separate residential, commercial, and other sectors (RCO); waste; solvent use; and international shipping) and four fuel categories (total coal, solid biofuel, the sum of liquid-fuel and natural-gas combustion, and remaining process-level emissions). The CEDSGBD-MAPS inventory additionally includes monthly global gridded (0.5°?×?0.5°) emission fluxes for each compound, sector, and fuel type to facilitate their use in earth system models. CEDSGBD-MAPS utilizes updated activity data, updates to the core CEDS default scaling procedure, and modifications to the final procedures for emissions gridding and aggregation. Relative to the previous CEDS inventory (Hoesly et al., 2018), these updates extend the emission estimates from 2014 to 2017 and improve the overall agreement between CEDS and two widely used global bottom-up emission inventories. The CEDSGBD-MAPS inventory provides the most contemporary global emission estimates to date for these key atmospheric pollutants and is the first to provide global estimates for these species as a function of multiple fuel types and source sectors. Dominant sources of global NOx and SO2 emissions in 2017 include the combustion of oil, gas, and coal in the energy and industry sectors as well as on-road transportation and international shipping for NOx. Dominant sources of global CO emissions in 2017 include on-road transportation and residential biofuel combustion. Dominant global sources of carbonaceous aerosol in 2017 include residential biofuel combustion, on-road transportation (BC only), and emissions from the waste sector. Global emissions of NOx, SO2, CO, BC, and OC all peak in 2012 or earlier, with more recent emission reductions driven by large changes in emissions from China, North America, and Europe. In contrast, global emissions of NH3 and NMVOCs continuously increase between 1970 and 2017, with agriculture as a major source of global NH3 emissions and solvent use, energy, residential, and the on-road transport sectors as major sources of global NMVOCs. Due to similar development methods and underlying datasets, the CEDSGBD-MAPS emissions are expected to have consistent sources of uncertainty as other bottom-up inventories. The CEDSGBD-MAPS source code is publicly available online through GitHub: https://github.com/emcduffie/CEDS/tree/CEDS_GBD-MAPS (last access: 1 December 2020). The CEDSGBD-MAPS emission inventory dataset (both annual country-total and monthly global gridded files) is publicly available under https://doi.org/10.5281/zenodo.3754964 (McDuffie et al., 2020c).

Mcduffie, Erin↗
DOE OSTI2025

High Resolution Siting Suitability of Various Power Plant Technologies

Energy sector planning models determine the aggregate need for new generation, but these models are typically at the state or regional scale and are not equipped to address the wide range of location- and technology-specific issues that are increasingly a factor in power plant siting. These animations demonstrate the aggregate siting suitability of various power plant technology configurations, considering technology-specific factors that can prohibit development. The data presented is from the GRIDCERF (Geospatial Raster Input Data for Capacity Expansion Regional Feasibility) data package. GRIDCERF is a harmonized, open-source geospatial product that can be used to evaluate siting suitability for renewable and non-renewable power plants in the conterminous United States. The animations presented here demonstrate a curated selection of the full suite of technology configurations available. GRIDCERF provides the necessary inputs for models that simulate power plant siting for regional capacity expansion planning such as the Capacity Expansion Regional Feasibility (CERF) model.

Mongird, Kendall [Pacific Northwest National Labor↗
DOE OSTI2019

Hydrothermally robust Ti/SiO 2 epoxidation catalysts via surface modification with oligomeric PMHS

We investigate grafting of poly(methylhydrosiloxane) (PMHS) onto Ti/SiO 2 catalysts for improving their robustness to water, using olefin epoxidation catalysis with organic hydroperoxide as oxidant as a relevant probe reaction. Our approach involves triggering catalyst deactivation with added water in the reactants as a means to simulate catalyst deactivation, thereby causing grafted Ti-site aggregation. When using harsh aqueous Soxhlet extraction conditions as a trigger for this aggregation, significant differences are observed via diffuse-reflectance UV-Vis spectrscopy on samples before and after treatment, for Ti/SiO 2 catalysts containing grafted PMHS. Not only was there a lack of appearance of red-shifted bands in the UV-Vis spectrum following Soxhlet extraction, the batch catalytic activity for catalysts before and after PMHS grafting remained virtually unchanged. This was in stark contrast to an unmodified Ti/SiO 2 catalyst, which showed a more than 60% decrease in catalytic activity following Soxhlet extraction as a result of aggregation, as ascertained by red shifts in its UV-Vis spectrum after Soxhlet extraction. Similar red shifts were also observed for a hydrophobically modified TMS Ti/SiO 2 catalyst. However, when comparing these catalysts under more gentle olefin epoxidation catalysis conditions with added water in a flow reactor, it was more difficult to differentiate the TMS Ti/SiO2 and grafted PMHS catalysts. Both catalysts exhibited similar activity and selectivity after a prolonged time on stream, though the rate of initial deactivation in the latter was less pronounced. Altogether, our data demonstrate that grafted PMHS catalysts are positively differentiated from conventional catalysts based on either TMS surface modification or no surface modification, under conditions involving aggregation induced via extreme hydrothermal environmentst. Thus, we expect that PMHS grafting of Lewis acid catalysts can offer an alternative approach for endowing hydrolytic stability to such catalysts, as demonstrated here for Ti/SiO 2 epoxidation catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Data Assimilation for Robust UQ Within Agent-Based Simulation on HPC Systems

Agent-based simulation provides a powerful tool for in silico system modeling. However, these simulations do not provide built-in methods for uncertainty quantification (UQ). Within these types of models a typical approach to UQ is to run multiple realizations of the model then compute aggregate statistics. This approach is limited due to the compute time required for a solution. When faced with an emerging biothreat, public health decisions need to be made quickly and solutions for integrating near real-time data with analytic tools are needed. We propose an integrated Bayesian UQ framework for agent-based models based on sequential Monte Carlo sampling. Given streaming or static data about the evolution of an emerging pathogen this Bayesian framework provides a distribution over the parameters governing the spread of a disease through a population. These estimates of the spread of a disease may be provided to public health agencies seeking to abate the spread. By coupling agent-based simulations with Bayesian modeling in a data assimilation, our proposed framework provides a powerful tool for modeling dynamical systems in silico. We propose a method which reduces model error and provides a range of realistic possible outcomes. Moreover, our method addresses two primary limitations of ABMs: the lack of UQ and an inability to assimilate data. Our proposed framework combines the flexibility of an agent-based model with UQ provided by the Bayesian paradigm in a workflow which scales well to HPC systems. We provide algorithmic details and results on a simulated outbreak with both static and streaming data.

Spannaus, Adam [ORNL] (ORCID:0000000225213657)↗
DOE OSTI2022

Simultaneous Insight into Dissolution and Aggregation of Metal Sulfide Nanoparticles through Single-Particle Inductively Coupled Plasma Mass Spectrometry

Nanoparticles (NPs) and their colloidal aggregates are ubiquitous and play important roles in the transport and release of metals. Knowledge of their dissolution rates and aggregation behavior in solution are crucial for better prediction of their fate in biogeochemical cycling, ecotoxicity, and environmental remediation. There are however significant technical challenges to accurately obtain such information as a result of the heterogeneity and highly dynamic transformation exhibited by NPs, particularly at relatively low particle concentrations in aqueous systems. Here, we quantitatively examine the simultaneous dissolution and aggregation behavior of metal sulfide NPs using single-particle inductively coupled plasma mass spectrometry (spICP–MS). We focus on nickel sulfide (NiS), with additional data presented for copper sulfide (CuS) and cobalt sulfide (CoS). The kinetics of metal release (dissolution and disaggregation) of NiS was fastest under strongly oxidizing conditions (from 0.04 to >3 min –1 with H 2 O 2 ) and were slower under near-neutral (HEPES buffer/H 2 O) and acidic (1 mM HNO 3 ) conditions (≤0.006 min –1 ). Metal release kinetics in HNO 3 was not faster than in H 2 O or HEPES, suggesting that the solution pH has an influence over both the dissolution kinetics of individual particles and the NP aggregation states, which in combination affect metal release rates over time. Between different metal sulfides, the measured metal release rates were largely consistent with predictions based on the crystallinity, solubility products, and specific surface areas of the NPs, following an order of CoS > NiS > CuS. Here, the spICP–MS approach described here can be easily applied to the characterization of metal release and aggregation of other NPs at low concentrations (~10 5 particles/mL) typically found in natural environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

CostMAP: an open-source software package for developing cost surfaces using a multi-scale search kernel

Cost surfaces are a crucial aspect of route optimization and least cost path (LCP) calculations and are used in awide range of disciplines including computer science, landscape ecology, and energy-infrastructure modeling. Linear features introduce akey weakness to traditional routing calculations along cost surfaces because they cannot identify whether moving from acell to its adjacent neighbors constitutes crossing alinear barrier (increased cost) or following acorridor (reduced cost). Following and avoiding linear features can drastically change predicted routes. We introduce an approach to address this adjacency issue using asearch kernel that determines these critical barriers and corridors. We have built this method into anew Java-based open-source software package– CostMAP (cost surface multi-layer aggregation program)– which calculates cost surfaces and cost networks using the search kernel. CostMAP allows users to input multiple GIS data layers and to set weights and rules for developing aweighted-cost network. We compare CostMAP performance with traditional cost surface approaches and show significant performance gains– both following corridors and avoiding barriers– by modeling the movement of alarge terrestrial animal– the Baird’s Tapir (Tapirus bairdii)– in amovement ecology framework and by modeling pipeline routing for carbon capture and storage (CCS).

58 GEOSCIENCES↗
DOE OSTI2021

sycl-reduction benchmark v1.0.0

Some different SYCL implementations of the reduction operation. The parallel reduction kernel aggregates vector elements into a single result. It consists of four ways to implement the reduction operation using two different data management strategies, which we could not find elsewhere as a single package.

Dufek, Amanda↗
DOE OSTI2023

Azure Data Tools (FKA: OEDI (Open Energy Data Initiative) Data Access Tools) [SWR-23-92]

The Open Energy Data Initiative (OEDI) provides a number of tools to enable the use of the open data published through this initiative. The source is largely written in Python, including Jupyter notebooks. The Open Energy Data Initiative (OEDI) is a partnership between the National Renewable Energy Laboratory (NREL), the U.S. Department of Energy (DOE), Amazon, Microsoft, and Google to provide universal access to big data in the cloud. At the heart of OEDI is a centralized repository of high-value energy research datasets aggregated from DOE Program Offices, National Laboratories and other collaborators.

Jonathan, Weers↗
DOE OSTI2023

Wildfire Smoke PM2.5 per Zipcode

This dataset contains daily aggregated measurements of daily PM2.5 from ambient wildfire smoke in the contiguous United States, spanning from 2006 to 2016. The data is sourced from a study by Childs et al. (2022), titled "Daily Local-Level Estimates of Ambient Wildfire Smoke PM2.5 for the Contiguous US" published in Environmental Science & Technology. To compute the standardized weight across different zip codes, we computed the weight calculation on a 10km grids. To compute the weight, we obtain area-weights that add up to 1 in each polygon of zipcodes. This enabled us to calculate the smoke values per zipcode for the aforementioned period. Those interested in replicating our data processing pipeline can access it at https://github.com/NSAPH-Data-Processing/smoke_aggregation.

PM2.5↗
DOE OSTI2026

Underlying Data for the EVI-RoadTrip Web Tool

The dataset contains simulation-based charging infrastructure outputs that are visualized on the EVI-RoadTrip webtool. The outputs are aggregated to lower spatial resolution (e.g., state-level, corridor-level).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Omega-Limit Sets and Input-To-State Stability in Power Grids with Switching Equilibria

This paper studies a power transmission system with both conventional generators (CGs) and distributed energy assets (DEAs) providing frequency control. We consider an operating condition with demand aggregating two dynamic components: one that switches between different values on a finite set, and one that varies smoothly over time. Such dynamic operating conditions may result from protection scheme activations, external cyber-attacks, or due to the integration of dynamic loads, such as data centers. Mathematically, the dynamics of the resulting system are captured by a system that switches between a finite number of vector fields - or modes -, with each mode having a distinct equilibrium point induced by the demand aggregation. To analyze the stability properties of the resulting switching system, we leverage tools from hybrid dynamic inclusions and the concept of ..omega.. -limit sets from sets. Specifically, we characterize a compact set that is semi-globally practically asymptotically stable under the assumption that the switching frequency and load variation rate are sufficiently slow. For arbitrarily fast variations of the load, we use a level-set argument with multiple Lyapunov functions to establish input-to-state stability of a larger set and with respect to the rate of change of the loads. The theoretical results are illustrated via numerical simulations on the IEEE 39-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗