SEARCH · Engineering Papers

Results for “Data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Storing Affordability: Battery Storage as an Asset to Reduce Data Center Cost Shifts

This report examines how battery energy storage systems (BESS) can help utilities accommodate large load growth while protecting affordability for existing ratepayers. Rapid growth in electricity demand from artificial intelligence (AI) data centers is straining the U.S. grid. Furthermore, many new data centers are entering rural markets, which could offer economic benefits but may also pose implementation challenges for smaller utilities. At the same time, retail electricity prices are increasing faster than inflation, elevating customer affordability as a key challenge. While data centers have not been the primary driver of increases in residential prices to date, they have pushed wholesale energy and capacity prices higher in several markets. Fundamental utility cost-allocation principles show that data center growth can be rate-positive for existing customers only if new peak demand grows faster than the costs a utility must incur to serve it. Several factors, including a utility’s degree of wholesale market exposure, forecast uncertainty and stranded-asset risk, and tariff design can determine the outcome of load growth on retail rates. Energy storage can make several affordability contributions in the face of this landscape of uncertainty and market volatility, including deferral of higher-cost grid investments through improved utilization of existing assets and flexibility of new large loads, insulation from volatile wholesale prices through peak shaving, and reliability support to address grid risks stemming from the behavior of AI data center loads. Different potential BESS deployment pathways—utility-scale front-of-the-meter systems, aggregated small-scale storage installations, and data center-sited behind-the-meter storage—are compared against each other and against conventional capacity alternatives. This framework is intended as a conceptual resource to utilities, particularly smaller public utilities with rural service territories, who may be considering the role that energy storage can play in insulating existing ratepayers from data center cost shifts.

25 ENERGY STORAGE↗

DOE OSTI2025

Polymer Size–Catalytic Activity Relationships in Solution by Fluorescence Correlation Spectroscopy

Measuring the catalytic activity of specific sizes of polymers with active catalysts in solution is typically challenging, due to limited instrument detection sensitivity and/or dynamic range. Here, a fluorescence correlation spectroscopy (FCS) method is developed to determine the catalytic activity of living polymers of a specific apparent size in solution. Deviation from a single-component FCS data fitting, as assessed by χ2, is also introduced and developed as a “speciation index”—a method to evaluate and track changes in the relative amount of distinct polymer sizes with reaction progress. These methods are enabled by incorporating a selectively reactive fluorescent monomer into growing polydicyclopentadiene or polynorbornene during ring-opening metathesis polymerization (ROMP). Compared to polynorbornene, data showed that catalysts in aggregates of polyDCPD retained higher activity for longer—outcomes not directly inferable from simple diffusional-access predictions. Here, the ability to assign catalytic activity to polymers of specific sizes, and then to determine how this activity evolves with reaction progress, support long-term goals in the development and measurement of nano-objects that possess size-dependent catalytic activity.

Active catalyst↗

DOE OSTI2024

RokBase Core Facility Data Collection

The RokBase Core Facility Data Collection v1.0 is an aggregation of information on the locations and collections of geologic core facilities in the United States. It contains two spatial files, their corresponding attribute tables within a catalog, and an interactive web map and dashboard. It is intended to be used for research and comparison purposes, see full disclaimer and credits. Please contact NETL if revisions / corrections can be made to improve this dataset.

core facility location↗

DOE OSTI2025

Queued Up: 2025 Edition – Characteristics of Power Plants Seeking Transmission Interconnection As of the End of 2024 [Slides]

Electric transmission system operators (ISOs, RTOs, or utilities) require proposed power plants seeking to connect to the transmission grid to undergo a series of impact studies before they can be built. This process establishes what new transmission equipment or upgrades may be needed before a project can connect to the system and assigns the costs of that equipment. The lists of projects in this process are known as “interconnection queues”. In collaboration with interconnection.fyi, Berkeley Lab compiled, aggregated, and cleaned interconnection queue data from >50 transmission grid operators (7 ISO/RTOs and 49 non-ISO balancing areas), which collectively represent ~97% of currently installed U.S. electric generating capacity. The dataset includes requests submitted to queues through the end of 2024, and only includes requests seeking to connect to the transmission grid (not distribution-connected or behind-the-meter projects). The files below include both a PDF report and an Excel data file. The PDF report analyzes interconnection data and metrics through the end of 2024. The Excel data file includes (a) the full project-level interconnection queue dataset through 2024, (b) a codebook (data dictionary) describing each data field, and (c) 35 additional tabs featuring tables summarizing a range of interconnection metrics. Key highlights from the Queued Up: 2025 Edition (featuring data through 2024) include: • As of the end of 2024, there were ~10,300 projects actively seeking grid interconnection in the U.S., representing 1,400 GW of generation and approximately 890 GW of storage. • Historic withdrawal rates alongside relatively fewer new requests resulted in a 12% decrease in total active queue volume compared to the prior year. • Active natural gas capacity (136 GW, +72% year-over-year) increased in 2024, while solar (956 GW, -12%), storage (890 GW, -13%), and wind (271 GW, -26%) capacity decreased. • 408 GW of capacity already has a draft or executed interconnection agreement (IA) but has not yet reached commercial operations. • The time projects spend in queues before reaching COD is increasing. For the regions with available data, the median duration from IR to COD has doubled from <2 years for projects built in 2000-2007 to over 4 years for those built in 2018-2024. • Ultimately, most of this proposed capacity will not be built. Only 13% of capacity that submitted interconnection requests from 2000-2019 had reached commercial operations by the end of 2024; 77% of that capacity had been withdrawn and 10% was still active. • FERC Order 2023 and various other reforms are being implemented. These are important measures to reduce interconnection bottlenecks and enhance grid system reliability, but it is too early to measure and assess their full impact. • New additions for the 2025 edition include: (a) additional detail on data processing and gaps; (b) updates on interconnection reforms; (c) new analysis on interconnection agreements, and more.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

Generator Interconnection Costs to the Transmission System in non-ISO Balancing Authorities [Slides]

Electric transmission system operators—including Independent System Operators (ISOs), Regional Transmission Organizations (RTOs), and utilities—require proposed power plants to undergo a series of interconnection studies before connecting to the grid. These studies assess what transmission upgrades or new infrastructure may be necessary and assign the associated costs to the project. Lawrence Berkeley National Laboratory has compiled, aggregated, and cleaned interconnection cost data, originally for ISOs/RTOs, and now for five non-ISO Balancing Authorities: PacifiCorp, Bonneville Power Authority, Duke Energy Progress, Duke Energy Carolinas and Duke Energy Florida. Insufficient transparency in interconnection cost data may contribute to rapidly expanding interconnection queues, with active queue capacities tripling between 2020 and 2024 in the studied BAs. Most projects withdraw after receiving high interconnection cost estimates. Interconnection costs have increased since the early 2000s, with average costs for "complete" projects reaching $194/kW between 2018 and 2024. Active queue projects and withdrawn projects incur substantially higher costs, primarily due to rising network upgrade costs. Recent interconnection costs in non-ISO balancing authorities are higher than in ISO regions, potentially due to a greater willingness to pay among developers. Utility-scale solar, wind, and storage projects have interconnection costs that exceed those for natural gas. However, when focusing on projects that do not withdraw from the queue, the interconnection costs for these technologies are more similar to natural gas projects. Other key findings include: (1) Larger generation projects benefit from lower proportional interconnection costs, (2) capacity transmission service (NRIS) often requires additional network investments, and (3) projects with high network upgrade costs are often clustered geographically. The dataset includes results from 2,104 interconnection studies conducted between 2000 and 2024, covering projects that are operational, withdrawn, or still progressing through the study process. The Excel file contains (a) the complete project-level interconnection cost dataset, and (b) seven additional tabs summarizing cost metrics across dimensions such as time, market structure, cost category (point of interconnection vs. broader network upgrades), fuel type, service type (ERIS vs. NRIS), generator size, and geography.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

Queued Up: 2026 Edition, Characteristics of Power Plants Seeking Transmission Interconnection As of the End of 2025 [Slides]

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Low Molecular Weight Volatile Organic Compounds Indicate Grazing by the Marine Rotifer Brachionus plicatilis on the Microalgae Microchloropsis salina

Microalgae produce specific chemicals indicative of stress and/or death. The aim of this study was to perform non-destructive monitoring of algal culture systems, in the presence and absence of grazers, to identify potential biomarkers of incipient pond crashes. Here, we report ten volatile organic compounds (VOCs) that are robustly generated by the marine alga, Microchloropsis salina, in the presence and/or absence of the marine grazer, Brachionus plicatilis. We cultured M. salina with and without B. plicatilis and collected in situ volatile headspace samples using thermal desorption tubes over the course of several days. Data from four experiments were aggregated, deconvoluted, and chromatographically aligned to determine VOCs with tentative identifications made via mass spectral library matching. VOCs generated by algae in the presence of actively grazing rotifers were confirmed via pure analytical standards to be pentane, 3-pentanone, 3-methylhexane, and 2-methylfuran. Six other VOCs were less specifically associated with grazing but were still commonly observed between the four replicate experiments. Through this work, we identified four biomarkers of rotifer grazing that indicate algal stress/death. This will aid machine learning algorithms to chemically define and diagnose algal mass production cultures and save algae cultures from imminent crash to make biofuel an alternative energy possibility.

headspace sampling↗

DOE OSTI2021

FLUXNET-CH 4 : a global, multi-ecosystem dataset and analysis of methane seasonality from freshwater wetlands

Methane (CH 4 ) emissions from natural landscapes constitute roughly half of global CH4 contributions to the atmosphere, yet large uncertainties remain in the absolute magnitude and the seasonality of emission quantities and drivers. Eddy covariance (EC) measurements of CH4 flux are ideal for constraining ecosystem-scale CH 4 emissions due to quasi-continuous and high-temporal-resolution CH 4 flux measurements, coincident carbon dioxide, water, and energy flux measurements, lack of ecosystem disturbance, and increased availability of datasets over the last decade. Here, we (1) describe the newly published dataset, FLUXNET-CH 4 Version 1.0, the first open-source global dataset of CH 4 EC measurements (available at https://fluxnet.org/data/fluxnet-ch4-community-product/, last access: 7 April 2021). FLUXNET-CH 4 includes half-hourly and daily gap-filled and non-gap-filled aggregated CH4 fluxes and meteorological data from 79 sites globally: 42 freshwater wetlands, 6 brackish and saline wetlands, 7 formerly drained ecosystems, 7 rice paddy sites, 2 lakes, and 15 uplands. Then, we (2) evaluate FLUXNET-CH 4 representativeness for freshwater wetland coverage globally because the majority of sites in FLUXNET-CH4 Version 1.0 are freshwater wetlands which are a substantial source of total atmospheric CH 4 emissions; and (3) we provide the first global estimates of the seasonal variability and seasonality predictors of freshwater wetland CH4 fluxes. Our representativeness analysis suggests that the freshwater wetland sites in the dataset cover global wetland bioclimatic attributes (encompassing energy, moisture, and vegetation-related parameters) in arctic, boreal, and temperate regions but only sparsely cover humid tropical regions. Seasonality metrics of wetland CH 4 emissions vary considerably across latitudinal bands. In freshwater wetlands (except those between 20°S to 20°N) the spring onset of elevated CH 4 emissions starts 3 d earlier, and the CH 4 emission season lasts 4 d longer, for each degree Celsius increase in mean annual air temperature. On average, the spring onset of increasing CH 4 emissions lags behind soil warming by 1 month, with very few sites experiencing increased CH 4 emissions prior to the onset of soil warming. In contrast, roughly half of these sites experience the spring onset of rising CH 4 emissions prior to the spring increase in gross primary productivity (GPP). The timing of peak summer CH 4 emissions does not correlate with the timing for either peak summer temperature or peak GPP. Our results provide seasonality parameters for CH 4 modeling and highlight seasonality metrics that cannot be predicted by temperature or GPP (i.e., seasonality of CH 4 peak). FLUXNET-CH 4 is a powerful new resource for diagnosing and understanding the role of terrestrial ecosystems and climate drivers in the global CH 4 cycle, and future additions of sites in tropical ecosystems and site years of data collection will provide added value to this database. All seasonality parameters are available at https://doi.org/10.5281/zenodo.4672601 (Delwiche et al., 2021). Additionally, raw FLUXNET-CH 4 data used to extract seasonality parameters can be downloaded from https://fluxnet.org/data/fluxnet-ch4-community-product/ (last access: 7 April 2021), and a complete list of the 79 individual site data DOIs is provided in Table 2 of this paper.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2019

Cache coherence for processing in memory

A cache coherence bridge protocol provides an interface between a cache coherence protocol of a host processor and a cache coherence protocol of a processor-in-memory, thereby decoupling coherence mechanisms of the host processor and the processor-in-memory. The cache coherence bridge protocol requires limited change to existing host processor cache coherence protocols. The cache coherence bridge protocol may be used to facilitate interoperability between host processors and processor-in-memory devices designed by different vendors and both the host processors and processor-in-memory devices may implement coherence techniques among computing units within each processor. The cache coherence bridge protocol may support different granularity of cache coherence permissions than those used by cache coherence protocols of a host processor and/or a processor-in-memory. The cache coherence bridge protocol uses a shadow directory that maintains status information indicating an aggregate view of copies of data cached in a system external to a processor-in-memory containing that data.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

How does drought affect residential water demand and price elasticity?

Urban water scarcity is an important social and economic concern, particularly as the intensity, duration, and frequency of droughts is increasing in many regions. We consider whether drought induces changes to water demand and the price elasticity of demand for water that may last beyond a drought’s official end date. If drought shocks prompt long-term changes in water demand behavior, and these changes occur at broad geographic scale, they could have important implications for modeling adaptive responses to water scarcity. We assemble a novel dataset on residential water demand and pricing in the western United States to test empirically for effects of drought on water demand and price elasticity. We perform our analysis with aggregate quantity, price, and drought data, accounting for endogenous prices under increasing-block water tariffs and using both average and marginal water fees in estimating water demand functions. Results are consistent with the hypothesis that households may become less price-sensitive after exposure to drought. However, we find no systematic evidence of long-run, drought-related reductions in water demand, itself.

demand hardening↗

DOE OSTI2022

A multi-scale time-series dataset of anthropogenic heat from buildings in Los Angeles County

The dataset contains hourly Anthropogenic heat (AH) from buildings in Los Angeles County, based on weather data from 2018. The hourly AH is aggregated at three spatial resolutions: 450m x 450m grid, 12km x 12km grid, and census tract. The AH is broken down into three components: building envelope surface convection, heating, ventilation, and air conditioning (HVAC) system heat release, and zone exfiltration and exhaust air heat loss. The dataset is created with the physics-based EnergyPlus building energy models to calculate individual buildings' AH considering WRF-UCM simulated microclimate conditions. Please refer to the paper "A multi-scale time-series dataset of anthropogenic heat from buildings in Los Angeles County" for more information about the data generation workflow and the data validation procedure. The data set contains two folders: the "output_data" folder holds the simulation results (EP_output and EP_output_csv), building metadata (building_metadata.geojson and building_metadata.csv), aggregated heat emission and energy consumption time-series data (hourly_heat_energy), and geographical data (geo_data) associated with the GEOID referenced in heat and energy consumption data. The "input_data" folder contains the raw data used to generate files in the "output_data" folder as well as data sets used in the validation. The code repository (https://github.com/IMMM-SFA/xu_etal_2022_sdata) holds the processing scripts for data curation, validation, and visualization.

Energy↗

DOE OSTI2022

A Multi-Branch Decoder Network Approach to Adaptive Temporal Data Selection and Reconstruction for Big Scientific Simulation Data

A key challenge in scientific simulation is that the simulation outputs often require intensive I/O and storage space to store the results for effective post hoc analysis. This article focuses on a quality-aware adaptive temporal data selection and reconstruction problem where the goal is to adaptively select simulation data samples at certain key timesteps in situ and reconstruct the discarded samples with quality assurance during post hoc analysis. This problem is motivated by the limitation of current solutions that a significant amount of simulation data samples are either discarded or aggregated during the sampling process, leading to inaccurate modeling of the simulated phenomena. Two unique challenges exist: 1) the sampling decisions have to be made in situ and adapted to the dynamics of the complex scientific simulation data; 2) the reconstruction error must be strictly bounded to meet the application requirement. To address the above challenges, we develop DeepSample , an error-controlled convolutional neural network framework, that jointly integrates a set of coherent multi-branch deep decoders to effectively reconstruct the simulation data with rigorous quality assurance. The results on two real-world scientific simulation applications show that DeepSample significantly outperforms other state-of-the-art methods on both sampling efficiency and reconstructed simulation data quality.

Zhang, Yang↗

DOE OSTI2021

A Taxonomy for Classification and Comparison of Dataflows for GNN Accelerators

Recently, Graph Neural Networks (GNNs) have received a lot of interest because of their success in learning representations from graph structured data. However, GNNs exhibit different compute and memory characteristics compared to traditional Deep Neural Networks (DNNs). Graph convolutions require feature aggregations from neighboring nodes (known as the aggregation phase), which leads to highly irregular data accesses. GNNs also have a very regular compute phase that can be broken down to matrix multiplications (known as the combination phase). All recently proposed GNN accelerators utilize different dataflows and microarchitecture optimizations for these two phases. Different communication strategies between the two phases have been also used. However, as more custom GNN accelerators are proposed, the harder it is to qualitatively classify them and quantitatively contrast them. In this work, we present a taxonomy to describe several diverse dataflows for running GNN inference on accelerators. This provides a structured way to describe and compare the design-space of GNN accelerators.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Differentially Private Adaptive Noise Injection (DP-ANI) v1.0

Location data is collected from users continuously to understand their mobility patterns. Releasing the user trajectories may compromise user privacy. Therefore, the general practice is to release aggregated location datasets. However, private information may still be inferred from an aggregated version of location trajectories. Differential privacy (DP) protects the query output against inference attacks regardless of background knowledge. This software implements a differential privacy-based privacy model that protects the user's origins and destinations from being inferred from aggregated mobility datasets. This is achieved by injecting Planar Laplace noise to the user origin and destination GPS points. The noisy GPS points are then transformed into a link representation using a link-matching algorithm. Finally, the link trajectories form an aggregated mobility network. The injected noise level is selected using the Sparse Vector Mechanism. This DP selection mechanism considers the link density of the location and the functional category of the localized links. Compared to the different baseline models, including a k-anonymity method, our differential privacy-based aggregation model offers query responses that are close to the raw data in terms of aggregate statistics at both the network and trajectory-levels with maximum 9% deviation from the baseline in terms of network length.

Peisert, Sean [Lawrence Berkeley National Laborato↗

DOE OSTI2024

LTE Electrolyzer Data Collection

The goal for NREL is to collect, develop and publish performance metrics relative to low temperature electrolyzer installations. This will be done through the development of: Secure storage solution to house the collection of data from multiple projects Standardization of data to be collected and analyzed. This will be done using data templates developed with the help of partners involved with electrolyzer installations. Analysis that produces metrics of interest for all stakeholders Aggregation of results from multiple projects to view industry progress as a whole Publication of aggregated results in the form of composite data products (CDPs) Collaboration with Idaho National Lab and their work with high temperature electrolyzer installations will enable efficient use of storage and analysis tools.

data↗

DOE OSTI2020

Amphiphile Organization in Organic Solutions: An Alternative Explanation for Small-Angle X-ray Scattering Features in Malonamide/Alkane Mixtures

In this work, the role of different intermolecular interactions in the aggregation of amphiphiles in an organic solvent is studied for systems of relevance to liquid-liquid extraction (LLE), a chemical process used to selectively recover metals from complex mixtures. Of specific interest is the role, or lack thereof, of hydrogen bonding, which is often assumed to be a main driver of the organic phase structural organization that has been linked to separation efficacy. Toward that end, a series of malonamide extractants in n-dodecane have been studied in the absence of any extracted aqueous solutes, including water. The series of extractants includes N,N'-dimethyl-N,N'-dibutyltetradecylmalonamide (DMDBTDMA), two of its homologs, and N,N'-dimethyl-N,N'-dioctylhexylethoxymalonamide (DMDOHEMA). This simplified model LLE system enables systematic investigation of the role of dipole-dipole and alkyl tail steric interactions in amphiphile aggregation. Small-angle X-ray scattering (SAXS) profiles computed from molecular dynamics trajectories are in good agreement with experimental SAXS data. Molecular dynamics simulations show that malonamide aggregation results from dipole-driven self-association and lacks characteristic aggregate sizes. Mid-q correlation peaks in the SAXS profiles emerge at high concentration for each malonamide. In those densely packed solutions, the correlation peaks are observed to result from alkyl tail-induced spacing between electron-rich polar head groups, with peak positions determined by the different alkyl tail lengths present in the malonamide molecule. This explanation of the SAXS correlation peaks contrasts with the prevailing literature, which attributes mesoscale features observed in small-angle scattering to the formation of microemulsions. Instead, this work finds that these features are present in the absence of water or any reverse micellar organization of the malonamides. As such, molecular-scale malonamide self-association and packing, rather than microemulsion-based colloidal-scale descriptions, is a more appropriate framework for these LLE systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Deciphering Dynamic Structural and Mechanistic Complexity in Cu/CeO2/ZSM-5 Catalysts for the Reverse Water-Gas Shift Reaction

Explore the source record for details and available documents.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

SOMA: Observability, monitoring, and in situ analytics for exascale applications

With the rise of exascale systems and large, data-centric workflows, the need to observe and analyze high performance computing (HPC) applications during their execution is becoming increasingly important. HPC applications are typically not designed with online monitoring in mind, therefore, the observability challenge lies in being able to access and analyze interesting events with low overhead while seamlessly integrating such capabilities into existing and new applications. We explore how our service-based observation, monitoring, and analytics (SOMA) approach to collecting and aggregating both application-specific diagnostic data and performance data addresses these needs. Furthermore, we present our SOMA framework and demonstrate its viability with LULESH, a hydrodynamics proxy application. Then we focus on Astaroth, a multi-GPU library for stencil computations, highlighting the integration of the TAU and APEX performance tools and SOMA for application and performance data monitoring.

97 MATHEMATICS AND COMPUTING↗