SEARCH · Engineering Papers

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Quantitative differentiation of benign and misfolded glaucoma-causing myocilin variants on the basis of protein thermal stability

Accurate predictions of the pathogenicity of mutations associated with genetic diseases are key to the success of precision medicine. Inherited missense mutations in the myocilin (MYOC) gene, within its olfactomedin (OLF) domain, constitute the strongest genetic link to primary open-angle glaucoma via a toxic gain of function, and thus MYOC is an attractive precision-medicine target. However, not all mutations in MYOC cause glaucoma, and common variants are expected to be neutral polymorphisms. The Genome Aggregation Database (gnomAD) lists ~100 missense variants documented within OLF, all of which are relatively rare (allele frequency <0.001%) and nearly all are of unknown pathogenicity. To distinguish disease-causing OLF variants from benign OLF variants, we first characterized the most prevalent population-based variants using a suite of cellular and biophysical assays, and identified two variants with features of aggregation-prone familial disease variants. Next, we considered all available biochemical and clinical data to demonstrate that pathogenic and benign variants can be differentiated statistically based on a single metric: the thermal stability of OLF. Our results motivate genotyping MYOC in patients for clinical monitoring of this widespread, painless and irreversible ocular disease.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Quantifying albedo susceptibility biases in shallow clouds

The evaluation of radiative forcing associated with aerosol–cloud interactions remains a significant source of uncertainty in future climate projections. The problem is confounded by the fact that aerosol particles influence clouds locally and that averaging to larger spatial and/or temporal scales carries biases that depend on the heterogeneity and spatial correlation of the interacting fields and the nonlinearity of the responses. Mimicking commonly applied satellite data analyses for calculation of albedo susceptibility S o , we quantify S o aggregation biases using an ensemble of 127 large eddy simulations of marine stratocumulus. We explore the cloud field properties that control this spatial aggregation bias and quantify the bias for a large range of shallow stratocumulus cloud conditions manifesting a variety of morphologies and ranges of cloud fractions. We show that S o spatial aggregation biases can be on the order of hundreds of percent, depending on the methodology. Key uncertainties emanate from the typically applied adiabatic drop concentration N d retrieval, the correlation between aerosol and cloud fields, and the extent to which averaging reduces the variance in cloud albedo A c and N d . So biases are more often positive than negative and are highly correlated with biases in the liquid water path adjustment. Temporal aggregation biases are shown to offset spatial aggregation biases. Both spatial and temporal biases have significant implications for observationally based assessments of aerosol indirect effects and our inferences of underlying aerosol–cloud–radiation effects.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

V1G Frequency Regulation: Algorithm Development, Validation & Analysis at Scale

Researchers at Argonne National Laboratory developed and validated a high-fidelity digital twin of a smart charging (V1G) ecosystem to model the participation of up to 1,000 unique electric vehicles (EVs) in the PJM frequency regulation market. Utilizing a discrete-event framework, the simulation models complex interactions, from dynamic grid signals (updated every 2 seconds) to individual EV charging dynamics. The simulation incorporates multiple EV models created from real-world lab test data. Researchers tested multiple control algorithms to balance the dual objectives of maximizing aggregator’s revenue and driver charging needs. Results demonstrate that aggregated EVs function as a controllable, highly effective grid resource, achieving high PJM Performance Scores (80–90%). Additionally, an optimized, market-aware bidding strategy was identified as key to profitability. The platform was shown to provide drivers with an average charging discount of nearly 50%. The algorithm was further validated in the lab using production EVs and charging stations to compare simulation results with real-world performance.

Manne, Nithin↗

DOE OSTI2018

DWT-Based Aggregated Load Modeling and Evaluation for Quasi-Static Time-Series Simulation on Distribution Feeders

This paper presents an extension of a previously reported discrete wavelet transform (DWT) based load modeling methodology which targets at modeling time-series load profiles to enable the more effective and realistic quasi-static time-series simulation of distribution feeders. The time-series load model is composed of two major parts: 1) The low-resolution field-measured load data which usually have a resolution of 30 or 15 min., 2) The high-resolution load variability model data extracted from the established variability database which can have resolution up to 1 sec. A load aggregation methodology is developed to aggregate the load profiles so that load profiles at different transformer ratings can be effectively modeled. Validation, evaluation, and analysis of the developed load modeling approach has been performed on the IEEE-123 feeder and an actual utility feeder from California. The analysis completed on the two feeders have demonstrated the effectiveness and revealed the value of the developed model for distribution feeder quasi-static time-series simulation at high temporal resolution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2018

DWT-Based Aggregated Load Modeling and Evaluation for Quasi-Static Time-Series Simulation on Distribution Feeders: Preprint

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2018

Automatic identification and classification of Palomar Transient Factory astrophysical objects in GLADE

Palomar Transient Factory (PTF) is a comprehensive detection system for the identification and classification of transient astrophysical objects. In this paper, we make two significant contributions to the PTF pipeline. First, we present an experimental study that evaluates a novel implementation of the real-time classifier in GLADE - a parallel data processing system that combines the efficiency of a database with the extensibility of map-reduce. We show how each stage in the classifier maps optimally into GLADE tasks by taking advantage of the unique features of the system - range-based data partitioning, columnar storage, multi-query execution, and in-database support for complex aggregate computation. Second, we introduce a novel parallel similarity join algorithm for advanced transient classification. In conclusion, we implement this algorithm in GLADE and execute it on a massive supercomputer with more than 3,000 threads, achieving more than three orders of magnitude improvement over the PostgreSQL solution.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Medium controlled aggregative growth as a key step in mesoporous silica nanoparticle formation

Near monodisperse mesoporous silica nanoparticles (MSN) represent a promising and rapidly developing type of mesoporous silica materials; however, the vast data on their synthesis remains unorganized and ill-understood. We systematically studied the formation of MSN under basic and neutral conditions using various temperatures, CTAB concentrations, hydrolyzing agents (triethanolamine, ammonia, phosphate buffers), and media with different colloidal stabilization properties (with ethanol as a cosolvent and monovalent salts). In the typical conditions for the preparation of stable MSN colloids, the particle size was controlled by colloidal stabilization by the medium (solvent type, ionic strength, and surfactant concentration) in agreement with the “aggregative growth” mechanism, rather than by solely the hydrolysis and condensation rates conventionally used for data interpretation in the classical nucleation theory. Medium properties (pH, ion types and concentration, polarity) also defined the efficiency of silica-surfactant cooperative self-assembly, which directly affected the porosity, mesopore size and pore wall thickness. Interestingly, this traditional silica-surfactant route showed a limited effect on the particle size, emphasizing the dominating role of colloidal stabilization in the studied reaction conditions. In situ pH measurements showed that every reaction medium has unique pH evolution profiles depending on the buffer capacity, hydrolysis and condensation rates. Reaction systems that fail to maintain the working pH can lead to non-porous products or undesired particle morphology and size distribution. The established particle formation mechanism allowed us to formulate comprehensive guidelines for preparing relatively concentrated colloids of near monodisperse (PDI 5–15%) mesoporous 30–700 nm silica spheres with variable porosity and mesopore size. Here, these findings will be particularly useful in designing new mesoporous silica-containing materials for biomedical applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2017

Open V2X at ESIF: June 2015 - February 2017 (Final Report)

The University of Delaware (UD), and their industrial partners, have carried out testing, documentation, and standards development at ESIF. These activities are intended to help meet the objective of NREL's INTEGRATE program, to enable clean energy technologies to increase the hosting capacity of the grid, by providing grid services in a holistic manner using an open source, interoperable platform. In particular, the 'Open V2X at ESIF' project worked to facilitate standardization and interoperability for Electric Vehicle technologies, including battery electric vehicles and plug-in hybrid vehicles (hence EV) to provide grid services. This was done by interconnecting and testing EV and EVSE (charging station) hardware from different manufacturers, by developing standards and test protocols for standards, and by documenting new protocols to be proposed as standards. Contractor-supplied equipment used in the testing included Vehicle Smart Links (VSLs) installed in an EV and School Bus, single-phase and three-phase charging stations, and an optimizing aggregator (software running on a server, hence just 'Aggregator'). The Aggregator software was developed by U of Delaware and is now licensed to Nuvve Corp for commercial development, and licensed to NRG/EVgo for demonstrations. The Aggregator monitors capacity and operations of the EVs and EVSEs, dispatches them in response to requests, and reports their operations and metered power flow. In operation, as vehicles move, plug-in and unplug, the aggregator tracks the total capacity available within a defined jurisdiction or RTO (Regional Transmission Organization, synonym for ISO or TSO), and dispatches part or all of that capacity based on market or direct dispatch signals from a grid entity. The VSL is the data acquisition and control module in the resource itself (EVSE or EV), with rich communication between a single Optimizing Aggregator and many VSL (one in each resource). All requests and dispatch events are also logged by the aggregator to make the provision of grid power auditable. For these tests, the dispatch was typically a recorded signal, the VSL was in the EV or EVSE, and the recording of experimental performance was often carried out by the normal logging functions of the aggregator.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

An assessment of power flexibility from commercial building cooling systems in the United States

Understanding varying characteristics and aggregate potential of power flexibility from different building types considering regional diversity is critically important to actively engaging building resources in future eco-friendly, low-cost, and sustainable power systems. This paper presents a comprehensive characteristics analysis and potential assessment of the power flexibility from heating, ventilation, and air conditioning (HVAC) loads in commercial buildings in the U.S. using a simulation-based method. In this method, commercial buildings are first grouped by building types and climate regions. The U.S. Department of Energy Commercial Prototype Building Models are used to represent an average building in each group and are simulated to characterize corresponding power flexibility. Based on building survey data, the number of commercial buildings in each group is estimated and used to calculate aggregate power flexibility. It is found that HVAC loads in commercial buildings offer more flexibility for increasing power consumption than for decreasing it. The power consumption of commercial buildings in the U.S. can be increased by 46 GW and decreased by 40 GW on peak summer days. Among all commercial building types, standalone retail buildings provide the most absolute flexibility while the medium office buildings have the most flexibility as a percentage of the rated power consumption.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

A synthesis of bacterial and archaeal phenotypic trait data

A synthesis of phenotypic and quantitative genomic traits is provided for bacteria and archaea, in the form of a scripted, reproducible workflow that standardizes and merges 26 sources. The resulting unified dataset covers 14 phenotypic traits, 5 quantitative genomic traits, and 4 environmental characteristics for approximately 170,000 strain-level and 15,000 species-aggregated records. It spans all habitats including soils, marine and fresh waters and sediments, host-associated and thermal. Trait data can find use in clarifying major dimensions of ecological strategy variation across species. They can also be used in conjunction with species and abundance sampling to characterize trait mixtures in communities and responses of traits along environmental gradients.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

A Graph-Net with Node Embeddings to Detect False Data Injection Attacks in Photovoltaic Systems

Distributed energy resources (DER) contribute to the operational stability of the larger power grid both at utility-scale as well as commercial and residential scales in aggregated forms. These DER in-turn are susceptible to increasing cyber threats. An adversary can plug into the same local network that a field photovoltaic (PV) system uses to interconnect its data loggers and inverters and manipulate certain measurements collected from the network or trick existing irradiance and inverter readings through false data injection attacks (FDIA). Control routines that rely on these measurements can propagate the false data, impacting critical decisions that result in a suboptimal operation or even cause intentional harm leading to inverter-tripping or unscheduled loads that need to be shed. To detect FDIA in PV systems, the paper introduces an attention-based graph neural network with node embeddings and applied it to a simple prototypical DC-coupled microgrid with PV, energy storage, and load. The algorithm shows a detection accuracy of up to 98.95%. The proposed FDIA detection technique will provide micro-grid operators with an effective method to safeguard their systems, guaranteeing the secure and reliable operation.

Parvez, Imtiaz [Utah Valley University]↗

DOE OSTI2020

ExpoKids: An R-based tool for characterizing aggregate chemical exposure during childhood

Background: Aggregate exposure, the combined exposures to a single chemical from all pathways, is a critical children’s health issue. Objective: The primary objective is to develop a tool to illustrate potential differences in aggregate exposure at various childhood lifestages and the adult lifestage. Methods: We developed ExpoKids (an R-based tool) using oral exposure estimates across lifestages generated by US EPA’s Exposure Factors Interactive Resource for Scenarios Tool (ExpoFIRST). Results: ExpoKids is applied to illustrate aggregate oral exposure, for ten media, as average daily doses (ADD) and lifetime average daily doses (LADD) in five graphs organized across seven postnatal childhood lifestages and the adult lifestage. This data visualization tool conveys ExpoFIRST findings, from available exposure data, to highlight the relative contributions of media and lifestages to chemical exposure. To evaluate the effectiveness of ExpoKids, three chemical case examples (di[2-ethylhexyl] phthalate [DEHP], manganese, and endosulfan) were explored. Data available from the published literature and databases for each case example were used to explore research questions regarding media and lifestage contributions to aggregate exposure. Significance: These illustrative case examples demonstrate ExpoKids’ versatile application to explore a diverse set of children’s health risk assessment and management questions by visually depicting specific media and lifestage contributions to aggregate exposure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

ComStock Measure Scenario Documentation: Chiller Replacement

Building on a 3-year effort to calibrate and validate the U.S. Department of Energy's ResStock (TM) and ComStock (TM) models, this work produces national datasets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of questions regarding their commercial building stock. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual energy consumption (at a subhourly resolution) of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project. The goal of this work is to develop energy efficiency and demand flexibility end-use load shapes that cover high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to various "what-if" scenarios that can be applied to buildings. An end-use savings shape is the difference in energy consumption between a baseline building (or collection of buildings) and a building with an energy efficiency or demand flexibility measure applied. It results in a time-series profile broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step, as well as annual aggregations. This report describes the modeling methodology for a single end-use savings shape measure - chiller replacement - and briefly introduces key results. The full public dataset can be accessed on the ComStock (TM) data lake or via the Data Viewer at comstock.nrel.gov. The public data set enables users to create custom aggregations of results for their use case (e.g., filter to a specific county).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2015

Density-Aware Clustering Based on Aggregated Heat Kernel and Its Transformation

Current spectral clustering algorithms suffer from the sensitivity to existing noise, and parameter scaling, and may not be aware of different density distributions across clusters. If these problems are left untreated, the consequent clustering results cannot accurately represent true data patterns, in particular, for complex real world datasets with heterogeneous densities. This paper aims to solve these problems by proposing a diffusion-based Aggregated Heat Kernel (AHK) to improve the clustering stability, and a Local Density Affinity Transformation (LDAT) to correct the bias originating from different cluster densities. AHK statistically\ models the heat diffusion traces along the entire time scale, so it ensures robustness during clustering process, while LDAT probabilistically reveals local density of each instance and suppresses the local density bias in the affinity matrix. Our proposed framework integrates these two techniques systematically. As a result, not only does it provide an advanced noise-resisting and density-aware spectral mapping to the original dataset, but also demonstrates the stability during the processing of tuning the scaling parameter (which usually controls the range of neighborhood). Furthermore, our framework works well with the majority of similarity kernels, which ensures its applicability to many types of data and problem domains. The systematic experiments on different applications show that our proposed algorithms outperform state-of-the-art clustering algorithms for the data with heterogeneous density distributions, and achieve robust clustering performance with respect to tuning the scaling parameter and handling various levels and types of noise.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2015

An Elegant Sufficiency: Load-Aware Differentiated Scheduling of Data Transfers

We investigate the file transfer scheduling problem, where transfers among different endpoints must be scheduled to maximize pertinent metrics. We propose two new algorithms that exploit the fact that the aggregate bandwidth obtained over a network or at a storage system tends to increase with the number of concurrent transfers—but only up to a certain limit. The first algorithm, SEAL, uses runtime information and data-driven models to approximate system load and adapt transfer schedules and concurrency so as to maximize performance while avoiding saturation. We implement this algorithm using GridFTP as the transfer protocol and evaluate it using real transfer logs in a production WAN environment. Results show that SEAL can improve average slowdowns and turnaround times by up to 25% and worst-case slowdown and turnaround times by up to 50%, compared with the best-performing baseline scheme. Our second algorithm, STEAL, further leverages user-supplied categorization of transfers as either “interactive” (requiring immediate processing) or “batch” (less time-critical). Results show that STEAL reduces the average slowdown of interactive transfers by 63% compared to the best-performing baseline and by 21% compared to SEAL. For batch transfers, compared to the best-performing baseline, STEAL improves by 18% the utilization of the bandwidth unused by interactive transfers. By elegantly ensuring a sufficient, but not excessive, allocation of concurrency to the right transfers, we significantly improve overall performance despite constraints.

Kettimuthu, Rajkumar↗

DOE OSTI2022

Updated U.S. Low-Temperature Heating and Cooling Demand by County and Sector

This dataset includes U.S. low-temperature heating and cooling demand at the county level in major end-use sectors: residential, commercial, manufacturing, agricultural, and data centers. Census division-level end-use energy consumption, expenditure, and commissioned power database were dis-aggregated to the county level. The county-level database was incorporated with climate zone, numbers of housing units and farms, farm size, and coefficient of performance (COP) for heating and cooling demand analysis. This dataset also includes a paper containing a full explanation of the methodologies used and maps. Residential data were updated from the latest Residential Energy Consumption Survey (RECS) dataset (2015) using 2020 census data. Commercial data were baselined off the latest Commercial Building Energy Consumption Survey (CBECS) dataset (2012). Manufacturing data were baselined off the latest Manufacturing Energy Consumption Survey (MECS) dataset (2021).

15 GEOTHERMAL ENERGY↗

DOE OSTI2024

Data driven discovery and quantification of hyperspectral leaf reflectance phenotypes across a maize diversity panel

Abstract Estimates of plant traits derived from hyperspectral reflectance data have the potential to efficiently substitute for traits, which are time or labor intensive to manually score. Typical workflows for estimating plant traits from hyperspectral reflectance data employ supervised classification models that can require substantial ground truth datasets for training. We explore the potential of an unsupervised approach, autoencoders, to extract meaningful traits from plant hyperspectral reflectance data using measurements of the reflectance of 2151 individual wavelengths of light from the leaves of maize ( Zea mays ) plants harvested from 1658 field plots in a replicated field trial. A subset of autoencoder‐derived variables exhibited significant repeatability, indicating that a substantial proportion of the total variance in these variables was explained by difference between maize genotypes, while other autoencoder variables appear to capture variation resulting from changes in leaf reflectance between different batches of data collection. Several of the repeatable latent variables were significantly correlated with other traits scored from the same maize field experiment, including one autoencoder‐derived latent variable (LV8) that predicted plant chlorophyll content modestly better than a supervised model trained on the same data. In at least one case, genome‐wide association study hits for variation in autoencoder‐derived variables were proximal to genes with known or plausible links to leaf phenotypes expected to alter hyperspectral reflectance. In aggregate, these results suggest that an unsupervised, autoencoder‐based approach can identify meaningful and genetically controlled variation in high‐dimensional, high‐throughput phenotyping data and link identified variables back to known plant traits of interest.

Tross, Michael C.↗

DOE OSTI2017

The Distributed Wind Cost Taxonomy

To date, there has been no standard method or tool to analyze the installed and operational costs for distributed wind turbine systems. This report describes the development of a classification system, or taxonomy, for distributed wind turbine project costs. The taxonomy establishes a framework to help collect, sort, and compare distributed wind cost data that mirrors how the industry categorizes information. The taxonomy organizes costs so they can be aggregated from installers, developers, vendors, and other sources without losing cost details. Developing a peer-reviewed taxonomy is valuable to industry stakeholders because a common understanding the details of distributed wind turbine costs and balance of station costs is a first step to identifying potential high-value cost reduction opportunities. Addressing cost reduction potential can help increase distributed wind's competitiveness and propel the U.S. distributed wind industry forward. The taxonomy can also be used to perform cost comparisons between technologies and track trends for distributed wind industry costs in the future. As an initial application and piloting of the taxonomy, preliminary cost data were collected for projects of different sizes and from different regions across the contiguous United States. Following the methods described in this report, these data are placed into the established cost categories.

17 WIND ENERGY↗