SEARCH · Engineering Papers

Results for “Data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

All sources NASA NTRS DOE OSTI

DOE OSTI2017

Exploiting Identical Generators in Unit Commitment

Here, we present sufficient conditions under which thermal generators can be aggregated in mixed-integer linear programming (MILP) formulations of the unit commitment (UC) problem, while maintaining feasibility and optimality for the original disaggregated problem. Aggregating thermal generators with identical characteristics (e.g., minimum/maximum power output, minimum up/down-time, and cost curves) into a single unit reduces redundancy in the search space induced by both exact symmetry (permutations of generator schedules) and certain classes of mutually non-dominated solutions. We study the impact of aggregation on two large-scale UC instances, one from the academic literature and another based on real-world operator data. Our computational tests demonstrate that when present, identical generators can negatively affect the performance of modern MILP solvers on UC formulations. Further, we show that our reformation of the UC MILP through aggregation is an effective method for mitigating this source of computational difficulty.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2016

Impact of Data Placement on Resilience in Large-Scale Object Storage Systems

Distributed object storage architectures have become the de facto standard for high-performance storage in big data, cloud, and HPC computing. Object storage deployments using commodity hardware to reduce costs often employ object replication as a method to achieve data resilience. Repairing object replicas after failure is a daunting task for systems with thousands of servers and billions of objects, however, and it is increasingly difficult to evaluate such scenarios at scale on realworld systems. Resilience and availability are both compromised if objects are not repaired in a timely manner. In this work we leverage a high-fidelity discrete-event simulation model to investigate replica reconstruction on large-scale object storage systems with thousands of servers, billions of objects, and petabytes of data. We evaluate the behavior of CRUSH, a well-known object placement algorithm, and identify configuration scenarios in which aggregate rebuild performance is constrained by object placement policies. After determining the root cause of this bottleneck, we then propose enhancements to CRUSH and the usage policies atop it to enable scalable replica reconstruction. We use these methods to demonstrate a simulated aggregate rebuild rate of 410 GiB/s (within 5% of projected ideal linear scaling) on a 1,024-node commodity storage system. We also uncover an unexpected phenomenon in rebuild performance based on the characteristics of the data stored on the system.

Carns, Philip↗

DOE OSTI2026

DOE EV Data Collection - Charging Data

Charging data are collected from one of three sources, each with varying levels of additional information. These sources, in approximate order from most to least additional information, are: • The electric vehicle supply equipment (charger) • Onboard the vehicle itself • From a utility submeter. Many chargers provide software that allows for the collection and reporting of charging session data. If unavailable, data may be recorded by the charging vehicle’s onboard systems. If neither of these options is available, data can be acquired from utility submeters that simply track the energy flowing to one or more chargers. Data collected directly from the electric vehicle supply equipment (EVSE) are typically the most accurate and highest frequency. However, it is not always possible to discern which exact vehicle is being charged during any one session. EVSE-side data can be identified where a single charger ID but a range of vehicle IDs are present (e.g., CH001, EV001-EV005). Data collected from the vehicle’s onboard systems usually does not provide information on which exact charger is being used. Vehicle-side data can be identified where a single Vehicle ID but a range of Charger IDs are present (e.g., EV001, CH001-CH005). Data collected from utility submeters provide no information on which specific vehicle is charging or which specific charger is in use. Submeter data can be identified where multiple Vehicle IDs and multiple Charger IDs are present, but only a single Fleet ID is present (e.g., EV001-EV005, CH001-CH005, Fleet01). The **Charge Data Daily/Session Dictionaries** contains definitions for each available parameter collected as part of an individual charging session, aggregated at either a daily or session level. The parameters available will vary between vehicles and chargers. The **Charger Attributes** table contains specific charger characteristics, coded to at least one anonymous Charger ID and linked to either a single or a range of Vehicle IDs. Vehicle ID can be used as a key between charging data and vehicle attribute tables. The **Charger Attributes Data Dictionary** contains definitions for each available parameter collected on the physical and operational characteristics of the charging hardware itself. The **Vehicle Attributes Data Dictionary** contains definitions for each available parameter associated with a vehicle’s physical and functional attributes and fleet context. The **Vehicle Attributes** table contains specific vehicle characteristics, coded to an anonymous Vehicle ID. This Vehicle ID can be used as a key between vehicle data and vehicle attribute tables, and in cases where charging data are supplied, links a vehicle with the charger(s) that supplied it power. The **Charging Data** tables contain the data from each charger’s operations, coded to at least one anonymous Charger ID and linked to either a single or a range of Vehicle IDs. Vehicle ID can be used as a key between charging data and vehicle attribute tables. Data is being uploaded quarterly through 2023 and subject to change until the conclusion of the project.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2017

The small molecule 2-phenylethynesulfonamide induces covalent modification of p53

p53 is a tumor suppressor protein which is either lost or inactivated in a large majority of tumors. The small molecule 2-phenylethynesulfonamide (PES) was originally identified as the inhibitor of p53 effects on the mitochondrial death pathway. In this report we demonstrate that p53 protein from PES-treated cells was detected in reduced mobility bands between molecular weights 95–220 kDa. Resolution of p53 aggregates on urea gel was unable to reduce the high molecular weight p53 aggregates, which were shown to be primarily located in the nucleus. Therefore, our data suggest that PES exerts its effects through covalent cross-linking and nuclear retention of p53. - Highlights: • p53 protein is in high molecular weight complexes in the nucleus of PES-treated cells. • PES is a drug that inhibits pro-apoptotic p53 action at the mitochondria. • We propose that PES action involves cross-linking and nuclear retention of p53.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Compound Continental Risk of Multiple Extreme Floods in the United States

Abstract Understanding spatially correlated floods and modeling joint hazard associated with threshold exceedances across multiple locations is crucial for accurate estimation of continental‐scale portfolio risk. This work uses a non‐parametric copula‐based spatial simulator to analyze peak floods across the United States to derive the first‐of‐its‐kind continental portfolio risk estimates at the 10‐ and 100‐year return levels. We find significant interdependence in floods across the nation, revealing the recurring pattern of extreme events affecting the Northeast, Central, West, and Northwest United States in the same year. The stochastic simulator effectively manages high‐dimensional data and offers reliable uncertainty estimates for both spatially dependent floods and the aggregated flood losses at the continental level. El Niño‐Southern Oscillation and Atlantic Multidecadal Oscillation are identified as statistically significant tele‐connectors of aggregate loss. This research aims to advance the understanding of compound continental flood hazard and the potential large‐scale climate teleconnections that lead to such compound floods.

Geology↗

DOE OSTI2016

Architecture and Implementation of OpenPET Firmware and Embedded Software

OpenPET is an open source, modular, extendible, and high-performance platform suitable for multi-channel data acquisition and analysis. Due to the versatility of the hardware, firmware, and software architectures, the platform is capable of interfacing with a wide variety of detector modules not only in medical imaging but also in homeland security applications. Analog signals from radiation detectors share similar characteristics-a pulse whose area is proportional to the deposited energy and whose leading edge is used to extract a timing signal. As a result, a generic design method of the platform is adopted for the hardware, firmware, and software architectures and implementations. The analog front-end is hosted on a module called a Detector Board, where each board can filter, combine, timestamp, and process multiple channels independently. The processed data is formatted and sent through a backplane bus to a module called Support Board, where 1 Support Board can host up to eight Detector Board modules. The data in the Support Board, coming from 8 Detector Board modules, can be aggregated or correlated (if needed) depending on the algorithm implemented or runtime mode selected. It is then sent out to a computer workstation for further processing. The number of channels (detector modules), to be processed, mandates the overall OpenPET System Configuration, which is designed to handle up to 1,024 channels using 16-channel Detector Boards in the Standard System Configuration and 16,384 channels using 32-channel Detector Boards in the Large System Configuration.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Quantitative differentiation of benign and misfolded glaucoma-causing myocilin variants on the basis of protein thermal stability

Accurate predictions of the pathogenicity of mutations associated with genetic diseases are key to the success of precision medicine. Inherited missense mutations in the myocilin (MYOC) gene, within its olfactomedin (OLF) domain, constitute the strongest genetic link to primary open-angle glaucoma via a toxic gain of function, and thus MYOC is an attractive precision-medicine target. However, not all mutations in MYOC cause glaucoma, and common variants are expected to be neutral polymorphisms. The Genome Aggregation Database (gnomAD) lists ~100 missense variants documented within OLF, all of which are relatively rare (allele frequency <0.001%) and nearly all are of unknown pathogenicity. To distinguish disease-causing OLF variants from benign OLF variants, we first characterized the most prevalent population-based variants using a suite of cellular and biophysical assays, and identified two variants with features of aggregation-prone familial disease variants. Next, we considered all available biochemical and clinical data to demonstrate that pathogenic and benign variants can be differentiated statistically based on a single metric: the thermal stability of OLF. Our results motivate genotyping MYOC in patients for clinical monitoring of this widespread, painless and irreversible ocular disease.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Quantifying albedo susceptibility biases in shallow clouds

The evaluation of radiative forcing associated with aerosol–cloud interactions remains a significant source of uncertainty in future climate projections. The problem is confounded by the fact that aerosol particles influence clouds locally and that averaging to larger spatial and/or temporal scales carries biases that depend on the heterogeneity and spatial correlation of the interacting fields and the nonlinearity of the responses. Mimicking commonly applied satellite data analyses for calculation of albedo susceptibility S o , we quantify S o aggregation biases using an ensemble of 127 large eddy simulations of marine stratocumulus. We explore the cloud field properties that control this spatial aggregation bias and quantify the bias for a large range of shallow stratocumulus cloud conditions manifesting a variety of morphologies and ranges of cloud fractions. We show that S o spatial aggregation biases can be on the order of hundreds of percent, depending on the methodology. Key uncertainties emanate from the typically applied adiabatic drop concentration N d retrieval, the correlation between aerosol and cloud fields, and the extent to which averaging reduces the variance in cloud albedo A c and N d . So biases are more often positive than negative and are highly correlated with biases in the liquid water path adjustment. Temporal aggregation biases are shown to offset spatial aggregation biases. Both spatial and temporal biases have significant implications for observationally based assessments of aerosol indirect effects and our inferences of underlying aerosol–cloud–radiation effects.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

V1G Frequency Regulation: Algorithm Development, Validation & Analysis at Scale

Researchers at Argonne National Laboratory developed and validated a high-fidelity digital twin of a smart charging (V1G) ecosystem to model the participation of up to 1,000 unique electric vehicles (EVs) in the PJM frequency regulation market. Utilizing a discrete-event framework, the simulation models complex interactions, from dynamic grid signals (updated every 2 seconds) to individual EV charging dynamics. The simulation incorporates multiple EV models created from real-world lab test data. Researchers tested multiple control algorithms to balance the dual objectives of maximizing aggregator’s revenue and driver charging needs. Results demonstrate that aggregated EVs function as a controllable, highly effective grid resource, achieving high PJM Performance Scores (80–90%). Additionally, an optimized, market-aware bidding strategy was identified as key to profitability. The platform was shown to provide drivers with an average charging discount of nearly 50%. The algorithm was further validated in the lab using production EVs and charging stations to compare simulation results with real-world performance.

Manne, Nithin↗

DOE OSTI2018

DWT-Based Aggregated Load Modeling and Evaluation for Quasi-Static Time-Series Simulation on Distribution Feeders

This paper presents an extension of a previously reported discrete wavelet transform (DWT) based load modeling methodology which targets at modeling time-series load profiles to enable the more effective and realistic quasi-static time-series simulation of distribution feeders. The time-series load model is composed of two major parts: 1) The low-resolution field-measured load data which usually have a resolution of 30 or 15 min., 2) The high-resolution load variability model data extracted from the established variability database which can have resolution up to 1 sec. A load aggregation methodology is developed to aggregate the load profiles so that load profiles at different transformer ratings can be effectively modeled. Validation, evaluation, and analysis of the developed load modeling approach has been performed on the IEEE-123 feeder and an actual utility feeder from California. The analysis completed on the two feeders have demonstrated the effectiveness and revealed the value of the developed model for distribution feeder quasi-static time-series simulation at high temporal resolution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2018

DWT-Based Aggregated Load Modeling and Evaluation for Quasi-Static Time-Series Simulation on Distribution Feeders: Preprint

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2018

Automatic identification and classification of Palomar Transient Factory astrophysical objects in GLADE

Palomar Transient Factory (PTF) is a comprehensive detection system for the identification and classification of transient astrophysical objects. In this paper, we make two significant contributions to the PTF pipeline. First, we present an experimental study that evaluates a novel implementation of the real-time classifier in GLADE - a parallel data processing system that combines the efficiency of a database with the extensibility of map-reduce. We show how each stage in the classifier maps optimally into GLADE tasks by taking advantage of the unique features of the system - range-based data partitioning, columnar storage, multi-query execution, and in-database support for complex aggregate computation. Second, we introduce a novel parallel similarity join algorithm for advanced transient classification. In conclusion, we implement this algorithm in GLADE and execute it on a massive supercomputer with more than 3,000 threads, achieving more than three orders of magnitude improvement over the PostgreSQL solution.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Medium controlled aggregative growth as a key step in mesoporous silica nanoparticle formation

Near monodisperse mesoporous silica nanoparticles (MSN) represent a promising and rapidly developing type of mesoporous silica materials; however, the vast data on their synthesis remains unorganized and ill-understood. We systematically studied the formation of MSN under basic and neutral conditions using various temperatures, CTAB concentrations, hydrolyzing agents (triethanolamine, ammonia, phosphate buffers), and media with different colloidal stabilization properties (with ethanol as a cosolvent and monovalent salts). In the typical conditions for the preparation of stable MSN colloids, the particle size was controlled by colloidal stabilization by the medium (solvent type, ionic strength, and surfactant concentration) in agreement with the “aggregative growth” mechanism, rather than by solely the hydrolysis and condensation rates conventionally used for data interpretation in the classical nucleation theory. Medium properties (pH, ion types and concentration, polarity) also defined the efficiency of silica-surfactant cooperative self-assembly, which directly affected the porosity, mesopore size and pore wall thickness. Interestingly, this traditional silica-surfactant route showed a limited effect on the particle size, emphasizing the dominating role of colloidal stabilization in the studied reaction conditions. In situ pH measurements showed that every reaction medium has unique pH evolution profiles depending on the buffer capacity, hydrolysis and condensation rates. Reaction systems that fail to maintain the working pH can lead to non-porous products or undesired particle morphology and size distribution. The established particle formation mechanism allowed us to formulate comprehensive guidelines for preparing relatively concentrated colloids of near monodisperse (PDI 5–15%) mesoporous 30–700 nm silica spheres with variable porosity and mesopore size. Here, these findings will be particularly useful in designing new mesoporous silica-containing materials for biomedical applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2017

Open V2X at ESIF: June 2015 - February 2017 (Final Report)

The University of Delaware (UD), and their industrial partners, have carried out testing, documentation, and standards development at ESIF. These activities are intended to help meet the objective of NREL's INTEGRATE program, to enable clean energy technologies to increase the hosting capacity of the grid, by providing grid services in a holistic manner using an open source, interoperable platform. In particular, the 'Open V2X at ESIF' project worked to facilitate standardization and interoperability for Electric Vehicle technologies, including battery electric vehicles and plug-in hybrid vehicles (hence EV) to provide grid services. This was done by interconnecting and testing EV and EVSE (charging station) hardware from different manufacturers, by developing standards and test protocols for standards, and by documenting new protocols to be proposed as standards. Contractor-supplied equipment used in the testing included Vehicle Smart Links (VSLs) installed in an EV and School Bus, single-phase and three-phase charging stations, and an optimizing aggregator (software running on a server, hence just 'Aggregator'). The Aggregator software was developed by U of Delaware and is now licensed to Nuvve Corp for commercial development, and licensed to NRG/EVgo for demonstrations. The Aggregator monitors capacity and operations of the EVs and EVSEs, dispatches them in response to requests, and reports their operations and metered power flow. In operation, as vehicles move, plug-in and unplug, the aggregator tracks the total capacity available within a defined jurisdiction or RTO (Regional Transmission Organization, synonym for ISO or TSO), and dispatches part or all of that capacity based on market or direct dispatch signals from a grid entity. The VSL is the data acquisition and control module in the resource itself (EVSE or EV), with rich communication between a single Optimizing Aggregator and many VSL (one in each resource). All requests and dispatch events are also logged by the aggregator to make the provision of grid power auditable. For these tests, the dispatch was typically a recorded signal, the VSL was in the EV or EVSE, and the recording of experimental performance was often carried out by the normal logging functions of the aggregator.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

An assessment of power flexibility from commercial building cooling systems in the United States

Understanding varying characteristics and aggregate potential of power flexibility from different building types considering regional diversity is critically important to actively engaging building resources in future eco-friendly, low-cost, and sustainable power systems. This paper presents a comprehensive characteristics analysis and potential assessment of the power flexibility from heating, ventilation, and air conditioning (HVAC) loads in commercial buildings in the U.S. using a simulation-based method. In this method, commercial buildings are first grouped by building types and climate regions. The U.S. Department of Energy Commercial Prototype Building Models are used to represent an average building in each group and are simulated to characterize corresponding power flexibility. Based on building survey data, the number of commercial buildings in each group is estimated and used to calculate aggregate power flexibility. It is found that HVAC loads in commercial buildings offer more flexibility for increasing power consumption than for decreasing it. The power consumption of commercial buildings in the U.S. can be increased by 46 GW and decreased by 40 GW on peak summer days. Among all commercial building types, standalone retail buildings provide the most absolute flexibility while the medium office buildings have the most flexibility as a percentage of the rated power consumption.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

A synthesis of bacterial and archaeal phenotypic trait data

A synthesis of phenotypic and quantitative genomic traits is provided for bacteria and archaea, in the form of a scripted, reproducible workflow that standardizes and merges 26 sources. The resulting unified dataset covers 14 phenotypic traits, 5 quantitative genomic traits, and 4 environmental characteristics for approximately 170,000 strain-level and 15,000 species-aggregated records. It spans all habitats including soils, marine and fresh waters and sediments, host-associated and thermal. Trait data can find use in clarifying major dimensions of ecological strategy variation across species. They can also be used in conjunction with species and abundance sampling to characterize trait mixtures in communities and responses of traits along environmental gradients.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

A Graph-Net with Node Embeddings to Detect False Data Injection Attacks in Photovoltaic Systems

Distributed energy resources (DER) contribute to the operational stability of the larger power grid both at utility-scale as well as commercial and residential scales in aggregated forms. These DER in-turn are susceptible to increasing cyber threats. An adversary can plug into the same local network that a field photovoltaic (PV) system uses to interconnect its data loggers and inverters and manipulate certain measurements collected from the network or trick existing irradiance and inverter readings through false data injection attacks (FDIA). Control routines that rely on these measurements can propagate the false data, impacting critical decisions that result in a suboptimal operation or even cause intentional harm leading to inverter-tripping or unscheduled loads that need to be shed. To detect FDIA in PV systems, the paper introduces an attention-based graph neural network with node embeddings and applied it to a simple prototypical DC-coupled microgrid with PV, energy storage, and load. The algorithm shows a detection accuracy of up to 98.95%. The proposed FDIA detection technique will provide micro-grid operators with an effective method to safeguard their systems, guaranteeing the secure and reliable operation.

Parvez, Imtiaz [Utah Valley University]↗

DOE OSTI2020

ExpoKids: An R-based tool for characterizing aggregate chemical exposure during childhood

Background: Aggregate exposure, the combined exposures to a single chemical from all pathways, is a critical children’s health issue. Objective: The primary objective is to develop a tool to illustrate potential differences in aggregate exposure at various childhood lifestages and the adult lifestage. Methods: We developed ExpoKids (an R-based tool) using oral exposure estimates across lifestages generated by US EPA’s Exposure Factors Interactive Resource for Scenarios Tool (ExpoFIRST). Results: ExpoKids is applied to illustrate aggregate oral exposure, for ten media, as average daily doses (ADD) and lifetime average daily doses (LADD) in five graphs organized across seven postnatal childhood lifestages and the adult lifestage. This data visualization tool conveys ExpoFIRST findings, from available exposure data, to highlight the relative contributions of media and lifestages to chemical exposure. To evaluate the effectiveness of ExpoKids, three chemical case examples (di[2-ethylhexyl] phthalate [DEHP], manganese, and endosulfan) were explored. Data available from the published literature and databases for each case example were used to explore research questions regarding media and lifestage contributions to aggregate exposure. Significance: These illustrative case examples demonstrate ExpoKids’ versatile application to explore a diverse set of children’s health risk assessment and management questions by visually depicting specific media and lifestage contributions to aggregate exposure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗