Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Remote sensing of agricultural crops and soils

Research results and accomplishments of sixteen tasks in the following areas are described: (1) corn and soybean scene radiation research; (2) soil moisture research; (3) sampling and aggregation research; (4) pattern recognition and image registration research; and (5) computer and data base services.

Bauer, M. E.↗

Hydrostatic and Physiologic Contributions to Intraocular Pressure Change During Postural Change

Many studies have observed that intraocular pressure (IOP) is dependent on tilt angle () during postural change. In this work, we aggregated 36 independent datasets from 30 published articles, representing 821 subjects, which reported data on IOP during postural change. From this data, we developed a generalized quantitative relationship between IOP and . We then compared the experimentally derived results to simulated predictions generated by our lumped parameter model of the eye, LPEye, considering only hydrostatic effects. The difference between the analytical and simulated values of IOP can be used to quantify the physiologic regulatory contribution.

Nelson, E.S.↗

V1G Frequency Regulation: Algorithm Development, Validation & Analysis at Scale

Researchers at Argonne National Laboratory developed and validated a high-fidelity digital twin of a smart charging (V1G) ecosystem to model the participation of up to 1,000 unique electric vehicles (EVs) in the PJM frequency regulation market. Utilizing a discrete-event framework, the simulation models complex interactions, from dynamic grid signals (updated every 2 seconds) to individual EV charging dynamics. The simulation incorporates multiple EV models created from real-world lab test data. Researchers tested multiple control algorithms to balance the dual objectives of maximizing aggregator’s revenue and driver charging needs. Results demonstrate that aggregated EVs function as a controllable, highly effective grid resource, achieving high PJM Performance Scores (80–90%). Additionally, an optimized, market-aware bidding strategy was identified as key to profitability. The platform was shown to provide drivers with an average charging discount of nearly 50%. The algorithm was further validated in the lab using production EVs and charging stations to compare simulation results with real-world performance.

Manne, Nithin↗

DWT-Based Aggregated Load Modeling and Evaluation for Quasi-Static Time-Series Simulation on Distribution Feeders

This paper presents an extension of a previously reported discrete wavelet transform (DWT) based load modeling methodology which targets at modeling time-series load profiles to enable the more effective and realistic quasi-static time-series simulation of distribution feeders. The time-series load model is composed of two major parts: 1) The low-resolution field-measured load data which usually have a resolution of 30 or 15 min., 2) The high-resolution load variability model data extracted from the established variability database which can have resolution up to 1 sec. A load aggregation methodology is developed to aggregate the load profiles so that load profiles at different transformer ratings can be effectively modeled. Validation, evaluation, and analysis of the developed load modeling approach has been performed on the IEEE-123 feeder and an actual utility feeder from California. The analysis completed on the two feeders have demonstrated the effectiveness and revealed the value of the developed model for distribution feeder quasi-static time-series simulation at high temporal resolution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DWT-Based Aggregated Load Modeling and Evaluation for Quasi-Static Time-Series Simulation on Distribution Feeders: Preprint

This paper presents an extension of a previously reported discrete wavelet transform (DWT) based load modeling methodology which targets at modeling time-series load profiles to enable the more effective and realistic quasi-static time-series simulation of distribution feeders. The time-series load model is composed of two major parts: 1) The low-resolution field-measured load data which usually have a resolution of 30 or 15 min., 2) The high-resolution load variability model data extracted from the established variability database which can have resolution up to 1 sec. A load aggregation methodology is developed to aggregate the load profiles so that load profiles at different transformer ratings can be effectively modeled. Validation, evaluation, and analysis of the developed load modeling approach has been performed on the IEEE-123 feeder and an actual utility feeder from California. The analysis completed on the two feeders have demonstrated the effectiveness and revealed the value of the developed model for distribution feeder quasi-static time-series simulation at high temporal resolution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Automatic identification and classification of Palomar Transient Factory astrophysical objects in GLADE

Palomar Transient Factory (PTF) is a comprehensive detection system for the identification and classification of transient astrophysical objects. In this paper, we make two significant contributions to the PTF pipeline. First, we present an experimental study that evaluates a novel implementation of the real-time classifier in GLADE - a parallel data processing system that combines the efficiency of a database with the extensibility of map-reduce. We show how each stage in the classifier maps optimally into GLADE tasks by taking advantage of the unique features of the system - range-based data partitioning, columnar storage, multi-query execution, and in-database support for complex aggregate computation. Second, we introduce a novel parallel similarity join algorithm for advanced transient classification. In conclusion, we implement this algorithm in GLADE and execute it on a massive supercomputer with more than 3,000 threads, achieving more than three orders of magnitude improvement over the PostgreSQL solution.

79 ASTRONOMY AND ASTROPHYSICS↗

Understanding amyloids to prevent biofilm formation in space

There is a pressing need to search for novel approaches to combat biofilm formation, both in space and in medical applications. Many proteins have the ability to form ordered aggregates called amyloids. Amyloids are known to be an important part of biofilms. The use of anti-amyloid drugs is a novel venue for the development of antimicrobial agents. The ultrastructure of the amyloid aggregate shows a high packing of proteins, the second-order structure of which is dominated by β-sheets. The ability to form an amyloid aggregate is especially typical for proteins containing domains (protein fragments) with sufficient lability to arrange themselves in a tight β-sheet structure. Bioinformatics tools allow the prediction of such behavior of proteins in genomic data. We use GeneLab data of microbial populations identified aboard the International Space Station and other spacecraft to look for bacterial species that utilize amyloid aggregation in biofilm formation. We use a combined bioinformatic approach with a relatively high throughput molecular biology assay and biophysical assays to evaluate the anti-amyloid anti-biofilm approach. The significance of the research extends from understanding basic microbial community responses to spaceflight, to biofouling of the built environments in space as well as the long-term health of astronauts. Bioinformatics shows that onboard the ISS, bacterial species produce far more amyloid and prion proteins than are currently verified, hence their role in bacterial ecosystems is largely unknown. As we propose there is a link between amyloid formation in space and biofilm production, this research should lead to new paths for biofilm remediation in space.

Tomasz Zajkowski↗

Medium controlled aggregative growth as a key step in mesoporous silica nanoparticle formation

Near monodisperse mesoporous silica nanoparticles (MSN) represent a promising and rapidly developing type of mesoporous silica materials; however, the vast data on their synthesis remains unorganized and ill-understood. We systematically studied the formation of MSN under basic and neutral conditions using various temperatures, CTAB concentrations, hydrolyzing agents (triethanolamine, ammonia, phosphate buffers), and media with different colloidal stabilization properties (with ethanol as a cosolvent and monovalent salts). In the typical conditions for the preparation of stable MSN colloids, the particle size was controlled by colloidal stabilization by the medium (solvent type, ionic strength, and surfactant concentration) in agreement with the “aggregative growth” mechanism, rather than by solely the hydrolysis and condensation rates conventionally used for data interpretation in the classical nucleation theory. Medium properties (pH, ion types and concentration, polarity) also defined the efficiency of silica-surfactant cooperative self-assembly, which directly affected the porosity, mesopore size and pore wall thickness. Interestingly, this traditional silica-surfactant route showed a limited effect on the particle size, emphasizing the dominating role of colloidal stabilization in the studied reaction conditions. In situ pH measurements showed that every reaction medium has unique pH evolution profiles depending on the buffer capacity, hydrolysis and condensation rates. Reaction systems that fail to maintain the working pH can lead to non-porous products or undesired particle morphology and size distribution. The established particle formation mechanism allowed us to formulate comprehensive guidelines for preparing relatively concentrated colloids of near monodisperse (PDI 5–15%) mesoporous 30–700 nm silica spheres with variable porosity and mesopore size. Here, these findings will be particularly useful in designing new mesoporous silica-containing materials for biomedical applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Open V2X at ESIF: June 2015 - February 2017 (Final Report)

The University of Delaware (UD), and their industrial partners, have carried out testing, documentation, and standards development at ESIF. These activities are intended to help meet the objective of NREL's INTEGRATE program, to enable clean energy technologies to increase the hosting capacity of the grid, by providing grid services in a holistic manner using an open source, interoperable platform. In particular, the 'Open V2X at ESIF' project worked to facilitate standardization and interoperability for Electric Vehicle technologies, including battery electric vehicles and plug-in hybrid vehicles (hence EV) to provide grid services. This was done by interconnecting and testing EV and EVSE (charging station) hardware from different manufacturers, by developing standards and test protocols for standards, and by documenting new protocols to be proposed as standards. Contractor-supplied equipment used in the testing included Vehicle Smart Links (VSLs) installed in an EV and School Bus, single-phase and three-phase charging stations, and an optimizing aggregator (software running on a server, hence just 'Aggregator'). The Aggregator software was developed by U of Delaware and is now licensed to Nuvve Corp for commercial development, and licensed to NRG/EVgo for demonstrations. The Aggregator monitors capacity and operations of the EVs and EVSEs, dispatches them in response to requests, and reports their operations and metered power flow. In operation, as vehicles move, plug-in and unplug, the aggregator tracks the total capacity available within a defined jurisdiction or RTO (Regional Transmission Organization, synonym for ISO or TSO), and dispatches part or all of that capacity based on market or direct dispatch signals from a grid entity. The VSL is the data acquisition and control module in the resource itself (EVSE or EV), with rich communication between a single Optimizing Aggregator and many VSL (one in each resource). All requests and dispatch events are also logged by the aggregator to make the provision of grid power auditable. For these tests, the dispatch was typically a recorded signal, the VSL was in the EV or EVSE, and the recording of experimental performance was often carried out by the normal logging functions of the aggregator.

24 POWER TRANSMISSION AND DISTRIBUTION↗

An assessment of power flexibility from commercial building cooling systems in the United States

Understanding varying characteristics and aggregate potential of power flexibility from different building types considering regional diversity is critically important to actively engaging building resources in future eco-friendly, low-cost, and sustainable power systems. This paper presents a comprehensive characteristics analysis and potential assessment of the power flexibility from heating, ventilation, and air conditioning (HVAC) loads in commercial buildings in the U.S. using a simulation-based method. In this method, commercial buildings are first grouped by building types and climate regions. The U.S. Department of Energy Commercial Prototype Building Models are used to represent an average building in each group and are simulated to characterize corresponding power flexibility. Based on building survey data, the number of commercial buildings in each group is estimated and used to calculate aggregate power flexibility. It is found that HVAC loads in commercial buildings offer more flexibility for increasing power consumption than for decreasing it. The power consumption of commercial buildings in the U.S. can be increased by 46 GW and decreased by 40 GW on peak summer days. Among all commercial building types, standalone retail buildings provide the most absolute flexibility while the medium office buildings have the most flexibility as a percentage of the rated power consumption.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A synthesis of bacterial and archaeal phenotypic trait data

A synthesis of phenotypic and quantitative genomic traits is provided for bacteria and archaea, in the form of a scripted, reproducible workflow that standardizes and merges 26 sources. The resulting unified dataset covers 14 phenotypic traits, 5 quantitative genomic traits, and 4 environmental characteristics for approximately 170,000 strain-level and 15,000 species-aggregated records. It spans all habitats including soils, marine and fresh waters and sediments, host-associated and thermal. Trait data can find use in clarifying major dimensions of ecological strategy variation across species. They can also be used in conjunction with species and abundance sampling to characterize trait mixtures in communities and responses of traits along environmental gradients.

59 BASIC BIOLOGICAL SCIENCES↗

A Graph-Net with Node Embeddings to Detect False Data Injection Attacks in Photovoltaic Systems

Distributed energy resources (DER) contribute to the operational stability of the larger power grid both at utility-scale as well as commercial and residential scales in aggregated forms. These DER in-turn are susceptible to increasing cyber threats. An adversary can plug into the same local network that a field photovoltaic (PV) system uses to interconnect its data loggers and inverters and manipulate certain measurements collected from the network or trick existing irradiance and inverter readings through false data injection attacks (FDIA). Control routines that rely on these measurements can propagate the false data, impacting critical decisions that result in a suboptimal operation or even cause intentional harm leading to inverter-tripping or unscheduled loads that need to be shed. To detect FDIA in PV systems, the paper introduces an attention-based graph neural network with node embeddings and applied it to a simple prototypical DC-coupled microgrid with PV, energy storage, and load. The algorithm shows a detection accuracy of up to 98.95%. The proposed FDIA detection technique will provide micro-grid operators with an effective method to safeguard their systems, guaranteeing the secure and reliable operation.

Parvez, Imtiaz [Utah Valley University]↗

NASA’s MODIS/VIIRS Global Water Reservoir Product Suite from Moderate Resolution Remote Sensing Data

Global reservoir information can not only benefit local water management but can also improve our understanding of the hydrological cycle. This information includes water area, elevation, and storage; evaporation rate and volume values; and other characteristics. However, operational wall-to-wall reservoir storage and evaporation monitoring information is lacking on a global scale. Here we introduce NASA’s new MODIS/VIIRS Global Water Reservoir product suite based on moderate resolution remote sensing data—the Moderate Resolution Imaging Spectroradiometer (MODIS), and the Visible Infrared Imaging Radiometer Suite (VIIRS). This product consists of 8-day (MxD28C2 and VNP28C2) and monthly (MxD28C3 and VNP28C3) measurements for 164 large reservoirs (MxD stands for the product from both Terra (MOD) or Aqua (MYD) satellites). The 8-day product provides area, elevation, and storage values, which were generated by first extracting water areas from surface reflectance data and then applying the area estimations to the pre-established Area–Elevation (A–E) relationships. These values were then further aggregated to monthly, with the evaporation rate and volume information added. The evaporation rate and volume values were calculated after the Lake Temperature and Evaporation Model (LTEM) using MODIS/VIIRS land surface temperature product and meteorological data from the Global Land Data Assimilation System (GLDAS). Validation results show that the 250 m area classifications from MODIS agree well with the high-resolution classifications from Landsat (R^(2) = 0.99). Validation of elevation and storage products for twelve Indian reservoirs show good agreement in terms of R^(2) values (0.71–0.96 for elevation, and 0.79–0.96 for storage) and normalized root-mean-square error (NRMSE) values (5.08–19.34% for elevation, and 6.39–18.77% for storage). The evaporation rate results for two reservoirs (Lake Nasser and Lake Mead) agree well with in situ measurements (R^(2) values of 0.61 and 0.66, and NRMSE values of 16.25% and 21.76%). Furthermore, preliminary results from the VIIRS reservoir product have shown good consistency with the MODIS based product, confirming the continuity of this 20-year product suite. This new global water reservoir product suite can provide valuable information with regard to water-sources-related studies, applications, management, and hydrological modeling and change analysis such as drought monitoring.

Yao Li↗

ExpoKids: An R-based tool for characterizing aggregate chemical exposure during childhood

Background: Aggregate exposure, the combined exposures to a single chemical from all pathways, is a critical children’s health issue. Objective: The primary objective is to develop a tool to illustrate potential differences in aggregate exposure at various childhood lifestages and the adult lifestage. Methods: We developed ExpoKids (an R-based tool) using oral exposure estimates across lifestages generated by US EPA’s Exposure Factors Interactive Resource for Scenarios Tool (ExpoFIRST). Results: ExpoKids is applied to illustrate aggregate oral exposure, for ten media, as average daily doses (ADD) and lifetime average daily doses (LADD) in five graphs organized across seven postnatal childhood lifestages and the adult lifestage. This data visualization tool conveys ExpoFIRST findings, from available exposure data, to highlight the relative contributions of media and lifestages to chemical exposure. To evaluate the effectiveness of ExpoKids, three chemical case examples (di[2-ethylhexyl] phthalate [DEHP], manganese, and endosulfan) were explored. Data available from the published literature and databases for each case example were used to explore research questions regarding media and lifestage contributions to aggregate exposure. Significance: These illustrative case examples demonstrate ExpoKids’ versatile application to explore a diverse set of children’s health risk assessment and management questions by visually depicting specific media and lifestage contributions to aggregate exposure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ComStock Measure Scenario Documentation: Chiller Replacement

Building on a 3-year effort to calibrate and validate the U.S. Department of Energy's ResStock (TM) and ComStock (TM) models, this work produces national datasets that empower analysts working for federal, state, utility, city, and manufacturer stakeholders to answer a broad range of questions regarding their commercial building stock. ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual energy consumption (at a subhourly resolution) of the commercial building stock across the United States. The baseline model intends to represent the U.S. commercial building stock as it existed in 2018. The methodology and results of the baseline model are discussed in the final technical report of the End-Use Load Profiles project. The goal of this work is to develop energy efficiency and demand flexibility end-use load shapes that cover high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to various "what-if" scenarios that can be applied to buildings. An end-use savings shape is the difference in energy consumption between a baseline building (or collection of buildings) and a building with an energy efficiency or demand flexibility measure applied. It results in a time-series profile broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step, as well as annual aggregations. This report describes the modeling methodology for a single end-use savings shape measure - chiller replacement - and briefly introduces key results. The full public dataset can be accessed on the ComStock (TM) data lake or via the Data Viewer at comstock.nrel.gov. The public data set enables users to create custom aggregations of results for their use case (e.g., filter to a specific county).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Density-Aware Clustering Based on Aggregated Heat Kernel and Its Transformation

Current spectral clustering algorithms suffer from the sensitivity to existing noise, and parameter scaling, and may not be aware of different density distributions across clusters. If these problems are left untreated, the consequent clustering results cannot accurately represent true data patterns, in particular, for complex real world datasets with heterogeneous densities. This paper aims to solve these problems by proposing a diffusion-based Aggregated Heat Kernel (AHK) to improve the clustering stability, and a Local Density Affinity Transformation (LDAT) to correct the bias originating from different cluster densities. AHK statistically\ models the heat diffusion traces along the entire time scale, so it ensures robustness during clustering process, while LDAT probabilistically reveals local density of each instance and suppresses the local density bias in the affinity matrix. Our proposed framework integrates these two techniques systematically. As a result, not only does it provide an advanced noise-resisting and density-aware spectral mapping to the original dataset, but also demonstrates the stability during the processing of tuning the scaling parameter (which usually controls the range of neighborhood). Furthermore, our framework works well with the majority of similarity kernels, which ensures its applicability to many types of data and problem domains. The systematic experiments on different applications show that our proposed algorithms outperform state-of-the-art clustering algorithms for the data with heterogeneous density distributions, and achieve robust clustering performance with respect to tuning the scaling parameter and handling various levels and types of noise.

97 MATHEMATICS AND COMPUTING↗

Bulk Elemental Composition of Aggregate Material From Asteroid Bennu

On September 24, 2023, NASA’s OSIRIS-REx mission returned pristine carbonaceous material from asteroid Bennu. One key aspect required to understand this returned material is to establish its bulk chemical composition. This is primarily due to each chondrite group having a distinct elemental composition, which is important both as a classification tool and for establishing the connections between the different chondrite groups. As the carbonaceous and non-carbonaceous chondrites are thought to have formed in the inner and outer protoplanetary disk, respectively, measuring the bulk elemental composition of Bennu material will help test the mission hypothesis that “Bennu's parent body formed beyond the snow line by accretion of material in the protoplanetary disk”. In addition, two further mission hypotheses — paraphrased as Bennu’s bulk elemental composition reflects that of its parent asteroid and is similar to the composition of the Sun and Bennu’s dominant lithologies are comparable in composition to the most aqueously altered carbonaceous chondrites — can be directly tested by bulk elemental analyses. Elemental analyses were undertaken on sample OREX-803015-0, a 20.66 mg aggregate sourced from inside the sample collector. All analyses were conducted using an iCAP Q ICP-MS. Overall, all 54 elements analyzed for the Bennu aggregate sample show similar abundances to those of the average CI chondrite, and thus the solar photosphere composition and some of the most aqueously altered carbonaceous chondrites. The elemental data also show that Bennu is indeed a carbonaceous asteroid that formed beyond the snow line by accretion of material in the protoplanetary disk. This Bennu aggregate sample appears similar in elemental composition to samples of asteroid Ryugu, yet without the small refractory element enrichments seen in Ryugu.

P Koefoed↗

An Elegant Sufficiency: Load-Aware Differentiated Scheduling of Data Transfers

We investigate the file transfer scheduling problem, where transfers among different endpoints must be scheduled to maximize pertinent metrics. We propose two new algorithms that exploit the fact that the aggregate bandwidth obtained over a network or at a storage system tends to increase with the number of concurrent transfers—but only up to a certain limit. The first algorithm, SEAL, uses runtime information and data-driven models to approximate system load and adapt transfer schedules and concurrency so as to maximize performance while avoiding saturation. We implement this algorithm using GridFTP as the transfer protocol and evaluate it using real transfer logs in a production WAN environment. Results show that SEAL can improve average slowdowns and turnaround times by up to 25% and worst-case slowdown and turnaround times by up to 50%, compared with the best-performing baseline scheme. Our second algorithm, STEAL, further leverages user-supplied categorization of transfers as either “interactive” (requiring immediate processing) or “batch” (less time-critical). Results show that STEAL reduces the average slowdown of interactive transfers by 63% compared to the best-performing baseline and by 21% compared to SEAL. For batch transfers, compared to the best-performing baseline, STEAL improves by 18% the utilization of the bandwidth unused by interactive transfers. By elegantly ensuring a sufficient, but not excessive, allocation of concurrency to the right transfers, we significantly improve overall performance despite constraints.

Kettimuthu, Rajkumar↗