Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Improving Performance of M-to-N Processing and Data Redistribution in In Transit Analysis and Visualization

In an in transit setting, a parallel data producer, such as a numerical simulation, runs on one set of ranks M, while a data consumer, such as a parallel visualization application, runs on a different set of ranks N: One of the central challenges in this in transit setting is to determine the mapping of data from the set of M producer ranks to the set of N consumer ranks. This is a challenging problem for several reasons, such as the producer and consumer codes potentially having different scaling characteristics and different data models. The resulting mapping from M to N ranks can have a significant impact on aggregate application performance. In this work, we present an approach for performing this M-to-N mapping in a way that has broad applicability across a diversity of data producer and consumer applications. We evaluate its design and performance with a study that runs at high concurrency on a modern HPC platform. By leveraging design characteristics, which facilitate an ''intelligent'' mapping from M-to-N, we observe significant performance gains are possible in terms of several different metrics, including time-to-solution and amount of data moved.

Loring, Burlen↗
DOE OSTI2026

Satellite Embedding-Based Population Imputation for Areas with Missing Building Footprint Data: A Computer Vision-Based Approach

High-resolution population modeling is important for supporting effective decision-making across diverse sectors. LandScan Mosaic generates population estimates at the level of individual buildings and aggregates them to 3 arc-second grids, and this approach performs well in regions where building footprint data are comprehensive and reliable. However, large portions of the globe still suffer from incomplete, sparse, or entirely missing building stock datasets, creating a structural limitation for strictly building-based population models. To address this research gap, this study proposes a computer vision-based framework that employs Google Earth Engine satellite embeddings and UNet, which allows us to directly impute grid-level population estimates in building-data-deficient areas. Applied to Taiwan as a case study, the framework achieved strong predictive performance with R$^{2}$ of 0.89, RMSE of 18.70, and MAE of 8.41, outperforming traditional machine learning approaches. Notably, the proposed framework effectively addressed building false-positive errors inherent in Global Human Settlement Layer (GHSL) data, correctly identifying uninhabited areas that were erroneously classified as populated. The framework also offers significant advantages for global population mapping, particularly in terms of scalability and temporal consistency, thereby extending the coverage and accuracy of high-resolution population products in data-scarce regions worldwide. Urban planners, decision makers, and related stakeholders can obtain granular population distributions to support more accurate and targeted infrastructure investment, service delivery, resource allocation, and risk assessment decisions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Chemical structure and complex growth modes of magnesium silicate hydrate: Nanoparticle orientation, aggregation, and fusion

The extent of utilization of magnesium silicate hydrate (MSH) in construction is limited partly because of insufficient data ascertaining the kinetics of its precipitation. In this report MSH grown homogeneously or heterogeneously in the range of magnesium to silicon solution molar concentration ratios, [Mg]/[Si] = 0.5-1.5, and temperature = 25-80 °C was analyzed for its chemical structure and morphology. Infrared spectroscopy and geochemical modeling show that increasing the [Mg]/[Si] ratio results in less silicate polymerization in MSH. Atomic force microscopy reveals the presence of nanoparticles that aggregate and fuse to form films. Oriented attachment of nanoparticles and features indicative of enhanced crystallinity were observed at higher temperatures and longer reaction times. These data provide direct evidence for the persistence of hierarchical structures (i.e., nanoparticles forming 3D microparticles and 2D film layers) at the nanoscale to mesoscale. These findings offer insights into the precise chemical synthesis of MSH and its widespread use as a binder for construction purposes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Experimentally Validated Computational Modeling of Creep and Creep-Cracking for Nuclear Concrete Structures

In a Nuclear Power Plant, one of the most important components is the concrete nuclear reactor cavity, which serves both a structural and protective function as the biological radiation shield. Given that creep has been identified as a major knowledge gap in the assessment of nuclear structures (NUREG/CR-7153), this work helps to further the understanding of creep behavior of massive concrete containment structures for decades to enable safe and long-term operation of these facilities. This project has developed a robust, experimentally validated model to predict creep in nuclear concrete structures for up 60 years using short-term creep data thereby enabling a longer service life of critical facilities and early detection of structural failure. The work presented in this report is a pairing of computational and experimental methods. For the first time, the time temperature superposition (TTS) principle was successfully used to generate a uniaxial creep compliance master curve to predict mortar creep response for up to 22,500 days (nearly 60 years) at a reference temperature of 20°C. These data were used as input into finite element analysis (FEA) codes that use highly realistic random, 3D concrete microstructures from reconstructed coarse limestone aggregates. Finite element analysis performed provides the ability to quickly upscale mortar viscoelastic behavior to long-term concrete creep/relaxation data. A master creep compliance curve, constructed from the TTS principle, spanning 27 years, was used to validate two and a half decades of simulated concrete creep. Concurrently, three different simulated wall specimens were designed to mimic the behavior of post-tensioned concrete nuclear containment facility vessel walls over time as a result of concrete creep. The specimens were designed with different thicknesses, transverse and longitudinal reinforcement ratios, and level of post-tensioning stress. Each specimen contained various instrumentation to measure internal concrete temperature, concrete strain, and post-tensioning strain hourly for over 3 years. The concrete creep model developed in this project, based on the FEA concrete simulations, was applied to simulate the structural-scale experiments of prestressed concrete walls conducted in this project using the Grizzly code. These models can represent the effects of reinforcing and prestressing. Although there are some discrepancies with the experimental data, the model can predict the overall trends of the creep response in these experiments. One of these experimental models was also applied to an extended time to demonstrate how the findings from this study can be used to predict the behavior of actual structures of interest that have been in service for extended periods of time.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Frustrated Coulombic and Cation Size Effects on Nanoscale Boehmite Aggregation: A Tumbler Small- and Ultra-Small-Angle Neutron Scattering Study

To better understand the effects of solution chemistry on particle aggregation in the complex legacy tank wastes at the Hanford (WA) and Savannah River (SC) sites, we have performed a series of tumbler small- and ultra-small-angle neutron scattering experiments on 20 wt % solid slurries of nanoparticulate aluminum oxyhydroxide (boehmite) with M 1+ nitrates of various concentrations and radii. In this study, the solutes consisted of H, Li, Na, K, and Rb nitrates at 10 –5 , 10 –3 , 10 –1 , 2, and 4 molal (m) concentrations, as well as in pure H 2 O. Synthetic boehmite nanoparticles were used with a size range from ~20 to 30 nm. Tumbler cells were used to keep the solids from settling. Although particles initially form individual rhombohedral platelets, once placed in solution, they quickly form well-bonded stacks, primary aggregates, up to ~1500 Å long, and a second level of aggregates whose concentration and structure vary as a function of cation type and concentration. Aggregation generally increases with increased solute concentration and with cation radius up to a concentration somewhat above 10 –1 m, at which point the trend reverses. Primary aggregates become more rodlike and larger. The Kirkwood-like reversal probably reflects a change from Derjaguin–Landau–Verwey–Overbeek (DLVO)/Debye behavior controlled by surface chemistry to a frustrated Coulombic system controlled by the solution structure. These data suggest that an understanding of the effects of salt concentration and chemistry on nanoparticle aggregate structures provides useful physical insights into the microscopic origin of slurry rheology in the Hanford and Savannah River legacy wastes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Bridging Control and Deployment: A Cross-Layer Analysis of Scalable Building Cluster Control

Building cluster control has emerged as a promising approach for enabling flexible and coordinated operation of distributed building systems, yet its transition from pilot demonstrations to routine grid-interactive operation remains limited. This paper argues that this gap cannot be explained by control algorithms alone. Instead, it arises from interacting barriers in communication infrastructure, data and semantic interoperability, uncertainty management, stakeholder participation, market design, and policy support. Accordingly, the paper reviews both technical and non-technical barriers to building cluster control. Technical challenges include heterogeneous devices and protocols, communication latency and reliability, distributed decision-making, and uncertainty propagation across aggregated loads. Non-technical barriers include user participation, stakeholder coordination, incentive allocation, and data governance. Existing solution approaches are synthesized, including semantic interoperability frameworks, edge and hierarchical communication architectures, distributed and transactive control strategies, uncertainty-aware optimization, policy mechanisms, and market reforms. Based on this analysis, two research directions are identified: testing infrastructures that can evaluate control performance under realistic multi-building conditions, and abstraction methods that allow building clusters to interact with other energy sectors through standardized flexibility representations. Overall, the paper provides a structured review of how building cluster control can move from isolated demonstrations toward reproducible, market-compatible, and grid-relevant implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Real-time deep-learning inversion of seismic full waveform data for CO 2 saturation and uncertainty in geological carbon storage monitoring

Deep-learning inversion has recently drawn attention in geological carbon storage research due to its potential of imaging and monitoring carbon storage in real time, significantly improving efficiency and safety of carbon storage operations. We present a deep-learning full waveform inversion method that after the neural network has been trained can image CO 2 saturation and its uncertainty in real time. Our deep-learning inversion method is based on the U-Net architecture with the neural network trained on pairs of synthetic seismic data and CO 2 saturation models. Accordingly, our training establishes a mapping relationship between seismic data and CO 2 saturation models and once fully trained directly estimates CO 2 saturation as a function of subsurface location. We further quantify uncertainties of CO 2 saturation estimates using the Monte Carlo dropout method and a bootstrap aggregating method. For this proof-of-concept study, the CO 2 training models and data are derived from the Kimberlina 1.2 model, a hypothetical 3D geological carbon storage model that is constructed based on various geological and hydrological data from the Southern San Joaquin Basin, California. We perform deep-learning inversion experiments using noise-free and noisy training and test data sets and compare the results. Our modelling experiments show that (1) the deep-learning inversion can estimate 2D distributions of CO 2 fairly well even in the presence of Gaussian random noise and (2) both CO 2 saturation imaging and uncertainty quantification can be done in real time. Our results suggest that the deep-learning inversion method can serve as a robust real-time monitoring tool for geological carbon storage and/or other time-varying reservoir/aquifer properties that result from injection, extraction, and/or other subsurface transport phenomena.

58 GEOSCIENCES↗
DOE OSTI2023

Extending OpenSHMEM with Aggregation Support for Improved Message Rate Performance

OpenSHMEM is a highly efficient one-sided communication API that implements the PGAS parallel programming model, and is known for its low latency communication operations that can be mapped efficiently to RDMA capabilities of network interconnects. However, applications that use OpenSHMEM can be sensitive to point-to-point message rates, as many-to-many communication patterns can generate large amounts of small messages which tend to overwhelm network hardware that has predominantly been optimised for bandwidth over message rate. Additionally, many important emerging classes of problems such as data analytics are similarly troublesome for the irregular access patterns they employ. Message aggregation strategies have been proven to significantly enhance network performance, but their implementation often involves complex restructuring of user code, making them unwieldy. This paper shows how to combine the best qualities of message aggregation within the communication model of OpenSHMEM such that applications with small and irregular access patterns can improve network performance while maintaining their algorithmic simplicity. We do this by providing a path to a message aggregation framework called conveyors through a minimally intrusive OpenSHMEM extension introducing aggregation contexts that fit more naturally to the OpenSHMEM atomics, gets, and puts model. We test these extensions using four of the bale 3.0 applications which contain essential many-to-many access patterns to show how they can produce performance improvements of up to 65×.

Welch, Aaron↗
DOE OSTI2025

Considerations for Distributed Edge Data Centers and Use of Building Loads to Support Large Interconnections

The rapid expansion of artificial intelligence (AI) and machine learning is driving unprecedented electricity demand from data centers. It is predicted that by 2030, 90% of AI workloads will be inference-based, requiring interconnection of multiple low-latency edge data centers (<20 MW) sited closer to end users - often on already constrained distribution feeders. Although individually small, these loads can aggregate to large loads per feeder, straining infrastructure, creating multi-year interconnection delays, and driving up customer costs. This paper proposes a data center-focused grid-integration framework that combines feeder hosting capacity analysis with building energy efficiency, building load flexibility, and waste heat reuse to expand effective feeder and substation headroom. Such approaches can reduce interconnection delays, lower costs for ratepayers, and accelerate AI-ready infrastructure deployment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

NREL OpenPATH: An Open-Source, Extensible Platform for Instrumenting Travel Behavior Data

NREL OpenPATH is an open-source, extensible platform that allows communities to instrument their own travel behavior data. The platform consists of a smartphone app, server and analysis pipeline, and enables collection of opt-in, multi-modal, end-to-end travel diaries. It makes the aggregate statistics available via a public dashboard, and allows deployers to download and visualize trip and trajectory data through the admin dashboard. It also allows for customization of the initial demographic survey and the trip-level qualitative information collected. Our goal is to provide an easy-to-use tool that can democratize travel behavior data collection by empower communities of all sizes to recruit participants and obtain a holistic picture of their travel patterns. The platform has been used by close to 40 partners, to collect data from thousands of participants. Upon signing a simple MOU, it is currently available for free to universities, non-profits and public agencies in the United States.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Effective Storage of Electrons in Water by the Formation of Highly Reduced Polyoxometalate Clusters

Aqueous solutions of polyoxometalates (POMs) have been shown to have potential as high-capacity energy storage materials due to their potential for multi-electron redox processes, yet the mechanism of reduction and practical limits are currently unknown. Herein, we explore the mechanism of multi-electron redox processes that allow the highly reduced POM clusters of the form {MO 3 } y to absorb y electrons in aqueous solution, focusing mechanistically on the Wells-Dawson structure X 6 [P 2 W 18 O 62 ], which comprises 18 metal centers and can uptake up to 18 electrons reversibly (y = 18) per cluster in aqueous solution when the countercations are lithium. This unconventional redox activity is rationalized by density functional theory, molecular dynamics simulations, UV-vis, electron paramagnetic resonance spectroscopy, and small-angle X-ray scattering spectra. These data point to a new phenomenon showing that cluster protonation and aggregation allow the formation of highly electron-rich meta-stable systems in aqueous solution, which produce H 2 when the solution is diluted. Finally, we show that this understanding is transferrable to other salts of [P 5 W 30 O 110 ] 15- and [P 8 W 48 O 184 ] 40- anions, which can be charged to 23 and 27 electrons per cluster, respectively.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

NERSC_Lightweight Distributed Metric Service (NERSC_LDMS) v4.4.2

Miscellany This LDMS Loftsman/Helm Chart horizontally scales LDMS daemons in order to achieve a 1Hz sample rate from over 5,000 nodes, collecting 38k metrics per minute on Perlmutter. This LMDS Configuration relies on already running `ldmsd` producers running on nodes, which produce metrics via sampler plugins. The Helm chart distributes the collection of metrics from producer acrross many aggregator and storage `ldmsd` daemons, ensuring no damon is overloaded and data loss is avoided.

Stile, John [Lawrence Berkeley National Laboratory↗
DOE OSTI2023

A General Method for Estimating Zonal Transmission Interface Limits from Nodal Network Data: Preprint

Capacity expansion models for the electric power system often employ zonal (rather than nodal) resolution, necessitating estimates of aggregate power transfer limits across the interfaces between model zones. Interface limits between planning areas are sometimes published, but they are not generalizable to arbitrary zone shapes. There is thus a need for a reproducible method for estimating interface transfer limits (ITLs) between user-defined zones directly from nodal transmission system data. Here, we present a simple method for estimating ITLs using a DC power flow approximation via the power transfer distribution factor (PTDF) matrix. Linear optimization is performed to identify the distribution of power flows that maximizes the total flow on interface-crossing lines, subject to individual line ratings, limits on bus injection/withdrawal, and the relationships among flows, injections, and withdrawals imposed by the PTDF matrix. We demonstrate the application of the method on a 134-zone ~65000-bus system, and we explore the influence of flow direction, contingency level, and zone size on the estimated ITLs. There is significant heterogeneity in the ratio of the ITL to the sum of interface-crossing line ratings, which highlights the importance of accounting for the physical constraints on power flows imposed by Kirchhoff's laws when estimating zonal ITLs.

17 WIND ENERGY↗
DOE OSTI2023

High-resolution imaging of Hg/Se aggregates in the brain of small Indian mongoose, a wild terrestrial species: insights into intracellular Hg detoxification

Human activities result in the emission of 2000 metric tons of mercury compounds annually. Mercury (Hg) biomagnification has been characterized in marine mammals and predatory fish; however, little is known about mercury accumulation in brains of wild terrestrial species. Elevated Hg content, of 1.27 μg/g wet wt.—found in the brain of wild small Indian mongoose, prompted us to use synchrotron X-ray fluorescence imaging for simultaneous, quantitative mapping of biologically relevant and neurotoxic elements with high spatial resolution. X-ray fluorescence combined with immunohistochemistry revealed ~0.5–1.9 micron Hg-rich aggregates in cells of the choroid plexus and astrocytes of the subventricular wall in the mongoose brain. Hg content within aggregates correlated with selenium. Hg aggregates did not co-localize with lysosomes. The low Hg density inside aggregates indicated diffuse Hg binding to a Se-containing biomolecule, rather than much denser HgSe nanoparticles proposed to form in other species. Our data show the susceptibility of the small Indian mongoose population to Hg pollution and highlight the vulnerability of the brain as an organ targeted by mercury. Data also provide evidence on the adaptation in the form of a Se-based detoxification mechanism sequestering Hg into intracellular aggregates.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Electromagnetic Transient Modeling of Large Data Centers for Grid-Level Studies

The magnitude and complexity of electricity usage patterns from large data centers are having significant impacts on the operation and dynamics of the power grid; grid operators and planners require a range of specialized data center models to properly evaluate these impacts and specify technical solutions as needed. Towards addressing this need, Pacific Northwest National Laboratory (PNNL) has developed a library of electromagnetic transient (EMT) models for grid-level studies of data centers called the data center model library (DML). This report describes how the DML was created and how it may properly be used. The models present in the DML are generic models; subject matter expertise and additional technical data are needed to modify these models before they can represent any real data center. However, they will significantly reduce the level of effort required to develop site-specific models and can serve as a common starting point to guide industry towards a more refined consensus. Most of the models within DML are dedicated to representing the power electronics interfaces commonly used in modern data centers, such as double-conversion uninterruptible power supplies and single-phase power factor correction converters. These models are intended for use in grid-level studies and are a simplified aggregation of many small components. That said, background material on the physical and electrical design of large data centers is provided as companion material so that users can be aware of many of the details which have been omitted or streamlined as a matter of practical necessity. Additionally, guidance on the application of EMT analysis for data center interconnection studies is provided, which aids users in identifying when the DML is necessary and what sort of additional model development may be necessary for conducting real-world studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Electromagnetic Transient Modeling of Large Data Centers for Grid-Level Studies: Beta Release

The magnitude and complexity of electricity usage patterns from large data centers are having significant impacts on the operation and dynamics of the power grid; grid operators and planners require a range of specialized data center models to properly evaluate these impacts and specify technical solutions as needed. Towards addressing this need, Pacific Northwest National Laboratory (PNNL) has developed a library of electromagnetic transient (EMT) models for grid-level studies of data centers called the data center model library (DML). This report describes how the DML was created and how it may properly be used. This report details the DML’s beta release, completed in July 2026. This is a revision and expansion of the alpha release, which was made available in January 2026 The models present in the DML are generic models; subject matter expertise and additional technical data are needed to modify these models before they can represent any real data center. However, they will significantly reduce the level of effort required to develop site-specific models and can serve as a common starting point to guide industry towards a more refined consensus. Most of the models within DML are dedicated to representing the power electronics interfaces commonly used in modern data centers, such as double-conversion uninterruptible power supplies and single-phase power factor correction converters. These models are intended for use in grid-level studies and are a simplified aggregation of many small components. That said, background material on the physical and electrical design of large data centers is provided as companion material so that users can be aware of many of the details which have been omitted or streamlined as a matter of practical necessity. Additionally, guidance on the application of EMT analysis for data center interconnection studies is provided, which aids users in identifying when the DML is necessary and what sort of additional model development may be necessary for conducting real-world studies.

electromagnetic transients↗
DOE OSTI2026

Strong Lens Discoveries in DESI Legacy Imaging Surveys DR10 with Two Deep Learning Architectures

Abstract We have conducted a search for strong gravitational lensing systems in the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys Data Release 10 (DR10). This paper is the fourth in a series of searches. This is the first catalog of lens candidates covering nearly the entirety of the extragalactic sky south of declination δ ≈ +32 ∘ , all observed by DECam, covering ∼14,000 deg 2 . We impose a z -band magnitude cut of <20 in AB magnitude. We deploy a residual neural network and EfficientNet as an ensemble trained on a compilation of known lensing systems and high-grade candidates as well as nonlenses in the same footprint. The predictions from these two base models are aggregated using a meta-learner. After applying our ensemble to the survey data, we exclude known candidates and systems, and use our own visual inspection portal to rank images in the top 0.01 percentile of all neural network recommendations. We have found 811 lens candidates, five of which are confirmed through Euclid Quick Data Release (Q1). These include 484 new candidates in the Legacy Surveys DR9 footprint, all parts of which have been searched for strong lenses at least once before, either by our group or others. Combining the discoveries from this work with those from the first three papers in this series (335, 1210, and 1512), we have discovered a total of 3868 new candidates in the DESI Legacy Surveys.

Inchausti, Jose Carlos [University of San Francisc↗