Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Complexity Reduction Methods for Large-Scale Spatially Explicit Biofuels Network Design

The size and complexity of energy system optimization models have increased significantly in recent years, driven by the availability of high-resolution spatial data. We present complexity reduction and solution methods that enable us to efficiently represent high-resolution spatial data in the network design of large-scale energy systems. We aim to reduce the size and enhance the computational efficiency of network design models without sacrificing solution accuracy. Specifically, we first present how to aggregate highly granular data into larger resolutions without averaging out their specific properties through a composite-curve-based approach and then develop a method to linearly represent these curves. Second, we utilize a general clustering method to determine groups of geographically proximate biomass fields and establish a single transportation arc for all of them, reducing the number of transportation-related variables while maintaining an accurate representation of the system. Finally, we introduce a two-step algorithm that decomposes large-scale network design problems into two smaller, more manageable subproblems. We demonstrate the application of our methods using a case study of switchgrass-to-biofuels network design in the eight states of the U.S. Midwest, using realistic and highly explicit spatial data.

09 BIOMASS FUELS↗
DOE OSTI2024

Where are the Data? Automating a Workflow for Carbon Storage Data Gap Analyses

This presentation demonstrates a spatial analysis workflow to assess data availability for the many components of geologic carbon storage technical viability. The workflow relies upon a knowledge-data framework that links the different components of GCS technical viability to the data types needed for evaluation. Using this contextual information, a combination of data science methods (e.g., natural language processing) and spatial analyses are applied to identify areas where sufficient data exists for a given component. The results are aggregated into maps illustrating data density and spatial gaps across all technical viability factors and data categories, as well as the individual component and category level for a more nuanced understanding. Presented at the FECM NETL Carbon Management Program Review Meeting 2024.

Creason, Christopher↗
DOE OSTI2024

Where are the Data? Automating a Workflow for Carbon Storage Data Gap Analyses

This presentation demonstrates a spatial analysis workflow to assess data availability for the many components of geologic carbon storage technical viability. The workflow relies upon a knowledge-data framework that links the different components of GCS technical viability to the data types needed for evaluation. Using this contextual information, a combination of data science methods (e.g., natural language processing) and spatial analyses are applied to identify areas where sufficient data exists for a given component. The results are aggregated into maps illustrating data density and spatial gaps across all technical viability factors and data categories, as well as the individual component and category level for a more nuanced understanding. Presented at the Geological Society of America Connects 2024 Annual Meeting in Anaheim, California, 22-25 September 2024.

Creason, Christopher↗
DOE OSTI2021

Hybrid electric buses fuel consumption prediction based on real-world driving data

Estimating fuel consumption by hybrid diesel buses is challenging due to its diversified operations and driving cycles. Here, long-term transit bus monitoring data were utilized to empirically compare fuel consumption of diesel and hybrid buses under various driving conditions. Artificial neural network (ANN) based high-fidelity microscopic (1 Hz) and mesoscopic (5–60 min) fuel consumption models were developed for hybrid buses. The microscopic model contained 1 Hz driving, grade, and environment variables. The mesoscopic model aggregated 1 Hz data into 5 to 60-minute traffic pattern factors and predicted average fuel consumption over its duration. The prediction results show mean absolute percentage errors of 1–2% for microscopic models and 5–8% for mesoscopic models. The data were partitioned by different driving speeds, vehicle engine demand, and road grade to investigate their impacts on prediction performance.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Single-crystal elasticity of (Al,Fe)-bearing bridgmanite up to 82 GPa

Abstract Thermoelastic properties of mantle candidate minerals are essential to our understanding of geophysical phenomena, geochemistry, and geodynamic evolutions of the silicate Earth. However, the lower-mantle mineralogy remains much debated due to the lack of single-crystal elastic moduli (Cij) and aggregate sound velocities of (Al,Fe)-bearing bridgmanite, the most abundant mineral of the planet, at the lower mantle pressure-temperature (P-T) conditions. Here we report single-crystal Cij of (Al,Fe)-bearing bridgmanite, Mg0.88Fe0.1Al0.14Si0.90O3 (Fe10-Al14-Bgm) with Fe3+/ΣFe = ~0.65, up to ~82 GPa using X-ray diffraction (XRD), Brillouin light scattering (BLS), and impulsive stimulated light scattering (ISLS) measurements in diamond-anvil cells (DACs). Two crystal platelets with orientations of (–0.50, 0.05, –0.86) and (0.65, –0.59, 0.48), that are sensitive to deriving all nine Cij, are used for compressional and shear wave velocity (νP and νS) measurements as a function of azimuthal angles over 200° at each experimental pressure. Our results show that all Cij of singe-crystal Fe10-Al14-Bgm increase monotonically with pressure with small uncertainties of 1–2% (±1σ), except C55 and C23, which have uncertainties of 3–4%. Using the third-order Eulerian finite-strain equations to model the elasticity data yields the aggregate adiabatic bulk and shear moduli and respective pressure derivatives at the reference pressure of 25 GPa: KS = 326 ± 4 GPa, µ = 211 ± 2 GPa, KS′ = 3.32 ± 0.04, and µ′ = 1.66 ± 0.02 GPa. The high-pressure aggregate νS and νP of Fe10-Al14-Bgm are 2.6–3.5% and 3.1–4.7% lower than those of MgSiO3 bridgmanite end-member, respectively. These data are used with literature reports on bridgmanite with different Fe and Al contents to quantitatively evaluate pressure and compositional effects on their elastic properties. Comparing with one-dimensional seismic profiles, our modeled velocity profiles of major lower-mantle mineral assemblages at relevant P-T suggest that the lower mantle could likely consist of about 89 vol% (Al,Fe)-bearing bridgmanite. After considering uncertainties, our best-fit model is still indistinguishable from pyrolitic or chondritic models.

Geochemistry & Geophysics↗
DOE OSTI2021

An adaptive adversarial domain adaptation approach for corn yield prediction

Recently, statistical machine learning and deep learning methods have been widely explored for corn yield prediction. Though successful, machine learning models generated within a specific spatial domain often lose their validity when directly applied to new regions. To address this issue, we designed an unsupervised adaptive domain adversarial neural network (ADANN). Specifically, through domain adversarial training, the ADANN model reduced the impact of domain shift by projecting data from different domains into the same subspace. Also, the ADANN model was designed to be trained in an adaptive way, which guaranteed the model can learn the domain-invariant features and perform accurate yield prediction simultaneously. Informative variables including time-series vegetation indices and sequential weather observations were first collected from multiple data sources and aggregated to the county level. Then, we trained the ADANN model with the extracted features and corresponding reported county-level corn yield from the U.S. Department of Agriculture (USDA). Finally, the trained model was evaluated in four testing years 2016–2019. The U.S. corn belt was used as the study area and counties under study were grouped into two diverse ecological regions. Overall, the experimental results showed that the developed ADANN model had better performance than three other state-of-the-art machine learning models in both local experiments (train and test in the same region) and transfer experiments (train and test in different regions). As the first study using adversarial learning for crop yield prediction, this research demonstrates a novel solution for improving model transferability on crop yield prediction.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Confronting the water potential information gap

Water potential directly controls the function of leaves, roots and microbes, and gradients in water potential drive water flows throughout the soil–plant–atmosphere continuum. Notwithstanding its clear relevance for many ecosystem processes, soil water potential is rarely measured in situ, and plant water potential observations are generally discrete, sparse, and not yet aggregated into accessible databases. These gaps limit our conceptual understanding of biophysical responses to moisture stress and inject large uncertainty into hydrologic and land-surface models. Here, we outline the conceptual and predictive gains that could be made with more continuous and discoverable observations of water potential in soils and plants. We discuss improvements to sensor technologies that facilitate in situ characterization of water potential, as well as strategies for building new networks that aggregate water potential data across sites. Here, we end by highlighting novel opportunities for linking more representative site-level observations of water potential to remotely sensed proxies. Together, these considerations offer a road map for clearer links between ecohydrological processes and the water potential gradients that have the ‘potential’ to substantially reduce conceptual and modelling uncertainties.

58 GEOSCIENCES↗
DOE OSTI2022

Spatial and Temporal Characterization of Activity in Public Space, 2019–2020

The data reported here characterize spatial and temporal variation in the ratio of short-to-long-duration visits in public places (i.e., points of interest) in the United States for each week between January 2019 and December 2020. The underlying data on anonymized and aggregated foot traffic to public places is curated by SafeGraph, a geospatial data provider. In this work, we report the estimated number and duration of “short” (i.e., <4 hours) and “long” (i.e., >4 hours) visits to public places at the US census block group level. Long visits are shown to be a good proxy for workers based on formal economic data. We propose that short visits are more likely to represent nonobligate activities: people visiting a public place for leisure, shopping, entertainment, or civic or cultural engagement. Our work constructs a ratio of short to long visits, which can be used to inform population estimates for nonworker use of public space. These data may be useful for understanding how people’s use of public space has changed during the COVID-19 pandemic and, more generally, for understanding activity patterns in public.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

MARIAH PCAP data for Validation Demonstration

This dataset holds simulated PCAP (packet capture) data from the SCEPTRE validation demonstration model as a set of pairwise communications between devices via specific protocols. All connections should be assumed to be symmetric, as this data is an aggregation of the true PCAP. A mapping is also provided associating each IP address with its true device type.

cyber-physical system↗
DOE OSTI2023

Biogeophysical Effects of Land-Use and Land-Cover Change Not Detectable in Warmest Month

Land-use and land-cover changes (hereafter simply “land use”) alter climates biogeophysically by affecting surface fluxes of energy and water. Yet, near-surface temperature responses to land use across observational versus model-based studies and spatial-temporal scales can be inconsistent. Here we assess the prevalence of the historical land use signal of daily maximum temperatures averaged over the warmest month of the year (t LU ) using regularized optimal fingerprinting for detection and attribution. We use observations from the Climatic Research Unit and Berkeley Earth alongside historical simulations with and without land use from phase 6 of the Coupled Model Intercomparison Project to reconstruct an experiment representing the effects of land use on climate. To assess the signal of land use at spatially resolved continental and global scales, we aggregate all input data across reference regions and continents, respectively. At both scales, land use does not comprise a significantly detectable set of forcings for two of four Earth system models and their multimodel mean. Furthermore, using a principal component analysis, we find that t LU is mostly composed of the nonlocal effects of land use rather than its local effects. These findings show that, at scales relevant for climate attribution, uncertainties in Earth system model representations of land use are too high relative to the effects of internal variability to confidently assess land use.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Adoption of AI in the Utility T&D Sector: Use Cases, Consequence, Assessment and Benefits

Digital transformation and utilization of artificial intelligence (AI) in the electric grid are fundamentally changing the industry’s approach to common problems and enabling a broader paradigm shift in grid planning and operations. The change in approach is circularly both enabling and driving modernization, with load growth and reliable management of data center and AI infrastructure shifting away from planning approaches with relatively predictable behaviors and toward a mix of consumer and industrial choices that surpass human cognitive abilities to process. This movement has potential to condition humans to not understand the system on which the AI depends, while requiring it for development of the necessary infrastructure. Approaches which would address most likely grid conditions and events, such as faults, aging of equipment, and weather, now must also account for large loads which shift not based upon weather or time of day, but the computational load. Quantifying computational load is independent of the traditional grid forecasting variables, where a data center’s aggregate load is determined by user and AI system behavior and decoupled from normal grid planning and operations. AI is both the cause and solution for these challenges, with new grid planning tools integrating massive amounts of decisions into frameworks.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Comparison of Radiosonde Datasets: SondeHub and Integrated Global Radiosonde Archive

SondeHub aggregates radiosonde telemetry data uploaded from community-run radiosonde receiver stations. This radiosonde telemetry dataset is open-source, available to anyone through Amazon S3. There are also other public radiosonde datasets such as National Centers for Environmental Information (NCEI)’s Integrated Global Radiosonde Archive (IGRA). While there are many similarities between the two datasets, there are many differences as well due to the nature of the two datasets: one is community-run, while the other is managed by a government agency. This report presents the result of analyzing and comparing the two datasets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

3D reconstruction identifies loci linked to variation in angle of individual sorghum leaves

Selection for yield at high planting density has reshaped the leaf canopy of maize, improving photosynthetic productivity in high density settings. Further optimization of canopy architecture may be possible. However, measuring leaf angles, the widely studied component trait of leaf canopy architecture, by hand is a labor and time intensive process. Here, we use multiple, calibrated, 2D images to reconstruct the 3D geometry of individual sorghum plants using a voxel carving based algorithm. Automatic skeletonization and segmentation of these 3D geometries enable quantification of the angle of each leaf for each plant. The resulting measurements are both heritable and correlated with manually collected leaf angles. This automated and scaleable reconstruction approach was employed to measure leaf-by-leaf angles for a population of 366 sorghum plants at multiple time points, resulting in 971 successful reconstructions and 3,376 leaf angle measurements from individual leaves. A genome wide association study conducted using aggregated leaf angle data identified a known large effect leaf angle gene, several previously identified leaf angle QTL from a sorghum NAM population, and novel signals. Genome wide association studies conducted separately for three individual sorghum leaves identified a number of the same signals, a previously unreported signal shared across multiple leaves, and signals near the sorghum orthologs of two maize genes known to influence leaf angle. Automated measurement of individual leaves and mapping variants associated with leaf angle reduce the barriers to engineering ideal canopy architectures in sorghum and other grain crops.

3D reconstruction↗
DOE OSTI2021

Evaluation of Stripping Resistance of Organoclay-Modified Asphalt Binder and Aggregate Systems Using an Optical Contact Angle Analyzer

Organoclays, often referred to as nanoclays (NCs), are organically modified phyllosilicates. They are derived from naturally occurring clay minerals and possess unique characteristics in improving the physical and mechanical properties of polymers and rubbers. Recently, NCs have drawn interest in the modification of asphalt binders as micro-scale fillers. A few recent studies have revealed that the addition of NCs in asphalt binders improved binders’ stiffness, aging characteristics, and fatigue resistance. This study aims to evaluate the changes in moisture resistance of different NC-modified asphalt binders through the surface free energy (SFE) technique. This technique estimates SFE properties of binders and aggregates from static contact angle (SCA) data measured from an optical contact angle analyzer (OCA). Further, this study examines the changes in chemical compositions (functional groups) of binders due to the addition of selected NCs by using the Fourier Transformation Infrared (FTIR) technique. To this end, a commonly used performance grade (PG) binder (PG 64-22) modified with four different types (shape and size) of NCs, namely, Cloisite® 15 (C-15), Cloisite® 20 (C-20), Cloisite® Na+ (C-Na), and Cloisite® Ca++ (C-Ca) were evaluated in this study. The SFE data of five different types of aggregates from Oklahoma, namely, Davis Limestone (DL), Snyder Granite (SG), Dolese-Cooperton Limestone (DCL), Hanson-Davis Rhyolite (HDR), and Martin-Marietta-Mill-Creek Granite (MMMG), were used to perform their compatibility with the aforementioned NC-modified binders. The FTIR spectra revealed the presence of various alcohols, ethers, and esters in NC-modified asphalt binders. The moisture susceptibility analysis shows that the addition of NC results in an increase of SFE and cohesive energy of an asphalt binder, which are desired for improved moisture resistance. The addition of NC also shows improved compatibility in cases of all aggregates. Among the five aggregates, MMMCG showed the highest compatibility with all binders, followed by DCL, HDR, DL, and SG. In regard to NCs, the C-15 sample showed the highest compatibility followed by C-20, C-Na, and C-Ca.

Hossain, Zahid↗
DOE OSTI2021

NeuralCubes: Deep Representations for Visual Data Exploration

Visual exploration of large multi-dimensional datasets has seen tremendous progress in recent years, allowing users to express rich data queries that produce informative visual summaries, all in real time. Techniques based on data cubes are some of the most promising approaches. However, these techniques usually require a large memory footprint for large datasets. To tackle this problem, we present NeuralCubes: neural networks that predict results for aggregate queries, similar to data cubes. NeuralCubes learns a function that takes as input a given query, for instance, a geographic region and temporal interval, and outputs the result of the query. The learned function serves as a real-time, low-memory approximator for aggregation queries. Our models are small enough to be sent to the client side (e.g. the web browser for a web-based application) for evaluation, enabling data exploration of large datasets without database/network connection. Here, we demonstrate the effectiveness of NeuralCubes through extensive experiments on a variety of datasets and discuss how NeuralCubes opens up opportunities for new types of visualization and interaction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Massively scalable Kerr comb-driven silicon photonic link

Abstract The growth of computing needs for artificial intelligence and machine learning is critically challenging data communications in today’s data-centre systems. Data movement, dominated by energy costs and limited ‘chip-escape’ bandwidth densities, is perhaps the singular factor determining the scalability of future systems. Using light to send information between compute nodes in such systems can dramatically increase the available bandwidth while simultaneously decreasing energy consumption. Through wavelength-division multiplexing with chip-based microresonator Kerr frequency combs, independent information channels can be encoded onto many distinct colours of light in the same optical fibre for massively parallel data transmission with low energy. Although previous high-bandwidth demonstrations have relied on benchtop equipment for filtering and modulating Kerr comb wavelength channels, data-centre interconnects require a compact on-chip form factor for these operations. Here we demonstrate a massively scalable chip-based silicon photonic data link using a Kerr comb source enabled by a new link architecture and experimentally show aggregate single-fibre data transmission of 512 Gb s −1 across 32 independent wavelength channels. The demonstrated architecture is fundamentally scalable to hundreds of wavelength channels, enabling massively parallel terabit-scale optical interconnects for future green hyperscale data centres.

Rizzo, Anthony (ORCID:000000034752797X)↗