Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Trustworthiness modeling and evaluation for a nearly autonomous management and control system

The Nearly Autonomous Management and Control (NAMAC) system supports the advanced reactor operation by recommending control actions to operators based on real-time measurements and digital twins (DTs) learning from the knowledge base. To enable the safe and reliable use of autonomous technologies, NAMAC and its recommendations should be trustworthy to operators and regulators at both the design and operation stages. This study proposes a NAMAC trustworthiness modeling and evaluation framework supported by trustworthiness ontologies and evidence-based approaches. The development-time and run-time ontologies are separately constructed and then converted to Bayesian networks to quantitatively evaluate the NAMAC trustworthiness. This evaluation is demonstrated by collecting and characterizing evidence from NAMAC practices, such as the development and assessment of the NAMAC system, data coverage assessment, and the training and optimizations of neural-network-based DTs. Our proposed approach can aggregate various trustworthiness attributes of complex artificial-intelligence-supported systems for safety-critical applications. It also considers the interaction between different DTs and extends beyond the trustworthiness evaluation of a single DT. In conclusion, the evidence-based method enhances the transparency of the trustworthiness modeling and evaluation processes and helps identify uncertainties and subjectivity involved in the processes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Electrification Futures Study Flexible Load Profiles

This data set includes hourly profiles for flexible load developed for the Electrification Futures Study (EFS). The load profiles represent projected end-use electricity demand that is assumed to be flexible (i.e., can be shifted throughout a day) for various scenarios of flexibility (Base, Enhanced), electrification (Reference, Medium, High), and technology advancement (Slow, Moderate, Rapid), and were developed as inputs into the ReEDS model. The quantity of flexible load is estimated using assumptions on the level of flexibility and customer participation within each subsector modeled in the EFS. Detailed assumptions and modeling implementation will be documented in ongoing EFS analyses. Flexible load profiles are provided for a subset of years (2018, 2020, 2024, 2030, 2040, 2050) and are aggregated to the state and sector level. Total electricity load profiles can be found in a related EFS data set (https://dx.doi.org/10.7799/1593122). NOTE: Due to the file size, Mac users may experience issues decompressing the zip files using the Mac Archive Utility. In those cases, decompressing using the command line is recommended. - Mai, Trieu, Paige Jadun, Jeffrey Logan, Colin McMillan, Matteo Muratori, Daniel Steinberg, Laura Vimmerstedt, Ryan Jones, Benjamin Haley, and Brent Nelson. 2018. Electrification Futures Study: Scenarios of Electric Technology Adoption and Power Consumption for the United States. National Renewable Energy Laboratory. NREL/TP-6A20-71500. https://doi.org/10.2172/1459351. - Murphy, Caitlin, Trieu Mai, Yinong Sun, Paige Jadun, Matteo Muratori, Brent Nelson, Ryan Jones. Forthcoming. Electrification Futures Study: Scenarios of Power System Evolution and Infrastructure Development for the United States. National Renewable Energy Laboratory. - Sun, Yinong, Paige Jadun, Brent Nelson, Matteo Muratori, Caitlin Murphy, Jeffrey Logan, and Trieu Mai. Forthcoming. Electrification Futures Study: Methodological Approaches for Assessing Long-Term Power System Impacts of End-Use Electrification. National Renewable Energy Laboratory.

buildings↗
DOE OSTI2022

Evaluation of Aggregated EV Flexibility With TSO-DSO Coordination

Electric vehicles (EVs) are becoming a promising source of grid ancillary services due to the temporal and spatial charging flexibility, quick response and storage capability. Such advantages are increasing with government policy promotion and technology improvement. However, the exploration of EV flexibility requires the coordination of both transmission system operators (TSOs) and distribution system operators (DSOs), to ensure the safe and reliable operation of power network. In this paper, we propose a coordinated evaluation method that determines the optimal utilization of EV temporal flexibility without compromising EV owners’ usage. At the distribution level, DSOs first evaluate EV aggregators’ operational boundaries to exploit distribution level services. At the transmission level, TSOs then determine EV charging schedules and ancillary service capacity simultaneously, taking into account the requirement from DSOs. Here, we validate the model in a case study using the IEEE 123 node test feeder and EV charging sessions obtained from a transportation simulation tool that uses real-world data.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2017

The second most disastrous windstorm of the nineteenth century in the Czech Lands, 26-27 October 1870

One of the most disastrous windstorms to take place over the Czech Lands occurred on the night of 26/27 October 1870. It is here analysed through the use of documentary data (narrative sources, newspapers, forestry journals, printed documents) and systematic meteorological observations (wind force and direction). Combining this evidence with information derived from an atmospheric reanalysis dataset allows the severity of the windstorm to be attributed to the passage of a cold front, a frontal system associated with a secondary low in a typically storm-prone synoptic environment. Its social impacts were characterised by great material damage, particularly to buildings and other structures, trees and forests. These are recorded not only for 174 places around the countryside and lesser settlements of the Czech Lands, but also for 28 city quarters in Prague, the capital city. The windstorm occurred in the night hours, so only a few people were killed or injured. However, the 1870 windstorm totally devastated many forested areas of the Šumava Mts. in south-west Bohemia. Damage to forests in other parts of the Czech Lands was also severe, but difficult to quantify exactly for lack of high-resolution spatial data. Because this windstorm followed only shortly upon a previous similarly disastrous wind event on 7 December 1868, the enormous quantity of windthrown wood in forests, which simply could not be fast-processed, contributed significantly to a subsequent bark-beetle infestation calamity in the 1870s. In certain forest stands, imprints of these aggregate effects appear to this day. The central-European scale of 1870 windstorm is also well documented by meteorological and documentary data from Germany, Austria and Slovakia.

Meteorology & Atmospheric Sciences↗
NASA NTRS1987

Experimental studies of collision and fragmentation phenomena

The reduction and publication of an extensive data set collected in experiments over several years at Ames and PSI is briefly examined. Hartmann has been assembling data sets from his experiments on catastrophic fragmentation of various materials, including basalt, other igneous rock, ice, and weak dirt clods. Weidenschilling and Davis have continued to gather and reduce data on oblique impacts. The data indicate a power law distribution of ejecta mass vs. velocity, with a slope that is independent of azimuth, and does not vary with impact angle from normal impacts to at least 75 deg from vertical. In order to improve models of coagulation of dust aggregates in the solar nebula, SJW developed an apparatus for drop tests of fragile projectiles. Davis and Weidenschilling continued to collect and analyze experimental data on collisional catastrophic disruption at the Ames Vertical Gun Range.

Hartmann, William K.↗
DOE OSTI2014

OTRA-THS MAC to reduce Power Outage Data Collection Latency in a smart meter network

The deployment of advanced metering infrastructure by the electric utilities poses unique communication challenges, particularly as the number of meters per aggregator increases. During a power outage, a smart meter tries to report it instantaneously to the electric utility. In a densely populated residential/industrial locality, it is possible that a large number of smart meters simultaneously try to get access to the communication network to report the power outage. If the number of smart meters is very high of the order of tens of thousands (metropolitan areas), the power outage data flooding can lead to Random Access CHannel (RACH) congestion. Several utilities are considering the use of cellular network for smart meter communications. In 3G/4G cellular networks, RACH congestion not only leads to collisions, retransmissions and increased RACH delays, but also has the potential to disrupt the dedicated traffic flow by increasing the interference levels (3G CDMA). In order to overcome this problem, in this paper we propose a Time Hierarchical Scheme (THS) that reduces the intensity of power outage data flooding and power outage reporting delay by 6/7th, and 17/18th when compared to their respective values without THS. Also, we propose an Optimum Transmission Rate Adaptive (OTRA) MAC to optimize the latency in power outage data collection. The analysis and simulation results presented in this paper show that both the OTRA and THS features of the proposed MAC results in a Power Outage Data Collection Latency (PODCL) that is 1/10th of the 4G LTE PODCL.

Garlapati, Shravan K↗
DOE OSTI2021

Gaussian Process Regression for Aggregate Baseline Load Forecasting

Demand response (DR) is one of the most effective ways to maintain the reliability and improve the flexibility of power systems. Accurate forecasts of baseline loads are essential for DR programs. In the era of big data, machine learning-based approaches present a unique opportunity for baseline load forecasting. Thus, this paper presents a machine learning-based approach using a relatively less explored algorithm, Gaussian process regression (GPR), to forecast aggregate baseline loads. As such, a dataset was generated using a set of EnergyPlus simulations. Using the generated dataset, a GPR-based forecasting model was developed. In addition, support vector regression (SVR)-, artificial neural network (ANN)-, and averaging-based models were developed as baseline models for comparison. These models were compared in terms of accuracy, simplicity, and integrity. The prediction performance of the models showed that the GPR-based model is more accurate and reliable than the others. Such high performance shows the potential of the GPR in baseline load forecasting. GPR, therefore, can be used for DR applications.

Amasyali, Kadir↗
DOE OSTI2022

What you get is not always what you see—pitfalls in solar array assessment using overhead imagery

Effective integration planning for small, distributed solar photovoltaic (PV) arrays into electric power grids requires access to high quality data: the location and power capacity of individual solar PV arrays. Unfortunately, national databases of small-scale solar PV do not exist; those that do are limited in their spatial resolution, typically aggregated up to state or national levels. While several promising approaches for solar PV detection have been published, strategies for evaluating the performance of these models are often highly heterogeneous from study to study. The resulting comparison of these methods for practical applications for energy assessments becomes challenging and may imply that the reported performance evaluations overly optimistic. The heterogeneity comes in many forms, each of which we explore in this work: the degree of diversity of the locations and sensors (e.g. different satellites, aerial photography) from which the training and validation data originate, the validation of ground truth (manual annotation of imagery vs known solar PV locations), the level of spatial aggregation (e.g. array-level vs regional estimates), and inconsistencies in the training and validation datasets (e.g. different datasets are used for each study and those data are not always made accessible). For each, we discuss emerging practices from the literature to address them or suggest directions of future research. As part of our investigation, we evaluate solar PV identification performance in two large regions: the entire state of Connecticut and the city of San Diego, CA. In Connecticut, we also use 33,114 known parcel-level solar PV installations from Berkeley Lab’s Tracking the Sun dataset to evaluate parcel-level performance and evaluate capacity estimates using 169 municipalities. We also make our code (which we call SolarMapper), pre-trained models, training data, and predictions publicly available and provide a web portal for interactively inspecting each prediction that was made. Here our findings suggest that traditional performance evaluation of the automated identification of solar PV from satellite imagery may be optimistic due to common limitations in the validation process. The takeaways from this work are intended to inform and catalyze the large-scale practical application of automated solar PV assessment techniques by energy researchers and professionals.

14 SOLAR ENERGY↗
DOE OSTI2016

The First Fermi LAT Supernova Remnant Catalog

To uniformly determine the properties of supernova remnants (SNRs) at high energies, we have developed the first systematic survey at energies from 1 to 100 GeV using data from the Fermi Large Area Telescope (LAT). Based on the spatial overlap of sources detected at GeV energies with SNRs known from radio surveys, we classify 30 sources as likely GeV SNRs. We also report 14 marginal associations and 245 flux upper limits. A mock catalog in which the positions of known remnants are scrambled in Galactic longitude allows us to determine an upper limit of 22% on the number of GeV candidates falsely identified as SNRs. We have also developed a method to estimate spectral and spatial systematic errors arising from the diffuse interstellar emission model, a key component of all Galactic Fermi LAT analyses. By studying remnants uniformly in aggregate, we measure the GeV properties common to these objects and provide a crucial context for the detailed modeling of individual SNRs. Combining our GeV results with multiwavelength (MW) data, including radio, X-ray, and TeV, we demonstrate the need for improvements to previously sufficient, simple models describing the GeV and radio emission from these objects. We model the GeV and MW emission from SNRs in aggregate to constrain their maximal contribution to observed Galactic cosmic rays.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Aggregation of cyclic polypeptoids bearing zwitterionic end-groups with attractive dipole–dipole and solvophobic interactions: a study by small-angle neutron scattering and molecular dynamics simulation

Aggregation behavior of cyclic polypeptoids bearing zwitterionic end-groups in methanol has been studied using a combination of experimental and simulation techniques. Here, the data from SANS and cryo-TEM indicate that the solution contains small clusters of these cyclic polypeptoids, ranging from a single polypeptoid chain to small oligomers, while the linear counterpart shows no cluster formation. Atomistic molecular dynamics simulations reveal that the driving force for this clustering behavior is due to the interplay between the effective repulsion due to the solvation of the dipoles formed by the charged end-groups in each polypeptoid chain and the attractive forces due to dipole–dipole interactions and the solvophobic effect.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2026

A comparative study of multimodal data fusion strategies for planetary spectroscopy

Integrating heterogeneous data sources can improve scientific inference when different modalities capture complementary information, but doing so is challenging in high-dimensional, small-sample settings. In spectroscopy for planetary exploration, Laser-Induced Breakdown Spectroscopy (LIBS), Raman Spectroscopy (Raman), Visible Infrared Spectroscopy (VISIR), and Mid-Infrared Spectroscopy (MIR) each examine different aspects of composition and mineralogy, raising fundamental questions about when and how data fusion improves predictive performance. Using a Mars-relevant set of geologic standards with measurements from all four modalities, we present a rigorous systematic evaluation of four data fusion strategies: low-level (data) fusion, mid-level (feature) fusion, high-level (decision) fusion, and residual-boosting (sequential) fusion. We assess performance in predicting oxide composition via nested cross-validation and corrected significance testing to evaluate whether data fusion improves upon single-modality baselines. We show that data fusion does not uniformly improve accuracy, and that observed gains are modest, oxide-dependent, and sensitive to modality and model structure. To move beyond aggregate accuracy metrics, we use model coefficients, permutation importance, and residual gain analysis to examine how the fusion models weight individual modalities and to identify patterns of apparent complementarity or redundancy. Though focused on spectroscopy for planetary exploration, our framework for data fusion evaluation and interpretation extends to other scientific domains with heterogeneous and scarce data and provides a principled approach evaluating data fusion strategies, interpreting modality contributions, and understanding tradeoffs among data fusion strategies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Empirical Investigations of the Opportunity Limits of Automatic Residential Electric Load Shaping

Residential electric load shaping is often modeled as infrequent, utility-initiated, short-duration deferral of peak demand through direct load control. In contrast, modeled herein is the potential for frequent, transactive, intraday, consumer-configurable load shaping for storage-capable thermostatically controlled electric loads (TCLs), including refrigerators, freezers, and hot water heaters. Unique to this study are 28 months of 15-minute-interval observations of usage in 101 homes in the Pacific Northwest United States that specify exact start, duration, and usage patterns of approximately 25 submetered loads per home. The magnitudes of the load shift from voluntarily-participating TCL appliances are aggregated to form hourly upper and lower load-shaping limits for the coordination of electrical generation, transmission, distribution, storage, and demand. Empirical data are statistically analyzed to define metrics that help quantify load-shaping opportunities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2015

Balancing aggregation and smoothing errors in inverse models

Inverse models use observations of a system (observation vector) to quantify the variables driving that system (state vector) by statistical optimization. When the observation vector is large, such as with satellite data, selecting a suitable dimension for the state vector is a challenge. A state vector that is too large cannot be effectively constrained by the observations, leading to smoothing error. However, reducing the dimension of the state vector leads to aggregation error as prior relationships between state vector elements are imposed rather than optimized. Here we present a method for quantifying aggregation and smoothing errors as a function of state vector dimension, so that a suitable dimension can be selected by minimizing the combined error. Reducing the state vector within the aggregation error constraints can have the added advantage of enabling analytical solution to the inverse problem with full error characterization. We compare three methods for reducing the dimension of the state vector from its native resolution: (1) merging adjacent elements (grid coarsening), (2) clustering with principal component analysis (PCA), and (3) applying a Gaussian mixture model (GMM) with Gaussian pdfs as state vector elements on which the native-resolution state vector elements are projected using radial basis functions (RBFs). The GMM method leads to somewhat lower aggregation error than the other methods, but more importantly it retains resolution of major local features in the state vector while smoothing weak and broad features.

Turner, A. J.↗
DOE OSTI2025

Comparisons of the v11.1 Orbiting Carbon Observatory‐2 (OCO‐2) X CO2 Measurements With GGG2020 TCCON

The Orbiting Carbon Observatory 2 (OCO-2) is NASA's first Earth observation satellite mission dedicated to studying the sources and sinks of carbon dioxide (CO 2 ) on a global scale. The observations of reflected sunlight are inverted in a retrieval algorithm to produce estimates of the dry air mole-fractions of CO 2 (X CO2 ). The OCO-2 Level 2 data release, version 11.1 (v11.1) retrievals from the Atmospheric Carbon Observations from Space (ACOS) algorithm, includes significant improvements in the X CO2 data product compared to older OCO-2 data versions. This work compares the v11.1 X CO2 from OCO-2 against X CO2 estimates collected from a global ground-based network known as the Total Carbon Column Observing Network (TCCON), OCO-2's primary validation source. The OCO-2 project provides a version of the Level 2 data product, called “lite” files that include calibrated and bias-corrected XCO2 values, accessible together with all OCO-2 data products through the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). This work shows that OCO-2 X CO2 observations made between September 2014 and December 2023, after quality filtering and the application of an averaging kernel correction, agree well with coincident TCCON data for all OCO-2 observational modes of land (nadir, glint, target) and ocean (glint). The aggregated, bias-corrected, and quality-filtered absolute average bias values are less than or equal to 0.20 parts per million (ppm) globally for all OCO-2 observation modes, where the biases do not indicate a statistically significant time dependence. The land nadir/glint mode has the lowest bias value of −0.03 ± 0.85 ppm.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

YGM

YGM provides a simplified distributed memory communication framework based on a mailbox abstraction for HPC applications. YGM is designed for irregular data-driven applications that communicate small message payloads in an all-to-all fashion. YGM aggregates and routes messages into larger payloads to gain greater bandwidth utilization on modern HPC interconnects. YGM has been demonstrated up to 131k cores of IBM BG/P Sequoia and 96k cores of Catalyst at LLNL, and contains a set of graph-inspired benchmarks.

Priest, BenjaminW.↗
DOE OSTI2016

Viscous Particle Breakup within a Cooling Nuclear Fireball

Following the surface detonation of a nuclear weapon, the Earth’s crust and immediate surroundings are drawn into the fireball and form melts. Fallout is formed as these melts incorporate radioactive material from the bomb vapor and cool rapidly. The resultant fallout plume and dispersion of radioactive contamination is a function of several factors including weather patterns and fallout particle shapes and size distributions. Accurate modeling of the size distributions of fallout forms an important data point for dispersion codes that calculate the aerial distribution of fallout. While morphological evidence for aggregation of molten droplets is well documented in fallout glass populations, the breakup of these molten droplets has not been similarly studied. This study documents evidence that quenched fallout populations preserve evidence of molten breakup mechanisms.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2019

Abstract for CRADA between VariGrid Explorations Inc. and NETL (AGMT-0863)

As the energy industry continues to invest in data, big data, and advanced analytics to improve production, reduce operation and maintenance costs, improve safety, and reduce risks, uncertainty will serve as a limiting factor in the success of these operations. Intuitive communication of uncertainty can provide more transparency in the decision-making process; offering the ability to more accurately evaluate the risk and impact of decisions, identify data and knowledge gaps, and evaluate trade-offs. The issue of uncertainty will thus play a large role in the success of investments that rely on big data and data analytics. However, no robust method for representation of uncertainty in spatial data visuals currently exists. As such, uncertainty is, at best, communicated using multiple independent visuals and aggregated in final displays, or frequently omitted altogether. Failure to accurately and effectively quantify and communicate uncertainty poses a barrier, limiting critical information that would better allow businesses to make more accurate and intelligent decisions.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2025

Circularity Futures Workshop Series: Summary Report

The aim of this report is to synthesize key feedback received from the three-part Circularity Futures workshop series held in Spring 2024. The workshop series was conducted by the National Renewable Energy Laboratory (NREL) on behalf of U.S. Department of Energy, Office Energy Efficiency and Renewable Energy (EERE), and was broken into three workshops: Workshop 1 - Circularity Analysis Needs and Priorities; Workshop 2 - Circularity Metrics and Indicators; and Workshop 3 - Circularity Data. Together, the workshops focused on identifying the existing priorities and gaps in the circularity modeling space, understanding different stakeholders' use and interpretation of circularity metrics and indicators, identifying common data gaps and data quality challenges, and assessing the robustness of available solutions. The workshop series brought a diverse group of stakeholders - including representatives from U.S. government offices, national labs, nonprofit organizations, industry, and academia - to collect first-hand feedback on needs, priorities, challenges and opportunities in the circularity modeling and analysis space. The workshop discussions highlighted numerous common needs, priorities and challenges among the interviewed groups. Several topics were frequently discussed, including: 1) Circularity as a pathway for sustainable economic growth: While circularity is generally defined in terms of resource conservation and reducing wasteful disposal of materials, participants agreed that circular strategies should serve broader economic, environmental, and social goals. It is therefore crucial for circularity analysis to look beyond waste reduction and instead evaluate a variety of impact metrics such as cost savings, job creation, air quality, and pollutant emissions. Mutli-criteria decision-making frameworks may be useful for making sense of disparate metrics and evaluating tradeoffs between impact categories.; 2) Economic and social factors are not well understood: Underdevelopment of existing end-of-life (EOL) management infrastructure, inconsistent standardization codes and policy space in reusing recycled content, and suboptimal collection and sorting strategies collectively contribute to uncertainty about the economic potential of circular pathways. The latter observation is consistent among all technologies but more emphasized for renewable energy systems. Social impacts of circularity practices are less understood and less researched than other sustainability aspects.; 3) Inconsistent methods for assessing emerging technologies: LCA and TEA results vary widely depending on the assumptions made with regards to market adoption of new technologies. Emerging technologies suffer limited availability of data needed to conduct a robust circularity analysis. Yet, understanding projected impacts of proposed nascent technology is a key need for different stakeholder groups.; and 4) Lack of temporally and geospatially explicit data: There is a need for open data that represents variations in circularity technologies over time and location. The lack thereof leads to aggregated and potentially misrepresented results in circularity analysis. Sensitivity analyses should be included to verify whether options perceived as more sustainable align with real-world practices.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗