Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
NASA NTRS1984

Investigation of SIR-B images for lithologic mapping

It is immediately apparent from the examination of almost any synthetic aperture radar (SAR) data that the radar return is primarily a function of the topographic relief. Yet radar reflectance is dependent on both surface roughness and the dielectric constant of the surface material. These two parameters can in many cases be related to lithologic units. Thus, if the first-order terrain effects due to topographic relief could (in essence) be removed from the radar image, the SAR data might well be used for lithologic discrimination. Such an approach is evaluated. Landsat Thematic Mapper data along with ground truth are used to define training cells that characterize the various lithologic units in the area. By aggregating the radar data for these cells, curves of radar reflectance versus local incidence are estimated. The curves are then used to classify the test area. The results are compared with lithologic classification based upon multi-spectral (visible and infrared) data.

Parr, J. T.↗
DOE OSTI2018

Qiita: rapid, web-enabled microbiome meta-analysis

Multi-omic insights into microbiome function and composition typically advance one study at a time. However, in order for relationships across studies to be fully understood, data must be aggregated into meta-analyses. This makes it possible to generate new hypotheses by finding features that are reproducible across biospecimens and data layers. Qiita dramatically accelerates such integration tasks in a web-based microbiome-comparison platform, which we demonstrate with Human Microbiome Project and Integrative Human Microbiome Project (iHMP) data.

microbiome, bioinformatics software, open source s↗
DOE OSTI2025

Data-Driven Energy Resilience Assessment and Enhancement in Urban Communities: A Case Study in Detroit

This paper presents a data-driven framework for assessing and enhancing energy resilience in urban communities. The resilience assessment is based on two datasets: 1) annual aggregated power outage data and 2) 15-minute interval outage data. High-impact, low-probability (HILP) events are identified within these datasets to evaluate community resilience under extreme conditions. To enhance resilience, an optimization framework utilizing mixed integer linear programming is developed to determine the optimal sizing and placement of solar photovoltaic (PV) systems and battery energy storage systems (BESS). This method offers a cost-effective and practical solution for improving energy resilience in vulnerable communities. Furthermore, a case study of the City of Detroit in Michigan demonstrates the effectiveness of the framework through simulation and validation.

Energy resilience assessment↗
DOE OSTI2020

Determining Compression Characteristics of Honeycomb Material - 19674

The objective is to determine compression test characteristics of stainless steel honeycomb material to be able to represent honeycomb structures accurately in analytical models used to simulate hypothetical accident scenarios of shipping packages. Honeycomb is a material used primary in the aerospace industry due to its high strength-to-weight ratio. Because it doesn't have a shelf life and can withstand high heats, it is an excellent candidate for a structural material in package designs. Honeycomb has orthotropic material properties. The honeycomb currently being evaluated is made of metal ribbons spot welded together to form hexagon pattern between metal plates. The hexagon ribbons are brazed to the metal plates. The complexity of the honeycomb significantly lengthens the simulation time, which is further complicated when the brazing, welding, and imperfections of the material is considered. This means to affectively represent the honeycomb in simulation programs, such as Abaqus, the material needs to be approximated as a uniform orthotropic material. This requires material properties in each of the three directions, T, W, and L. The T direction is defined as the 'strong' direction, perpendicular to the honeycomb sheet. The L direction is parallel the ribbon and the W direction is perpendicular to the ribbon. Honeycomb has 3 different compression stages. Stage 1 is the initial compression where the honeycomb maintains its structural integrity and does not permanently deform from loads from normal operations. Stage 2 is when the initial buckling causes irreversible damage to the honeycomb. Stage 2 is the one we are most interested in because it absorbs the most energy from a hypothetical accident scenario. During Stage 2, the honeycomb fails layer-by-layer, indicating that the more layers, the longer material crushing is sustained, and thus the more energy that is absorbed. Stage 3 is final compression, similar to compressing solid metal. During stage 3 the stress increases with a diminishing rate of elongation and the honeycomb is completely failed where the plates between the honeycomb core sandwich the crushed honeycomb ribbon. The stress-strain graph bellow shows compression test of 3 different samples in the T direction. The red lines divide the three stages. The far left is Stage 1, the middle stage 2, and the right stage 3. The data collected is displayed in the table below. The expressions in the table represent the regression formula that represents each stage of the compression on a stress-strain graph. Stage 1 is assumed to intersect with the origin; data for stage 3 for the crush in W and L directions where unable to be gathered due to the nature of failure for those directions. Stage 1 and 2 are linear regressions while stage 3 is a degree 2, to best match the curve. Linear regression is used on stage 2 because ultimately that represents the energy absorbed. With more data, a degree n x 2 regression would be a more appropriate regression for stage 2, where n is the number of layers. The table below is the approximation of each scenario and stage. Each stage starts and ends at the intersection of the next stage. There where two main objectives for these tests: firstly to understand how honeycomb performs under extreme compression, and secondly to be able to numerically represent the honeycomb structure. Both of these where completed to varying degrees. It is important understood how the honeycomb fails. If it is crushed in the T direction it retains its integrity even after being crushed, however when crushed in the L and W crush direction, if it fails, it disintegrates, and loses all integrity. Also, the more layers the more time the material spends in stage 2. Failure is started by buckling, thus if there is any imperfection, the stress will not spike but transition straight into stage 2. The data collected and aggregated can be used for initial simulation of honeycomb used in packages. The initial testing has set the ground work for more data to be collected in order to verify results and to allow more confidence in the simulation results. This is only the initial data collected. The next steps is to continue to collect more data to verify results and to test more variants of honeycomb, with different brazing, layers, and shape.

36 MATERIALS SCIENCE↗
NASA NTRS2013

Recent Efforts to Improve the Near Real Time Forest Disturbance Monitoring Capabilities of the ForWarn System

This presentation discusses the development of anew method for computing NDVI temporal composites from near real time eMODIS data This research is being conducted to improve forest change products used in the ForWarn system for monitoring regional forest disturbances in the United States. ForWarn provides nation-wide NDVI-based forest disturbance detection products that are refreshed every 8 days. Current eMODIS and historical MOD13 24 day NDVI data are used to compute the disturbance detection products. The eMODIS 24 day NDVI data re-aggregated from 7 day NDVI products. The 24 day eMODIS NDVIs are generally cloud free, but do not necessarily use the freshest quality data. To shorten the disturbance detection time, a method has been developed that performs adaptive length/maximum value compositing of eMODIS NDVI, along with cloud and shadow "noise" mitigation. Tests indicate that this method can reduce detection rates by 8-16 days for known recent disturbance events, depending on the cloud frequencies and disturbance type. The noise mitigation in these tests, though imperfect, helped to improve quality of the resulting NDVI and forest change products.

Spruce, Joseph↗
DOE OSTI2018

Directional Statistics of Preferential Orientations of Two Shapes in Their Aggregate and Its Application to Nanoparticle Aggregation

Nanoscientists have long conjectured that adjacent nanoparticles aggregate with one another in certain preferential directions during chemical syntheses of nanoparticles, which is so called the oriented attachment. For the study of the oriented attachment phenomenon, the microscopy and nanoscience community have used dynamic electron microscopy for direct observations of nanoparticle aggregation and have been so far relying on the manual and qualitative analysis of the observations. In this paper, we present a statistical approach for studying the oriented attachment phenomenon with multiple aggregation examples observed by dynamic microscope data. We abstract a nanoparticle aggregation by an event of two primary geometric objects merging into a secondary geometric object. We define a metric space for geometrical bodies, and the endowed metric in the space allows us to define the likelihood function of the orientation angles of two primary objects within the corresponding secondary object. We maximize the likelihood to estimate the orientation angles. We fit a mixture of bivariate von Mises distributions to the estimated orientation angles for the density estimation. By analyzing the density estimate, we are able to demonstrate that nanoparticles of certain geometries have indeed preferential orientations in their aggregates.

Mixture of bivariate von Mises distributions, Bi-a↗
DOE OSTI2020

Recursive Dynamic Compressive Sensing in Smart Distribution Systems

With a transition to a smarter grid, we are witnessing a significant growth in smart metering infrastructure and sensor deployment in the distribution system. The underlying communication infrastructure is stressed due to the large volume of data that is generated by the smart meters/sensors. Furthermore, real time operations such as state estimation and control are impaired due to the lack of reliable aggregation of the data. In this paper, we exploit the underlying sparsity in grid data to implement two recursive dynamic compressive sensing (CS) approaches-streaming modified weighted-`1 CS and Kalman filtered CS. These approaches aim to reconstruct the sparse signal using the current underdetermined measurements and the prior information about the sparse signal and its support set. Slow signal and support change is in distribution grid data is validated using Pecan Street data. Both the IEEE 34 node test feeder system and PecanStreet data are considered as two examples to validate the superior performance of the two recursive CS techniques relative to classic CS.

Karimi, Hazhar Sufi↗
DOE OSTI2017

Performance of the CMS Event Builder

The data acquisition system (DAQ) of the CMS experiment at the CERN Large Hadron Collider assembles events at a rate of 100 kHz, transporting event data at an aggregate throughput of to the high-level trigger farm. The DAQ architecture is based on state-of-the-art network technologies for the event building. For the data concentration, 10/40 Gbit/s Ethernet technologies are used together with a reduced TCP/IP protocol implemented in FPGA for a reliable transport between custom electronics and commercial computing hardware. A 56 Gbit/s Infiniband FDR Clos network has been chosen for the event builder. This paper presents the implementation and performance of the event-building system.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Advancing Our Understanding of System Availability through the PV Fleet Performance Data Initiative

The PV Fleet Performance Data Initiative partners with photovoltaic (PV) fleet owners to collect time-series data of PV production data and publishes aggregated anonymized results of system performance metrics. With an extensive dataset drawn from over 2,200 PV systems across the United States, comprising 8.5 GW and 24,000 separate inverter data channels, this initiative aims to ensure that systemic risks in the US PV fleet are detected. The current work explores system availability, revealing a pronounced dependence on time, especially within the initial 6 months of system performance. Following this start-up period, the average system availability stabilizes. Statistical analyses illustrate a median (P5O) monthly availability of 0.991 and a dependence on system size with a negative trend in availability with increasing system size. This finding indicates that larger systems experience lower availability compared to their smaller counterparts.

inverter availability↗
DOE OSTI2016

Insights into the Morphology and Kinetics of Growth of Silver Metal–Organic Nanotubes

The kinetics of the formation of novel porous metal organic nanotubes, [Ag2(4,4 -(1,4-(xylene)diyl)bis- (1,2,4-triazole) (NO3)2] NMP, was investigated by means of ex-situ time-resolved small-angle X-ray scattering (SAXS) and scanning electron microscopy (SEM). The SAXS results were modeled using the Gualtieri model, which decouples the nucleation and growth processes giving additional insight into the crystal formation mechanism. The results show that the semirigid 4,4 -(1,4-(xylene)diyl)bis(1,2,4-triazole) ligand (L) binds with silver ions, adopting a seesaw geometry to form a polydisperse isotropic framework immediately after mixing the ligands and metal ions. In addition, the SEM imaging demonstrates that the microcrystals grow anisotropically, with nucleation along the edge of the 3D aggregate. These combined data demonstrate that the growth of this MONT occurs in two steps: a rapid formation of an isotropic porous structure immediately after mixing the reactant, which then develops anisotropically as the aggregates of nanorods grow in a preferred direction. The anisotropic growth of the crystal is autocatalytic and determined by the rate of nucleation of new growth sites on the crystals. Moreover, the results of this analysis elucidate, for the rst time, the exact order of the competing processes that occur in the synthesis of these MONTs, showing that their anisotropic growth occurs on the initial 3D aggregate and appears to be directed by the interplay between the surface energies that exist during the MONT formation process. This insight is crucial to the use of crystal engineering to guide the crystal formation processes in MONTs to targeted structures, properties, and applications.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Spatial temporal cluster analysis to enhance awareness of disease re-emergence on a global scale

ObjectiveThe application of spatial analysis to improve the awareness and use of surveillance data.IntroductionThe re-emergence of an infectious disease is dependent on social, political, behavioral, and disease-specific factors. Global disease surveillance is a requisite of early detection that facilitates coordinated interventions to these events. Novel informatics tools developed from publicly available data are constantly evolving with the incorporation of new data streams. Re-emerging Infectious Disease (RED) Alert is an open-source tool designed to help analysts develop a contextual framework when planning for future events, given what has occurred in the past. Geospatial methods assist researchers in making informed decisions by incorporating the power of place to better explain the relationships between variables.MethodsDisease incidence and indicator data derived for the RED Alert project were analyzed for spatial associations. Using aggregate country-level data, spatial and spatiotemporal clusters were identified in ArcMap 10.5.1. The identified clusters were then used as the outcome for a series of binary logistic regression models to determine significant covariates that help explain global hotspots. These methods will continue to evolve and be incorporated into the RED Alert decision support ecosystem to provide analysts with a global perspective on potential re-emergence.ResultsHotspots of high disease incidence in relation to neighboring countries were identified for measles, cholera, dengue, and yellow fever between 2000 and 2014. Disease-specific predictors were identified using aggregate estimates from World Bank indicator dataset. Data was imputed where possible to enhance the validity of the Gi * statistic for clustering. In the future, as data streams become more readily available, hotspot modeling at a finer resolution will help to improve the precision of spatial epidemiology.ConclusionsSpatial methods enhance the capability of understanding complex population and disease relationships, which in turn improves surveillance and the ability to predict re-emergence. With tools like RED Alert, public health analysts can better prepare to respond rapidly to future re-emerging disease threats.

Altherr, Forest M.↗
DOE OSTI2017

Basin Assessment Spatial Planning Platform

The tool is intended to facilitate hydropower development and water resource planning by improving synthesis and interpretation of disparate spatial datasets that are considered in development actions (e.g., hydrological characteristics, environmentally and culturally sensitive areas, existing or proposed water power resources, climate-informed forecasts). The tool enables this capability by providing a unique framework for assimilating, relating, summarizing, and visualizing disparate spatial data through the use of spatial aggregation techniques, relational geodatabase platforms, and an interactive web-based Geographic Information Systems (GIS). Data are aggregated and related based on shared intersections with a common spatial unit; in this case, industry-standard hydrologic drainage areas for the U.S. (National Hydrography Dataset) are used as the spatial unit to associate planning data. This process is performed using all available scalar delineations of drainage areas (i.e., region, sub-region, basin, sub-basin, watershed, sub-watershed, catchment) to create spatially hierarchical relationships among planning data and drainages. These entity-relationships are stored in a relational geodatabase that provides back-end structure to the web GIS and its widgets. The full technology stack was built using all open-source software in modern programming languages. Interactive widgets that function within the viewport are also compatible with all modern browsers.

Source record↗
NASA NTRSDate not supplied

TPSAS-NF1676L-17867-DND

In response to the exponential growth in science data analysis and visualization capabilities, data centers have been developing new processes to package and deliver large volumes of aggregated subsets of archived data. New standards are evolving to help data providers and application programmers manage the growing needs of the science community. These standards evolve from the best practices gleaned from new products and capabilities. The NASA Atmospheric Sciences Data Center (ASDC) has developed and deployed production provider-specific search and subset web applications for the CALIPSO, CERES, TES, and MOPITT missions. This presentation explores a CERES CCCM (CALIPSO, CloudSat, CERES, MODIS) data validation use case that leverages aggregated subset results from CERES CCCM (Level2), CERES SSF (Level2), and CALIPSO LIDAR (Level) datasets. Additionally, it examines the standards and formats that ASDC developers have applied to the delivered files as well as the implementation strategies for subsetting and processing the aggregated products.

Walter E Baskin↗
DOE OSTI2025

Complexity Reduction Methods for Large-Scale Spatially Explicit Biofuels Network Design

The size and complexity of energy system optimization models have increased significantly in recent years, driven by the availability of high-resolution spatial data. We present complexity reduction and solution methods that enable us to efficiently represent high-resolution spatial data in the network design of large-scale energy systems. We aim to reduce the size and enhance the computational efficiency of network design models without sacrificing solution accuracy. Specifically, we first present how to aggregate highly granular data into larger resolutions without averaging out their specific properties through a composite-curve-based approach and then develop a method to linearly represent these curves. Second, we utilize a general clustering method to determine groups of geographically proximate biomass fields and establish a single transportation arc for all of them, reducing the number of transportation-related variables while maintaining an accurate representation of the system. Finally, we introduce a two-step algorithm that decomposes large-scale network design problems into two smaller, more manageable subproblems. We demonstrate the application of our methods using a case study of switchgrass-to-biofuels network design in the eight states of the U.S. Midwest, using realistic and highly explicit spatial data.

09 BIOMASS FUELS↗
DOE OSTI2019

Fuzzy logic model of irradiated aggregates

The worldwide need for nuclear power plant (NPP) lifetime extension to meet future national energy requirements while reducing greenhouse gases raises the question of the condition of concrete structures exposed to ionizing radiation. Although research into the effects of radiation has a long history and the phenomenon of deterioration of concrete due to irradiation is not yet completely understood, the main assumed degradation mode is radiation-induced volumetric expansion of aggregates. There are experimental data on irradiated concrete obtained over decades under different conditions; however, the collection of data exhibits considerable scatter. Fuzzy logic modeling offers an effective tool that can interconnect various data sets obtained by different teams of experts under different conditions. The main goal of this work is to utilize available data on irradiated concrete components such as minerals and aggregates that expand upon irradiation. Furthermore, aggregate radiation-induced volumetric expansion gives an estimate of the change in mechanical properties of aggregate after years of reactor operation. The mechanical properties of irradiated aggregate can then be used for modeling irradiated concrete in the actual NPP structure based on the composition of concrete, the average temperature on the surface of the biological shield structure, and the neutron dose received by biological shield.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Where are the Data? Automating a Workflow for Carbon Storage Data Gap Analyses

This presentation demonstrates a spatial analysis workflow to assess data availability for the many components of geologic carbon storage technical viability. The workflow relies upon a knowledge-data framework that links the different components of GCS technical viability to the data types needed for evaluation. Using this contextual information, a combination of data science methods (e.g., natural language processing) and spatial analyses are applied to identify areas where sufficient data exists for a given component. The results are aggregated into maps illustrating data density and spatial gaps across all technical viability factors and data categories, as well as the individual component and category level for a more nuanced understanding. Presented at the FECM NETL Carbon Management Program Review Meeting 2024.

Creason, Christopher↗
DOE OSTI2024

Where are the Data? Automating a Workflow for Carbon Storage Data Gap Analyses

This presentation demonstrates a spatial analysis workflow to assess data availability for the many components of geologic carbon storage technical viability. The workflow relies upon a knowledge-data framework that links the different components of GCS technical viability to the data types needed for evaluation. Using this contextual information, a combination of data science methods (e.g., natural language processing) and spatial analyses are applied to identify areas where sufficient data exists for a given component. The results are aggregated into maps illustrating data density and spatial gaps across all technical viability factors and data categories, as well as the individual component and category level for a more nuanced understanding. Presented at the Geological Society of America Connects 2024 Annual Meeting in Anaheim, California, 22-25 September 2024.

Creason, Christopher↗
DOE OSTI2018

Spectroscopic and Theoretical Studies of Fluorescence Effects in 2-Methylamino-5-(2,4-dihydroxyphenyl)-1,3,4-thiadiazole Induced by Molecular Aggregation

The article presents the results of fluorescence analyses of 2-methylamino-5-(2,4-dihydroxyphenyl)-1,3,4-thiadiazole (MDFT) in an aqueous environment. MDFT dissolved in aqueous solutions with a pH value in the range from 1 to 4.5 yielded an interesting effect of two clearly separated fluorescence emissions. In turn, a single fluorescence was observed in MDFT dissolved in water solutions with a pH value from 4.5 to 12. As it was suggested in the previous investigations of other 1,3,4-thiadiazole compounds, these effects may be associated with conformational changes in the structure of the analysed molecule accompanied by aggregation effects. Crystallographic data showed that the effect of the two separated fluorescence emissions occurred in a conformation with the –OH group in the resorcyl ring bound on the side of the sulphur atom from the 1,3,4-thiadiazole ring. The hypothesis of aggregation as the mechanism involved in the change in the spectral properties at low pH is supported by the results of (Time-Dependent) Density Functional Theory calculations. The possibility of rapid analysis of conformational changes with the fluorescence spectroscopy technique may be rather important outcome obtained from the spectroscopic studies presented in this article. Additionally, the presented results seem to be highly important as they can be easily observed in solutions and biologically important samples.

74 ATOMIC AND MOLECULAR PHYSICS↗