Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Psychological changes in hundred-day remote Antarctic field groups

Psychological adaptation to extreme environments has been examined from several perspectives. In this study, two Australian teams, each consisting of six male crew members, completed computer-administered questionnaires twice weekly during 100-day traverses around the Lambert Glacier Basin, Antarctica. Only small trends were noted when data were aggregated at the group level, which is consistent with the findings of others. Data were then analyzed using pooled time-series regression. These analyses incorporated personality characteristics, environmental factors, and interpersonal factors as predictors of Group Tensions, Personal Morale, Emotional State, Cognitive Readiness, and the Team's Work Life. Most of the psychological discomfort and problems that occurred appeared to be within the individual or between individuals. They did not affect all members of the group equally.

NASA Discipline Space Human Factors↗

Exploratory analysis of high-resolution power interruption data reveals spatial and temporal heterogeneity in electric grid reliability

Modern grid monitoring equipment enables utilities to collect detailed records of power interruptions. Here, these data are aggregated to compute publicly reported metrics describing high-level characteristics of grid performance. The current work explores the depth of insights that can be gained from public data, and the implications of losing visibility into heterogeneity in grid performance through aggregation. We present an exploratory analysis examining three years of high-resolution power interruption data collected by archiving information posted in real-time on the public-facing website of a utility in the Western United States. We report on the size, frequency and duration of individual power interruptions, and on spatio-temporal variability in aggregate reliability metrics. Our results show that metrics of grid performance can vary spatially and temporally by orders of magnitude, revealing heterogeneity that is not evidenced in publicly reported metrics. We show that limited access to granular information presents a substantive barrier to conducting detailed policy analysis, and discuss how more widespread data access could help to answer questions that remain unanswered in the literature to date. Lastly, given open questions about whether grid performance is adequate to support societal needs, we recommend establishing pathways to make high-resolution power interruption data available to support policy research.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluation of a Surface Spill Operation to Return Adult Steelhead Overshoots Downstream of McNary Dam

This study, funded by the U.S. Army Corps of Engineers (USACE), was conducted by the Pacific Northwest National Laboratory to evaluate the efficacy of operating one Top Spill Weir (TSW) at McNary Dam outside the normal TSW operation dates for juvenile salmon passage. Of interest is whether the TSW is an effective downstream passage route for adult steelhead overshoots. Overshoots are fish which, having passed upstream at McNary Dam, must pass downstream to return to their natal stream to spawn. This report covers Fall (2019) and Spring (2020) study periods. The study design arranged the available 24 hours of TSW spill per week into weekly blocks with sub-blocks differentiated into day and night operations with TSW discharge periods of 4- and 8-hours duration. Hydroacoustic techniques were used to sample adult fish passage at the TSW and at turbine units 1 and 10. The experimental design contrasted TSW spill periods of differing duration and at different times of the day. The small number of fish detected passing the TSW, and the smaller number of fish detected passing the turbine units, were best suited to an ad hoc, exploratory approach to evaluating the effect of TSW spill. It is worthwhile to note that the operations data obtained for the fall study period had a greater than expected number of gaps and apparent anomalies that we believe were a result of how the data were aggregated. These problems are not particularly problematic for the present study, because the available data still provide a good indication of whether the TSW was operating at each point in time. TSW flows in both fall and spring data sets were able to be cleaned up using the established relationship between forebay elevation and TSW discharge rate. Additional cleanup of operations data would be needed, however, if more quantitative evaluation of dam-wide flow and passage relationships were needed. This study contrasted TSW spill periods of differing duration and at different times of the day. The small number of fish detected passing the TSW, and the smaller number of fish detected passing the turbine units were best suited to an ad hoc, exploratory approach to evaluating the effect of TSW spill. Spring adult steelhead passage numbers estimated using hydroacoustics were notably lower than during the fall study period, and that was consistent with our analysis of PIT tagged fish likely to be in the vicinity during each study period. Detections of fish in BlueView sampling areas upstream of the TSW and powerhouse were not correlated with detections of fish passing hydroacoustic sampling areas, which suggests that fish approaching the face of the dam can move around the forebay before passing. Other fish detected in the forebay in large numbers, such as shad, were able to be filtered out of steelhead passage counts and did not appear to be influencing hydroacoustic passage rate estimates. A pulse of passage at the initial TSW opening was weakly evident, but trends across 4- and 8-hour operational periods did not show a distinct decline in passage over time as TSW operation continued. Our findings do not indicate a reason to choose one 8-hour period over two 4-hour periods, or vice versa. This suggests that the duration of spill periods can be chosen based on operational or other considerations. Passage rates were consistently higher during the daytime TSW discharge periods, relative to nighttime TSW discharge periods. The experimental design of the current study used start times near dawn for day periods and near dusk for night periods.

59 BASIC BIOLOGICAL SCIENCES↗

A critical assessment of wind tunnel results for the NACA 0012 airfoil

A large body of experimental results, obtained in more than 40 wind tunnels on a single, well-known two-dimensional configuration, has been critically examined and correlated. An assessment of some of the possible sources of error has been made for each facility, and data which are suspect have been identified. It was found that no single experiment provided a complete set of reliable data, although one investigation stands out as superior in many respects. However, from the aggregate of data the representative properties of the NACA 0012 airfoil can be identified with reasonable confidence over wide ranges of Mach number, Reynolds number, and angles of attack. This synthesized information can now be used to assess and validate existing and future wind tunnel results and to evaluate advanced Computational Fluid Dynamics codes.

Mccroskey, W. J.↗

A critical assessment of wind tunnel results for the NACA 0012 airfoil

A large body of experimental results, obtained in more than 40 wind tunnels on a single, well known two-dimensional configuration, was critically examined and correlated. An assessment of some of the possible sources of error was made for each facility, and data which are suspect were identified. It was found that no single experiment provided a complete set of reliable data, although an investigation stands out as superior in many respects. However, from the aggregate of data the representative properties of the NACA 0012 airfoil can be identified with reasonable confidence over wide range of Mach numbers, Reynolds number, and angles of attack. This synthesized information can now be used to assess and validate existing and future wind tunnel results and to evaluate advanced Computational Fluid Dynamics codes.

Mccroskey, W. J.↗

Multi-Kernel Adaptive Support Vector Machine for Scalable Predictive Maintenance

Application of data-driven solutions across an industry is challenging, since the data are often stored locally, and increasing privacy and security concerns restrict access to the data. In addition, it is highly unlikely that all potential data patterns are captured in a single data source. Because it is highly unlikely that all potential data patterns are captured in a single data source, machine learning (ML) models developed from a single source cannot be robust enough. An alternative is to train the ML model at each source and develop a distributed knowledge discovery and aggregation approach to build global knowledge. In this paper, we develop and demonstrate a distributed ML model, federated transfer learning (FTL), using a multi-kernel-based adaptive support vector machine (MK-A-SVM). For federated learning (FL), the multi-kernel (MK) approach enables feature-specific model aggregation under data heterogeneity; whereas for transfer learning (TL) the adaptive model enables utilization of an aggregated model from a different task. The proposed approach is validated using nuclear power plant (NPP) vertical motor-driven pump data to predict the health condition of vertical motor-driven pumps as an anomaly detection. The efficiency of the proposed approach is also quantified and compared with neural network.

42 ENGINEERING↗

A method for processing the Confidential Carload Waybill Sample for railroad freight analysis

Freight transportation research is often constrained by the availability of appropriate data. Within the context of freight rail research, use of traditional freight datasets present some critical challenges. Aggregating freight data to geographic areas diminishes the ability to perform nuanced analysis. More challenging, the complexity of railroad operations limits the usability of publicly available freight flow data which do not account for which rail company is economically and legally responsible for the movement of the goods or for the contractual arrangements between infrastructure owners and carriers. Finally, detailed data are usually privately owned and not readily-accessible for analysis outside the individual rail companies. As part of their regulatory authority, the Surface Transportation Board has developed the Confidential Carload Waybill Sample, a stratified sample representing 1% to 3% of all rail traffic in the United States for a particular year. While the sample is rich with data, it is limited in spatial information as well as in its implementation in geospatial analysis. This paper introduces a methodology for geospatially enabling the Confidential Carload Waybill Sample which can then be used to generate rail routes based on a topological representation of the U.S. railroad network. As a result, this methodology is applied using two case studies, a freight diversion analysis and transporting hazardous materials.

42 ENGINEERING↗

Open Humans: A platform for participant-centered research and personal data exploration

Background: Many aspects of our lives are now digitized and connected to the internet. As a result, individuals are now creating and collecting more personal data than ever before. This offers an unprecedented chance for human-participant research ranging from the social sciences to precision medicine. With this potential wealth of data comes practical problems (e.g., how to merge data streams from various sources), as well as ethical problems (e.g., how best to balance risks and benefits when enabling personal data sharing by individuals). Results: To begin to address these problems in real time, we present Open Humans, a community-based platform that enables personal data collections across data streams, giving individuals more personal data access and control of sharing authorizations, and enabling academic research as well as patient-led projects. We showcase data streams that Open Humans combines (e.g., personal genetic data, wearable activity monitors, GPS location records, and continuous glucose monitor data), along with use cases of how the data facilitate various projects. Conclusions: Open Humans highlights how a community-centric ecosystem can be used to aggregate personal data from various sources, as well as how these data can be used by academic and citizen scientists through practical, iterative approaches to sharing that strive to balance considerations with participant autonomy, inclusion, and privacy.

59 BASIC BIOLOGICAL SCIENCES↗

Trend Detection of Atmospheric Time Series: Incorporating Appropriate Uncertainty Estimates and Handling Extreme Events

This paper is aimed at atmospheric scientists without formal training in statistical theory. Its goal is to, 1) provide a critical review of the rationale for trend analysis of the time series typically encountered in the field of atmospheric chemistry; 2) describe a range of trend-detection methods; and 3) demonstrate effective means of conveying the results to a general audience. Trend detections in atmospheric chemical composition data are often challenged by a variety of sources of uncertainty, which often behave differently to other environmental phenomena such as temperature, precipitation rate, or stream flow, and may require specific methods depending on the science questions to be addressed. Some sources of uncertainty can be explicitly included in the model specification, such as autocorrelation and seasonality, but some inherent uncertainties are difficult to quantify, such as data heterogeneity and measurement uncertainty due to the combined effect of short- and long-term natural variability, instrumental stability, and aggregation of data from sparse sampling frequency. Failure to account for these uncertainties might result in an inappropriate inference of the trends and their estimation errors. On the other hand, the variation in extreme events might be interesting for different scientific questions, for example, the frequency of extremely high surface ozone events and their relevance to human health. In this study we aim to, 1) review trend detection methods for addressing different levels of data complexity in different chemical species; 2) demonstrate that the incorporation of scientifically interpretable covariates can outperform pure numerical curve fitting techniques in terms of uncertainty reduction and improved predictability; 3) illustrate the study of trends based on extreme quantiles that can provide insight beyond standard mean or median based trend estimates; and 4) present an advanced method of quantifying regional trends based on the inter-site correlations of multi-site data. All demonstrations are based on time series of observed trace gases relevant to atmospheric chemistry, but the methods can be applied to other environmental data sets.

Trace gas↗

The Green Berry Consortia of the Sippewissett Salt Marsh: Millimeter-Sized Aggregates of Diazotrophic Unicellular Cyanobacteria

Microbial interactions driving key biogeochemical fluxes often occur within multispecies consortia that form spatially heterogeneous microenvironments. Here, we describe the “green berry” consortia of the Sippewissett salt marsh (Falmouth, MA, United States): millimeter-sized aggregates dominated by an uncultured, diazotrophic unicellular cyanobacterium of the order Chroococcales (termed GB-CYN1). We show that GB-CYN1 is closely related to Crocosphaera watsonii (UCYN-B) and “ Candidatus Atelocyanobacterium thalassa” (UCYN-A), two groups of unicellular diazotrophic cyanobacteria that play an important role in marine primary production. Other green berry consortium members include pennate diatoms and putative heterotrophic bacteria from the Alphaproteobacteria and Bacteroidetes . Tight coupling was observed between photosynthetic oxygen production and heterotrophic respiration. When illuminated, the green berries became supersaturated with oxygen. From the metagenome, we observed that GB-CYN1 encodes photosystem II genes and thus has the metabolic potential for oxygen production unlike UCYN-A. In darkness, respiratory activity rapidly depleted oxygen creating anoxia within the aggregates. Metagenomic data revealed a suite of nitrogen fixation genes encoded by GB-CYN1, and nitrogenase activity was confirmed at the whole-aggregate level by acetylene reduction assays. Metagenome reads homologous to marker genes for denitrification were observed and suggest that heterotrophic denitrifiers might co-occur in the green berries, although the physiology and activity of facultative anaerobes in these aggregates remains uncharacterized. Nitrogen fixation in the surface ocean was long thought to be driven by filamentous cyanobacterial aggregates, though recent work has demonstrated the importance of unicellular diazotrophic cyanobacteria (UCYN) from the order Chroococcales . Here, the green berries serve as a useful contrast to studies of open ocean UCYN and may provide a tractable model system to investigate microbial dynamics within phytoplankton aggregates, a phenomenon of global importance to the flux of particulate organic carbon and nitrogen in surface waters.

59 BASIC BIOLOGICAL SCIENCES↗

Is it possible to identify a trend in problem/failure data

One of the major obstacles in identifying and interpreting a trend is the small number of data points. Future trending reports will begin with 1983 data. As the problem/failure data are aggregated by year, there are just seven observations (1983 to 1989) for the 1990 reports. Any statistical inferences with a small amount of data will have a large degree of uncertainty. Consequently, a regression technique approach to identify a trend is limited. Though trend determination by failure mode may be unrealistic, the data may be explored for consistency or stability and the failure rate investigated. Various alternative data analysis procedures are briefly discussed. Techniques that could be used to explore problem/failure data by failure mode are addressed. The data used are taken from Section One, Space Shuttle Main Engine, of the Calspan Quarterly Report dated April 2, 1990.

Church, Curtis K.↗

Standard Component Commodity Usage Guides (CUGs) for Charge-Coupled Devices (CCDs)

Communicating risk and reliability information within NASA Goddard’s missions is crucial to continuing the development of new technology and ensuring GSFC missions achieve their science objectives. The Reliability and Risk Assessment Branch (Code 371) within the SMA directorate is one of GSFC’s leaders in communicating this information to missions, and one tool 371 engineers use to provide this information is the Commodity Usage Guides (CUGs). CUGs are helpful in compiling various critical parameters and heritage information for standard payload components, ensuring project personnel inherit the lessons learned from previous experiences. The purpose of this project was to create CUGs for CCDs used within GSFC missions. To formulate a CUG applicable data was aggregated into the CUG template for Charge-Coupled Devices (CCDs)--electro-optical components used to convert photons into digital images and data. CCDs can easily be adapted to a variety of mission requirements making them widely used at GSFC, and therefore suitable for CUGs. Once the CUGs for CCDs are completed the information can be distributed to engineers, scientists and other project members to ensure the lessons learned are passed on to the next mission.

Christman, Jerika H.↗

Cross-Measurement Comparisons for a CFD Validation Dataset on Mach 2.5 Axisymmetric Turbulent Shock-Wave/Boundary-Layer Interactions

Experimental data for a shock-wave/boundary-layer interaction has been collected using multiple measurement techniques. Unfortunately, diversity of methods for acquisition begets an aggregation of data which does not directly quantify the same properties of the flowfield. The objective in this paper was to (a) present the collection of flowfield measurements in one venue in a format more usable for those validating CFD models against the data, (b) evaluate the degree to which the experimental data support each other, and (c) highlight the differences and relative advantages/shortcomings of each measurement techniques. To present the various measured quantities into common format, CFD results from a companion paper also submitted for presentation at this meeting are utilized. For the case where the boundary layer remains attached, there is agreement between the various measurements as well as with Reynolds-averaged Navier-Stokes simulation solutions. As the impinging shock strength is increased beyond the point of separating the boundary layer, the congruity of the data wanes. Generally, agreement among the measurements exceeds the degree to which the CFD solutions agree with experiments. This suggests that unmodeled physical phenomena, such as transient motion of the reflected shock and separation bubble, give rise to the discrepancies observed in the computational results.

Shock-wave Boundary-layer interaction↗

Data Albums: An Event Driven Search, Aggregation and Curation Tool for Earth Science

One of the largest continuing challenges in any Earth science investigation is the discovery and access of useful science content from the increasingly large volumes of Earth science data and related information available. Approaches used in Earth science research such as case study analysis and climatology studies involve gathering discovering and gathering diverse data sets and information to support the research goals. Research based on case studies involves a detailed description of specific weather events using data from different sources, to characterize physical processes in play for a specific event. Climatology-based research tends to focus on the representativeness of a given event, by studying the characteristics and distribution of a large number of events. This allows researchers to generalize characteristics such as spatio-temporal distribution, intensity, annual cycle, duration, etc. To gather relevant data and information for case studies and climatology analysis is both tedious and time consuming. Current Earth science data systems are designed with the assumption that researchers access data primarily by instrument or geophysical parameter. Those who know exactly the datasets of interest can obtain the specific files they need using these systems. However, in cases where researchers are interested in studying a significant event, they have to manually assemble a variety of datasets relevant to it by searching the different distributed data systems. In these cases, a search process needs to be organized around the event rather than observing instruments. In addition, the existing data systems assume users have sufficient knowledge regarding the domain vocabulary to be able to effectively utilize their catalogs. These systems do not support new or interdisciplinary researchers who may be unfamiliar with the domain terminology. This paper presents a specialized search, aggregation and curation tool for Earth science to address these existing challenges. The search tool automatically creates curated "Data Albums", aggregated collections of information related to a specific science topic or event, containing links to relevant data files (granules) from different instruments; tools and services for visualization and analysis; and information about the event contained in news reports, images or videos to supplement research analysis. Curation in the tool is driven via an ontology based relevancy ranking algorithm to filter out non-relevant information and data.

Ramachandran, Rahul↗

How close are urban scale building simulations to measured data? Examining bias derived from building metadata in urban building energy modeling

Residential and commercial buildings in the United States accounted for 40% of total energy in 2020. Building energy modeling (BEM) is a useful tool that allows individuals, researchers, companies, or utilities to save energy by optimizing buildings through estimation of building technology savings and performance projection of building energy under various environmental conditions. Urban building energy modeling (UBEM) expands the scope beyond individual buildings to the buildings in a neighborhood, city, utility and more. Yet there is a knowledge gap in the literature as to how these models compare to measured data on an individual and aggregated basis. As UBEM data and methods continue to develop, it is important to consider the accuracy, bias, and limitations of the models. Here, nation-scale data and UBEM software suite named Automatic Building Energy Modeling (AutoBEM) was used to model 50,843 buildings in Chattanooga, Tennessee. The uncalibrated simulation results were compared to aggregated 15-minute electricity data for the year 2019 with visualizations highlighting sources of bias in building data and the AutoBEM framework while considering how they relate to other UBEM methods. Estimation of building type and year of constructions are found to be the major sources of bias. Accounting for the amount of conditioned area per building significantly improves the overall fit of the simulated energy use intensity. it was found that inherent variation in building energy use contributes to R 2 values between 0.008 and 0.095 across building types but slope values near 1 for the total number of buildings. This indicates the need for building aggregation for representative building energy modeling with data sources available at an urban scale while illustrating the need for additional individual building data and model improvement beyond the originally produced UBEM models for individual building analysis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

CROCUS Weather Data at Chicago State University Prairie Site

Vaisala WXT sensor is an all-in-one weather instrument that provides 6 of the most important weather parameters: barometric pressure, temperature, relative humidity, rainfall, wind speed and direction. Temperature, pressure, relative humidity, and rainfall are sampled at 1 second frequency, while wind speed/direction is measured at ten per second (10Hz) frequency. These measurements are useful for looking at characterizing local weather, identifying unique weather events, and studying local turbulence, especially given the high temporal resolution of the wind measurements. These measurements are collected at Chicago State University (CSU) at a prarie site on campus in Chicago, Illinois. Data is available in the netCDF data format, we encourage data users review documentation through Project Pythia to understand how to work with netCDF data https://foundations.projectpythia.org/core/data-formats/netcdf-cf.html. The data is aggregated into daily frequency to make it easier to process multiple days, and compress the higher-resolution fields. Each file contains one day's worth of data (24 hours, starting at 0000 UTC). File naming convention includes the project (CROCUS), location (CSU), data level (raw, a1), date (year, month, day), and hour (0000).

54 ENVIRONMENTAL SCIENCES↗

CROCUS Weather Data at Argonne National Laboratory Prairie Site

Vaisala WXT sensor is an all-in-one weather instrument that provides 6 of the most important weather parameters: barometric pressure, temperature, relative humidity, rainfall, wind speed and direction. Temperature, pressure, relative humidity, and rainfall are sampled at 1 second frequency, while wind speed/direction is measured at ten per second (10Hz) frequency. These measurements are useful for looking at characterizing local weather, identifying unique weather events, and studying local turbulence, especially given the high temporal resolution of the wind measurements. These measurements are collected at the Argonne Testbed for Multiscale Observational Science (ATMOS), a prairie field site at Argonne National Laboratory in Lemont, Illinois. Data is available in the netCDF data format, we encourage data users review documentation through Project Pythia to understand how to work with netCDF data https://foundations.projectpythia.org/core/data-formats/netcdf-cf.html. The data is aggregated into daily frequency to make it easier to process multiple days, and compress the higher-resolution fields. Each file contains one day's worth of data (24 hours, starting at 0000 UTC). File naming convention includes the project (CROCUS), location (atmos), data level (raw, a1), date (year, month, day), and hour (0000).

54 ENVIRONMENTAL SCIENCES↗

Aggregation Tool to Create Curated Data albums to Support Disaster Recovery and Response

Despite advances in science and technology of prediction and simulation of natural hazards, losses incurred due to natural disasters keep growing every year. Natural disasters cause more economic losses as compared to anthropogenic disasters. Economic losses due to natural hazards are estimated to be around $6-$10 billion dollars annually for the U.S. and this number keeps increasing every year. This increase has been attributed to population growth and migration to more hazard prone locations such as coasts. As this trend continues, in concert with shifts in weather patterns caused by climate change, it is anticipated that losses associated with natural disasters will keep growing substantially. One of challenges disaster response and recovery analysts face is to quickly find, access and utilize a vast variety of relevant geospatial data collected by different federal agencies such as DoD, NASA, NOAA, EPA, USGS etc. Some examples of these data sets include high spatio-temporal resolution multi/hyperspectral satellite imagery, model prediction outputs from weather models, latest radar scans, measurements from an array of sensor networks such as Integrated Ocean Observing System etc. More often analysts may be familiar with limited, but specific datasets and are often unaware of or unfamiliar with a large quantity of other useful resources. Finding airborne or satellite data useful to a natural disaster event often requires a time consuming search through web pages and data archives. Additional information related to damages, deaths, and injuries requires extensive online searches for news reports and official report summaries. An analyst must also sift through vast amounts of potentially useful digital information captured by the general public such as geo-tagged photos, videos and real time damage updates within twitter feeds. Collecting and aggregating these information fragments can provide useful information in assessing damage in real time and help direct recovery efforts. The search process for the analyst could be made much more efficient and productive if a tool could go beyond a typical search engine and provide not just links to web sites but actual links to specific data relevant to the natural disaster, parse unstructured reports for useful information nuggets, as well as gather other related reports, summaries, news stories, and images. This presentation will describe a semantic aggregation tool developed to address similar problem for Earth Science researchers. This tool provides automated curation, and creates "Data Albums" to support case studies. The generated "Data Albums" are compiled collections of information related to a specific science topic or event, containing links to relevant data files (granules) from different instruments; tools and services for visualization and analysis; information about the event contained in news reports, and images or videos to supplement research analysis. An ontology-based relevancy-ranking algorithm drives the curation of relevant data sets for a given event. This tool is now being used to generate a catalog of Hurricane Case Studies at Global Hydrology Resource Center (GHRC), one of NASA's Distribute Active Archive Centers. Another instance of the Data Albums tool is currently being created in collaboration with NASA/MSFC's SPoRT Center, which conducts research on unique NASA products and capabilities that can be transitioned to the operational community to solve forecast problems. This new instance focuses on severe weather to support SPoRT researchers in their model evaluation studies

Ramachandran, Rahul↗