Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data warehouse”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Communication Demand in the National Airspace - A Federated Learning Approach

Within the national airspace system (NAS), efficient use of spectrum remains a challenge; as UAS and UAM missions evolve, the amount of mission-critical aircraft communications are expected to significantly grow. To accommodate the increased demand, NASA Glenn Research Center is investigating artificial intelligence approaches that could dynamically allocate spectrum; however, these solutions are driven by communication and aviation data items, many of which are not directly available. One such cornerstone data item is communication demand, parameterizing the needs within a sector in terms that may directly inform spectrum allocation, such as channel access duration, bandwidth, and modulation type. This paper considers the complexity of predicting communication demand as a function of NAS behaviors. Unlike prior prediction work in communications, this research must consider how the NAS may be impacted by external factors - such as convective weather and closures - rather than estimating demand from time-series forecasting alone. Much of this research considers a federated learning design to predict communication events in terms of the type of event occurring (sector coordination, conflict resolution, etc.). To do so, an investigation of products from Sherlock Data Warehouse is conducted, identifying the trends, sufficiency, and correlations of each product to identified events. Additionally, a preliminary discussion for inferring associations between these event types and their communication parameters (duration, bandwidth, modulation) is presented. By utilizing federated learning, imbalances in the types of events and data present throughout the NAS can inform local models without impairing global training. Furthermore, the two-stage approach proposed allows for robust and speculative communication modelling, as communication techniques continue to evolve. As a result, this model enables a generalized approach to understanding NAS communications which is able to inform long-term changes to aviation spectrum management.

Nathan Schimpf↗
NASA NTRSDate not supplied

A Federated Learning Approach to Predicting Communication Demand in the National Airspace

Within the national airspace system (NAS), efficient use of spectrum remains a challenge; as UAS and UAM missions evolve, the amount of mission-critical aircraft communications are expected to significantly grow. To accommodate the increased demand, NASA Glenn Research Center is investigating artificial intelligence approaches that could dynamically allocate spectrum; however, these solutions are driven by communication and aviation data items, many of which are not directly available. One such cornerstone data item is communication demand, parameterizing the needs within a sector in terms that may directly inform spectrum allocation, such as channel access duration, bandwidth, and modulation type. This paper considers the complexity of predicting communication demand as a function of NAS behaviors. Unlike prior prediction work in communications, this research must consider how the NAS may be impacted by external factors - such as convective weather and closures - rather than estimating demand from time-series forecasting alone. Much of this research considers a federated learning design to predict communication events in terms of the type of event occurring (sector coordination, conflict resolution, etc). To do so, an investigation of products from Sherlock Data Warehouse is conducted, identifying the trends, sufficiency, and correlations of each product to identified events. Additionally, a preliminary discussion for inferring associations between these event types and their communication parameters (duration, bandwidth, modulation) is presented. By utilizing federated learning, imbalances in the types of events and data present throughout the NAS can inform local models without impairing global training. Furthermore, the two-stage approach proposed allows for robust and speculative communication modelling, as communication techniques continue to evolve. As a result, this model enables a generalized approach to understanding NAS communications which is able to inform long-term changes to aviation spectrum management.

Nathan Schimpf↗
NASA NTRSDate not supplied

Flight Trajectory Prediction Based on Hybrid-Recurrent Networks

The development of future technologies for the National Airspace System (NAS) will be reliant on a new communications infrastructure capable of managing the limited available spectrum for communications among aircraft and ground systems. Emerging approaches to autonomous allocation of aviation spectrum mostlyrely on machine learning techniques, where 4D (longitude, latitude, altitude, time) trajectory prediction is an important data input to enable real-time resource allocation. This study explores and evaluates effective data sources and deep recurrent neural network techniques when determining flight trajectories. Specifically, data are collected and evaluated in a 100-day and 14-day period. Sources of data include NASA Sherlock Data Warehouse, MIT Lincoln Labs Corridor Integrated Weather Service (CIWS), and assorted NOAA weather datasets. Deep learning models for 4D predictions all utilize a hybrid-recurrent technique. A baseline model is considered via the convolutional-LSTM design from the existing literature. The modified design considers Gated Recurrent Units (GRU), Independently Recurrent Neural Networks (IndRNN), and stand-alone self-attention layers. Results indicatethe effectiveness of LSTM and GRUcells for state-of-the-art data processing (interpolation). Additionally, GRUs may be quickly trained with limited data, allowing for exacting improvements with optimizer selection. Attention mechanisms provide notable performance improvements to convolutional layers and may extend dimensional capabilities of a learning model. Finally, NOAA measurements provide only a supplemental value, requiring support from tailored measurements for Air Traffic Management.

Nathan Schimpf↗
NASA NTRS1998

Student Research Projects

Numerous FY1998 student research projects were sponsored by the Mississippi State University Center for Air Sea Technology. This technical note describes these projects which include research on: (1) Graphical User Interfaces, (2) Master Environmental Library, (3) Database Management Systems, (4) Naval Interactive Data Analysis System, (5) Relocatable Modeling Environment, (6) Tidal Models, (7) Book Inventories, (8) System Analysis, (9) World Wide Web Development, (10) Virtual Data Warehouse, (11) Enterprise Information Explorer, (12) Equipment Inventories, (13) COADS, and (14) JavaScript Technology.

Yeske, Lanny A.↗
NASA NTRS1998

An Image Retrieval and Processing Expert System for the World Wide Web

This paper presents a system that is being developed in the Laboratory of Applied Remote Sensing and Image Processing at the University of P.R. at Mayaguez. It describes the components that constitute its architecture. The main elements are: a Data Warehouse, an Image Processing Engine, and an Expert System. Together, they provide a complete solution to researchers from different fields that make use of images in their investigations. Also, since it is available to the World Wide Web, it provides remote access and processing of images.

Rodriguez, Ricardo↗
NASA NTRS2001

Business Systems Integration

An Oracle based system, which provides reporting and data warehouse functions is briefly described. The system is modifiable.

Bramley, Craig↗
NASA NTRS2004

Knowledge Driven Image Mining with Mixture Density Mercer Kernels

This paper presents a new methodology for automatic knowledge driven image mining based on the theory of Mercer Kernels; which are highly nonlinear symmetric positive definite mappings from the original image space to a very high, possibly infinite dimensional feature space. In that high dimensional feature space, linear clustering, prediction, and classification algorithms can be applied and the results can be mapped back down to the original image space. Thus, highly nonlinear structure in the image can be recovered through the use of well-known linear mathematics in the feature space. This process has a number of advantages over traditional methods in that it allows for nonlinear interactions to be modelled with only a marginal increase in computational costs. In this paper, we present the theory of Mercer Kernels, describe its use in image mining, discuss a new method to generate Mercer Kernels directly from data, and compare the results with existing algorithms on data from the MODIS (Moderate Resolution Spectral Radiometer) instrument taken over the Arctic region. We also discuss the potential application of these methods on the Intelligent Archive, a NASA initiative for developing a tagged image data warehouse for the Earth Sciences.

Srivastava, Ashok N.↗
NASA NTRS2004

Knowledge Driven Image Mining with Mixture Density Mercer Kernals

This paper presents a new methodology for automatic knowledge driven image mining based on the theory of Mercer Kernels, which are highly nonlinear symmetric positive definite mappings from the original image space to a very high, possibly infinite dimensional feature space. In that high dimensional feature space, linear clustering, prediction, and classification algorithms can be applied and the results can be mapped back down to the original image space. Thus, highly nonlinear structure in the image can be recovered through the use of well-known linear mathematics in the feature space. This process has a number of advantages over traditional methods in that it allows for nonlinear interactions to be modelled with only a marginal increase in computational costs. In this paper we present the theory of Mercer Kernels; describe its use in image mining, discuss a new method to generate Mercer Kernels directly from data, and compare the results with existing algorithms on data from the MODIS (Moderate Resolution Spectral Radiometer) instrument taken over the Arctic region. We also discuss the potential application of these methods on the Intelligent Archive, a NASA initiative for developing a tagged image data warehouse for the Earth Sciences.

Srivastava, Ashok N.↗
NASA NTRS2015

Manual Asset Inventory: NASA Kennedy Space Center

The National Aeronautics and Aerospace Administration (NASA) relies in the security and protection of the information and information systems to know the devices that are connected to the Agency networks whether these are business, mission, research, or engineering devices. The Agency uses different Information Technology resources in order to do this process automatically, however, there are some devices that need to be reported manually. As a result of this, every month the Agency distributes among its Information System Owners (ISOs) the Manual Asset Inventory, a document that consists of a Microsoft Excel spreadsheet with twenty field descriptions cells that has to be filled out by the ISO of every Security Plan in the Center [fifty three in total] and uploaded into the IT Security Enterprise Data Warehouse (ITSEC-EDW).

Presentation↗
NASA NTRSDate not supplied

Historical Domestic Flights from 2016-2020 with Estimations of Greenhouse Gas Emissions by Aircraft Type

Data and analyses are presented on the utilization of aircraft fuel in the U.S. and the greenhouse gas emissions that they create. Aggregated commercial passenger and freight aviation flight data from 2016-2020 is captured from the Bureau of Transportation Statistics website is used to augment flight data from the Sherlock data warehouse at NASA Ames is used to determine the miles flown by major aircraft models. The corresponding fuel burn is estimated using the International Civilian Aviation Organization fuel burn tables and carbon dioxide emissions are calculated using a fuel-burn multiplicative factor. One key conclusion of this analysis is that long haul flights (i.e. >2485 statute miles) create a disproportionately large amount of carbon dioxide emissions in the U.S while short flights (i.e. < 311 statute miles) contribute less than five percent of the U.S. aviation-related carbon dioxide emission. Although these short-haul flights may not have a large impact on overall carbon dioxide emissions, they will be a critical entry point for the adoption of future, larger fuel-efficient novel vehicles and the impact to future airport and infrastructure requirements. The final paper will present some estimates of the impact of advanced technologies on fuel burn and CO₂ emissions in various scenarios.

Susie Go↗
NASA NTRSDate not supplied

Estimations of Aircraft and Airport Domestic Greenhouse Gas Emissions from 2016-2021

Data and analyses are presented on the utilization of aircraft fuel in the U.S. and the resulting greenhouse gas emissions. Commercial passenger and freight flight data and airport fuel consumption usage from 2016-2021 are captured from the Bureau of Transportation Statistics website and the Sherlock Data Warehouse managed at NASA Ames Research Center. The resulting dataset is used to determine the miles flown by major aircraft. The corresponding aircraft fuel burn is estimated based on the International Civilian Aviation Organization fuel burn tables, and carbon dioxide emissions are calculated using a fuel-burn multiplicative factor. One conclusion of this analysis is that long-haul flights (flight distances > 2485 statute miles) create a disproportionately large amount of carbon dioxide emissions in the U.S, while short flights (< 311 statute miles) contribute less than five percent of the U.S. aviation-related carbon dioxide emissions. Although these short-haul flights may not have a large impact on overall carbon dioxide emissions, they will be valuable as demonstration missions for the next generation of electric, hybrid, and hydrogen-powered vehicles and their supporting energy infrastructures. This paper discusses recent trends in short-haul missions, their associated aircraft and airport types, and extracts several key requirements for future short-haul vehicles.

Susie Go↗
NASA NTRS2023

Estimations of Aircraft and Airport Domestic Greenhouse Gas Emissions from 2016-2021

Data and analyses are presented on the utilization of aircraft fuel in the U.S. and the resulting greenhouse gas emissions. Commercial passenger and freight flight data and airport fuel consumption usage from 2016-2021 are captured from the Bureau of Transportation Statistics website and the Sherlock Data Warehouse managed at NASA Ames Research Center. The resulting dataset is used to determine the miles flown by major aircraft. The corresponding aircraft fuel burn is estimated based on the International Civilian Aviation Organization fuel burn tables, and carbon dioxide emissions are calculated using a fuel-burn multiplicative factor. One conclusion of this analysis is that long-haul flights (flight distances > 2485 statute miles) create a disproportionately large amount of carbon dioxide emissions in the U.S, while short flights (< 311 statute miles) contribute less than five percent of the U.S. aviation-related carbon dioxide emissions. Although these short-haul flights may not have a large impact on overall carbon dioxide emissions, they will be valuable as demonstration missions for the next generation of electric, hybrid, and hydrogen-powered vehicles and their supporting energy infrastructures. This paper discusses recent trends in short-haul missions, their associated aircraft and airport types, and extracts several key requirements for future short-haul vehicles.

Susie Go↗
NASA NTRS2022

Information Fusion and Data Analytics for Human Lunar Exploration (CIF REPORT: Detailed PI Write-up)

The Information Fusion & Data Analytics (IFDA) project commenced in FY20, continued through FY21, and its final platform development phase continues in FY22. The objective remains the fusion and rapid accessibility of large quantities of disparate sourced human spaceflight data. IFDA is a platform tailored for NA (S&MA) to develop highly advanced operational data integration and analysis techniques. IFDA leverages the JSC ER7 modeling, simulation,and data fusion capabilities to collect, warehouse, and augment data human exploration data integration and analysis techniques. The IFDA project’s integrated data visualizations have been demonstrated in two validation scenarios in FY21, and provided the architecture and platform basis for development of a full-scale data analysis suite and storage solution useful to all JSC organizations engaged in real time operations and safety tasks. Scenarioand prototypical development including the construction of a full scale data analysis suite and storage solution, useful to all JSC organizations engaged in real time operations and safety tasks, is central to IFDA Phase 3 and provides a demonstrable pathway for the Digital Transformation Program. IFDA Phase 3 is focused on data provider, data utilizer, and SME hands-on workshops that will conclude the Dem / Valphase and deliver a program-ready data integration tool as a product.

information fusion↗
NASA NTRS2022

Information Fusion & Analytics for Human Lunar Exploration

The Information Fusion & Data Analytics (IFDA) project commenced in FY20, continued through FY21, and its final platform development phase continues in FY22. The objective remains the fusion and rapid accessibility of large quantities of disparate sourced human spaceflight data. IFDA is a platform tailored for NA (S&MA) to develop highly advanced operational data integration and analysis techniques. IFDA leverages the JSC ER7 modeling, simulation,and data fusion capabilities to collect, warehouse, and augment data human exploration data integration and analysis techniques. The IFDA project’s integrated data visualizations have been demonstrated in two validation scenarios in FY21, and provided the architecture and platform basis for development of a full-scale data analysis suite and storage solution useful to all JSC organizations engaged in real time operations and safety tasks. Scenarioand prototypical development including the construction of a full scale data analysis suite and storage solution, useful to all JSC organizations engaged in real time operations and safety tasks, is central to IFDA Phase 3 and provides a demonstrable pathway for the Digital Transformation Program. IFDA Phase 3 is focused on data provider, data utilizer, and SME hands-on workshops that will conclude the Dem / Valphase and deliver a program-ready data integration tool as a product.

information fusion↗
NASA NTRS1993

Volume server: A scalable high speed and high capacity magnetic tape archive architecture with concurrent multi-host access

A major challenge facing data processing centers today is data management. This includes the storage of large volumes of data and access to it. Current media storage for large data volumes is typically off line and frequently off site in warehouses. Access to data archived in this fashion can be subject to long delays, errors in media selection and retrieval, and even loss of data through misplacement or damage to the media. Similarly, designers responsible for architecting systems capable of continuous high-speed recording of large volumes of digital data are faced with the challenge of identifying technologies and configurations that meet their requirements. Past approaches have tended to evaluate the combination of the fastest tape recorders with the highest capacity tape media and then to compromise technology selection as a consequence of cost. This paper discusses an architecture that addresses both of these challenges and proposes a cost effective solution based on robots, high speed helical scan tape drives, and large-capacity media.

Rybczynski, Fred↗
NASA NTRS2021

CIF Report - Information Fusion and Data Analytics for Human Lunar Exploration

This project leverages the Concept Exploration Laboratory (CEL) to collect, warehouse, and augment data relevant to human lunar exploration as a platform for NA (S&MA) to develop operational data integration techniques. The project capitalizes on 16+ years of CEL experience applied to NASA, DoD, the City of Houston, the State of Texas, and private industry. The integrated data will be utilized in the two scenarios described in a definition of concept for development of a full scale data analysis suite and storage solution, useful to all JSC organizations engaged in real time operations and safety tasks, and may be useful as pathfinders for the Digital Transformation Program.

information fusion↗
NASA NTRS1996

A Note on Interfacing Object Warehouses and Mass Storage Systems for Data Mining Applications

Data mining is the automatic discovery of patterns, associations, and anomalies in data sets. Data mining requires numerically and statistically intensive queries. Our assumption is that data mining requires a specialized data management infrastructure to support the aforementioned intensive queries, but because of the sizes of data involved, this infrastructure is layered over a hierarchical storage system. In this paper, we discuss the architecture of a system which is layered for modularity, but exploits specialized lightweight services to maintain efficiency. Rather than use a full functioned database for example, we use light weight object services specialized for data mining. We propose using information repositories between layers so that components on either side of the layer can access information in the repositories to assist in making decisions about data layout, the caching and migration of data, the scheduling of queries, and related matters.

Grossman, Robert L.↗
NASA NTRS2009

NASA's Earth Observing Data and Information System

NASA's Earth Observing System Data and Information System (EOSDIS) has been a central component of NASA Earth observation program for over 10 years. It is one of the largest civilian science information system in the US, performing ingest, archive and distribution of over 3 terabytes of data per day much of which is from NASA s flagship missions Terra, Aqua and Aura. The system supports a variety of science disciplines including polar processes, land cover change, radiation budget, and most especially global climate change. The EOSDIS data centers, collocated with centers of science discipline expertise, archive and distribute standard data products produced by science investigator-led processing systems. Key to the success of EOSDIS is the concept of core versus community requirements. EOSDIS supports a core set of services to meet specific NASA needs and relies on community-developed services to meet specific user needs. EOSDIS offers a metadata registry, ECHO (Earth Observing System Clearinghouse), through which the scientific community can easily discover and exchange NASA s Earth science data and services. Users can search, manage, and access the contents of ECHO s registries (data and services) through user-developed and community-tailored interfaces or clients. The ECHO framework has become the primary access point for cross-Data Center search-and-order of EOSDIS and other Earth Science data holdings archived at the EOSDIS data centers. ECHO s Warehouse Inventory Search Tool (WIST) is the primary web-based client for discovering and ordering cross-discipline data from the EOSDIS data centers. The architecture of the EOSDIS provides a platform for the publication, discovery, understanding and access to NASA s Earth Observation resources and allows for easy integration of new datasets. The EOSDIS also has developed several methods for incorporating socioeconomic data into its data collection. Over the years, we have developed several methods for determining needs of the user community including use of the American Customer Satisfaction Index and a broad metrics program.

Mitchell, Andrew E.↗