Results for “data warehouse” — Page 3

NASA NTRS2004

Knowledge Driven Image Mining with Mixture Density Mercer Kernels

This paper presents a new methodology for automatic knowledge driven image mining based on the theory of Mercer Kernels; which are highly nonlinear symmetric positive definite mappings from the original image space to a very high, possibly infinite dimensional feature space. In that high dimensional feature space, linear clustering, prediction, and classification algorithms can be applied and the results can be mapped back down to the original image space. Thus, highly nonlinear structure in the image can be recovered through the use of well-known linear mathematics in the feature space. This process has a number of advantages over traditional methods in that it allows for nonlinear interactions to be modelled with only a marginal increase in computational costs. In this paper, we present the theory of Mercer Kernels, describe its use in image mining, discuss a new method to generate Mercer Kernels directly from data, and compare the results with existing algorithms on data from the MODIS (Moderate Resolution Spectral Radiometer) instrument taken over the Arctic region. We also discuss the potential application of these methods on the Intelligent Archive, a NASA initiative for developing a tagged image data warehouse for the Earth Sciences.

Srivastava, Ashok N.↗

NASA NTRS2004

Knowledge Driven Image Mining with Mixture Density Mercer Kernals

This paper presents a new methodology for automatic knowledge driven image mining based on the theory of Mercer Kernels, which are highly nonlinear symmetric positive definite mappings from the original image space to a very high, possibly infinite dimensional feature space. In that high dimensional feature space, linear clustering, prediction, and classification algorithms can be applied and the results can be mapped back down to the original image space. Thus, highly nonlinear structure in the image can be recovered through the use of well-known linear mathematics in the feature space. This process has a number of advantages over traditional methods in that it allows for nonlinear interactions to be modelled with only a marginal increase in computational costs. In this paper we present the theory of Mercer Kernels; describe its use in image mining, discuss a new method to generate Mercer Kernels directly from data, and compare the results with existing algorithms on data from the MODIS (Moderate Resolution Spectral Radiometer) instrument taken over the Arctic region. We also discuss the potential application of these methods on the Intelligent Archive, a NASA initiative for developing a tagged image data warehouse for the Earth Sciences.

Srivastava, Ashok N.↗

NASA NTRS2015

Manual Asset Inventory: NASA Kennedy Space Center

The National Aeronautics and Aerospace Administration (NASA) relies in the security and protection of the information and information systems to know the devices that are connected to the Agency networks whether these are business, mission, research, or engineering devices. The Agency uses different Information Technology resources in order to do this process automatically, however, there are some devices that need to be reported manually. As a result of this, every month the Agency distributes among its Information System Owners (ISOs) the Manual Asset Inventory, a document that consists of a Microsoft Excel spreadsheet with twenty field descriptions cells that has to be filled out by the ISO of every Security Plan in the Center [fifty three in total] and uploaded into the IT Security Enterprise Data Warehouse (ITSEC-EDW).

Presentation↗

NASA NTRSDate not supplied

Historical Domestic Flights from 2016-2020 with Estimations of Greenhouse Gas Emissions by Aircraft Type

Data and analyses are presented on the utilization of aircraft fuel in the U.S. and the greenhouse gas emissions that they create. Aggregated commercial passenger and freight aviation flight data from 2016-2020 is captured from the Bureau of Transportation Statistics website is used to augment flight data from the Sherlock data warehouse at NASA Ames is used to determine the miles flown by major aircraft models. The corresponding fuel burn is estimated using the International Civilian Aviation Organization fuel burn tables and carbon dioxide emissions are calculated using a fuel-burn multiplicative factor. One key conclusion of this analysis is that long haul flights (i.e. >2485 statute miles) create a disproportionately large amount of carbon dioxide emissions in the U.S while short flights (i.e. < 311 statute miles) contribute less than five percent of the U.S. aviation-related carbon dioxide emission. Although these short-haul flights may not have a large impact on overall carbon dioxide emissions, they will be a critical entry point for the adoption of future, larger fuel-efficient novel vehicles and the impact to future airport and infrastructure requirements. The final paper will present some estimates of the impact of advanced technologies on fuel burn and CO₂ emissions in various scenarios.

Susie Go↗

NASA NTRSDate not supplied

Estimations of Aircraft and Airport Domestic Greenhouse Gas Emissions from 2016-2021

Data and analyses are presented on the utilization of aircraft fuel in the U.S. and the resulting greenhouse gas emissions. Commercial passenger and freight flight data and airport fuel consumption usage from 2016-2021 are captured from the Bureau of Transportation Statistics website and the Sherlock Data Warehouse managed at NASA Ames Research Center. The resulting dataset is used to determine the miles flown by major aircraft. The corresponding aircraft fuel burn is estimated based on the International Civilian Aviation Organization fuel burn tables, and carbon dioxide emissions are calculated using a fuel-burn multiplicative factor. One conclusion of this analysis is that long-haul flights (flight distances > 2485 statute miles) create a disproportionately large amount of carbon dioxide emissions in the U.S, while short flights (< 311 statute miles) contribute less than five percent of the U.S. aviation-related carbon dioxide emissions. Although these short-haul flights may not have a large impact on overall carbon dioxide emissions, they will be valuable as demonstration missions for the next generation of electric, hybrid, and hydrogen-powered vehicles and their supporting energy infrastructures. This paper discusses recent trends in short-haul missions, their associated aircraft and airport types, and extracts several key requirements for future short-haul vehicles.

Susie Go↗

NASA NTRS2023

Estimations of Aircraft and Airport Domestic Greenhouse Gas Emissions from 2016-2021

Data and analyses are presented on the utilization of aircraft fuel in the U.S. and the resulting greenhouse gas emissions. Commercial passenger and freight flight data and airport fuel consumption usage from 2016-2021 are captured from the Bureau of Transportation Statistics website and the Sherlock Data Warehouse managed at NASA Ames Research Center. The resulting dataset is used to determine the miles flown by major aircraft. The corresponding aircraft fuel burn is estimated based on the International Civilian Aviation Organization fuel burn tables, and carbon dioxide emissions are calculated using a fuel-burn multiplicative factor. One conclusion of this analysis is that long-haul flights (flight distances > 2485 statute miles) create a disproportionately large amount of carbon dioxide emissions in the U.S, while short flights (< 311 statute miles) contribute less than five percent of the U.S. aviation-related carbon dioxide emissions. Although these short-haul flights may not have a large impact on overall carbon dioxide emissions, they will be valuable as demonstration missions for the next generation of electric, hybrid, and hydrogen-powered vehicles and their supporting energy infrastructures. This paper discusses recent trends in short-haul missions, their associated aircraft and airport types, and extracts several key requirements for future short-haul vehicles.

Susie Go↗

NASA NTRS2022

Information Fusion and Data Analytics for Human Lunar Exploration (CIF REPORT: Detailed PI Write-up)

The Information Fusion & Data Analytics (IFDA) project commenced in FY20, continued through FY21, and its final platform development phase continues in FY22. The objective remains the fusion and rapid accessibility of large quantities of disparate sourced human spaceflight data. IFDA is a platform tailored for NA (S&MA) to develop highly advanced operational data integration and analysis techniques. IFDA leverages the JSC ER7 modeling, simulation,and data fusion capabilities to collect, warehouse, and augment data human exploration data integration and analysis techniques. The IFDA project’s integrated data visualizations have been demonstrated in two validation scenarios in FY21, and provided the architecture and platform basis for development of a full-scale data analysis suite and storage solution useful to all JSC organizations engaged in real time operations and safety tasks. Scenarioand prototypical development including the construction of a full scale data analysis suite and storage solution, useful to all JSC organizations engaged in real time operations and safety tasks, is central to IFDA Phase 3 and provides a demonstrable pathway for the Digital Transformation Program. IFDA Phase 3 is focused on data provider, data utilizer, and SME hands-on workshops that will conclude the Dem / Valphase and deliver a program-ready data integration tool as a product.

information fusion↗

NASA NTRS2022

Information Fusion & Analytics for Human Lunar Exploration

The Information Fusion & Data Analytics (IFDA) project commenced in FY20, continued through FY21, and its final platform development phase continues in FY22. The objective remains the fusion and rapid accessibility of large quantities of disparate sourced human spaceflight data. IFDA is a platform tailored for NA (S&MA) to develop highly advanced operational data integration and analysis techniques. IFDA leverages the JSC ER7 modeling, simulation,and data fusion capabilities to collect, warehouse, and augment data human exploration data integration and analysis techniques. The IFDA project’s integrated data visualizations have been demonstrated in two validation scenarios in FY21, and provided the architecture and platform basis for development of a full-scale data analysis suite and storage solution useful to all JSC organizations engaged in real time operations and safety tasks. Scenarioand prototypical development including the construction of a full scale data analysis suite and storage solution, useful to all JSC organizations engaged in real time operations and safety tasks, is central to IFDA Phase 3 and provides a demonstrable pathway for the Digital Transformation Program. IFDA Phase 3 is focused on data provider, data utilizer, and SME hands-on workshops that will conclude the Dem / Valphase and deliver a program-ready data integration tool as a product.

information fusion↗

DOE OSTI2024

The AGN-201 Digital Twin: A test bed for remotely monitoring nuclear reactors

Research reactors have historically provided researchers and scientists with a means for testing and understanding the workings of nuclear phenomena. With the lack of new research reactors built in the past decades, it is important now more than ever to utilize and provide evidence for the usefulness of research reactors. Here, this work explores the use of the AGN-201 research reactor at Idaho State University as a test bed for developing a digital twin (named the AGN-201 DT) to realize remote monitoring for nuclear reactors. The goal of the AGN-201 DT is to monitor the AGN-201 reactor and detect when undeclared events take place to provide information for a monitoring agency. The AGN-201 DT was able to detect (without a priori knowledge) when multiple undeclared experiments were placed in the core using on-the-fly machine learning and reactor physics analysis. The AGN-201 reactor provided a test bed for developing, deploying, and testing a digital twin for monitoring nuclear reactors.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

DOE OSTI2025

Faraday Slidedeck

Faraday is a data science and visualization platform for electrochemical impedance spectroscopy. The slide deck is a visual guide with high-level information pertaining to the background, theory, and development of the application.

data warehouse↗

NASA NTRS1993

Volume server: A scalable high speed and high capacity magnetic tape archive architecture with concurrent multi-host access

A major challenge facing data processing centers today is data management. This includes the storage of large volumes of data and access to it. Current media storage for large data volumes is typically off line and frequently off site in warehouses. Access to data archived in this fashion can be subject to long delays, errors in media selection and retrieval, and even loss of data through misplacement or damage to the media. Similarly, designers responsible for architecting systems capable of continuous high-speed recording of large volumes of digital data are faced with the challenge of identifying technologies and configurations that meet their requirements. Past approaches have tended to evaluate the combination of the fastest tape recorders with the highest capacity tape media and then to compromise technology selection as a consequence of cost. This paper discusses an architecture that addresses both of these challenges and proposes a cost effective solution based on robots, high speed helical scan tape drives, and large-capacity media.

Rybczynski, Fred↗

NASA NTRS2021

CIF Report - Information Fusion and Data Analytics for Human Lunar Exploration

This project leverages the Concept Exploration Laboratory (CEL) to collect, warehouse, and augment data relevant to human lunar exploration as a platform for NA (S&MA) to develop operational data integration techniques. The project capitalizes on 16+ years of CEL experience applied to NASA, DoD, the City of Houston, the State of Texas, and private industry. The integrated data will be utilized in the two scenarios described in a definition of concept for development of a full scale data analysis suite and storage solution, useful to all JSC organizations engaged in real time operations and safety tasks, and may be useful as pathfinders for the Digital Transformation Program.

information fusion↗

NASA NTRS1996

A Note on Interfacing Object Warehouses and Mass Storage Systems for Data Mining Applications

Data mining is the automatic discovery of patterns, associations, and anomalies in data sets. Data mining requires numerically and statistically intensive queries. Our assumption is that data mining requires a specialized data management infrastructure to support the aforementioned intensive queries, but because of the sizes of data involved, this infrastructure is layered over a hierarchical storage system. In this paper, we discuss the architecture of a system which is layered for modularity, but exploits specialized lightweight services to maintain efficiency. Rather than use a full functioned database for example, we use light weight object services specialized for data mining. We propose using information repositories between layers so that components on either side of the layer can access information in the repositories to assist in making decisions about data layout, the caching and migration of data, the scheduling of queries, and related matters.

Grossman, Robert L.↗

NASA NTRS2009

NASA's Earth Observing Data and Information System

NASA's Earth Observing System Data and Information System (EOSDIS) has been a central component of NASA Earth observation program for over 10 years. It is one of the largest civilian science information system in the US, performing ingest, archive and distribution of over 3 terabytes of data per day much of which is from NASA s flagship missions Terra, Aqua and Aura. The system supports a variety of science disciplines including polar processes, land cover change, radiation budget, and most especially global climate change. The EOSDIS data centers, collocated with centers of science discipline expertise, archive and distribute standard data products produced by science investigator-led processing systems. Key to the success of EOSDIS is the concept of core versus community requirements. EOSDIS supports a core set of services to meet specific NASA needs and relies on community-developed services to meet specific user needs. EOSDIS offers a metadata registry, ECHO (Earth Observing System Clearinghouse), through which the scientific community can easily discover and exchange NASA s Earth science data and services. Users can search, manage, and access the contents of ECHO s registries (data and services) through user-developed and community-tailored interfaces or clients. The ECHO framework has become the primary access point for cross-Data Center search-and-order of EOSDIS and other Earth Science data holdings archived at the EOSDIS data centers. ECHO s Warehouse Inventory Search Tool (WIST) is the primary web-based client for discovering and ordering cross-discipline data from the EOSDIS data centers. The architecture of the EOSDIS provides a platform for the publication, discovery, understanding and access to NASA s Earth Observation resources and allows for easy integration of new datasets. The EOSDIS also has developed several methods for incorporating socioeconomic data into its data collection. Over the years, we have developed several methods for determining needs of the user community including use of the American Customer Satisfaction Index and a broad metrics program.

Mitchell, Andrew E.↗

NASA NTRS2006

ECHO Status for International Partners

The EOS Clearinghouse (ECHO) is a clearinghouse of spatial and temporal metadata, inclusive of NASA's Distributed Active Archive Center (DAAC) data holdings, that enables the science community to more easily exchange NASA data and information. Currently, ECHO has metadata descriptors for over 55 million individual data granules and 13 million browse images. The majority of ECHO's holdings come directly from data held in the NASA DAACs. The science disciplines and domains represented in ECHO are diverse and include metadata for all of NASA's Science Focus Area data. As middleware for a service-oriented enterprise, ECHO offers access to its capabilities through a set of publicly available Application Program Interfaces (APIs). More information about ECHO is available at http://eos.nasa.gov.echo. The presentation will discuss the status of the ECHO Partners, holdings, and activities, including the transition from the EOS Data Gateway to the Warehouse Inventory Search Tool (WIST)

Weinstein, Beth↗

NASA NTRS2018

GeneLab Analysis Working Group Kick-Off Meeting

Goals to achieve for GeneLab AWG - GL vision - Review of GeneLab AWG charter Timeline and milestones for 2018 Logistics - Monthly Meeting - Workshop - Internship - ASGSR Introduction of team leads and goals of each group Introduction of all members Q/A Three-tier Client Strategy to Democratize Data Physiological changes, pathway enrichment, differential expression, normalization, processing metadata, reproducibility, Data federation/integration with heterogeneous bioinformatics external databases The GLDS currently serves over 100 omics investigations to the biomedical community via open access. In order to expand the scope of metadata record searches via the GLDS, we designed a metadata warehouse that collects and updates metadata records from external systems housing similar data. To demonstrate the capabilities of federated search and retrieval of these data, we imported metadata records from three open-access data systems into the GLDS metadata warehouse: NCBI's Gene Expression Omnibus (GEO), EBI's PRoteomics IDEntifications (PRIDE) repository, and the Metagenomics Analysis server (MG-RAST). Each of these systems defines metadata for omics data sets differently. One solution to bridge such differences is to employ a common object model (COM) to which each systems' representation of metadata can be mapped. Warehoused metadata records are then transformed at ETL to this single, common representation. Queries generated via the GLDS are then executed against the warehouse, and matching records are shown in the COM representation (Fig. 1). While this approach is relatively straightforward to implement, the volume of the data in the omics domain presents challenges in dealing with latency and currency of records. Furthermore, the lack of a coordinated has been federated data search for and retrieval of these kinds of data across other open-access systems, so that users are able to conduct biological meta-investigations using data from a variety of sources. Such meta-investigations are key to corroborating findings from many kinds of assays and translating them into systems biology knowledge and, eventually, therapeutics.

GeneLab↗

NASA NTRS1992

Space Exposed Experiment Developed for Students (SEEDS) (P0004-2)

SEEDS, a cooperative endeavor of NASA Headquarters, the NASA Langley Research Center, and the George W. Park Seed Company, resulted in the distribution of approximately 132,000 SEEDS kits to 3.3 million students. Kits contained Rutger's tomato seeds that had flown on the Long Duration Exposure Facility (LDEF), as well as seeds that had been stored in a climate controlled warehouse for the same time period. Preliminary data indicates the germination rate for space exposed seeds was 73.8 percent while Earth based seeds germinated at a rate of 70.3 percent. Tests conducted within the first six months after retrieval indicated space exposed seeds germinated in an average of 8.0 days, while Earth based seeds' average germination time was 8.3 days. Some mutations (assumed to be radiation induced) include plants that added a leaf instead of the usual flower at the end of the flower frond. Also, fruit produced from a flower with a variegated calyx bore seeds producing albino plants, while fruit from a flower with a green calyx from the same plant bore seeds producing green plants.

Grigsby, Doris K.↗

NASA NTRS1990

Heat Pipes

Bobs Candies, Inc. produces some 24 million pounds of candy a year, much of it 'Christmas candy.' To meet Christmas demand, it must produce year-round. Thousands of cases of candy must be stored a good part of the year in two huge warehouses. The candy is very sensitive to temperature. The warehouses must be maintained at temperatures of 78-80 degrees Fahrenheit with relative humidities of 38- 42 percent. Such precise climate control of enormous buildings can be very expensive. In 1985, energy costs for the single warehouse ran to more than $57,000 for the year. NASA and the Florida Solar Energy Center (FSEC) were adapting heat pipe technology to control humidity in building environments. The heat pipes handle the jobs of precooling and reheating without using energy. The company contacted a FSEC systems engineer and from that contact eventually emerged a cooperative test project to install a heat pipe system at Bobs' warehouses, operate it for a period of time to determine accurately the cost benefits, and gather data applicable to development of future heat pipe systems. Installation was completed in mid-1987 and data collection is still in progress. In 1989, total energy cost for two warehouses, with the heat pipes complementing the air conditioning system was $28,706, and that figures out to a cost reduction.

Source record↗