Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “End-user data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

34 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2000

Health Monitoring System Technology Assessments: Cost Benefits Analysis

The subject of sensor-based structural health monitoring is very diverse and encompasses a wide range of activities including initiatives and innovations involving the development of advanced sensor, signal processing, data analysis, and actuation and control technologies. In addition, it embraces the consideration of the availability of low-cost, high-quality contributing technologies, computational utilities, and hardware and software resources that enable the operational realization of robust health monitoring technologies. This report presents a detailed analysis of the cost benefit and other logistics and operational considerations associated with the implementation and utilization of sensor-based technologies for use in aerospace structure health monitoring. The scope of this volume is to assess the economic impact, from an end-user perspective, implementation health monitoring technologies on three structures. It specifically focuses on evaluating the impact on maintaining and supporting these structures with and without health monitoring capability.

Kent, Renee M.↗
NASA NTRS2009

A Landsat-Based Assessment of Mobile Bay Land Use and Land Cover Change from 1974 to 2008

The Mobile Bay region has experienced noteworthy land use and land cover (LULC) change in the latter half of the 20th century. Accompanying this change has been urban expansion and a reduction of rural land uses. Much of this LULC change has reportedly occurred since the landfall of Hurricane Frederic in 1979. The Mobile Bay region provides great economic and ecologic benefits to the Nation, including important coastal habitat for a broad diversity of fisheries and wildlife. Regional urbanization threatens the estuary s water quality and aquatic-habitat dependent biota, including commercial fisheries and avian wildlife. Coastal conservation and urban land use planners require additional information on historical LULC change to support coastal habitat restoration and resiliency management efforts. This presentation discusses results of a Gulf of Mexico Application Pilot project that was conducted in 2008 to quantify and assess LULC change from 1974 to 2008. This project was led by NASA Stennis Space Center and involved multiple Gulf of Mexico Alliance (GOMA) partners, including the Mobile Bay National Estuary Program (NEP), the U.S. Army Corps of Engineers, the National Oceanic and Atmospheric Administration s (NOAA s) National Coastal Data Development Center (NCDDC), and the NOAA Coastal Services Center. Nine Landsat images were employed to compute LULC products because of their availability and suitability for the application. The project also used Landsat-based national LULC products, including coastal LULC products from NOAA s Coastal Change & Analysis Program (C-CAP), available at 5-year intervals since 1995. Our study was initiated in part because C-CAP LULC products were not available to assess the region s urbanization prior to 1995 and subsequent to post Hurricane Katrina in 2006. This project assessed LULC change across the 34-year time frame and at decadal and middecadal scales. The study area included the majority of Mobile and Baldwin counties that encompass Mobile Bay. In doing so, each date of Landsat data was classified using an end-user defined modified Anderson level 1 classification scheme. LULC classifications were refined using a decision rule approach in conjunction with available C-CAP products. Individual dates of LULC classifications were validated by image interpretation of stratified random locations on raw Landsat color composite imagery in combination with higher resolution remote sensing and in-situ reference data. The results indicate that during the 34-year study period, urban areas increased from 96,688 to 150,227 acres, representing a 55.37% increase, or 1.63% per annum. Most of the identified urban expansion results from conversion of rural forest and agriculture to urban cover types. Final LULC mapping and metadata products were produced for the entire study area as well as watersheds of concern within the study area. Final project products, including LULC trend information, were incorporated into the Mobile Bay NEP State of the Bay report. Products and metadata were transferred to NOAA NCDDC to allow free online accessibility and use by GOMA partners and by the public.

Spruce, Joseph↗
NASA NTRS2011

Evaluating the Use of Remote Sensing Data in the USAID Famine Early Warning Systems Network

The US Agency for International Development (USAID) s Famine Early Warning System Network (FEWS NET) provides monitoring and early warning support to decision makers responsible for responding to food insecurity emergencies on three continents. FEWS NET uses satellite remote sensing and ground observations of rainfall and vegetation in order to provide information on drought, floods and other extreme weather events to decision makers. Previous research has presented results from a professional review questionnaire with FEWS NET expert end-users whose focus was to elicit Earth observation requirements. The review provided FEWS NET operational requirements and assessed the usefulness of additional remote sensing data. Here we analyzed 1342 food security update reports from FEWS NET. The reports consider the biophysical, socioeconomic, and contextual influences on the food security in 17 countries in Africa from 2000-2009. The objective was to evaluate the use of remote sensing information in comparison with other important factors in the evaluation of food security crises. The results show that all 17 countries use rainfall information, agricultural production statistics, food prices and food access parameters in their analysis of food security problems. The reports display large scale patterns that are strongly related to history of the FEWS NET program in each country. We found that rainfall data was used 84% of the time, remote sensing of vegetation 28% of the time, and gridded crop models 10%, reflecting the length of use of each product in the regions. More investment is needed in training personnel on remote sensing products to improve use of data products throughout the FEWS NET system.

Brown, Molly E.↗
NASA NTRS2012

Evaluating the Use of Remote Sensing Data in the U.S. Agency for International Development Famine Early Warning Systems Network

The U.S. Agency for International Development (USAID)'s Famine Early Warning System Network (FEWS NET) provides monitoring and early warning support to decision makers responsible for responding to food insecurity emergencies on three continents. FEWS NET uses satellite remote sensing and ground observations of rainfall and vegetation in order to provide information on drought, floods, and other extreme weather events to decision makers. Previous research has presented results from a professional review questionnaire with FEWS NET expert end-users whose focus was to elicit Earth observation requirements. The review provided FEWS NET operational requirements and assessed the usefulness of additional remote sensing data. We analyzed 1342 food security update reports from FEWS NET. The reports consider the biophysical, socioeconomic, and contextual influences on the food security in 17 countries in Africa from 2000 to 2009. The objective was to evaluate the use of remote sensing information in comparison with other important factors in the evaluation of food security crises. The results show that all 17 countries use rainfall information, agricultural production statistics, food prices, and food access parameters in their analysis of food security problems. The reports display large-scale patterns that are strongly related to history of the FEWS NET program in each country. We found that rainfall data were used 84% of the time, remote sensing of vegetation 28% of the time, and gridded crop models 10% of the time, reflecting the length of use of each product in the regions. More investment is needed in training personnel on remote sensing products to improve use of data products throughout the FEWS NET system.

USAID↗
NASA NTRS2021

Characterization Study of TestBed Infrastructure Performance in a Distributed Simulation Environment: Baseline Analysis

Characterization of the performance of Air Traffic Management Exploration (ATM-X) TestBed integration environment has been investigated and documented for one system configuration for progressively increasing traffic. Several statistical parameters were used to assess the performance of the TestBed distributed system such as mean, standard deviation, skewness, and kurtosis of latency, and update rate for aircraft state messages that are transmitted through the simulated system under investigation. It is necessary to assess the performance characteristics of distributed systems in terms of the indicated statistical parameters mentioned above. It is critical to verify the system performance with respect to a researcher’s required system performance. Computer host specifications are documented in terms of Central Processing Unit (CPU) clock speed and core count. Transmission Control Protocol/ Internet Protocol (TCP/IP) message protocol was used for data transmission. The system network topology also contributes to the latency and update rate variations from the one imposed by the data source. The motivation for selecting the TestBed infrastructure as the focus of this study can be attributed to the number of services and capabilities it provides that help simplify the process of preparing and conducting a simulation. These capabilities include an easy to use GUI for simulation configuration, access to TestBed library by the end-user of other simulation software components, a modular adapter paradigm that allows simple connectivity of external software to TestBed, connectivity with other simulation laboratories, and a Software Development Kit (SDK) for quicker development. Two types of traffic generators, Air Traffic Generator (ATG) and Multi Aircraft Control System (MACS) were used to generate messages that were injected into the TestBed distributed environment. Eight different air traffic scenarios with progressively increasing loads were generated for each air traffic simulator. The corresponding air traffic loads between the two simulators had an identical number of aircraft per scenario, but different flight plans. It was observed that the performance of MACS degraded for air traffic scenarios containing more than 200 aircraft (37.5 KB/s nominal throughput). However, ATG performed adequately under all tested air traffic loads up to 1200 aircraft (225. KB/s nominal throughput). The tests show that MACS exhibits better latency performance with smaller aircraft loads when compared to ATG. The tests also show that the TestBed infrastructure successfully transmits 1200 aircraft without significant degradation of its performance. From the latency trends for both MACS and ATG, it is clear that as aircraft load increases, the latency in the system increases as well as its standard deviation. Likewise, the trends for the update data rate for both MACS and ATG show that as the aircraft load increases, so does the standard deviation and mean of the update rates which can be attributed to the performance of MACS and ATG applications. The analysis of the results of this study have proven that the overall system performance is dependent on the individual performance of each system component that is connected to TestBed, which subsequently propagates into the system. All TestBed characterization tests were conducted in SimLabs at NASA Ames Research Center in November 2019. This study addresses the need for a baseline TestBed characterization, and the results will serve as a reference for more complex simulation systems.

Air Traffic Management simulations↗
NASA NTRSDate not supplied

Capturing Complex Multivariate Time Series Interactions to Detect High-Risk Adverse Events During Flight

The reduction of aviation safety metrics below target thresholds continue to drive down the number of aviation fatalities and accidents. To meet future safety demands, sustained efforts by aviation agencies promoting safety assurance processes and systems have prompted ongoing research on identifying and mitigating in-flight risks. With the projected increase in passenger load factor and rollout of more autonomous systems into the national airspace, the need to detect high-risk events in-time or ahead-of-time is becoming increasingly crucial. New anomaly detection and precursor identification algorithms will need to scale to different airframes, levels of autonomy, and system complexity. While the pervasiveness of deep learning has resulted in the development of performant anomaly detection methods, these sophisticated models currently suffer from low end-user interpretability. Building off our previous work on identifying adverse events in multivariate flight data during descent, we propose a data-driven approach for detecting in-flight adverse events caused by the complex interplay of flight variables. Our approach utilizes ordinal patterns of important aircraft stability variables (e.g., airspeed and descent rate) to capture multivariate flight dynamics that can be used to predict the onset of unstable approaches, a high-risk adverse event that can occur during approach. Through the use of ordinal patterns, we aim to create more interpretable detection models of in-flight adverse events that can be translated to future autonomous systems without difficulty. Our analysis shows the presence of distinct ordinal pattern distributions that can be used to predict unstable approaches 1 minute ahead of time with an accuracy of 0.69 and a recall of 0.73 and 30 seconds ahead with an accuracy of 0.70 and a recall of 0.86.

Risk detection↗
NASA NTRSDate not supplied

Capturing Multivariate Time Series Interactions to Detect High‑Risk Instability During Approach

The reduction of aviation safety metrics below target thresholds continue to drive down the number of aviation fatalities and accidents. To meet future safety demands, sustained efforts by aviation agencies promoting safety assurance processes and systems have prompted ongoing research on identifying and mitigating in-flight risks. With the projected increase in passenger load factor and rollout of more autonomous systems into the national airspace, the need to detect high-risk events in-time or ahead-of-time is becoming increasingly crucial. New anomaly detection and precursor identification algorithms will need to scale to different airframes, levels of autonomy, and system complexity. While the pervasiveness of deep learning has resulted in the development of performant anomaly detection methods, these sophisticated models currently suffer from low end-user interpretability. Building off our previous work on identifying adverse events in multivariate flight data during descent, we propose a data-driven approach for detecting in-flight adverse events caused by the complex interplay of flight variables. Our approach utilizes ordinal patterns of important aircraft stability variables (e.g., airspeed and descent rate) to capture multivariate flight dynamics that can be used to predict the onset of unstable approaches, a high-risk adverse event that can occur during approach. Through the use of ordinal patterns, we aim to create more interpretable detection models of in-flight adverse events that can be translated to future autonomous systems without difficulty. Our analysis shows the presence of distinct ordinal pattern distributions that can be used to predict unstable approaches 1 minute ahead of time with an accuracy of 0.69 and a recall of 0.73 and 30 seconds ahead with an accuracy of 0.70 and a recall of 0.86.

Risk detection↗
NASA NTRS2013

Interagency Collaborators Develop and Implement ForWarn, a National, Near Real Time Forest Monitoring Tool

ForWarn is a satellite-based forest monitoring tool that is being used to detect and monitor disturbances to forest conditions and forest health. It has been developed through the synergistic efforts, capabilities and contributions of four federal agencies, including the US Forest Service Eastern Forest and Western Wildland Environmental Threat Assessment Centers, NASA Stennis Space Center (SSC), Department of Energy's (DOE) Oak Ridge National Laboratory (ORNL) and US Geological Survey Earth (USGS) Earth Research Observation System (EROS), as well as university partners, including the University of North Carolina Asheville's National Environmental Modeling and Analysis Center (NEMAC). This multi-organizational partnership is key in producing a unique, path finding near real-time forest monitoring system that is now used by many federal, state and local government end-users. Such a system could not have been produced so effectively by any of these groups on their own. The forests of the United States provide many societal values and benefits, ranging from ecological, economic, cultural, to recreational. Therefore, providing a reliable and dependable forest and other wildland monitoring system is important to ensure the continued health, productivity, sustainability and prudent use of our Nation's forests and forest resources. ForWarn does this by producing current health indicator maps of our nation's forests based on satellite data from NASA's MODIS (Moderate Resolution Imaging Spectroradiometer) sensors. Such a capability can provide noteworthy value, cost savings and significant impact at state and local government levels because at those levels of government, once disturbances are evident and cause negative impacts, a response must be carried out. The observations that a monitoring system like ForWarn provide, can also contribute to a much broader-scale understanding of vegetation disturbances.

Underwood, Lauren↗
NASA NTRS2015

Credibility Assessment of Deterministic Computational Models and Simulations for Space Biomedical Research and Operations

Human missions beyond low earth orbit to destinations, such as to Mars and asteroids will expose astronauts to novel operational conditions that may pose health risks that are currently not well understood and perhaps unanticipated. In addition, there are limited clinical and research data to inform development and implementation of health risk countermeasures for these missions. Consequently, NASA's Digital Astronaut Project (DAP) is working to develop and implement computational models and simulations (M&S) to help predict and assess spaceflight health and performance risks, and enhance countermeasure development. In order to effectively accomplish these goals, the DAP evaluates its models and simulations via a rigorous verification, validation and credibility assessment process to ensure that the computational tools are sufficiently reliable to both inform research intended to mitigate potential risk as well as guide countermeasure development. In doing so, DAP works closely with end-users, such as space life science researchers, to establish appropriate M&S credibility thresholds. We will present and demonstrate the process the DAP uses to vet computational M&S for space biomedical analysis using real M&S examples. We will also provide recommendations on how the larger space biomedical community can employ these concepts to enhance the credibility of their M&S codes.

Mulugeta, Lealem↗
NASA NTRS2018

Toward Long-Term Aquatic Science Products from Heritage Landsat Missions

This paper aims at generating a long-term consistent record of Landsat-derived remote sensing reflectance (Rrs) products, which are central for producing downstream aquatic science products (e.g., concentrations of total suspended solids). The products are derived from Landsat-5 and Landsat-7 observations leading to Landsat-8 era to enable retrospective analyses of inland and nearshore coastal waters. In doing so, the data processing was built into the SeaWiFS Data Analysis System (SeaDAS) followed by vicariously calibrating Landsat-7 and -5 data using reference in situ measurements and near-concurrent ocean color products, respectively. The derived Rrs products are then validated using (a) matchups using the Aerosol Robotic Network (AERONET) data measured by in situ radiometers, i.e., AERONET-OC, and (b) ocean color products at select sites in North America. Following the vicarious calibration adjustments, it is found that the overall biases in Rrs products are significantly reduced. The root-mean-square errors (RMSE), however, indicate noticeable uncertainties due to random and systematic noise. Long-term (since 1984) seasonal Rrs composites over 12 coastal and inland systems are further evaluated to explore the utility of Landsat archive processed via SeaDAS. With all the qualitative and quantitative assessments, it is concluded that with careful algorithm developments, it is possible to discern natural variability in historic water quality conditions using heritage Landsat missions. This requires the changes in Rrs exceed maximum expected uncertainties, i.e., 0.0015 [1/sr], estimated from mean RMSEs associated with the matchups and intercomparison analyses. It is also anticipated that Landsat-5 products will be less susceptible to uncertainties in turbid waters with Rrs(660) > 0.004 [1/sr], which is equivalent of ~1.2% reflectance. Overall, end-users may utilize heritage Rrs products with "fitness-for-purpose" concept in mind, i.e., products could be valuable for one application but may not be viable for another. Further research should be dedicated to enhancing atmospheric correction to account for non-negligible near-infrared reflectance in CDOM-rich and extremely turbid waters.

Pahlevan, Nima↗
NASA NTRS2011

An Integrated Hydrological and Water Management Study of the Entire Nile River System - Lake Victoria to Nile Delta

The Nile basin River system spans 3 million km(exp 2) distributed over ten nations. The eight upstream riparian nations, Ethiopia, Eretria, Uganda, Rwanda, Burundi, Congo, Tanzania and Kenya are the source of approximately 86% of the water inputs to the Nile, while the two downstream riparian countries Sudan and Egypt, presently rely on the river's flow for most of the their needs. Both climate and agriculture contribute to the complicated nature of Nile River management: precipitation in the headwaters regions of Ethiopia and Lake Victoria is variable on a seasonal and inter-annual basis, while demand for irrigation water in the arid downstream region is consistently high. The Nile is, perhaps, one of the most difficult trans-boundary water issue in the world, and this study would be the first initiative to combine NASA satellite observations with the hydrologic models study the overall water balance in a to comprehensive manner. The cornerstone application of NASA's Earth Science Research Results under this project are the NASA Land Data Assimilation System (LDAS) and the USDA Atmosphere-land Exchange Inverse (ALEXI) model. These two complementary research results are methodologically independent methods for using NASA observations to support water resource analysis in data poor regions. Where an LDAS uses multiple sources of satellite data to inform prognostic simulations of hydrological process, ALEXI diagnoses evapotranspiration and water stress on the basis of thermal infrared satellite imagery. Specifically, this work integrates NASA Land Data Assimilation systems into the water management decision support systems that member countries of the Nile Basin Initiative (NBI) and Regional Center for Mapping of Resources for Development (RCMRD, located in Nairobi, Kenya) use in water resource analysis, agricultural planning, and acute drought response to support sustainable development of Nile Basin water resources. The project is motivated by the recognition that accurate, frequent, and spatially distributed estimates of the water balance are necessary for effective water management. This creates a challenge for watersheds that are large, include data poor regions, and/or span multiple nations. All of these descriptors apply to the Nile River basin, yet successful management of the Nile is critical for development and political stability in the region. For this reason, improved hydrological data to support cooperative water management in the Nile basin is a priority for USAID, the US State Department, the World Bank and other international organizations. In this project, the U.S. based research team is working with partners at RCMRD, Nile Basin Initiative (NBI), and their member national-level agencies to develop satellite-based land cover maps, satellite-derived evapotranspiration estimates (using the ALEXI algorithm), and NASA's Land Data Assimilation System (LDAS) customized to match identified information needs. The cornerstone applied sciences product of the project is the development of a customized "Nile LDAS" that will produce optimal estimates of hydrological states and fluxes, as vetted against the in situ observations of NBI and RCMRD member organizations and independent satellite-derived hydrological estimates. Nile LDAS will be applied to improve the reliability of emerging Decision Support Systems in applications that include drought monitoring, reservoir management, and irrigation planning. The end-users such as RCMRD, NBI, Ethiopian and Kenya Meteorological and Famine Early Warning System Network (FEWSNet) will be the eventual benefactors of this work. There will be a capacity building process involving the above end-user organizations and transfer the models and the results for these organizations to execute for future use. The team has already initiated this study and the early results of first years' work are shown. The plan is to complete this work by late 2013.

Habib, Shahid↗
NASA NTRS2001

Ontolology Negotiation Between Scientific Archives

This paper describes an approach to ontology negotiation between information agents. Ontologies are declarative (data driven) expressions of an agent's "world": the objects, operations, facts, and rules that constitute the logical space within which an agent performs. Ontology negotiation enables agents to cooperate in performing a task, even if they are based on different ontologies. 'Me process allows agents to discover ontology conflicts and then, though incremental interpretation, clarification, and explanation, establish a common basis for communicating with each other. The need for ontology negotiation stems from the proliferation of information sources and of agents with widely varying specialty expertise. The unmanageability of massive amounts of web-based information is already becoming apparent. It is starting to have an impact on professions that rely on distributed archived information. If the expansion continues at its present rate without an ontology negotiation process being introduced, there will soon be no way to ensure the accuracy and completeness of information that scientists obtain from sources other than their own experiments. Ontology negotiation is becoming increasingly recognized as a crucial element of scalable agent technology. This is because agents, by their very nature, are supposed to operate with a fair amount of autonomy and independence from their end-users. Part of this independence is the ability to enlist other agents for help in performing a task (such as locating information on the web). The agents enlisted for help may be "owned" by a different end-user or organization (such as a document archive), and there is no guarantee that they will use the same terminology or understand the same concepts (objects, operators, theorems, rules) as the recruiting agent. For NASA, the need for ontology negotiation arises at the boundaries between scientific disciplines. For example: modeling the effects of global warming might involve knowledge about imaging, climate analysis, ecology, demographics, industrial economics, and biology. The need for ontology negotiation also arises at the boundaries between scientific programs. For example, a Principal Investigator may want to use information from a previous mission to complement downloads from the instruments currently deployed.

Bailin, Sidney C.↗
NASA NTRS1989

Integrating NASA's Land Analysis System (LAS) image processing software with an appropriate Geographic Information System (GIS): A review of candidates in the public domain

A user requirements analysis (URA) was undertaken to determine and appropriate public domain Geographic Information System (GIS) software package for potential integration with NASA's LAS (Land Analysis System) 5.0 image processing system. The necessity for a public domain system was underscored due to the perceived need for source code access and flexibility in tailoring the GIS system to the needs of a heterogenous group of end-users, and to specific constraints imposed by LAS and its user interface, Transportable Applications Executive (TAE). Subsequently, a review was conducted of a variety of public domain GIS candidates, including GRASS 3.0, MOSS, IEMIS, and two university-based packages, IDRISI and KBGIS. The review method was a modified version of the GIS evaluation process, development by the Federal Interagency Coordinating Committee on Digital Cartography. One IEMIS-derivative product, the ALBE (AirLand Battlefield Environment) GIS, emerged as the most promising candidate for integration with LAS. IEMIS (Integrated Emergency Management Information System) was developed by the Federal Emergency Management Agency (FEMA). ALBE GIS is currently under development at the Pacific Northwest Laboratory under contract with the U.S. Army Corps of Engineers' Engineering Topographic Laboratory (ETL). Accordingly, recommendations are offered with respect to a potential LAS/ALBE GIS linkage and with respect to further system enhancements, including coordination with the development of the Spatial Analysis and Modeling System (SAMS) GIS in Goddard's IDM (Intelligent Data Management) developments in Goddard's National Space Science Data Center.

Rochon, Gilbert L.↗
NASA NTRS1989

Data system interprobability

Software was developed and tested which allows an end-user to build a book data object in an interactive fashion. The electronic book model was developed for the Library front-end of the DAVID (Distributed Access View Integrated Database) system. It is a complex data object which is capable of holding data of different types and formats. After the task, the plan was to assess the Book model and investigate the possibility of it serving as a knowledge base for a expert system front-end to the DAVID system. For the rest of the fellowship period, data system interoperability was examined. Specifically, a plan was prepared titled Implementations of the Land Analysis System (LAS) to Meet UNEP/GRID Requirements. This plan is aimed at reaching the goal of building one virtual global change information system which will link existing and future data systems allowing earth and space scientists to learn about, locate, access, and correlate data of interest regardless of its physical location. The plan proposed the construction of a master directory (MD) for the European data systems that is equivalent in structure to NASA's MD. The MD is to contain brief, high-level information about existing Earth and space science data sets sufficient for a user to know where data of interest reside and how to go about getting additional information. The plan also outlined the tasks that would be involved to electronically connect the MD system to the various discipline data systems (e.g., LAS) in order to achieve general interroperabilty, that is, the abilty to perform cross-systems searches and exchange of and access to distributed information.

Wakim, Nagi T.↗
NASA NTRS2017

Giovanni in the Cloud: Earth Science Data Exploration in Amazon Web Services

Giovanni is an exploration tool at the NASA Goddard Earth Sciences Data Information Services Center (GES DISC), providing 22 analysis and visualization services for over 1600 Earth Science data variables. Owing to its popularity, Giovanni has experienced a consistent growth in overall demand, with periodic usage spikes attributed to trainings by education organizations, extensive data analysis in response to natural disasters, preparations for science meetings, etc. Furthermore, the new generation of spaceborne sensors and high resolution models have resulted in an exponential growth in data volume with data distributed across the traditional boundaries of data centers. Seamless exploration of data (without users having to worry about data center boundaries) has been a key recommendation of the GES DISC User Working Group. These factors have required new strategies for delivering acceptable performance. The cloud-based Giovanni, built on Amazon Web Services (AWS), evaluates (1) AWS native solutions to provide a scalable, serverless architecture; (2) open standards for data storage in the Cloud; (3) a cost model for operations; and (4) end-user performance. Our preliminary findings indicate that the use of serverless architecture has a potential to significantly reduce development and operational cost of Giovanni. The combination of using AWS managed services, storage of data in open standards, and schema-on-read data access strategy simplifies data access and analytics, in addition to making data more accessible to the end users of Giovanni through popular programming languages.

Giovanni↗
NASA NTRSDate not supplied

Assessing the Needs of NASA's Near Real-Time Earth Observation Products

"The 2017-2027 Decadal Survey for Earth Science and Applications from Space stated that NASA's Earth Science with planned implementation of applications provides sustained earth observations for societal benefits [1]. The Decadal Survey indicated that data latency is invaluable for time-sensitive applications including disaster risk reduction, wildland fire carbon emissions quantification, real-time measurements of the state of the hydrologic systems and many more. Data latency refers to the time between earth observation and data products available to users. During the past 13 years, NASA's Land, Atmosphere Near Real-Time Capability for Earth Observing Systems (LANCE) continues to provide free access to earth observation products that are made available much quicker than routine processing allows. The latency of most LANCE data products is Near Real-time (NRT) which is defined as less than three hours from satellite observations [2]. LANCE is managed by the Earth Science Data and Information System (ESDIS) Project at NASA Goddard Space Flight Center [3], and a User Working Group (UWG) is responsible for providing guidance to LANCE. LANCE data are used by direct users and brokers who add value to the data [4]. NASA Earth Applied Sciences Program (ASP) is one of the primary users of LANCE, which collaborates with partner organizations and provides support to scientists to solve problems in applications of earth observations. ASP promotes the use of LANCE NRT data products to demonstrate applications in decision making, facilitates end-user feedback to the science team to improve data products, and provides information on future demands for research. LANCE supports applications that need a rapid response including detecting wildland fires and volcanic eruptions, tracking smoke, ash and dust plumes, monitoring air quality and tracking extreme weather events such as hurricanes, landslides, and floods. To gather feedback regarding the availability, accessibility and actionability of NASA's NRT data products for societal benefit, three surveys and a few discussions with experts involved in the topic within ASP were conducted from the perspective of users. Feedback has been collected from users who are interested in using low latency NASA data within application communities of agriculture, disasters, water resources, health and air quality, ecological conservation, wildland fires and capacity building. Analysis-ready NRT data products in a variety of formats have been mentioned many times in the collected feedback, especially for applied users with little to no experience using research-grade earth observation products. Users prefer to have products that can be easily integrated into their existing workflows and take their analysis to the data. HDF5 is a commonly used data format for research, but typically requires some conversion to a more friendly format for applications and regular use in decision-making. Users prefer the GeoTIFF data format that can be directly ingested into a GIS mapping software and platform for data analysis and visualization. For example, LANCE’s fire, flood, SO2 and Black Marble Nighttime Blue/Yellow Composite data products have been integrated into NASA Disasters Mapping Portal, which is an GIS-based open data portal, for users in the disaster management community. There are 291 LANCE NRT layers available through GIBS and Worldview, where users can download a snapshot in GeoTIFF format. Operational users expect data to be processed as close to the user as possible. The collected feedback indicates that LANCE fire products within 3 hours latency would meet the needs of the wildland fire community. The ideal latency for volcanic application is 10-15 minutes. Users in Volcanic Ash Advisory Centers (VAAC) reported that the first forecast volcanic product should be issued within 75 minutes from the volcano eruption [5]. Overall, for disaster applications, data latency within 3 hours is useful while latency greater than 12 hours is not timely enough for operational use. Capacity building and training are critical for users to be able to access, interpret and use data products and tools for their decision making, especially for applied users with limited experience using earth observation products. LANCE data products have been used in a number of capacity building projects domestically and internationally [6]. As LANCE continues to bring new products into the system, users request training to utilize LANCE new and upcoming data products and capabilities in their applications. Due to the limitation of bandwidth and downstream flow paths, users in some developing countries need tools to select and download data for a specific area of interest instead of bulk downloads. The collected feedback also shows the lack of available SAR satellite low latency data products. The advantages of SAR to monitor conditions and changes on the ground through darkness, clouds, volcanic ash, and other atmospheric conditions, are appealing to low latency users. For example, terabytes of low latency but cloudy optical images are not helpful in rapidly identifying the extent of flood or fire impacts. LANCE could be complemented with low latency measurements via the upcoming NASA-ISRO Synthetic Aperture Radar (NISAR) mission [7]. Requests for higher spatial resolution products are expressed. A user from the wildland fire management community reported that products with 30-m spatial resolution could be used to detect small fires. The 30-m Landsat OLI fire data is now part of NASA’s Fire Information for Resource Management System (FIRMS) US/Canada [8]. Within the open and free NASA resources, LANCE disseminates NRT data products in a manner that allows them to be accessible and understandable to both scientific and applied users. In many application areas, latency plays an important or even decisive role where low latency earth observations help people to observe areas of interest, detect and track changes in the environment and make timely decisions. NASA’s Earth Applied Sciences Program promotes the use of LANCE NRT products and builds a bridge between application users and research teams. The collected feedback indicates data latency within 3 hours is useful for most of the applications, and shows the needs of user-friendly, analysis-ready products, and requests training on LANCE’s new and upcoming data products. User feedback has been provided to LANCE UWG for guidance and recommendations, and for translating findings into something actionable.

Tian Yao↗