Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Web Services”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

LAADS DAAC Migrates to the Cloud: Lessons Learned from Communicating About Earth Science Data on the Cloud

The Level-1 and Atmosphere Archive Distribution System (LAADS) Distributed Active Archive Center (DAAC) is migrating data to the cloud. As one of twelve DAACS supported by NASA’s Earth Science Data and Information System (ESDIS), LAADS is using moving away from on premise data storage facilities to migrating to Amazon Web Services, where the massive archive of data from the Moderate Imaging Spectroradiometer (MODIS) and the Visible Infrared Imaging Radiometer Suite (VIIRS) will be available for download and post-processing transformations online. The migration is happening in three phases and LAADS is concluding its beta testing period. This poster shows the lessons learned from communicating with a select group of users about how to effectively educate data users on using data in the cloud.

Tassia Owen↗
NASA NTRSDate not supplied

NASA GEOS Composition Forecast System, GEOS-CF

NASA's Global Modeling and Assimilation Office (GMAO) produces high-resolution analysis and forecasts for weather, aerosols, and air quality. Since 2019, the NASA Global Earth Observing System (GEOS) model provides global near-real-time historical estimates and daily 5-day forecasts of atmospheric composition to the public at unprecedented horizontal resolution of 0.25 degrees (~25 km) from the surface up to the lower mesosphere. This composition forecast system (“GEOS-CF”) combines the operational GEOS weather forecasting model with the state-of-the-science GEOS-Chem chemistry module to deliver detailed analysis of a wide range of air pollutants, including the policy-relevant species such as ozone, carbon monoxide, nitrogen oxides, sulfur dioxide and fine particulate matter (PM2.5). The GEOS-CF is a tool for scientists and the public health community. This presentation will cover 1) an overview of the GEOS-CF modeling framework and data/visualization access, 2) examples of current and future applications to support NASA missions (e.g., a priori for trace gas retrievals by TEMPO, ground-based instrument teams and field campaigns), and 3) research and development activities as the GEOS-CF system continues to evolve to include multi-constituent data assimilation, near-real time emission adjustment estimates, down-scaling methods to urban-scale, and data access on Google Earth Engine, Amazon Web Services, and other platforms to integrate our state-of-the-science air quality information onto platforms used by stakeholders, air quality managers, and the public.

K. Emma Knowland↗
NASA NTRSDate not supplied

A Global Agroclimatology Solar Insolation and Meteorological Parameter Data Base: Meteorological Evaluation and Application Updates to NASA POWER

NASA’s Prediction of Worldwide Energy Resource (POWER) project facilitates the use of NASA Earth Science data holdings within the energy, agricultural, and architectural industries. POWER packages solar and meteorological data at various temporal levels from several NASA projects in a user friendly GIS-enabled web services system (https://power.larc.nasa.gov). Among other possible formats, data users can request POWER data in a column formatted DSSAT ASCII format by entering single site-specific coordinates or from an area by entering the appropriate area coordinate bounds. We present here recent evaluations of the POWER meteorological data through comparisons with global surface site measurements. While most meteorological parameters are taken from the NASA Modern Era Retrospective-analysis for Research and Applications (MERRA-2) data set, an alternate precipitation source from Integrated Multi-satellitE Retrievals for GPM (IMERG) is available and included in this evaluation. Expected updates to both IMERG and solar insolation sources will be evaluated as they become available.

J. Colleen Mikovitz↗
NASA NTRSDate not supplied

Advancing Open Source Science Initiatives Through Public-Private Partnerships

Collaboration is fundamental to advancing open science within the science community. With the recent developments in technology and research, the establishment of formal partnerships between the private sector and government agencies are needed to bridge the knowledge gaps and expedite the time to actionable science. NASA’s Interagency Implementation and Advanced Concepts Team (IMPACT) seeks to address this challenge by establishing non-reimbursable Space Act Agreements with industry leaders in cloud computing, artificial intelligence (AI) and machine learning. The purpose of these agreements is to advance open source science initiatives in the areas of data discovery, access and use of high value NASA science data sets on the cloud. As well as, jointly work on common research problems to accelerate the development and adoption of new AI technologies. Current success stories include co-locating NASA datasets from multiple science disciplines on one platform using Amazon Web Services Open Data Registry, developing AI Foundation Models for Science with IBM and co-hosting training workshops and tutorials for the science community aimed at providing hands-on experience with using NASA data and AI models on the cloud. In summary, we will present an overview of our partnerships supporting open source science initiatives, describe current activities and lessons learned that may be useful to others considering similar partnerships with the private sector.

Elizabeth Fancher↗
NASA NTRSDate not supplied

Estimating Future Changes of Energy Demand for Heating and Cooling Buildings at NASA Centers GC23J-1198

With its unique and trusted earth observations, NASA is a critical source in informing decisions that will help achieve the U.S. goal of Net-Zero Greenhouse Gas (GHG) Emissions by 2050. NASA’s Prediction of Worldwide Energy Resource (POWER) project facilitates the use of NASA Earth Science data holdings within the energy, agricultural, and building heating/cooling design industries. POWER packages solar and meteorological data from several NASA projects in a user friendly GIS-enabled web services system (https://power.larc.nasa.gov). As part of the development of new data products to support the energy and building heating/cooling design communities, we estimate the changes in energy required to heat and cool buildings in the future climate at 14 different NASA site locations spread throughout the continental United States, as projected by CMIP6 climate models under different emissions scenarios. Bias-corrected downscaled time series of meteorological variables are taken from NASA Earth Exchange (NEX) Global Daily Downscaled Projections (GDDP-CMIP6) downscaled climate model data. The spread between the different model projections is accounted for by analyzing both the ensemble average of 22 CMIP6 models and 6 representative models with different climate sensitivities and different interannual variability. Changes in energy use are estimated in two ways. First, changes in the total annual heating and cooling degree days (HDD and CDD, respectively) are calculated relative to the current climate. This is done at all 14 sites. Second, the downscaled time series are used as inputs into RETScreen(R), a clean energy management decision tool, to give an estimate of heating/cooling energy use for a typical office building. We use this estimation method with model data at Langley Research Center. In the next 50 years, the annual total of HDD (CDD) is projected to decrease by 8-38% (increase by 5-28%) at all sites, with the increase in CDD typically a larger magnitude the decrease in HDD. For a typical small office building at Langley Research Center, the amount of energy needed to cool increases by 33-54% and the amount of energy to heat decreases by 29-40%. POWER is working to develop long term climate data services based on these results to include in future data products to provide to users.

Bradley M. Hegyi↗
NASA NTRSDate not supplied

Open Science in Action: The Role of SWxSOC in Expedited Data Release and Cloud-based Data Processing for Heliophysics Missions

NASA's Space Weather Science Operations Center (SWxSOC) is an effort to develop a multi-mission Science Operations Center for the community and specifically Space Weather missions that require data products to be released consistently and quickly. The SWxSOC is committed to Open Science in its approach to software development and data product releases. We are currently supporting the Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) that will fly on the Lunar Gateway and the PADRE Small Sat mission. SWxSOC has established an open-source, reusable solution for transitioning data management from on-premises to the cloud, processing data files, and setting up a cloud-based analysis environment to monitor instrument anomalies. Leveraging Amazon Web Services (AWS) and making open-source tools available on GitHub, HERMES exemplifies NASA's commitment to open-source standardization, showcasing the real-world effectiveness of cloud technology in data processing, analysis, and observability. This enhances current operations and ensures faster, standardized deployments for future missions.

hermes↗
NASA NTRSDate not supplied

Global-to-local air quality forecasts using the NASA GEOS Composition Forecast System

Since 2019, the NASA Global Earth Observing System (GEOS) model has been used to generate global, near-real-time estimates and daily five-day forecasts of atmospheric composition at a horizontal resolution of 0.25 degrees (~25 km) from the surface up to the lower mesosphere. This composition forecast system (“GEOS-CF”) combines the GEOS weather forecasting model with the state-of-the-science GEOS-Chem chemistry module to deliver detailed analysis of a wide range of air pollutants, including the policy-relevant species such as ozone, carbon monoxide, nitrogen oxides, sulfur dioxide and fine particulate matter (PM2.5). Because GEOS-CF includes atmospheric levels up through the stratosphere, this system has been leveraged to support the Tropospheric Emissions: Monitoring of Pollution (TEMPO) satellite mission and provide stratospheric intrusion alerts to ground-based monitoring stations. We will present recent advances to GEOS-CF which target increased computational efficiency and accuracy. These include the incorporation of simplified chemistry mechanisms to accelerate model forecasts, use of model-observation data fusion techniques to provide highly localized forecasts, and assimilation of satellite observations to produce more accurate model analyses. We further discuss our attempts to make these tools publicly available on platforms outside the NASA domain, such as Google Earth Engine and Amazon Web Services with the goal to facilitate the integration of state-of-the-science air quality information onto platforms used by stakeholders, air quality managers, and the public.

Emma Knowland↗
NASA NTRSDate not supplied

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗
NASA NTRSDate not supplied

Open-Source Data Engineering at NASA: CCMC's Approach to Managing Petabyte-Scale Heliophysics Data

The Community Coordinated Modeling Center (CCMC) at NASA Goddard Space Flight Center (GSFC) leads heliophysics research by providing open access to numerous models and their outputs. Our resources are available on-demand and continuously updated with real-time data, covering sun-earth interactions across multiple domains. These domains include coronal, heliosphere, inner and global magnetosphere, ionosphere, thermosphere, and lower atmosphere interactions. Operating in a hybrid environment, CCMC utilizes both self-owned hardware and Amazon Web Services (AWS) cloud infrastructure. Managing petabytes of data across multiple locations necessitates robust data engineering solutions. To address this challenge, CCMC has adopted industry-standard and open-source tools. We use Apache Airflow as our primary data engineering platform, Python for scripting and data processing, and GitLab for version control and CI/CD. Additionally, we employ Kubernetes for containerized services, Grafana and Prometheus for metrics and monitoring, and Terraform and Puppet for reproducible infrastructure as code. This presentation will discuss lessons learned from our data engineering experiences, platforms evaluated but found unsuitable for our scientific data requirements, and specific techniques developed to enhance data transfer speed and reliability. By using these technologies effectively, CCMC continues to advance heliophysics research through efficient data management and open-access modeling.

space weather↗
NASA NTRS2016

CMR Catalog Service for the Web

With the impending retirement of Global Change Master Directory (GCMD) Application Programming Interfaces (APIs) the Common Metadata Repository (CMR) was charged with providing a collection-level Catalog Service for the Web (CSW) that provided the same level of functionality as GCMD. This talk describes the capabilities of the CMR CSW API with particular reference to the support of the Committee on Earth Observation Satellites (CEOS) Working Group on Information Systems and Services (WGISS) Integrated Catalog (CWIC).

CMR↗
NASA NTRS2011

Development of a Web-Based Visualization Platform for Climate Research Using Google Earth

Recently, it has become easier to access climate data from satellites, ground measurements, and models from various data centers, However, searching. accessing, and prc(essing heterogeneous data from different sources are very tim -consuming tasks. There is lack of a comprehensive visual platform to acquire distributed and heterogeneous scientific data and to render processed images from a single accessing point for climate studies. This paper. documents the design and implementation of a Web-based visual, interoperable, and scalable platform that is able to access climatological fields from models, satellites, and ground stations from a number of data sources using Google Earth (GE) as a common graphical interface. The development is based on the TCP/IP protocol and various data sharing open sources, such as OPeNDAP, GDS, Web Processing Service (WPS), and Web Mapping Service (WMS). The visualization capability of integrating various measurements into cE extends dramatically the awareness and visibility of scientific results. Using embedded geographic information in the GE, the designed system improves our understanding of the relationships of different elements in a four dimensional domain. The system enables easy and convenient synergistic research on a virtual platform for professionals and the general public, gr$tly advancing global data sharing and scientific research collaboration.

Sun, Xiaojuan↗
NASA NTRS2013

Development of WMS Capabilities to Support NASA Disasters Applications and App Development

During the last year several significant disasters have occurred such as Superstorm Sandy on the East coast of the United States, and Typhoon Bopha in the Phillipines, along with several others. In support of these disasters NASA's Short‐term Prediction Research and Transition (SPoRT) Center delivered various products derived from satellite imagery to help in the assessment of damage and recovery of the affected areas. To better support the decision makers responding to the disasters SPoRT quickly developed several solutions to provide the data using open Geographical Information Service (GIS) formats. Providing the data in open GIS standard formats allowed the end user to easily integrate the data into existing Decision Support Systems (DSS). Both Tile Mapping Service (TMS) and Web Mapping Service (WMS) were leveraged to quickly provide the data to the end‐user. Development of the deliver methodology allowed quick response to rapidly developing disasters and enabled NASA SPoRT to bring science data to decision makers in a successful research to operations transition.

Bell, Jordan R.↗
NASA NTRS2013

Development of WMS Capabilities to Support NASA Disasters Applications and App Development

During the last year several significant disasters have occurred such as Superstorm Sandy on the East coast of the United States, and Typhoon Bopha in the Phillipines, along with several others. In support of these disasters NASA's Short‐term Prediction Research and Transition (SPoRT) Center delivered various products derived from satellite imagery to help in the assessment of damage and recovery of the affected areas. To better support the decision makers responding to the disasters SPoRT quickly developed several solutions to provide the data using open Geographical Information Service (GIS) formats. Providing the data in open GIS standard formats allowed the end user to easily integrate the data into existing Decision Support Systems (DSS). Both Tile Mapping Service (TMS) and Web Mapping Service (WMS) were leveraged to quickly provide the data to the end‐user. Development of the deliver methodology allowed quick response to rapidly developing disasters and enabled NASA SPoRT to bring science data to decision makers in a successful research to operations transition.

Bell, Jordan R.↗
NASA NTRS2013

A Web-Based Search Service to Support Imaging Spectrometer Instrument Operations

Imaging spectrometers yield rich and informative data products, but interpreting them demands time and expertise. There is a continual need for new algorithms and methods for rapid first-draft analyses to assist analysts during instrument opera-tions. Intelligent data analyses can summarize scenes to draft geologic maps, searching images to direct op-erator attention to key features. This validates data quality while facilitating rapid tactical decision making to select followup targets. Ideally these algorithms would operate in seconds, never grow bored, and be free from observation bias about the kinds of mineral-ogy that will be found.

hyperspectral imagery↗
NASA NTRS2012

Integrating NASA Satellite Data Into USDA World Agricultural Outlook Board Decision Making Environment To Improve Agricultural Estimates

The USDA World Agricultural Outlook Board (WAOB) is responsible for monitoring weather and climate impacts on domestic and foreign crop development. One of WAOB's primary goals is to determine the net cumulative effect of weather and climate anomalies on final crop yields. To this end, a broad array of information is consulted. The resulting agricultural weather assessments are published in the Weekly Weather and Crop Bulletin, to keep farmers, policy makers, and commercial agricultural interests informed of weather and climate impacts on agriculture. The goal of the current project is to improve WAOB estimates by integrating NASA satellite precipitation and soil moisture observations into WAOB's decision making environment. Precipitation (Level 3 gridded) is from the TRMM Multi-satellite Precipitation Analysis (TMPA). Soil moisture (Level 2 swath and Level 3 gridded) is generated by the Land Parameter Retrieval Model (LPRM) and operationally produced by the NASA Goddard Earth Sciences Data and Information Services Center (GBS DISC). A root zone soil moisture (RZSM) product is also generated, via assimilation of the Level 3 LPRM data by a land surface model (part of a related project). Data services to be available for these products include GeoTIFF, GDS (GrADS Data Server), WMS (Web Map Service), WCS (Web Coverage Service), and NASA Giovanni. Project benchmarking is based on retrospective analyses of WAOB analog year comparisons. The latter are between a given year and historical years with similar weather patterns and estimated crop yields. An analog index (AI) was developed to introduce a more rigorous, statistical approach for identifying analog years. Results thus far show that crop yield estimates derived from TMPA precipitation data are closer to measured yields than are estimates derived from surface-based precipitation measurements. Work is continuing to include LPRM surface soil moisture data and model-assimilated RZSM.

Teng, William↗
NASA NTRS2016

Web Map Apps using NASA's Earth Observing Fleet

Through the miracle of open web mapping services for satellite imagery, a garden of new applications has sprouted to monitor the planet across a variety of domains. The Global Imagery Browse Services (GIBS) provide free and open access to full resolution imagery captured by NASAs Earth observing fleet. Spanning 15+ years and running through as recently as a few hours ago, GIBS aims to provide a general-purpose window into NASA's vast archive of the planet. While the vast nature of this archive can be daunting, many domain-specific applications have been built to meet the needs of their respective communities. This presentation will demonstrate a diverse set of these new applications which can take planetarium visitors into (virtual) orbit, guide fire resource managers to hotspots, help anglers find their next catch, illustrate global air quality patterns to local regulators, and even spur a friendly competition to find clouds which are shaped the most like cats. We hope this garden will continue to grow and will illustrate upcoming upgrades to GIBS which may open new pathways for development. data visualization, web services, open access

data visualization↗