Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Amazon”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

519 records · Page 29
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Sampling Biases of Space-Based Observations of XCO2 Associated With South American Biomass Burning Events During 2017-2020

- We examine time series of OCO-2 xCO 2 observations coincident with other remotely sensed and in-situ observations to better understand external sampling effects. - The OCO-2 Level 3 assimilation product fills in gaps where OCO-2 does not have observations. - Although the Level 3 clearly shows the increased CO 2 over the Amazon associated with the September 2017 biomass burning event, the total amount of CO 2 may be underestimated because of a sampling bias. - Since TCCON is also a remotely sensed product, it may suffer the same sampling biases associated with biomass burning events as OCO-2. - Aircraft data show that there is significant variation in xCO 2 with altitude. - The OCO-2 fused products created by kriging may be better than the assimilated product at detecting deviations from the average state.

OCO↗
NASA NTRSDate not supplied

Global-to-local air quality forecasts using the NASA GEOS Composition Forecast System

Since 2019, the NASA Global Earth Observing System (GEOS) model has been used to generate global, near-real-time estimates and daily five-day forecasts of atmospheric composition at a horizontal resolution of 0.25 degrees (~25 km) from the surface up to the lower mesosphere. This composition forecast system (“GEOS-CF”) combines the GEOS weather forecasting model with the state-of-the-science GEOS-Chem chemistry module to deliver detailed analysis of a wide range of air pollutants, including the policy-relevant species such as ozone, carbon monoxide, nitrogen oxides, sulfur dioxide and fine particulate matter (PM2.5). Because GEOS-CF includes atmospheric levels up through the stratosphere, this system has been leveraged to support the Tropospheric Emissions: Monitoring of Pollution (TEMPO) satellite mission and provide stratospheric intrusion alerts to ground-based monitoring stations. We will present recent advances to GEOS-CF which target increased computational efficiency and accuracy. These include the incorporation of simplified chemistry mechanisms to accelerate model forecasts, use of model-observation data fusion techniques to provide highly localized forecasts, and assimilation of satellite observations to produce more accurate model analyses. We further discuss our attempts to make these tools publicly available on platforms outside the NASA domain, such as Google Earth Engine and Amazon Web Services with the goal to facilitate the integration of state-of-the-science air quality information onto platforms used by stakeholders, air quality managers, and the public.

Emma Knowland↗
NASA NTRS2024

Accounting for 3D Radiative Effects in MODIS Aerosol Retrievals near Clouds using CALIPSO Observations

Retrievals of aerosol properties near clouds from passive remote sensing is challenging. Sunlight scattered by clouds into nearby clear regions can effectively enhance the clear area reflectance. These cloud 3D radiative effects may lead to large biases in aerosol retrievals if uncorrected, risking an incorrect interpretation of satellite observations for aerosol-cloud interaction in cloudy atmosphere. In earlier studies, we developed a simple two-layer model (2LM) to estimate the cloud-induced clear-sky radiance enhancements in cloud fields. In this study, we take advantage of CALIPSO lidar observations, which should not be affected by the 3D radiative effect, to study passive aerosol retrievals in cloud fields in the Amazon region, specifically those produced by the operational Dark Target algorithm applied to Aqua-MODIS. From two-years’ worth of co-located CALIPSO/MODIS aerosol retrievals, we find a larger increase in operationally retrieved MODIS AOD from clear to cloudy regions (~0.075 or ~40%) than for the CALIPSO AOD (~0.021 or ~20%). The much larger increase in MODIS AOD is mainly due to the 3D radiative effects. After using the 2LM model to account for cloud 3D radiative effects, the clear to cloudy increase in MODIS AOD was reduced to ~0.043 (~23%), much closer to CALIPSO observations. The 3D corrected average MODIS AOD for cloudy scenes is significantly larger than AOD for clear conditions, even for cloud fraction (CF) less than 0.1, suggesting aerosols in cloudy scenes are characteristically different from aerosols in clear conditions. Furthermore, the 3D correction of AOD (i.e., τ_1D-τ_3D) increases linearly with CF for a large range of CF. We have also examined the impact of the 3D effect on aerosol Ångström Exponent (AE) and fine model fraction (FMF) of AOD. We found that the uncorrected average AE and FMF depend strongly on CF, ~25% increase in AE (decrease in particle size) and ~60% increase in FMF as CF increases from 0.05 to 0.45. The 3D correction leads to smaller average AE (bigger particle size) and FMF that are almost independent of CF. Thus, the 3D corrected aerosol properties are expected to provide more accurate information for better understanding aerosol-cloud interactions.

MODIS↗
NASA NTRSDate not supplied

Evaluation of Regional Water and Energy Balance in Contemporary Reanalyses

Regional to continental water and energy balance in reanalyses provide crucial information on the climate and climate variations in that region and can contrast other regions. Reanalyses are a valuable tool in piecing together the complete balance owing to the incorporation of the budgets in the background model and the assimilation of observation. On the other hand, the background model has its own biases and observational assimilation can lead to non-negligible tendencies within the budgets, and these can vary over space and time. Here, we will compare the balance within several reanalyses and how they have evolved over recent decades. Several observational data products will provide reference points in the comparison. In addition, a recent project has integrated observations of the water and energy budgets in an optimization that aims to reduce the imbalance of regional budgets in using observational terms from disparate sources. In evaluating the regional balances, we will incorporate, when available, the water and energy convergence terms as well as their analysis increments (which may be diagnosed as residuals). The reanalyses considered here include: Japanese Reanalyses for Three Quarters Century (JRA3Q), ECMWF Reanalysis version 5 (ERA5), Modern Era Retrospective-analysis for Research and Applications version 2 (MERRA-2) and the NCEP Reanalysis II (NCEPR2). NCEPR2 is representative of the late 90s technology, while the others represent the contemporary climate reanalyses presently available. We will discuss the regional balances over key river basins (e.g. Mississippi and Amazon), and a range of continents including those well observed (North America and Europe) and those with fewer consistent observations (e.g. Africa). These contrasting regions show the degree of advancement in reanalyses and expose areas in need of improvement. The results also demonstrate the usefulness of producing complete atmospheric water and energy budgets as part of the diagnostic output.

Michael G Bosilovich↗
NASA NTRSDate not supplied

NASA Power: Global Solar Insolation, Meteorological Parameter Data, and Web Services to Support Sustainable Building Design and Operations

The buildings industry is currently striving to adopt green solutions to make infrastructure more energy-efficient in order to meet the 2050 net-zero climate goals. This planning requires reliable environmental datasets that are crucial in designing, building, and maintaining our world’s-built environment, as well as other energy-related processes and investments. This webinar for the National Institute of Building Sciences provides an overview of NASA’s Prediction Of Worldwide Energy Resources (POWER) Project that informs decision-making and development for sustainable building design and operations by enabling public open discovery, efficient access, and convenient distribution of NASA’s Earth Observations and global atmospheric model datasets. POWER’s datastore is comprised of solar radiation and surface meteorology parameters, spanning nearly 40 years of hourly data, that are easily accessible via several access methods and tools to support three focus areas: 1) renewable energy deployment and management, 2) sustainable infrastructure, and 3) agroclimatology applications. POWER and NASA Earth Science both plan future data parameters, updated tools, and improved observations that could directly support U.S. and international sustainable development goals, climate strategies, and building information modeling. To this end, solar data from several NASA projects and meteorological data from NASA assimilation models have already been reformatted and disseminated to the public via a user-friendly web GIS-enabled based data portal through the POWER Project. POWER data is analysis-ready and accessible through an Application Programming Interface (API), ArcGIS Image Services, and the project’s Data Access Viewer enhanced (DAVe), an interactive online tool. The POWER DAVe also features data consistent with ASHRAE Climate Design Conditions and has developed web image services showing Building Climate Zones and their variability. Through those tools, the data can be downloaded into multiple formats that support the infrastructure community, including CSV and Energy Plus Weather (EPW). POWER’s entire data product catalog is available through Amazon Web Services (AWS) Open Data Registry (ODR) via a free and publicly accessible Simple Storage Service (S3). This webinar provides a full overview of the NASA POWER Project's data and services developed in collaboration with the sustainable infrastructure community. Examples of how the renewable energy and building communities have utilized POWER data products to make decisions and a preview of future data product expansion, including climate projections, and web services will also be provided. Additionally, use case stories from our broad community of users will be presented.

Paul W. Stackhouse↗
NASA NTRSDate not supplied

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗
NASA NTRSDate not supplied

Evaluation of Regional Water and Energy Balance in Contemporary Reanalyses

Regional to continental water and energy balance in reanalyses provide crucial information on the climate and climate variations in that region and can contrast other regions. Reanalyses are a valuable tool in piecing together the complete balance owing to the incorporation of the budgets in the background model and the assimilation of observation. On the other hand, the background model has its own biases and observational assimilation can lead to non-negligible tendencies within the budgets, and these can vary over space and time. Here, we will compare the balance within several reanalyses and how they have evolved over recent decades. Several observational data products will provide reference points in the comparison. In addition, a recent project has integrated observations of the water and energy budgets in an optimization that aims to reduce the imbalance of regional budgets in using observational terms from disparate sources. In evaluating the regional balances, we will incorporate, when available, the water and energy convergence terms as well as their analysis increments (which may be diagnosed as residuals). The reanalyses considered here include: Japanese Reanalyses for Three Quarters Century (JRA3Q), ECMWF Reanalysis version 5 (ERA5), Modern Era Retrospective-analysis for Research and Applications version 2 (MERRA-2) and the NCEP Reanalysis II (NCEPR2). NCEPR2 is representative of the late 90s technology, while the others represent the contemporary climate reanalyses presently available. We will discuss the regional balances over key river basins (e.g. Mississippi and Amazon), and a range of continents including those well observed (North America and Europe) and those with fewer consistent observations (e.g. Africa). These contrasting regions show the degree of advancement in reanalyses and expose areas in need of improvement. The results also demonstrate the usefulness of producing complete atmospheric water and energy budgets as part of the diagnostic output.

Michael Bosilovich↗
NASA NTRSDate not supplied

Open-Source Data Engineering at NASA: CCMC's Approach to Managing Petabyte-Scale Heliophysics Data

The Community Coordinated Modeling Center (CCMC) at NASA Goddard Space Flight Center (GSFC) leads heliophysics research by providing open access to numerous models and their outputs. Our resources are available on-demand and continuously updated with real-time data, covering sun-earth interactions across multiple domains. These domains include coronal, heliosphere, inner and global magnetosphere, ionosphere, thermosphere, and lower atmosphere interactions. Operating in a hybrid environment, CCMC utilizes both self-owned hardware and Amazon Web Services (AWS) cloud infrastructure. Managing petabytes of data across multiple locations necessitates robust data engineering solutions. To address this challenge, CCMC has adopted industry-standard and open-source tools. We use Apache Airflow as our primary data engineering platform, Python for scripting and data processing, and GitLab for version control and CI/CD. Additionally, we employ Kubernetes for containerized services, Grafana and Prometheus for metrics and monitoring, and Terraform and Puppet for reproducible infrastructure as code. This presentation will discuss lessons learned from our data engineering experiences, platforms evaluated but found unsuitable for our scientific data requirements, and specific techniques developed to enhance data transfer speed and reliability. By using these technologies effectively, CCMC continues to advance heliophysics research through efficient data management and open-access modeling.

space weather↗
NASA NTRSDate not supplied

NASA POWER: Providing Analysis-Ready, Cloud-Optimized Data for AI /ML Training and Applications in Earth Science

As global demand for sustainable development grows, the integration of Earth Observation (EO) data into decision making frameworks has become a primary objective for the scientific community. The NASA Prediction of Worldwide Energy Resources (POWER) project serves as a bridge between NASA EO data and the specialized needs of the renewable energy, sustainable infrastructure and agroclimatology communities. In this poster presentation we will present an overview of POWER data products and services along with its use in diverse research to decision-making workflows. By providing over 40 years of high-resolution historical, hourly and daily solar and meteorological data, POWER transforms satellite observations and global model reanalysis into actionable, Analysis-Ready Dataset (ARD). Currently, the project delivers over 250 industry-friendly parameters to the users from different NASA datasets like CERES SYN1Deg, MERRA-2, and IMERG alongside downscaled CMIP6 climate model data, fulfilling over 16 million requests from 50,000 unique users monthly. To ensure data quality and traceability, these parameters are rigorously validated against the ground-based observations from the Baseline Surface Radiation Network (BSRN) and the Global Surface Summary of the Day (GSOD) – these results will be discussed in the presentation. A newly introduced web-based PaRameter Uncertainty ViEwer (PRUVE) tool will be presented that provides an online validation platform to the users that benchmarks satellite-based and assimilation data products against these surface measurements. To reduce technical barriers to data adoption, POWER data is accessible through RESTful APIs, ESRI ArcGIS Image Services, a web-based Data Access Viewer tool, allowing users to visualize, validate and apply the dataset. For efficient data delivery POWER data is cloud-optimized into Zarr datastore accessible through NASA managed Amazon S3 ensures high-performance allowing users to integrate EO directly into operational pipelines. These customized services will be presented. Use cases from application will be presented from the energy sector - such as for design of generation systems, performance monitoring of solar power plants, in infrastructure sector- optimizing building energy efficiency and thermal comfort, in agriculture – such as driving crop simulation and yield forecasting models to enable climate resilient farming. Furthermore, the shift toward machine learning (ML) in EO research that has positioned POWER as a key provider for training datasets which will be discussed. Use-cases will be presented to showcase how NASA data is enabling the development of predictive tools for climate variability and resource management. The poster will present POWER’s future plans including technology development to enhance data traceability and reproducibility and improving I/O performance to support the rapid integration of new EO products, ensuring that POWER remains a robust scalable backend for the evolving landscape of AI-driven Earth Science. Additionally, POWER is developing an AI Agent and an MCP-Server to enable industry AI-Agentic workflows.

Neha Khadka↗
NASA NTRS1996

(abstract) The Evolving Spaceborne Radar Data Support to Earth Science and Operations at the Alaska SAR Facility

The Alaska SAR Facility (ASF) has been receiving, processing, archiving, and distributing data for Earth scientists and operations since it began receiving data in 1991. Four radar satellites are now being handled. Recent developments have served to increase the level of services of ASF to the Earth science community considerably. These developments are discussed.

mapping radar interferometry Alaska topography ant↗
NASA NTRS2016

Fast Track to the Cloud: Design Patterns for 12-Factor Earth Sciences Applications

As expanding service offerings and decreasing prices make the cloud increasingly attractive to Earth Science applications, there are nontrivial practical considerations which can hinder its meaningful use. In this talk, we will discuss architectural recommendations and lessons learned while working on EOSDIS' cloud efforts, particularly the NASA-compliant General Application Platform (NGAP) and its associated applications. Prominent in our findings is the importance of 12-factor design patterns and the powerful "wins" they enable in the cloud. We will share our strategies for "fast-tracking" applications to the cloud --whether they be legacy, planned for the future, or somewhere in between.

cloud↗
NASA NTRS2018

Spatially-Explicit Monitoring of Crop Photosynthetic Capacity Through the Use of Space-Based Chlorophyll Fluorescence Data

Plant functional traits such as photosynthetic capacity are critical parameters for terrestrial biosphere models. However, their spatial and temporal characteristics are still poorly represented. In this study, we used satellite observations of sun-induced fluorescence (SIF) to estimate top-of-canopy photosynthetic capacity (maximum carboxylation rate, V(sub cmax) at a reference temperature of 25 deg C) for crops, which was in turn utilized to simulate regional gross primary production (GPP). We first estimate the key parameter, V(sub cmax), in the widely-used FvCB photosynthesis model using field measurements of CO2 and water fluxes during 2007-2012 at seven crop eddy covariance flux sites over the US Corn Belt. The results showed that satellite far-red SIF retrievals have a stronger link to V(sub cmax) at the seasonal scale (R(squared)=0.70 for C4 and R(squared)=0.63 for C3 crop) as compared with widely-used vegetation indices. We calibrate an empirical model linking V(sub cmax) with SIF that was used to estimate spatially and temporally varying crop V(sub cmax) for the US Corn Belt region. The resulting V(sub cmax) maps are used together with meteorological data from MERRA reanalysis data and vegetation structural parameters derived from the satellite- based spectral reflectance data to constrain the Soil-Canopy Observation of Photosynthesis and Energy (SCOPE) balance model in order to estimate regional crop GPP. Our results show a substantial improvement in the seasonal and spatial patterns of cropland GPP when compared with crop yield inventory data. The evaluation with tall tower atmospheric CO2 measurements further supports our estimation of spatiotemporal V(sub cmax) from space-borne SIF. Considering that SIF has a direct link to photosynthetic activity, our findings highlight the potential to infer regional V(sub cmax) using remotely sensed SIF data and to use this information for a better quantification of regional cropland carbon cycles.

Drought↗