Context-aware implicit neural representations to compress Earth systems model data
Not provided.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not provided.
The Monthly Gridded TOA/Surface Fluxes and Clouds (SFC) product contains a month of space and time averaged Clouds and the Earth's Radiant Energy System (CERES) data for a single scanner instrument. The SFC is also produced for combinations of scanner instruments. All instantaneous shortwave, longwave, and window fluxes at the Top-of-the-Atmosphere (TOA) and surface from the CERES SSF product for a month are sorted by 1-degree spatial regions and by the local hour of observation. The mean of the instantaneous fluxes for a given region-hour bin is determined and recorded on the SFC along with other flux statistics and scene information. These average fluxes are given for both clear-sky and total-sky scenes. The regional cloud properties are column averaged and are included on the SFC. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2005-03-31] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=100] [Data_Resolution: Latitude_Resolution=1 degree; Longitude_Resolution=1 degree; Horizontal_Resolution_Range=100 km - < 250 km or approximately 1 degree - < 2.5 degrees; Temporal_Resolution=1 hour; Temporal_Resolution_Range=Hourly - < Daily].
The ES-8 archival data product contains a 24-hour, single-satellite, instantaneous view of scanner fluxes at the top-of-atmosphere (TOA) reduced from spacecraft altitude unfiltered radiances using Earth Radiation Budget Experiment (ERBE) scanner Inversion algorithms and the ERBE shortwave (SW) and longwave (LW) Angular Distribution Models (ADMs). The ES-8 also includes the total (TOT), SW, LW, and window (WN) channel radiometric data; SW, LW, and WN unfiltered radiance values; and the ERBE scene identification for each measurement. These data are organized according to the CERES 3.3-second scan into 6.6-second records. As long as there is one valid scanner measurement within a record, the ES-8 record will be generated. The following CERES ES8 data sets are currently available: CER_ES8_TRMM-PFM_Edition1 CER_ES8_TRMM-PFM_Edition2 CER_ES8_TRMM-PFM_Transient-Ops2 CER_ES8_Terra-FM1_Edition1 CER_ES8_Terra-FM2_Edition1 CER_ES8_Terra-FM1_Edition2 CER_ES8_Terra-FM2_Edition2 CER_ES8_Aqua-FM3_Edition1 CER_ES8_Aqua-FM4_Edition1 CER_ES8_Aqua-FM3_Edition2 CER_ES8_Aqua-FM4_Edition2 CER_ES8_Aqua-FM3_Edition1-CV CER_ES8_Aqua-FM4_Edition1-CV CER_ES8_Terra-FM1_Edition1-CV CER_ES8_Terra-FM1_Edition1-CV. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1997-12-27; Stop_Date=2005-03-29] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Temporal_Resolution=1 day; Temporal_Resolution_Range=Daily - < Weekly].
The ERBE-like Monthly Regional Averages (ES-9) product contains a month of space and time averaged Clouds and the Earth's Radiant Energy System (CERES) data for a single scanner instrument. The ES-9 is also produced for combinations of scanner instruments. All instantaneous shortwave and longwave fluxes at the Top-of-the-Atmosphere (TOA) from the CERES ES-8 product for a month are sorted by 2.5-degree spatial regions, by day number, and by the local hour of observation. The mean of the instantaneous fluxes for a given region-day-hour bin is determined and recorded on the ES-9 along with other flux statistics and scene information. For each region, the daily average flux is estimated from an algorithm that uses the available hourly data, scene identification data, and diurnal models. This algorithm is 'like' the algorithm used for the Earth Radiation Budget Experiment (ERBE). The ES-9 also contains hourly average fluxes for the month and an overall monthly average for each region. These average fluxes are given for both clear-sky and total-sky scenes. The following CERES ES9 data sets are currently available: CER_ES9_FM1+FM2_Edition1 CER_ES9_PFM+FM1+FM2_Edition1 CER_ES9_PFM+FM1+FM2_Edition2 CER_ES9_PFM+FM1_Edition1 CER_ES9_PFM+FM2_Edition1 CER_ES9_PFM+FM1_Edition2 CER_ES9_PFM+FM2_Edition2 CER_ES9_TRMM-PFM_Edition1 CER_ES9_TRMM-PFM_Edition2 CER_ES9_Terra-FM1_Edition1 CER_ES9_Terra-FM2_Edition1 CER_ES9_FM1+FM2_Edition2 CER_ES9_Terra-FM1_Edition2 CER_ES9_Terra-FM2_Edition2 CER_ES9_Aqua-FM3_Edition1 CER_ES9_Aqua-FM4_Edition1 CER_ES9_FM1+FM2+FM3+FM4_Edition1 CER_ES9_Aqua-FM3_Edition2 CER_ES9_Aqua-FM4_Edition2 CER_ES9_FM1+FM3_Edition2 CER_ES9_FM1+FM4_Edition2 CER_ES9_Aqua-FM3_Edition1-CV CER_ES9_Aqua-FM4_Edition1-CV CER_ES9_Terra-FM1_Edition1-CV CER_ES9_Terra-FM2_Edition1-CV. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2000-03-31] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=2.5 degree; Longitude_Resolution=2.5 degree; Horizontal_Resolution_Range=250 km - < 500 km or approximately 2.5 degrees - < 5.0 degrees; Temporal_Resolution=hourly, daily, monthly; Temporal_Resolution_Range=Hourly - < Daily, Daily - < Weekly, Monthly - < Annual].
Since the passage of the Geospatial Data Act (GDA) in 2018, federal agencies, including the Department of Energy (DOE), have been working to ensure compliance and outline guidance for the geospatial datasets and affiliated products publicly released from their agencies. At DOE this sparked work to develop a geospatial data management strategy and implementation plan; both of which spotlighted the need for the agency to set preferred guidance for the agency to use to inform the release of any public facing geospatial data and products. One of the immediate needs was set around establishing preferred guidance for coordinate systems, given the foundational role they play in all geospatial data, as they help reference data to the earth. DOE’s Geospatial Information Officer (GIO) and the Geospatial Sciences Steering Committee (GSSC) worked together to summarize best practices and current DOE uses to outline recommendations for coordinate systems to use for public geospatial data and products. This poster summarizes the role of coordinate systems, trends in coordinate system use from across the Department that were used to set preferred guidance for the Department to consider when releasing public-facing geospatial data and products.
The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provides archive and distribution services for several data products in the Planetary Boundary Layer (PBL) category. As a new variable added to the Atmospheric Infrared Sounder (AIRS) Version 6 support product, the PBL height from AIRS is derived based on the gradients of the retrieved relative humidity profile, and provides the atmospheric pressure at the top of the PBL over the ocean. The GES DISC also hosts the Modern-Era Retrospective analysis for Research and Applications-2 (MERRA-2) product generated by the Goddard Earth Observing System Model Version 5 (GEOS-5) data assimilation system. The PBL height from MERRA-2 is based on the total eddy diffusion coefficient of heat. The monthly PBL height has been made available in the Giovanni system (Giovanni is a Web-based application developed by the GES DISC providing a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data). Recently, the GES DISC began serving the global PBL height climatology product derived from the COSMIC/FORMOSAT-3 and TerraSAR-X Global Positioning System (GPS) radio occultation (RO) measurements from June 2006 to December 2015. In a previous study, we presented the monthly PBL height data from AIRS and MERRA-2 and demonstrated the GES DISC services which support data intercomparison, such as access, plotting, sub-setting, regridding, and generation of a multi-year monthly mean. We also provided intercomparison results, and found that different PBL height definitions contributed to significant differences of PBL height values between AIRS and MERRA-2. In this work, we present the 10-year seasonal climatologies from the AIRS, MERRA-2 and GPS-RO. We also used the cross section and vertical profile services in Giovanni to display and analyze the vertical atmosphere structure over regions where the PBL height derived from the AIRS and MERRA-2 are quite different. The examination of the AIRS and MERRA-2 three-dimensional data found that the relative humidity profiles had larger differences than the temperature profiles. The MERRA-2 gives more details than the AIRS for the vertical distribution of the humidity.
The Monthly Gridded TOA/Surface Fluxes and Clouds (SFC) product contains a month of space and time averaged Clouds and the Earth's Radiant Energy System (CERES) data for a single scanner instrument. The SFC is also produced for combinations of scanner instruments. All instantaneous shortwave, longwave, and window fluxes at the Top-of-the-Atmosphere (TOA) and surface from the CERES SSF product for a month are sorted by 1-degree spatial regions and by the local hour of observation. The mean of the instantaneous fluxes for a given region-hour bin is determined and recorded on the SFC along with other flux statistics and scene information. These average fluxes are given for both clear-sky and total-sky scenes. The regional cloud properties are column averaged and are included on the SFC. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2005-12-31] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=100] [Data_Resolution: Latitude_Resolution=1 degree; Longitude_Resolution=1 degree; Horizontal_Resolution_Range=100 km - < 250 km or approximately 1 degree - < 2.5 degrees; Temporal_Resolution=1 hour; Temporal_Resolution_Range=Hourly - < Daily].
The Clouds and Radiative Swath (CRS) product contains one hour of instantaneous Clouds and the Earth's Radiant Energy System (CERES) data for a single scanner instrument. The CRS contains all of the CERES SSF product data. For each CERES footprint on the SSF the CRS also contains vertical flux profiles evaluated at four levels in the atmosphere: the surface, 500-, 70-, and 1-hPa. The CRS fluxes and cloud parameters are adjusted for consistency with a radiative transfer model and adjusted fluxes are evaluated at the four atmospheric levels for both clear-sky and total-sky. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2001-12-31] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Temporal_Resolution=1 hour; Temporal_Resolution_Range=Hourly - < Daily].
The Single Scanner Footprint TOA/Surface Fluxes and Clouds (SSF) product contains one hour of instantaneous Clouds and the Earth's Radiant Energy System (CERES) data for a single scanner instrument. The SSF combines instantaneous CERES data with scene information from a higher-resolution imager such as Visible/Infrared Scanner (VIRS) on TRMM or Moderate-Resolution Imaging Spectroradiometer (MODIS) on Terra and Aqua. Scene identification and cloud properties are defined at the higher imager resolution and these data are averaged over the larger CERES footprint. For each CERES footprint, the SSF contains the number of cloud layers and for each layer the cloud amount, height, temperature, pressure, optical depth, emissivity, ice and liquid water path, and water particle size. The SSF also contains the CERES filtered radiances for the total, shortwave (SW), and window (WN) channels and the unfiltered SW, longwave (LW), and WN radiances. The SW, LW, and WN radiances at spacecraft altitude are converted to Top-of-the-Atmosphere (TOA) fluxes based on the imager defined scene. These TOA fluxes are used to estimate surface fluxes. Only footprints with adequate imager coverage are included on CER_SSF_TRMM-PFM-VIRS_Subset_Edition1the SSF which is much less than the full set of footprints on the CERES ES-8 product. The following CERES SSF data sets are currently available: CER_SSF_TRMM-PFM-VIRS_Edition1 CER_SSF_TRMM-PFM-VIRS_Subset_Edition1 CER_SSF_TRMM-PFM-VIRS_Edition2A CER_SSF_TRMM-SIM-VIRS_Edition2_VIRSonly CER_SSF_TRMM-PFM-VIRS_Edition2A-TransOps CER_SSF_TRMM-PFM-VIRS_Edition2B-TransOps CER_SSF_TRMM-PFM-VIRS_Edition2B CER_SSF_Terra-FM1-MODIS_Edition1A CER_SSF_Terra-FM1-MODIS_Edition1A CER_SSF_Terra-FM1-MODIS_Edition2A CER_SSF_Terra-FM2-MODIS_Edition2A CER_SSF_Terra-FM1-MODIS_Edition2B CER_SSF_Terra-FM2-MODIS_Edition2B CER_SSF_Aqua-FM4-MODIS_Beta1 CER_SSF_Aqua-FM3-MODIS_Beta2 CER_SSF_Aqua-FM4-MODIS_Beta2. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2002-10-31] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Temporal_Resolution=1 hour; Temporal_Resolution_Range=Hourly - < Daily].
NASA has made science and technology investments to better utilize its large space-borne remote sensing data holdings of the Earth. With the launch of Terra, NASA created a data-rich environment where the challenge is to fully utilize the data collected from EOS however, despite unprecedented amounts of observed data, there is a need for increasing the frequency, resolution, and diversity of observations. Current terrestrial models that use remote sensing data were constructed in a relatively data and compute limited era and do not take full advantage of on-line learning methods and assimilation techniques that can exploit these data. NASA has invested in visualization, data mining and knowledge discovery methods which have facilitated data exploitation, but these methods are insufficient for improving Earth science models that have extensive background knowledge nor do these methods refine understanding of complex processes. Investing in interdisciplinary teams that include computational scientists can lead to new models and systems for online operation and analysis of data that can autonomously improve in prediction skill over time.
The National Aeronautics and Space Administration's (NASA) Earth Observing System (EOS) will provide a comprehensive long term set of observations of the Earth to the Earth science research community. The data will aid in determining global changes caused both naturally and through human interaction. Understanding man's impact on the global environment will allow sound policy decisions to be made to protect our future. EOS is a major component of the Mission to Planet Earth program, which is NASA's contribution to the U.S. Global Change Research Program. EOS consists of numerous instruments on multiple spacecraft and a distributed ground system. The EOS Data and Information System (EOSDIS) is the major ground system developed to support EOS. The EOSDIS will provide EOS spacecraft command and control, data processing, product generation, and data archival and distribution services for EOS spacecraft. Data from EOS instruments on other Earth science missions (e.g., Tropical Rainfall Measuring Mission (TRMM)) will also be processed, distributed, and archived in EOSDIS. The U.S. and various International Partners (IP) (e.g., the European Space Agency (ESA), the Ministry of International Trade and Industry (MITI) of Japan, and the Canadian Space Agency (CSA)) participate in and contribute to the international EOS program. The EOSDIS will also archive processed data from other designated NASA Earth science missions (e.g., UARS) that are under the broad umbrella of Mission to Planet Earth.
The Monthly Gridded TOA/Surface Fluxes and Clouds (SFC) product contains a month of space and time averaged Clouds and the Earth's Radiant Energy System (CERES) data for a single scanner instrument. The SFC is also produced for combinations of scanner instruments. All instantaneous shortwave, longwave, and window fluxes at the Top-of-the-Atmosphere (TOA) and surface from the CERES SSF product for a month are sorted by 1-degree spatial regions and by the local hour of observation. The mean of the instantaneous fluxes for a given region-hour bin is determined and recorded on the SFC along with other flux statistics and scene information. These average fluxes are given for both clear-sky and total-sky scenes. The regional cloud properties are column averaged and are included on the SFC. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2003-12-31] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=100] [Data_Resolution: Latitude_Resolution=1 degree; Longitude_Resolution=1 degree; Horizontal_Resolution_Range=100 km - < 250 km or approximately 1 degree - < 2.5 degrees; Temporal_Resolution=1 hour; Temporal_Resolution_Range=Hourly - < Daily].
Focal Area(s): How do we use AI tools to integrate observations, simulated data and physical and chemical fundamentals (Focal Area 3) into model components (Focal Area 2) that have high accuracy and stability and low computational burden to improve Earth System Predictability? Science Challenge: Earth system modeling of the hydrological cycle involves compute-intensive modules representing complex chemical and physical process. Recently, AI tools that are far less compute intensive have been developed that emulate these modules, but many of these efforts are not yet sufficiently accurate or even stable. We know a lot about the physics and chemistry of earth system processes. The Science Challenge is developing AI tools that not only incorporate observations and simulated data, but also incorporate the physics and chemistry of the process, while still maintaining the compute efficiency.
The Earth system is made of multiple complex subsystems. While scientists tend to specialize in single subsystems or even portions of a subsystem, to fully understand the physical, chemical and biological processes occurring on the Earth, we must understand how these systems interact. Thus, scientists need to be able to expand beyond their chosen field and collaborate across disciplines. The NASA Earth Observing System Data and Information System (EOSDIS) is focusing on new capabilities to make interdisciplinary science easier. The EOSDIS DAACS are responsible for archiving and distributing NASA’s rapidly growing collection of satellite, airborne and field data. Like the scientists they serve, the DAACs are discipline oriented. This has many advantages. Scientists are able to interact with experts on data in their domain and receive data appropriate for their research. However, discipline-oriented services may be confusing to cross-disciplinary users who may not know how to get started. Fortunately, collaboration across scientific communities is a specialty of the DAACs who support interdisciplinary users with a collaborative culture and technology that empowers the open sharing of data, information, and knowledge within the scientific community and the wider public to accelerate scientific research and understanding. This presentation will discuss the capabilities of a discipline-oriented approach to support future Earth science goals including those of Open Science and cross-disciplinary collaboration.
With the Kepler Mission, exoplanet science has entered the era of Big Data and has benefited tremendously from the availability of the NAS (NASA Advanced Supercomputing Division) Pleiades supercomputer. This presentation provides an overview of the history of exoplanet discoveries and highlights the key enabling technologies for Kepler. I provide an overview of the Kepler science pipeline and the algorithms used to analyze the data and detect transiting planets, all of which run routinely on the NAS Pleiades system. The presentation also provides a description of the Blender analysis program used to validate Kepler planet discoveries statistically, and the effort to discover exomoons lurking in Kepler data, both of which also run on Pleiades. Finally, I describe NASA's TESS (Transiting Exoplanet Survey Satellite) Mission, which leverages Kepler heritage to provide a science pipeline similar to that for Kepler and that will also run routinely on the NAS Pleiades supercomputer.
Airborne measurements are pivotal for providing detailed, spatiotemporally resolved information about atmospheric parameters and aerosol and cloud properties, thereby enhancing our understanding of dynamic atmospheric processes. For 30 years, the US Department of Energy (DOE) Office of Science supported an instrumented Gulfstream 1 (G-1) aircraft for atmospheric field campaigns. Data from the final decade of G-1 operations were archived by the Atmospheric Radiation Measurement (ARM) Data Center and made publicly available at no cost to all registered users. To ensure a consistent data format and to improve the accessibility of the ARM airborne data, an integrated dataset was recently developed covering the final 6 years of G-1 operations (2013 to 2018, https://doi.org/10.5439/1999133; Mei and Gaustad, 2024). The integrated dataset includes data collected from 236 flights (766.4 h), which covered the Arctic, the US Southern Great Plains (SGP), the US West Coast, the eastern North Atlantic (ENA), the Amazon Basin in Brazil, and the Sierras de Córdoba range in Argentina. These comprehensive data streams provide much-needed insight into spatiotemporal variability in the thermodynamic quantities and aerosol and cloud properties for addressing essential science questions in Earth system process studies. This paper describes the DOE ARM merged G-1 datasets, including information on the acquisition, data collection challenges and future potentials, and quality control processes. It further illustrates the usage of this merged dataset to evaluate the Energy Exascale Earth System Model (E3SM) with the Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package.
NASA has been studying the Earth and its changing environment by observing the atmosphere, oceans, land, ice, and snow and their influence on climate and weather since the agency's creation. This study has lead to a new approach to understanding the interaction of the Earth's systems, Earth System Science. The Earth Science Enterprise, NASA's comprehensive program for Earth System Science, uses satellites and other tools to intensively study the Earth. The Earth Science Enterprise has three main components: (1) a series of Earth-observing satellites, (2) an advanced data system and (3) teams of scientist who study the data. Key areas of study include: (1) clouds, (2) water and energy cycles, (3) oceans, (4) chemistry of the atmosphere, (5) land surface, water and ecosystems processes; (6) glaciers and polar ice sheets, and (7) the solid earth.
The GLOBE Program, NASA’s largest and longest lasting citizen science program about the Earth, has been collecting cloud observations matched to multiple satellite data daily. The program’s cloud protocol is historically the most popular protocol as your eyes are the only instruments you need to collect observations of the sky. This dataset includes over 3,300,000 cloud observations with variables like total cloud cover, cloud type and opacity that are collocated to the nearest overpass times of geostationary satellites (GOES-15, GOES-16, GOES-17, Meteosat-8, Meteosat-11, or Himawari-8), or to Clouds and the Earth’s Radiant Energy System (CERES) instruments onboard Aqua and Terra, or the Cloud–Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) satellite. In order to increase the usability of this dataset, the Community science project Leveraging Online and User Data through GLOBE And Zooniverse Engagement (CLOUD GAZE) has been developed to generate data quality flags of these ground-up and top-down perspectives of sky and clouds. Recently funded through NASA’s Citizen Science for Earth Systems Program, CLOUD GAZE has partnered with the Zooniverse online platform to obtain reference data and image tagging of sky photographs collected through The GLOBE Program’s clouds protocol. This paper will present the GLOBE Clouds dataset matched to NASA satellite data, integration of CLOUD GAZE to develop data quality flags, and research applications of the dataset (includes ground-up and top-down perspective comparisons, ground observations of dust storms and smoke plumes, and cloud observations in polar regions). The paper will also present on techniques and recommendations for classroom use and for community engagement, particularly for those looking to online resources.