Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Earth Science Data Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

SDN-NGenIA, a Software Defined Next Generation Integrated Architecture for HEP and Data Intensive Science

This project aims to enable the LHC and other leading programs in high energy physics and other global science domains funded by the DOE to operate with a new level of efficiency and control, through the development of a Next Generation Integrated Architecture (NGenIA) based on intelligent software defined network (SDN)-driven network systems coupled to high throughput applications. While the initial focus is on the challenging LHC use case, the systems and products being developed are general, and apply to many fields of data intensive science ranging from astrophysical sky surveys to bioinformatics and earth observation, as well as other organizations facing the challenges of extracting knowledge from distributed multi-petabyte data stores. A central concept in this development program is a new paradigm ‘consistent network operations’ among widely distributed computing and storage facilities, where stable high throughput flows, at set rates, cross load-balanced network paths, up to flexible high water marks that are adjusted in real time to accommodate other network traffic. The large smooth flows are launched and managed by SDN services that act in concert with the experiments’ site-resident data distribution and management systems, to meet the expanding needs of the science programs. The technical goals include the construction of autonomous, intelligent site-resident services that interact dynamically with network-resident services, and with the science programs’ principal data distribution and management tools, to request or command network resources in support of high throughput petascale to exascale workflow Specific work items include: 1. Developing compact Data Transfer Nodes (DTNs) with auto-tuning functions that support data transfer rates in the 100 Gbps to the 1 Tbps range when used with high throughput data transfer applications 2. Deep site orchestration among virtualized clusters, storage subsystems and subnets to successfully coschedule CPU, storage and network resources 3. Science-program designed site architectures, operational modes, and policy and resource usage priorities, adjudicated across multiple network domains and virtual organizations, using the orchestration functions and methods 4. Seamlessly extending end-to-end operation across both extra-site and intra-site boundaries through the use of Open vSwitch (OVS), FireQoS + next generation Science DMZs 5. Novel methods of system integration that enable granular control of extreme scale long distance transfers through flow matching of scattered source-destination address pairs to multi-domain dynamic circuits 6. Funneling massive sets of streams to DTNs at the site edge hosting petascale buffer pools configured for flows of 100 Gbps and up, exploiting state of the art data transfers 7. Adaptive scheduling based on pervasive end-to-end monitoring, including DTN or compute-node resident agents providing comprehensive end-system profiling 8. Developing unsupervised and supervised machine learning and modeling methods to optimize the workflow involving terabyte to multi-petabyte datasets.

47 OTHER INSTRUMENTATION↗
NASA NTRS1989

A study of spatial data management and analysis systems

The Earth Resources Laboratory of the NASA Stennis Space Center is a center of space related technology for Earth observations. It has assumed the task, in a joint effort with Jackson State University, to reach out to the science community and acquire information pertaining to characteristics of spatially oriented data processing.

Christopher, Clyde↗
NASA NTRS2002

Timekeeping for the Space Technology 5 (ST-5) Mission

Space Technology 5, or better known as ST-5, is a space technology development mission in the New Millennium Program (NMP) and NASA s first experiment in the design of miniaturized satellite constellations. The mission will design, integrate and launch multiple spacecraft into an orbit high above the Earth s protective magnetic field known as the magnetosphere. Each spacecraft incorporates innovative technology and constellation concepts which will be instrumental in future space science missions. A total of three ST-5 spacecraft will be launched as secondary payloads into a highly elliptical geo-synchronous transfer orbit, and will operate as a 3-element constellation for a minimum duration of 90 days. In order to correlate the time of science measurements with orbit position relative to the Earth, orbit position in space (with respect to other objects in space) and/or with events measured on Earth or other spacecraft, accurate knowledge of spacecraft and ground time is needed. Ground time as used in the USA (known as Universal Time Coordinated or UTC) is maintained by the U.S. Naval Observatory. Spacecraft time is maintained onboard within the Command and Data Handling (C&DH) system. The science requirements for ST-5 are that spacecraft time and ground time be correlatable to each other, with some degree of accuracy. Accurate knowledge of UTC time on a spacecraft is required so that science measurements can be correlated with orbit position relative to the Earth, orbit position in space and with events measured on Earth or other spacecraft. The most crucial parameter is not the clock oscillator frequency, but more importantly, how the clock oscillator frequency varies with time or temperature (clock oscillator drift). Even with an incorrect clock oscillator frequency, if there were no drift, the frequency could be assessed by comparing the spacecraft clock to a ground clock during a few correlation events. Once the frequency is accurately known, it is easy enough to make a regular adjustment to the spacecraft clock or to calculate the correct ground time for a given spacecraft clock time. The oscillator frequency, however, is temperature dependent, drifts with age and is affected by radiation; hence, repeated correlation measurements are required.

Raphael, Dave↗
NASA NTRSDate not supplied

CERES BiDirectional Scans (BDS) data in HDF (CER_BDS_Aqua-FM3_Edition1)

Each BiDirectional Scans (BDS) data product contains twenty-four hours of Level-1b data for each CERES scanner instrument mounted on each spacecraft. The BDS includes samples taken in normal and short Earth scan elevation profiles in both fixed and rotating azimuth scan modes (including space, internal calibration, and solar calibration views). The BDS contains Level-0 raw (unconverted) science and instrument data as well as the geolocated converted science and instrument data. The BDS contains additional data not found in the Level-0 input file, including converted satellite position and velocity data, celestial data, converted digital status data, and parameters used in the radiance count conversion equations. The following CERES BDS data sets are currently available: CER_BDS_TRMM-PFM_Edition1 CER_BDS_Terra-FM1_Edition1 CER_BDS_Terra-FM2_Edition1 CER_BDS_Terra-FM1_Edition2 CER_BDS_Terra-FM2_Edition2 CER_BDS_Aqua-FM3_Edition1 CER_BDS_Aqua-FM4_Edition1 CER_BDS_Aqua-FM3_Edition2 CER_BDS_Aqua-FM4_Edition2 CER_BDS_Aqua-FM3_Edition1-CV CER_BDS_Aqua-FM4_Edition1-CV CER_BDS_Terra-FM1_Edition1-CV CER_BDS_Terra-FM2_Edition1-CV. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1997-12-27; Stop_Date=2005-11-02] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Temporal_Resolution=1 day; Temporal_Resolution_Range=Daily - < Weekly].

EOSDIS↗
NASA NTRS2003

Interleaved Observation Execution and Rescheduling on Earth Observing Systems

Observation scheduling for Earth orbiting satellites solves the following problem: given a set of requests for images of the Earth, a set of instruments for acquiring those images distributed on a collecting of orbiting satellites, and a set of temporal and resource constraints, generate a set of assignments of instruments and viewing times to those requests that satisfy those constraints. Observation scheduling is often construed as a constrained optimization problem with the objective of maximizing the overall utility of the science data acquired. The utility of an image is typically based on the intrinsic importance of acquiring it (for example, its importance in meeting a mission or science campaign objective) as well as the expected value of the data given current viewing conditions (for example, if the image is occluded by clouds, its value is usually diminished). Currently, science observation scheduling for Earth Observing Systems is done on the ground, for periods covering a day or more. Schedules are uplinked to the satellites and are executed rigorously. An alternative to this scenario is to do some of the decision-making about what images are to be acquired on-board. The principal argument for this capability is that the desirability of making an observation can change dynamically, because of changes in meteorological conditions (e.g. cloud cover), unforeseen events such as fires, floods, or volcanic eruptions, or un-expected changes in satellite or ground station capability. Furthermore, since satellites can only communicate with the ground between 5% to 10% of the time, it may be infeasible to make the desired changes to the schedule on the ground, and uplink the revisions in time for the on-board system to execute them. Examples of scenarios that motivate an on-board capability for revising schedules include the following. First, if a desired visual scene is completely obscured by clouds, then there is little point in taking it. In this case, satellite resources, such as power and storage space can be better utilized taking another image that is higher quality. Second, if an unexpected but important event occurs (such as a fire, flood, or volcanic eruption), there may be good reason to take images of it, instead of expending satellite resources on some of the lower priority scheduled observations. Finally, if there is unexpected loss of capability, it may be impossible to carry out the schedule of planned observations. For example, if a ground station goes down temporarily, a satellite may not be able to free up enough storage space to continue with the remaining schedule of observations. This paper describes an approach for interleaving execution of observation schedules with dynamic schedule revision based on changes to the expected utility of the acquired images. We describe the problem in detail, formulate an algorithm for interleaving schedule revision and execution, and discuss refinements to the algorithm based on the need for search efficiency. We summarize with a brief discussion of the tests performed on the system.

Khatib, Lina↗
NASA NTRS1990

Master data directories and Catalog Interoperability

While the 'Catalog Interoperability' (CI) project began as a NASA effort to facilitate identification, location, and access to data of interest to space and earth sciences researchers, it now has a membership encompassing numerous U.S. and international agencies as well as academic institutions. CI is creating a global network of interconnected directory, catalog, and inventory systems. Its directories contain brief summary information about data sets, and can either furnish automated links to other information systems yielding greater detail on matters of interest or indicate to whom requests for additional information can go.

Thieman, J. R.↗
NASA NTRS1989

Improved capabilities of the Multispectral Atmospheric Mapping Sensor (MAMS)

The Multispectral Atmospheric Mapping Sensor (MAMS) is an airborne instrument being investigated as part of NASA's high altitude research program. Findings from work on this and other instruments have been important as the scientific justification of new instrumentation for the Earth Observing System (EOS). This report discusses changes to the instrument which have led to new capabilities, improved data quality, and more accurate calibration methods. In order to provide a summary of the data collected with MAMS, a complete list of flight dates and locations is provided. For many applications, registration of MAMS imagery with landmarks is required. The navigation of this data on the Man-computer Interactive Data Access System (McIDAS) is discussed. Finally, research applications of the data are discussed and specific examples are presented to show the applicability of these measurements to NASA's Earth System Science (ESS) objectives.

Jedlovec, Gary J.↗
NASA NTRS1989

Remote sensing information sciences research group: Browse in the EOS era

The problem of science data browse was examined. Given the tremendous data volumes that are planned for future space missions, particularly the Earth Observing System in the late 1990's, the need for access to large spatial databases must be understood. Work was continued to refine the concept of data browse. Further, software was developed to provide a testbed of the concepts, both to locate possibly interesting data, as well as view a small portion of the data. Build II was placed on a minicomputer and a PC in the laboratory, and provided accounts for use in the testbed. Consideration of the testbed software as an element of in-house data management plans was begun.

Estes, John E.↗
NASA NTRS1998

Pathfinder Instruments for Cloud and Aerosol Spaceborne Observations (PICASSO)

This paper will describe the planned 3-year Pathfinder Instruments for Cloud and Aerosol Spaceborne Observations (PICASSO) mission, its instrumentation and implementation. It will use LITE and other data, plus analyses, to show the feasibility of such a mission. PICASSO is being proposed for NASA's Earth System Science Pathfinder (ESSP) program with launch predicted in 2003.

McCormick, M. Patrick↗
NASA NTRSDate not supplied

CERES ERBE-like Monthly Regional Averages (ES-9) in HDF (CERES:CER_ES9_PFM+FM1_Edition2)

The ERBE-like Monthly Regional Averages (ES-9) product contains a month of space and time averaged Clouds and the Earth's Radiant Energy System (CERES) data for a single scanner instrument. The ES-9 is also produced for combinations of scanner instruments. All instantaneous shortwave and longwave fluxes at the Top-of-the-Atmosphere (TOA) from the CERES ES-8 product for a month are sorted by 2.5-degree spatial regions, by day number, and by the local hour of observation. The mean of the instantaneous fluxes for a given region-day-hour bin is determined and recorded on the ES-9 along with other flux statistics and scene information. For each region, the daily average flux is estimated from an algorithm that uses the available hourly data, scene identification data, and diurnal models. This algorithm is 'like' the algorithm used for the Earth Radiation Budget Experiment (ERBE). The ES-9 also contains hourly average fluxes for the month and an overall monthly average for each region. These average fluxes are given for both clear-sky and total-sky scenes. The following CERES ES9 data sets are currently available: CER_ES9_FM1+FM2_Edition1 CER_ES9_PFM+FM1+FM2_Edition1 CER_ES9_PFM+FM1+FM2_Edition2 CER_ES9_PFM+FM1_Edition1 CER_ES9_PFM+FM2_Edition1 CER_ES9_PFM+FM1_Edition2 CER_ES9_PFM+FM2_Edition2 CER_ES9_TRMM-PFM_Edition1 CER_ES9_TRMM-PFM_Edition2 CER_ES9_Terra-FM1_Edition1 CER_ES9_Terra-FM2_Edition1 CER_ES9_FM1+FM2_Edition2 CER_ES9_Terra-FM1_Edition2 CER_ES9_Terra-FM2_Edition2 CER_ES9_Aqua-FM3_Edition1 CER_ES9_Aqua-FM4_Edition1 CER_ES9_FM1+FM2+FM3+FM4_Edition1 CER_ES9_Aqua-FM3_Edition2 CER_ES9_Aqua-FM4_Edition2 CER_ES9_FM1+FM3_Edition2 CER_ES9_FM1+FM4_Edition2 CER_ES9_Aqua-FM3_Edition1-CV CER_ES9_Aqua-FM4_Edition1-CV CER_ES9_Terra-FM1_Edition1-CV CER_ES9_Terra-FM2_Edition1-CV. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2000-03-31] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=2.5 degree; Longitude_Resolution=2.5 degree; Horizontal_Resolution_Range=250 km - < 500 km or approximately 2.5 degrees - < 5.0 degrees; Temporal_Resolution=hourly, daily, monthly; Temporal_Resolution_Range=Hourly - < Daily, Daily - < Weekly, Monthly - < Annual].

CLEAR-SKY ALBEDO↗
NASA NTRS2014

Geospatial Standards and the Knowledge Generation Lifescycle

Standards play an essential role at each stage in the sequence of processes by which knowledge is generated from geoscience observations, simulations and analysis. This paper provides an introduction to the field of informatics and the knowledge generation lifecycle in the context of the geosciences. In addition we discuss how the newly formed Earth Science Informatics Technical Committee is helping to advance the application of standards and best practices to make data and data systems more usable and interoperable.

Khalsa, Siri Jodha S.↗
NASA NTRS2015

The Global Structure of UTLS Ozone in GEOS-5: A Multi-Year Assimilation of EOS Aura Data

Eight years of ozone measurements retrieved from the Ozone Monitoring Instrument (OMI) and the Microwave Limb Sounder, both on the EOS Aura satellite, have been assimilated into the Goddard Earth Observing System version 5 (GEOS-5) data assimilation system. This study thoroughly evaluates this assimilated product, highlighting its potential for science. The impact of observations on the GEOS-5 system is explored by examining the spatial distribution of the observation-minus-forecast statistics. Independent data are used for product validation. The correlation coefficient of the lower-stratospheric ozone column with ozonesondes is 0.99 and the bias is 0.5%, indicating the success of the assimilation in reproducing the ozone variability in that layer. The upper-tropospheric assimilated ozone column is about 10% lower than the ozonesonde column but the correlation is still high (0.87). The assimilation is shown to realistically capture the sharp cross-tropopause gradient in ozone mixing ratio. Occurrence of transport-driven low ozone laminae in the assimilation system is similar to that obtained from the High Resolution Dynamics Limb Sounder (HIRDLS) above the 400 K potential temperature surface but the assimilation produces fewer laminae than seen by HIRDLS below that surface. Although the assimilation produces 5 - 8 fewer occurrences per day (up to approximately 20%) during the three years of HIRDLS data, the interannual variability is captured correctly. This data-driven assimilated product is complementary to ozone fields generated from chemistry and transport models. Applications include study of the radiative forcing by ozone and tracer transport near the tropopause.

GEOS-5↗
NASA NTRS2003

AIRS/AMSU/HSB on EOS Aqua: first year post launch assessment

The Atmospheric Infrared Sounder (AIRS), Advanced Microwave Sounding Unit (AMSU), and Humidity Sounder from Brazil (HSB) are three instruments onboard the Earth Observing System (EOS) Aqua Spacecraft. This paper discusses the science objectives and the status of the instruments and their data products one year after launch

Strow, L. Larrabee↗
DOE OSTI2017

Multiscale Methods for Accurate, Efficient, and Scale-Aware Models of the Earth System

The major goal of this project was to contribute improvements to the infrastructure of an Earth System Model in order to support research in the Multiscale Methods for Accurate, Efficient, and Scale-Aware models of the Earth System project. In support of this, the NCAR team accomplished two main tasks: improving input/output performance of the model and improving atmospheric model simulation quality. Improvement of the performance and scalability of data input and diagnostic output within the model required a new infrastructure which can efficiently handle the unstructured grids common in multiscale simulations. This allows for a more computationally efficient model, enabling more years of Earth System simulation. The quality of the model simulations was improved by reducing grid-point noise in the spectral element version of the Community Atmosphere Model (CAM-SE). This was achieved by running the physics of the model using grid-cell data on a finite-volume grid.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2007

Production and Distribution of NASA MODIS Remote Sensing Products

The two Moderate Resolution Imaging Spectroradiometer (MODIS) instruments on-board NASA's Earth Observing System (EOS) Terra and Aqua satellites make key measurements for understanding the Earth's terrestrial ecosystems. Global time-series of terrestrial geophysical parameters have been produced from MODIS/Terra for over 7 years and for MODIS/Aqua for more than 4 1/2 years. These well calibrated instruments, a team of scientists and a large data production, archive and distribution systems have allowed for the development of a new suite of high quality product variables at spatial resolutions as fine as 250m in support of global change research and natural resource applications. This talk describes the MODIS Science team's products, with a focus on the terrestrial (land) products, the data processing approach and the process for monitoring and improving the product quality. The original MODIS science team was formed in 1989. The team's primary role is the development and implementation of the geophysical algorithms. In addition, the team provided feedback on the design and pre-launch testing of the instrument and helped guide the development of the data processing system. The key challenges the science team dealt with before launch were the development of algorithms for a new instrument and provide guidance of the large and complex multi-discipline processing system. Land, Ocean and Atmosphere discipline teams drove the processing system requirements, particularly in the area of the processing loads and volumes needed to daily produce geophysical maps of the Earth at resolutions as fine as 250 m. The processing system had to handle a large number of data products, large data volumes and processing loads, and complex processing requirements. Prior to MODIS, daily global maps from heritage instruments, such as Advanced Very High Resolution Radiometer (AVHRR), were not produced at resolutions finer than 5 km. The processing solution evolved into a combination of processing the lower level (Level 1) products and the higher level discipline specific Land and Atmosphere products in the MODIS Science Investigator Lead Processing System (SIPS), the MODIS Adaptive Processing System (MODAPS), and archive and distribution of the Land products to the user community by two of NASA s EOS Distributed Active Archive Centers (DAACs). Recently, a part of MODAPS, the Level 1 and Atmosphere Archive and Distribution System (LAADS), took over the role of archiving and distributing the Level 1 and Atmosphere products to the user community.

Wolfe, Robert↗
NASA NTRS2022

Calibration Inter-Comparison of MODIS and VIIRS Reflective Solar Bands Using Lunar Observations

Multispectral band observations from Terra and Aqua MODIS, launched in December 1999 and May 2002, respectively, and from SNPP and NOAA-20 VIIRS, launched in November 2011 and October 2017, respectively, have continuously enabled a broad range of applications and studies of the Earth system and its changes via a set of geophysical and environmental parameters. The quality of MODIS and VIIRS science and environmental data products relies strongly on the calibration accuracy and stability of individual sensors, as well as their calibration consistency, especially for the data products generated using observations from sensors across different platforms. Both MODIS and VIIRS instruments carry a similar set of on-board calibrators for their on-orbit calibration. Besides, lunar observations are regularly scheduled and implemented in support of their reflective solar bands (RSB) calibration, especially their long-term stability monitoring. In this paper, we provide an overview of MODIS and VIIRS solar and lunar calibration methodologies applied for the RSB on-orbit calibration, and describe the approach developed for their calibration inter-comparisons using lunar observations, including corrections for the effects caused by differences in the relative spectral response and adopted solar spectra between individual sensors. The MODIS and VIIRS calibration inter-comparison results derived from their regularly scheduled lunar observations are presented and discussed, including associated uncertainties and a comparison with those derived using the Earth-view targets. Also discussed are remaining challenges in lunar calibration and inter-comparison for the Earth-observing sensors, as well as on-going efforts for future improvements.

Multispectral band↗
NASA NTRS2017

Framework for Processing Citizens Science Data for Applications to NASA Earth Science Missions

Citizen science (or crowdsourcing) has drawn much high-level recent and ongoing interest and support. It is poised to be applied, beyond the by-now fairly familiar use of, e.g., Twitter for natural hazards monitoring, to science research, such as augmenting the validation of NASA earth science mission data. This interest and support is seen in the 2014 National Plan for Civil Earth Observations, the 2015 White House forum on citizen science and crowdsourcing, the ongoing Senate Bill 2013 (Crowdsourcing and Citizen Science Act of 2015), the recent (August 2016) Open Geospatial Consortium (OGC) call for public participation in its newly-established Citizen Science Domain Working Group, and NASA's initiation of a new Citizen Science for Earth Systems Program (along with its first citizen science-focused solicitation for proposals). Over the past several years, we have been exploring the feasibility of extracting from the Twitter data stream useful information for application to NASA precipitation research, with both "passive" and "active" participation by the twitterers. The Twitter database, which recently passed its tenth anniversary, is potentially a rich source of real-time and historical global information for science applications. The time-varying set of "precipitation" tweets can be thought of as an organic network of rain gauges, potentially providing a widespread view of precipitation occurrence. The validation of satellite precipitation estimates is challenging, because many regions lack data or access to data, especially outside of the U.S. and in remote and developing areas. Mining the Twitter stream could augment these validation programs and, potentially, help tune existing algorithms. Our ongoing work, though exploratory, has resulted in key components for processing and managing tweets, including the capabilities to filter the Twitter stream in real time, to extract location information, to filter for exact phrases, and to plot tweet distributions. The key step is to process the "precipitation" tweets to be compatible with satellite-retrieved precipitation data. These key components for processing and managing "precipitation" tweets (and additional ones to be developed) are not limited to precipitation, nor are they limited to the Twitter social medium. Indeed, to maximize the value of our work for NASA earth science programs, these components should be generalized and be part of an overall framework for processing citizen science data for science research. In this paper, we outline such a framework.

earth science satellite data↗
NASA NTRS1992

A multi-mission flyby strategy for the near-earth asteroids

Recent developments in miniaturization of spacecraft systems and science instruments have led to great interest in their application to deep space missions. A recent JPL study, for example, considered the design of a small spacecraft which could yield useful science data from fast flybys of the near-earth asteroids. Called AIM (Asteroid Investigation with Microspacecraft), three spacecrafts would be launched with Pegasus into low earth orbit (LEO), separated, and then remain there up to 2 weeks, each waiting for the opportune time to inject to a flyby with a preselected asteroid. Each spacecraft has its own kick stage for this injection maneuver. This paper briefly describes the spacecraft design and capability, the asteroid flyby opportunities available within the coming decade, and other possible mission scenarios which could take advantage of a single launch multi-spacecraft option.

Penzo, Paul A.↗