Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

The Earth Observing System's Space Measurement System

The EOS Space Measurement System (SMS) is intended to provide global earth science data from a low-altitude orbit on a long-term, sustained basis. The SMS consists of a series of small and intermediate spacecraft carrying a diverse set of scientific instruments. The instruments include optical, IR, and microwave sensors that provide detailed imagtes of the earth's surface; tropospheric and stratospheric sounders that provide vertical profiles of parameters such as temperature, trace gas concentration, and humdity; and accurate positioning instruments.

Scolese, Christopher J.↗

Magellan: Principal Venus science findings

This is a brief summary of the science findings of the Magellan mission, principally based on data from the radar system. Future plans for Magellan include acquisition of high resolution gravity data from a nearly circular orbit and atmospheric drag and occultation experiments. The Magellan science results represent the combined effort of more than 100 Magellan investigators and their students and colleagues. More extensive discussions can be found in the August and October, 1992 issues of the Journal of Geophysical Research, Planets. The Magellan mission's scientific objectives were to provide a global characterization of landforms and tectonic features; to distinguish and understand impact processes; to define and explain erosion, deposition, and chemical processes; and to model the interior density distribution. All but the last objective, which requires new global gravity data, have been accomplished, or we have acquired the data that are required to accomplish them.

Saunders, R. Stephen↗

Grant Proposal for the Continuation of the Voyager Interstellar Mission: LECP Investigation

This proposal documents the plans of the Low Energy Charged Particle (LECP) investigation team for participation in NASA's Voyager Interstellar Mission (VIM) as the Voyager 1 and 2 spacecraft explore the outer reaches of the heliosphere and search for the termination shock and the heliopause. The proposal covers the four year period from 1 January 1997 to 31 December 2000. The LECP instruments on Voyager 1 and 2 measure in situ intensities of charged particles with energies from about 30 keV to 100 MeV for ions, and about 20 keV to greater than 10 MeV for electrons. The instruments provide detailed spectral, angular, and compositional information about the particles. Composition is available for greater than 200 keV/nuc using multi-parameter measurements. Angular information is obtained by a mechanically scanned platform that rotates at various commanded rates. Measurements of low energy ion and electron intensities versus time and spatial location within the heliosphere contain an abundance of information regarding various transport and acceleration processes on both local (approx. 1 hr, approx. 0.01 AU) and global (approx. 11 yrs, approx. 100 AU) scales. The LECP instruments provide unique observations of such dynamical processes, and we anticipate that it will return critical information regarding the boundaries of the heliosphere. Several recent and exciting discoveries based on LECP measurements emphasize the important role that low energy charged particle distributions play in physical processes in the interplanetary medium. Yet, at the same time, these discoveries also underscore the fact that our understanding of processes in the outer heliosphere is, in most cases, incomplete, and in others, only rudimentary at best. Among the discoveries referred to above are the following: (1) Shocks: Examination of greater than 30 keV ion intensities have revealed: (a) a total absence of acceleration beyond only -100-200 keV at a strong transient shock in May 1991 at 35 AU, despite an enhanced level of seed particles; (b) a large transient shock in September 1991 of global scale, with intensities of shock-accelerated ions greater than or equal to 30 keV to approx. 30 MeV showing complex, highly energy-dependent spatial evolution, and small-scale (approx. few gyroradii), often anisotropic, micro-structures; (c) recurrent intensity increases in greater than or equal to 30 keV to -few MeV ions, with structures that, in some cases, show no correlation with the associated corotating shock. (2) Superthermal ion pressure: A global merged interaction region with a leading shock, downstream of which the superthermal ion (greater than or equal to 30 keV to approx. 4 MeV) pressure is comparable to that of the thermal plasma, and the total particle pressure yields a plasma beta of order unity. (3) Pickup ions: Measurements of the C/O ratio within transient structures at 35-45 AU showing the first clear evidence that transient shocks can pre-accelerate interstellar pickup ions from approx. 1 keV/nuc to at least 1 MeV/nuc. (4) Seed particles: Injection of ions for acceleration to high energies at the termination shock is unlikely to be a problem, since interplanetary transient and recurrent shocks are continually accelerating ions, of solar wind or interstellar origin, to highly superthermal energies. (5) Precursor electrons: Ambient solar electrons (greater than or equal to few tens of keV) that exist in the outer heliosphere ca form a broad precursor, several days wide, that is upstream of the termination shock and potentially observable a few months prior to the shock crossing. (6) Solar wind velocity at Voyager 1: We can use LECP ion data to obtain the solar wind velocity at Voyager 1, enabling us to provide critical measurement of the plasma flow as we approach and encounter the termination shock and other regions (necessary due to the partial failure of the Voyager 1 PLS experiment). The work of the LECP investigator team during the VIM will include: (1) Continuing operations with regard to the receipt, processing, verification, cataloging, display, and distribution of the data from the LECP instruments on Voyager 1 and 2, (2) Monitoring the health and performance of the LECP instruments, and evaluating and characterizing the response of the LECP instruments to various energetic particle and plasma environments, (3) Participating in, and supporting Voyager Project planning exercises and other coordinated activities relevant to exploration of the outer heliosphere, (4) Developing analysis techniques and operational procedures suitable for searching for and characterizing the boundaries and unique regions of the outher heliosphere, (5) Continuing the preparation of data sets appropriate for submission to the National Space Sciences Data Center (NSSDC) and, where appropriate, the Planetary Data System (PDS), (6) Maintaining direct Web access to online LECP data through the JHU/APL Voyager LECP home page, (7) Performing scientific evaluations of the Voyager 1 and 2 LECP data sets in conjunction with other data sets and other investigators, with particular focus on the outer regions of the heliosphere, and (8) Publishing the results of these evaluations in the scientific literature and presenting the results in scientific conferences.

Krimigis, Stamatios M.↗

[MODIS Investigation]

The objectives of the last six months were: (1) Revise the algorithms for the Fluorescence Line Height (FLH) and Chlorophyll Fluorescence Efficiency (CFE) products, especially the data quality flags; (2) Revise the MOCEAN validation plan; (3) Deploy and recover bio-optical instrumentation at the Hawaii Ocean Time-series (HOT) site as part of the Joint Global Ocean Flux Study (JGOFS); (4) Prepare for field work in the Antarctic Polar Frontal Zone as part of JGOFS; (5) Submit manuscript on bio-optical time scales as estimated from Lagrangian drifters; (6) Conduct chemostat experiments on fluorescence; (7) Interface with the Global Imager (GLI) science team; and (8) Continue development of advanced data system browser. We are responsible for the delivery of two at-launch products for AM-1: Fluorescence line height (FLH) and chlorophyll fluorescence efficiency (CFE). We also considered revising the input chlorophyll, which is used to determine the degree of binning. We have refined the quality flags for the Version 2 algorithms. We have acquired and installed a Silicon Graphics Origin 200. We are working with the University of Miami team to develop documentation that will describe how the MODIS ocean components are linked together.

Abbott, Mark R.↗

CERES Monthly TOA and SRB Averages (SRBAVG) data in HDF-EOS Grid (CER_SRBAVG_TRMM-PFM-VIRS_Edition2B)

The Monthly TOA/Surface Averages (SRBAVG) product contains a month of space and time averaged Clouds and the Earth's Radiant Energy System (CERES) data for a single scanner instrument. The SRBAVG is also produced for combinations of scanner instruments. The monthly average regional flux is estimated using diurnal models and the 1-degree regional fluxes at the hour of observation from the CERES SFC product. A second set of monthly average fluxes are estimated using concurrent diurnal information from geostationary satellites. These fluxes are given for both clear-sky and total-sky scenes and are spatially averaged from 1-degree regions to 1-degree zonal averages and a global average. For each region, the SRBAVG also contains hourly average fluxes for the month and an overall monthly average. The cloud properties from SFC are column averaged and are included on the SRBAVG. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-02-01; Stop_Date=2000-03-31] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1 degree; Longitude_Resolution=1 degree; Horizontal_Resolution_Range=100 km - < 250 km or approximately 1 degree - < 2.5 degrees; Temporal_Resolution=1 month; Temporal_Resolution_Range=Monthly - < Annual].

CLEAR-SKY ALBEDO↗

MISR Level 1B2 Terrain Data (MI1B2T_V2)

The MISR instrument consists of nine pushbroom cameras which measure radiance in four spectral bands. Global coverage is achieved in nine days. The cameras are arranged with one camera pointing toward the nadir, four cameras pointing forward and four cameras pointing aftward. It takes 7 minutes for all nine cameras to view the same surface location. The view angles relative to the surface reference ellipsoid, are 0, 26.1, 45.6, 60.0, and 70.5 degrees. The spectral band shapes are nominally gaussian, centered at 443, 555, 670, and 865 nm. The Terrain data are re-projected to the terrain altitude. In this product, surface data from all cameras will appear in the same geographic location. Thus, this product is the primary input to Level 2 aerosol/surface processing, which requires co-registration of the L1B2 imagery at the surface. Clouds will still be displaced due to their elevation above the surface, but this time with respect to the terrain rather than the ellipsoid. (The mountain location T is now assigned the geographic location at T, and the Cloud at F appears at the geographic location T.) In Level 2 aerosol/surface processing, algorithms are applied to screen out the clouds. Terrain data only exist for MISR blocks containing some land. [Location=GLOBAL LAND] [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=563.2 km (cross-track); Longitude_Resolution=140.8 km (along-track).; Temporal_Resolution=about 15 orbits/day; Temporal_Resolution_Range=about 15 orbits/day].

SPECTRAL BANDS↗

MISR Level 1B2 Terrain Data (MI1B2T_V3)

The MISR instrument consists of nine pushbroom cameras which measure radiance in four spectral bands. Global coverage is achieved in nine days. The cameras are arranged with one camera pointing toward the nadir, four cameras pointing forward and four cameras pointing aftward. It takes 7 minutes for all nine cameras to view the same surface location. The view angles relative to the surface reference ellipsoid, are 0, 26.1, 45.6, 60.0, and 70.5 degrees. The spectral band shapes are nominally gaussian, centered at 443, 555, 670, and 865 nm. The Terrain data are re-projected to the terrain altitude. In this product, surface data from all cameras will appear in the same geographic location. Thus, this product is the primary input to Level 2 aerosol/surface processing, which requires co-registration of the L1B2 imagery at the surface. Clouds will still be displaced due to their elevation above the surface, but this time with respect to the terrain rather than the ellipsoid. (The mountain location T is now assigned the geographic location at T, and the Cloud at F appears at the geographic location T.) In Level 2 aerosol/surface processing, algorithms are applied to screen out the clouds. Terrain data only exist for MISR blocks containing some land. [Location=GLOBAL LAND] [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=563.2 km (cross-track); Longitude_Resolution=140.8 km (along-track).; Temporal_Resolution=about 15 orbits/day; Temporal_Resolution_Range=about 15 orbits/day].

IMAGERY↗

The Algorithm Theoretical Basis Document for Level 1A Processing

The first process of the Geoscience Laser Altimeter System (GLAS) Science Algorithm Software converts the Level 0 data into the Level 1A Data Products. The Level 1A Data Products are the time ordered instrument data converted from counts to engineering units. This document defines the equations that convert the raw instrument data into engineering units. Required scale factors, bias values, and coefficients are defined in this document. Additionally, required quality assurance and browse products are defined in this document.

Jester, Peggy L.↗

Ultralight Weight Optical Systems Using Nano-Layered Synthesized Materials

Optical imaging is important for many NASA science missions. Even though complex optical systems have advanced, the optics, based on conventional glass and mirrors, require components that are thick, heavy and expensive. As the need for higher performance expands, glass and mirrors are fast approaching the point where they will be too large, heavy and costly for spacecraft, especially small satellite systems. NASA Langley Research Center is developing a wide range of novel nano-layered synthesized materials that enable the development and fabrication of ultralight weight optical device systems that enable many NASA missions to collect science data imagery using small satellites. In addition to significantly reducing weight, the nano-layered synthesized materials offer advantages in performance, size, and cost.

Clark, Natalie↗

Thermal Analysis of Propulsion Components for the Europa Clipper Mission

This presentation describes the thermal analysis and model development that occurred for selected components on the propulsion module subsystem of the Europa Clipper mission, which will fly to Jupiter's icy moon Europa and collect science data from orbit. An overview of a bipropellant system is given, as well as a description of a typical thermal propulsion design. A comparison is also provided, describing the unique Europa Clipper thermal design, which is atypical in many respects. The engine thermal model development is also discussed, including hot-firing tests with nozzle convection correlation, as well as thermal vacuum tests to measure and correlate the emissivity of critical nozzle surfaces. A description of engine firing, as well as valve soak back, is also provided, including temperature maps and results of engine cases. A summary is also provided, of lessons learned regarding thermal propulsion considerations.

propulsion module subsystem↗

Langston University - High Energy Physics (LU-HEP)

This final report is presented by Langston University (LU) for the project entitled "Langston University High Energy Physics" (LUHEP) under the direction of principal investigator (PI) and project director Professor Joel Snow. The project encompassed high energy physics research performed at hadron colliders. The PI is a collaborator on the DZero experiment at Fermi National Accelerator Laboratory in Batavia, IL, USA and the ATLAS experiment at CERN in Geneva, Switzerland and was during the entire project period from April 1, 1999 until May 14, 2012. Both experiments seek to understand the fundamental constituents of the physical universe and the forces that govern their interactions. In 1999 as member of the Online Systems group for Run 2 the PI developed a cross-platform Python-based, Graphical User Interface (GUI) application for monitoring and control of EPICS based devices for control room use. This served as a model for other developers to enhance and build on for further monitoring and control tasks written in Python. Subsequently the PI created and developed a cross-platform C++ GUI utilizing a networked client-server paradigm and based on ROOT, the object oriented analysis framework from CERN. The GUI served as a user interface to the Examine tasks running in the D\O\ control room which monitored the status and integrity of data taking for Run 2. The PI developed the histogram server/control interface to the GUI client for the EXAMINE processes. The histogram server was built from the ROOT framework and was integrated into the D\O\ framework used for online monitoring programs and offline analysis. The PI developed the first implementation of displaying histograms dynamically generated by ROOT in a Web Browser. The PI's work resulted in several talks and papers at international conferences and workshops. The PI established computing software infrastructure at LU and U. Oklahoma (OU) to do analysis of DZero production data and produce simulation data for the experiment. Eventually this included the FNAL SAM data grid system, the SAMGrid (SG) infrastructure, and the Open Science Grid software stacks for computing and storage elements. At the end of 2003 Snow took on the role of global Monte Carlo production coordinator for the DØ experiment. A role which continues til this day. In January of 2004 Snow started working with the SAMGrid development team to help debug, deploy, and integrate SAMGrid with DØ Monte Carlo production. Snow installed and configured SG execution and client sites at LUHEP and OUHEP, and a SG scheduler site at LUHEP. The PI developed a python based GUI (DAJ) that acts as a front end for job submission to SAMGrid. The GUI interfaces to the DZero Mone Carlo (MC) request system that uses SAM to manage MC requests by the physics analysis groups. DAJ significantly simplified SG job submission and was deployed in DZero in an effort to increase the user base of SG. The following year was the advent of SAMGrid job submission to the Open Science Grid (OSG) and LHC Computing Grid (LCG) through a forwarding mechanism. The PI oversaw the integration of these grids into the existing production infrastructure. The PI developed an automatic MC (Automc) request processing system capable of operating without user intervention (other than getting grid credentials), and able to submit to any number of sites on various grids. The system manages production at all but 2 sites. The system was deployed at Fermilab and remains operating there today. The PI's work in distributed computing resulted in several talks at international conferences. UTA, OU, and LU were chosen as the collaborating institutions that form the Southwest Tier 2 Center (SWT2) for ATLAS. During the project period the PI contributed to the online and offline software infrastructure through his work with the Run 2 online group, and played a major role in Monte Carlo production for DZero. During the part of the project period in which the PI served as MC production coordinator MC production increased very significantly. In the first year of the PI's tenure as production coordinator production was 159M events and 6.7~TB of data. During the last year of the project period production was 2,342~M events and 262~TB of data. That is a factor of 15 increase in events and 39 in data volume. The increase occurred with improvements in computer hardware and networks, through the use of grid technology on diverse resources, and through increased automation and efficiency of the production process. LU HEP developed and deployed the automatic MC request processing system in use at FNAL. The complementary strategies of automation and grid production served DZero well. Fermilab has recognized LU HEP's contribution to DZero by allowing the PI to devote full time to research activities by appointing him a guest scientist for the last six years of the project period.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The NASA Orbiting Carbon Observatory (OCO) Mission: Objectives, Approach, and Status

The Orbiting Carbon Observatory (OCO) is a NASA Earth System Science Pathfinder (ESSP) mission that is currently under development at the Jet Propulsion Laboratory (JPL). OCO will make global, space-based measurements of atmospheric carbon dioxide (CO2) with the precision, resolution, and coverage needed to characterize regional-scale sources and sinks of this important greenhouse gas. The observatory consists of a dedicated spacecraft bus that carries a single instrument. The bus employs single-string version of Orbital Sciences Corporation (OSC) LEOStar-2 architecture. This 3-axis stabilized bus includes a propulsion system for orbit insertion and maintenance, provides power, points the instrument, receives and processes commands from the ground, and records, stores, and downlinks science and engineering data. The OCO instrument incorporates 3 oboresighted, high resolution grating spectrometers that will make coincident measurements of reflected sunlight in near-infrared CO2 and molecular oxygen (O2) bands. The instrument was designed and manufactured by Hamilton Sundstrand (Pomona, CA), and then integrated, flight qualified, and calibrated by JPL. It is scheduled for delivery to OSC (Dulles, VA) for integration with the spacecraft bus in the spring of 2008. OCO will be launched from the Vandenberg Air Force Base on a dedicated OSC Taurus XL launch vehicle in December 2008. It will fly in formation with the Earth Observing System Afternoon Constellation, a group of satellites that files in a 98.8 minute, 705 km altitude, sun-synchronous orbit. This orbit provides coverage of the sunlit hemisphere with a 16-day ground track repeat cycle. OCO will fly approx.4 minutes ahead of the EOS Aqua platform, with an ascending nodal crossing time of approx.1:26 PM. The OCO science data will be transmitted to the NASA Ground Network Stations in Alaska and Virginia, and then transferred to the OCO Ground Data System at JPL. There, the CO2 and O2 spectra will be analyzed by the OCO Science Team to provide spatially resolved estimates of the column-averaged CO2 dry air mole fraction, XCO2. These measurements are expected to improve our understanding of the nature and processes that regulate atmospheric CO2 enabling more reliable forecasts of CO2 buildup and its impact on climate change.

global measurements↗

Progress toward a universal biomedical data translator

Clinical, biomedical, and translational science has reached an inflection point in the breadth and diversity of available data and the potential impact of such data to improve human health and well-being. However, the data are often siloed, disorganized, and not broadly accessible due to discipline-specific differences in terminology and representation. To address these challenges, the Biomedical Data Translator Consortium has developed and tested a pilot knowledge graph-based “Translator” system capable of integrating existing biomedical data sets and “translating” those data into insights intended to augment human reasoning and accelerate translational science. Having demonstrated feasibility of the Translator system, the Translator program has since moved into development, and the Translator Consortium has made significant progress in the research, design, and implementation of an operational system. Herein, we describe the current system’s architecture, performance, and quality of results. We apply Translator to several real-world use cases developed in collaboration with subject-matter experts. Finally, we discuss the scientific and technical features of Translator and compare those features to other state-of-the-art, biomedical graph-based question-answering systems.

60 APPLIED LIFE SCIENCES↗

Earth Observing System: Science Objectives and Challenges

The Earth Observing System (EOS) is a space-based observing system comprised of a series of satellite sensors by which scientists can monitor the Earth, a Data and Information System (EOSDIS) enabling researchers worldwide to access the satellite data, and an interdisciplinary science research program to interpret the satellite data. In this presentation I will describe the key areas of scientific uncertainty in understanding climate and global change, and follow that with a description of the EOS goals, objectives, and scientific research elements that comprise the program (instrument science teams and interdisciplinary investigations). Finally, I will describe how scientists and policy makers intend to use EOS data to improve our understanding of key global change uncertainties, such as: (i) clouds and radiation, including fossil fuel and natural emissions of sulfate aerosol and its potential impact on cloud feedback, (ii) man's impact on ozone depletion, with examples of ClO and O3 obtained from the UARS satellite during the Austral Spring, and (iii) volcanic eruptions and their impact on climate, with examples from the eruption of Mt. Pinatubo.

King, Michael D.↗

Earth Observing System: Science Objectives and Challenges

The Earth Observing System (EOS) is a space-based observing system comprised of a series of satellite sensors by which scientists can monitor the Earth, a Data and Information System (EOSDIS) enabling researchers worldwide to access the satellite data, and an interdisciplinary science research program to interpret the satellite data. In this presentation we review the key areas of scientific uncertainty in understanding climate and global change, and follow that with a description of the EOS goals, objectives, and scientific research elements that comprise the program (instrument science teams and interdisciplinary investigations). Finally, I will describe how scientists and policy makers intend to use EOS data improve our understanding of key global change uncertainties, such as: (i) clouds and radiation, including fossil fuel and natural emissions of sulfate aerosol and its potential impact on cloud feedback, (ii) man's impact on ozone depletion, with examples of ClO and O3 obtained from the UARS satellite during the Austral Spring, and (iii) volcanic eruptions and their impact on climate, with examples from the eruption of Mt. Pinatubo.

King, Michael D.↗

Readout system of TPC/MPD NICA project

The time-projection chamber (TPC) is the main tracking detector in the MPD/NICA. The information on charge-particle tracks in the TPC is registered by the MWPG with cathode pad readout. The frontend electronics (FEE) are developed with use of modern technologies such as application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), and data transfer to a concentrator via a fast optical interface. The main parameters of the FEE are as follows: total number of channels, ∼95 000; data stream from the whole TPC, 5 GB/s; low power consumption, less than 100 mW/ch; signal to noise ratio (S/N), 30; equivalent noise charge (ENC), <1000e{sup –} (C{sub in} = 10–20 pF); and zero suppression (pad signal rejection ∼90%). The article presents the status of the readout chamber construction and the data acquisition system. The results of testing FEE prototypes are presented.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Earth Science Data Analytics: Preparing for Extracting Knowledge from Information

Data analytics is the process of examining large amounts of data of a variety of types to uncover hidden patterns, unknown correlations and other useful information. Data analytics is a broad term that includes data analysis, as well as an understanding of the cognitive processes an analyst uses to understand problems and explore data in meaningful ways. Analytics also include data extraction, transformation, and reduction, utilizing specific tools, techniques, and methods. Turning to data science, definitions of data science sound very similar to those of data analytics (which leads to a lot of the confusion between the two). But the skills needed for both, co-analyzing large amounts of heterogeneous data, understanding and utilizing relevant tools and techniques, and subject matter expertise, although similar, serve different purposes. Data Analytics takes on a practitioners approach to applying expertise and skills to solve issues and gain subject knowledge. Data Science, is more theoretical (research in itself) in nature, providing strategic actionable insights and new innovative methodologies. Earth Science Data Analytics (ESDA) is the process of examining, preparing, reducing, and analyzing large amounts of spatial (multi-dimensional), temporal, or spectral data using a variety of data types to uncover patterns, correlations and other information, to better understand our Earth. The large variety of datasets (temporal spatial differences, data types, formats, etc.) invite the need for data analytics skills that understand the science domain, and data preparation, reduction, and analysis techniques, from a practitioners point of view. The application of these skills to ESDA is the focus of this presentation. The Earth Science Information Partners (ESIP) Federation Earth Science Data Analytics (ESDA) Cluster was created in recognition of the practical need to facilitate the co-analysis of large amounts of data and information for Earth science. Thus, from a to advance science point of view: On the continuum of ever evolving data management systems, we need to understand and develop ways that allow for the variety of data relationships to be examined, and information to be manipulated, such that knowledge can be enhanced, to facilitate science. Recognizing the importance and potential impacts of the unlimited ways to co-analyze heterogeneous datasets, now and especially in the future, one of the objectives of the ESDA cluster is to facilitate the preparation of individuals to understand and apply needed skills to Earth science data analytics. Pinpointing and communicating the needed skills and expertise is new, and not easy. Information technology is just beginning to provide the tools for advancing the analysis of heterogeneous datasets in a big way, thus, providing opportunity to discover unobvious scientific relationships, previously invisible to the science eye. And it is not easy It takes individuals, or teams of individuals, with just the right combination of skills to understand the data and develop the methods to glean knowledge out of data and information. In addition, whereas definitions of data science and big data are (more or less) available (summarized in Reference 5), Earth science data analytics is virtually ignored in the literature, (barring a few excellent sources).

data analytics↗

Technology Assessment of High Capacity Data Storage Systems: Can We Avoid a Data Survivability Crisis?

In a recent address at the California Science Center in Los Angeles, Vice President Al Gore articulated a Digital Earth Vision. That vision spoke to developing a multi-resolution, three-dimensional visual representation of the planet into which we can roam and zoom into vast quantities of embedded geo-referenced data. The vision was not limited to moving through space, but also allowing travel over a time-line, which can be set for days, years, centuries, or even geological epochs. A working group of Federal Agencies, developing a coordinated program to implement the Vice President's vision, developed the definition of the Digital Earth as a visual representation of our planet that enables a person to explore and interact with the vast amounts of natural and cultural geo-referenced information gathered about the Earth. One of the challenges identified by the agencies was whether the technology existed that would be available to permanently store and deliver all the digital data that enterprises might want to save for decades and centuries. Satellite digital data is growing by Moore's Law as is the growth of computer generated data. Similarly, the density of digital storage media in our information-intensive society is also increasing by a factor of four every three years. The technological bottleneck is that the bandwidth for transferring data is only growing at a factor of four every nine years. This implies that the migration of data to viable long-term storage is growing more slowly. The implication is that older data stored on increasingly obsolete media are at considerable risk if they cannot be continuously migrated to media with longer life times. Another problem occurs when the software and hardware systems for which the media were designed are no longer serviced by their manufacturers. Many instances exist where support for these systems are phased out after mergers or even in going out of business. In addition, survivability of older media can suffer from physical breakdown of components (e.g. tapes simply lose their magnetic properties after a long time in storage). As a result, a potential data survivability crisis is emerging. The scale of the crisis is comparable to that facing the Social Security System. Sometime in one or two decades, the exponential growth of data will become so great that many enterprises will not be able to migrate through their data to more permanent media during the lifetime of the media on which it resides. This will result in significant losses of data and their resultant impacts. To avoid this crisis, we need to plan and devote greater financial and intellectual resources are needed for the development and refinement of new storage media and migration technologies in order to preserve all data any organization determines worth saving permanently. This talk will explore technological solutions and suggested recommendations to address this technological data crisis.

Halem, Milton↗