Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

NASA's EOSDIS Cumulus: Ingesting, Archiving, Managing, and Distributing Earth Science Data from the Commercial Cloud

NASA's Earth Observing System Data and Information System (EOSDIS) has been working towards a vision of a cloud-based, highly-flexible, ingest, archive, management, and distribution system for its ever-growing and evolving data holdings. This system, Cumulus, is emerging from its prototyping stages and is poised to make a huge impact on how NASA manages and disseminates its Earth science data. This talk will outline the motivation for this work, present the achievements and hurdles of the past 18 months and will chart a course for the future expansion of the Cumulus expansion. We will explore on not just the technical, but also the socio-technical challenges that we face in evolving a system of this magnitude into the cloud and how we are rising to meet those challenges through open collaboration and intentional stakeholder engagement.

Earth Scienc↗
NASA NTRS1993

The SSABLE system - Automated archive, catalog, browse and distribution of satellite data in near-real time

Historically, locating and browsing satellite data has been a cumbersome and expensive process. This has impeded the efficient and effective use of satellite data in the geosciences. SSABLE is a new interactive tool for the archive, browse, order, and distribution of satellite date based upon X Window, high bandwidth networks, and digital image rendering techniques. SSABLE provides for automatically constructing relational database queries to archived image datasets based on time, data, geographical location, and other selection criteria. SSABLE also provides a visual representation of the selected archived data for viewing on the user's X terminal. SSABLE is a near real-time system; for example, data are added to SSABLE's database within 10 min after capture. SSABLE is network and machine independent; it will run identically on any machine which satisfies the following three requirements: 1) has a bitmapped display (monochrome or greater); 2) is running the X Window system; and 3) is on a network directly reachable by the SSABLE system. SSABLE has been evaluated at over 100 international sites. Network response time in the United States and Canada varies between 4 and 7 s for browse image updates; reported transmission times to Europe and Australia typically are 20-25 s.

Simpson, James J.↗
NASA NTRS2005

AIRSAR Automated Web-based Data Processing and Distribution System

In this paper, we present an integrated, end-to-end synthetic aperture radar (SAR) processing system that accepts data processing requests, submits processing jobs, performs quality analysis, delivers and archives processed data. This fully automated SAR processing system utilizes database and internet/intranet web technologies to allow external users to browse and submit data processing requests and receive processed data. It is a cost-effective way to manage a robust SAR processing and archival system. The integration of these functions has reduced operator errors and increased processor throughput dramatically.

WEB SERVICES↗
NASA NTRS2004

Science Data Processing for the Advanced Microwave Scanning Radiometer: Earth Observing System

The National Aeronautics and Space Administration established the framework for the Science Investigator-led Processing Systems (SIPS) to enable the Earth science data products to be produced by personnel directly associated with the instrument science team and knowledgeable of the science algorithms. One of the first instantiations implemented for NASA was the Advanced Microwave Scanning Radiometer - Earth Observing System (AMSR-E) SIPS. The AMSR-E SIPS is a decentralized, geographically distributed ground data processing system composed of two primary components located in California and Alabama. Initial science data processing is conducted at Remote Sensing Systems (RSS) in Santa Rosa, California. RSS ingests antenna temperature orbit data sets from JAXA and converts them to calibrated, resampled, geolocated brightness temperatures. The brightness temperatures are sent to the Global Hydrology and Climate Center in Huntsville, Alabama, which generates the geophysical science data products (e.g., water vapor, sea surface temperature, sea ice extent, etc.) suitable for climate research and applications usage. These science products are subsequently sent to the National Snow and Ice Data Center Distributed Active Archive Center in Boulder, Colorado for archival and dissemination to the at-large science community. This paper describes the organization, coordination, and production techniques employed by the AMSR-E SIPS in implementing, automating and operating the distributed data processing system.

Goodman, H. Michael↗
NASA NTRS1984

The distribution of reconnection geometry in flux transfer events using energetic ion, plasma and magnetic data

The distribution of energetic ion anisotropies in flux transfer events (FTEs) about the dayside magnetopause has been determined for ISEE 2 crossings of the boundary in 1977 and 1978. When the events are sorted according to the sign of the east-west component of the magnetic field in the magnetosphere, a clear correlation is observed on the northern morningside. When the field is eastward, particles flow antiparallel to the field, implying field line connection to the Northern Hemisphere; when the field is westward, the opposite is true. On the afternoonside, the particle anisotropies are correlated with latitude. Explanations for this pattern are discussed which involve FTE formation at low latitudes with subsequent motion at a velocity given by the vector superposition of the Alfven velocity from the release of magnetic tension and the magnetosheath bulk flow velocity. Evidence that the geomagnetic and not the geocentric solar magnetospheric equator is the source of FTEs is considered.

Daly, P. W.↗
NASA NTRS1994

A distributed computing model for telemetry data processing

We present a new approach to distributing processed telemetry data among spacecraft flight controllers within the control centers at NASA's Johnson Space Center. This approach facilitates the development of application programs which integrate spacecraft-telemetered data and ground-based synthesized data, then distributes this information to flight controllers for analysis and decision-making. The new approach combines various distributed computing models into one hybrid distributed computing model. The model employs both client-server and peer-to-peer distributed computing models cooperating to provide users with information throughout a diverse operations environment. Specifically, it provides an attractive foundation upon which we are building critical real-time monitoring and control applications, while simultaneously lending itself to peripheral applications in playback operations, mission preparations, flight controller training, and program development and verification. We have realized the hybrid distributed computing model through an information sharing protocol. We shall describe the motivations that inspired us to create this protocol, along with a brief conceptual description of the distributed computing models it employs. We describe the protocol design in more detail, discussing many of the program design considerations and techniques we have adopted. Finally, we describe how this model is especially suitable for supporting the implementation of distributed expert system applications.

Barry, Matthew R.↗
NASA NTRS2002

Visualizing 2D Probability Distributions from Satellite Image-Derived Data

Creating maps of biophysical and geophysical variables using Earth Observing System (EOS) satellite image data is an important component of Earth science. These 2D maps have a single value at every location and standard techniques are used to visualize them. Current tools fall short, however, when it is necessary to describe a distribution of values at each location. Distributions may represent a frequency of occurrence over time, frequency of occurrence from multiple runs of an ensemble forecast or possible values from an uncertainty model. 'Distribution data sets' are described, then a case study is presented to visualize such 2D distributions. Distribution data sets are different from multivariate data sets in the sense that the values are for a single variable instead of multiple variables. Our case study data consists of multiple realizations of percent forest cover, generated using a geostatistical technique that combines ground measurements and satellite imagery to model uncertainty about forest cover. We present several approaches for analyzing and visualizing such data sets. The first is a pixel-wise analysis of the probability density functions for the 2D image while the second is an analysis of features identified within the image. Such pixel-wise and feature-wise views will give Earth scientists a more complete understanding of distribution data sets.

Kao, David↗
NASA NTRS1985

Microwave inversion of leaf area and inclination angle distributions from backscattered data

The backscattering coefficient from a slab of thin randomly oriented dielectric disks over a flat lossy ground is used to reconstruct the inclination angle and area distributions of the disks. The disks are employed to model a leafy agricultural crop, such as soybeans, in the L-band microwave region of the spectrum. The distorted Born approximation, along with a thin disk approximation, is used to obtain a relationship between the horizontal-like polarized backscattering coefficient and the joint probability density of disk inclination angle and disk radius. Assuming large skin depth reduces the relationship to a linear Fredholm integral equation of the first kind. Due to the ill-posed nature of this equation, a Phillips-Twomey regularization method with a second difference smoothing condition is used to find the inversion. Results are obtained in the presence of 1 and 10 percent noise for both leaf inclination angle and leaf radius densities.

Lang, R. H.↗
NASA NTRS1997

Examination of Soil Moisture Retrieval Using SIR-C Radar Data and a Distributed Hydrological Model

A major objective of soil moisture-related hydrological-research during NASA's SIR-C/X-SAR mission was to determine and compare soil moisture patterns within humid watersheds using SAR data, ground-based measurements, and hydrologic modeling. Currently available soil moisture-inversion methods using active microwave data are only accurate when applied to bare and slightly vegetated surfaces. Moreover, as the surface dries down, the number of pixels that can provide estimated soil moisture by these radar inversion methods decreases, leading to less accuracy and, confidence in the retrieved soil moisture fields at the watershed scale. The impact of these errors in microwave- derived soil moisture on hydrological modeling of vegetated watersheds has yet to be addressed. In this study a coupled water and energy balance model operating within a topographic framework is used to predict surface soil moisture for both bare and vegetated areas. In the first model run, the hydrological model is initialized using a standard baseflow approach, while in the second model run, soil moisture values derived from SIR-C radar data are used for initialization. The results, which compare favorably with ground measurements, demonstrate the utility of combining radar-derived surface soil moisture information with basin-scale hydrological modeling.

Hsu, A. Y.↗
NASA NTRS1996

Monitoring Data-Structure Evolution in Distributed Message-Passing Programs

Monitoring the evolution of data structures in parallel and distributed programs, is critical for debugging its semantics and performance. However, the current state-of-art in tracking and presenting data-structure information on parallel and distributed environments is cumbersome and does not scale. In this paper we present a methodology that automatically tracks memory bindings (not the actual contents) of static and dynamic data-structures of message-passing C programs, using PVM. With the help of a number of examples we show that in addition to determining the impact of memory allocation overheads on program performance, graphical views can help in debugging the semantics of program execution. Scalable animations of virtual address bindings of source-level data-structures are used for debugging the semantics of parallel programs across all processors. In conjunction with light-weight core-files, this technique can be used to complement traditional debuggers on single processors. Detailed information (such as data-structure contents), on specific nodes, can be determined using traditional debuggers after the data structure evolution leading to the semantic error is observed graphically.

Sarukkai, Sekhar R.↗
NASA NTRS2015

Lidar-Radiometer Inversion Code (LIRIC) for the Retrieval of Vertical Aerosol Properties from Combined Lidar Radiometer Data: Development and Distribution in EARLINET

This paper presents a detailed description of LIRIC (LIdar-Radiometer Inversion Code)algorithm for simultaneous processing of coincident lidar and radiometric (sun photometric) observations for the retrieval of the aerosol concentration vertical profiles. As the lidar radiometric input data we use measurements from European Aerosol Re-search Lidar Network (EARLINET) lidars and collocated sun-photometers of Aerosol Robotic Network (AERONET). The LIRIC data processing provides sequential inversion of the combined lidar and radiometric data by the estimations of column-integrated aerosol parameters from radiometric measurements followed by the retrieval of height-dependent concentrations of fine and coarse aerosols from lidar signals using integrated column characteristics of aerosol layer as a priori constraints. The use of polarized lidar observations allows us to discriminate between spherical and non-spherical particles of the coarse aerosol mode. The LIRIC software package was implemented and tested at a number of EARLINET stations. Inter-comparison of the LIRIC-based aerosol retrievals was performed for the observations by seven EARLNET lidars in Leipzig, Germany on 25 May 2009. We found close agreement between the aerosol parameters derived from different lidars that supports high robustness of the LIRIC algorithm. The sensitivity of the retrieval results to the possible reduction of the available observation data is also discussed.

Chaikovsky, A.↗
NASA NTRS1995

Model-based VQ for image data archival, retrieval and distribution

An ideal image compression technique for image data archival, retrieval and distribution would be one with the asymmetrical computational requirements of Vector Quantization (VQ), but without the complications arising from VQ codebooks. Codebook generation and maintenance are stumbling blocks which have limited the use of VQ as a practical image compression algorithm. Model-based VQ (MVQ), a variant of VQ described here, has the computational properties of VQ but does not require explicit codebooks. The codebooks are internally generated using mean removed error and Human Visual System (HVS) models. The error model assumed is the Laplacian distribution with mean, lambda-computed from a sample of the input image. A Laplacian distribution with mean, lambda, is generated with uniform random number generator. These random numbers are grouped into vectors. These vectors are further conditioned to make them perceptually meaningful by filtering the DCT coefficients from each vector. The DCT coefficients are filtered by multiplying by a weight matrix that is found to be optimal for human perception. The inverse DCT is performed to produce the conditioned vectors for the codebook. The only image dependent parameter used in the generation of codebook is the mean, lambda, that is included in the coded file to repeat the codebook generation process for decoding.

Manohar, Mareboyana↗
NASA NTRS2007

Understanding Local Structure Globally in Earth Science Remote Sensing Data Sets

Empirical probability distributions derived from the data are the signatures of physical processes generating the data. Distributions defined on different space-time windows can be compared and differences or changes can be attributed to physical processes. This presentation discusses on ways to reduce remote sensing data in a way that preserves information, focusing on the rate-distortion theory and using the entropy-constrained vector quantization algorithm.

massive data sets↗
NASA NTRSDate not supplied

The Future of Oaks in the Santa Monica Mountains: A Case Study in Using Remote Sensing Data for Species Distributions Models

The Woolsey Fire began on November 8, 2018, and lasted for almost two weeks, during which it burned almost 100,000 acres of valuable landscape and habitat, including a vast area of woodland. The persistence of key woodland species provides aesthetic, monetary, and ecological value to the landscape through carbon sequestration, air temperature moderation, and erosion mitigation, among other ecosystem services. This study investigated the impact of the Woolsey Fire on native woodland species distributions and identified areas suitable for restoration within the Santa Monica Mountains National Recreation Area. The team partnered with the Resource Conservation District of the Santa Monica Mountains; National Park Service, Santa Monica Mountains National Recreation Area; California Department of Parks and Recreation, Los Angeles County Division; County of Los Angeles Fire Department, Prevention Services Bureau, Forestry Division; County of Los Angeles Department of Regional Planning; and the University of Montana. The Earth observations used include data from Landsat 8 Operational Land Imager, NASA ER-2 Jet Airborne Visible InfraRed Imaging Spectrometer, Shuttle Radar Topography Mission, and RapidEye. The team produced maps of burn severity from the Woolsey Fire, its impact on plant species distributions, and habitat suitability projections for 2050 and 2099 to assist partners in prioritizing areas for restoration. A plant community classification was successfully created using Multiple Endmember Spectral Mixture Analysis (MESMA). Overall accuracy was assessed at 90.54% by comparing the classification to validation pixels derived from ground truth information provided by our partners.

Roger Ly↗
NASA NTRS1995

Experimental evaluation of dynamic data allocation strategies in a distributed database with changing workloads

Traditionally, allocation of data in distributed database management systems has been determined by off-line analysis and optimization. This technique works well for static database access patterns, but is often inadequate for frequently changing workloads. In this paper we address how to dynamically reallocate data for partionable distributed databases with changing access patterns. Rather than complicated and expensive optimization algorithms, a simple heuristic is presented and shown, via an implementation study, to improve system throughput by 30 percent in a local area network based system. Based on artificial wide area network delays, we show that dynamic reallocation can improve system throughput by a factor of two and a half for wide area networks. We also show that individual site load must be taken into consideration when reallocating data, and provide a simple policy that incorporates load in the reallocation decision.

Brunstrom, Anna↗
NASA NTRS1997

Comparison of OARE Accelerometer Data with Dopant Distribution in Se-Doped GaAs Crystals Grown During USML-1

Experiments were conducted in the crystal growth furnace (CGF) during the first United States Microgravity Laboratory (USML-1), the STS-50 flight of the Space Shuttle Columbia, to determine the segregation behavior of selenium in bulk GaAs in a microgravity environment. After the flight, the selenium-doped GaAs crystals were sectioned, polished, and analyzed to determine the free carrier concentration as a function of position, One of the two crystals initially exhibited an axial concentration profile indicative of diffusion controlled growth, but this profile then changed to that predicted for a complete mixing type growth. An analytical model, proposed by Naumann [R.J. Naumann, J. Crystal Growth 142 (1994) 253], was utilized to predict the maximum allowable microgravity disturbances transverse to the growth direction during the two different translation rates used for each of the experiments. The predicted allowable acceleration levels were 4.86 microgram for the 2.5 micrometers/s furnace translation rate and 38.9 microgram for the 5.0 micrometers/s rate. These predicted values were compared to the Orbital Acceleration Research Experiment (OARE) accelerometer data recorded during the crystal growth periods for these experiments. Based on the analysis of the OARE acceleration data and utilizing the predictions from the analytical model, it is concluded that the change in segregation behavior was not caused by any acceleration events in the microgravity environment.

Moskowitz, Milton E.↗
NASA NTRS1991

WetNet: Using SSM/I data interactively for global distribution of rainfall and precipitable water

By completing hardware installation, preparing for comparative studies of SSM/I, radar, and lightning data, it is believed that this will be a powerful combination for evaluating the global distribution of tropical rainfall, and the vertical distribution of latent heating, with strong application to algorithms for use on TRMM, EOS-A, and future GOES spacecraft. Potential data bases will be surveyed, about 5 case studies with surface rainfall, radar, lightning, and sounding data will be identified. SSM/I algorithms will be used to identify convective regions of MCSs. A catalog will be developed of the global profile of heavy tropical rainfall, and how these zones are organized within larger tropical weather systems. Beginning with the first few months of SSM/I data distributed over WetNet, SSM/I radiances will be compared with TOVS radiance (moisture and thermal) and OLR observations. The purpose is to improve understanding of how real world water vapor profiles in the tropical atmosphere are perceived by SSM/I precipitable water algorithm and, at the same time, by the TOVS water vapor channel.

Zipser, Edward J.↗
NASA NTRS1986

Global distribution of SAGE II data products

Techniques employed to map the global distribution of stratospheric aerosols using SAGE II data at four wavelengths (385, 453, 525 and 1020 microns) are described. The methods were devised to integrate the 900 data points scanned by the instrument with account taken of the different times the vertical profiles were obtained. The data have been used to calculate the O3, H2O, NO2 and aerosol optical thicknesses. Sample details of data gathered during April 1985 are discussed, with emphasis on difficulties being encountered in analyzing the differences being observed in the dawn and dusk data.

Rind, D.↗