Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

Surface radiation budget - Current perspective

The surface radiation budget of the earth is important in climate research because it gives an understanding of the distribution of solar and IR radiation exchanges at the surface. Data on the distribution and exchange of these surface radiations are needed over the entire earth on a long-term basis. Global satellite data, coupled with highly developed models, now provide estimates of the surface radiation budget which are near the accuracy required for climate research. A description of surface radiation research, its current state, and planned programs are presented.

Darnell, Wayne L.↗

Incremental Parallelization of Non-Data-Parallel Programs Using the Charon Message-Passing Library

Message passing is among the most popular techniques for parallelizing scientific programs on distributed-memory architectures. The reasons for its success are wide availability (MPI), efficiency, and full tuning control provided to the programmer. A major drawback, however, is that incremental parallelization, as offered by compiler directives, is not generally possible, because all data structures have to be changed throughout the program simultaneously. Charon remedies this situation through mappings between distributed and non-distributed data. It allows breaking up the parallelization into small steps, guaranteeing correctness at every stage. Several tools are available to help convert legacy codes into high-performance message-passing programs. They usually target data-parallel applications, whose loops carrying most of the work can be distributed among all processors without much dependency analysis. Others do a full dependency analysis and then convert the code virtually automatically. Even more toolkits are available that aid construction from scratch of message passing programs. None, however, allows piecemeal translation of codes with complex data dependencies (i.e. non-data-parallel programs) into message passing codes. The Charon library (available in both C and Fortran) provides incremental parallelization capabilities by linking legacy code arrays with distributed arrays. During the conversion process, non-distributed and distributed arrays exist side by side, and simple mapping functions allow the programmer to switch between the two in any location in the program. Charon also provides wrapper functions that leave the structure of the legacy code intact, but that allow execution on truly distributed data. Finally, the library provides a rich set of communication functions that support virtually all patterns of remote data demands in realistic structured grid scientific programs, including transposition, nearest-neighbor communication, pipelining, gather/scatter, and redistribution. At the end of the conversion process most intermediate Charon function calls will have been removed, the non-distributed arrays will have been deleted, and virtually the only remaining Charon functions calls are the high-level, highly optimized communications. Distribution of the data is under complete control of the programmer, although a wide range of useful distributions is easily available through predefined functions. A crucial aspect of the library is that it does not allocate space for distributed arrays, but accepts programmer-specified memory. This has two major consequences. First, codes parallelized using Charon do not suffer from encapsulation; user data is always directly accessible. This provides high efficiency, and also retains the possibility of using message passing directly for highly irregular communications. Second, non-distributed arrays can be interpreted as (trivial) distributions in the Charon sense, which allows them to be mapped to truly distributed arrays, and vice versa. This is the mechanism that enables incremental parallelization. In this paper we provide a brief introduction of the library and then focus on the actual steps in the parallelization process, using some representative examples from, among others, the NAS Parallel Benchmarks. We show how a complicated two-dimensional pipeline-the prototypical non-data-parallel algorithm- can be constructed with ease. To demonstrate the flexibility of the library, we give examples of the stepwise, efficient parallel implementation of nonlocal boundary conditions common in aircraft simulations, as well as the construction of the sequence of grids required for multigrid.

VanderWijngaart, Rob F.↗

Impact of cell size on inventory and mapping errors in a cellular geographic information system

The author has identified the following significant results. The effect of grid position was found insignificant for maps but highly significant for isolated mapping units. A modelable relationship between mapping error and cell size was observed for the map segment analyzed. Map data structure was also analyzed with an interboundary distance distribution approach. Map data structure and the impact of cell size on that structure were observed. The existence of a model allowing prediction of mapping error based on map structure was hypothesized and two generations of models were tested under simplifying assumptions.

Wehde, M. E.↗

Dynacounter Electronic Data-Reduction System

Proposed "dynacounter" electronic data-reduction system acquires statistics on occurrence of various amplitude levels in signal. Processes tape-recorded signal from accelerometer (or other sensor) into data on statistical distribution of amplitudes in signal at given frequency. Output data suitable for calculations of fatigue.

Mustain, Roy W.↗

Archiving Space Geodesy Data for 20+ Years at the CDDIS

Since 1982, the Crustal Dynamics Data Information System (CDDIS) has supported the archive and distribution of geodetic data products acquired by NASA programs. These data include GPS (Global Positioning System), GLONASS (GLObal NAvigation Satellite System), SLR (Satellite Laser Ranging), VLBI (Very Long Baseline Interferometry), and DORIS (Doppler Orbitography and Radiolocation Integrated by Satellite). The data archive supports NASA's space geodesy activities through the Solid Earth and Natural Hazards (SENH) program. The CDDIS data system and its archive have become increasingly important to many national and international programs, particularly several of the operational services within the International Association of Geodesy (IAG), including the International GPS Service (IGS), the International Laser Ranging Service (ILRS), the International VLBI Service for Geodesy and Astrometry (IVS), the International DORIS Service (IDS), and the International Earth Rotation Service (IERS). The CDDIS provides easy and ready access to a variety of data sets, products, and information about these data. The specialized nature of the CDDIS lends itself well to enhancement and thus can accommodate diverse data sets and user requirements. All data sets and metadata extracted from these data sets are accessible to scientists through ftp and the web; general information about each data set is accessible via the web. The CDDIS, including background information about the system and its user communities, the computer architecture, archive contents, available metadata, and future plans will be discussed.

Noll, Carey E.↗

The Crustal Dynamics Data Information System: A Resource to Support Scientific Analysis Using Space Geodesy

Since 1982. the Crustal Dynamics Data Information System (CDDIS) has supported the archive and distribution of geodetic data products acquired by the National Aeronautics and Space Administration (NASA) as well as national and international programs. The CDDIS provides easy, timely, and reliable access to a variety of data sets, products, and information about these data. These measurements. obtained from a global network of nearly 650 instruments at more than 400 distinct sites, include DORIS (Doppler Orbitography and Radiopositioning Integrated by Satellite), GNSS (Global Navigation Satellite System), SLR and LLR (Satellite and Lunar Laser Ranging), and VLBI (Very Long Baseline Interferometry). The CDDIS data system and its archive have become increasingly important to many national and international science communities, particularly several of the operational services within the International Association of Geodesy (IAG) and its observing system the Global Geodetic Observing System (GGOS), including the International DORIS Service (IDS), the International GNSS Service (IGS). the International Laser Ranging Service (ILRS), the International VLBI Service for Geodesy and Astrometry (IVS). and the International Earth rotation and Reference frame Service (IERS), Investigations resulting from the data and products available through the CDDIS support research in many aspects of Earth system science and global change. Each month, the CDDIS archives more than one million data and derived product files totaling over 90 Gbytes in volume. In turn. the global user community downloads nearly 1.2 TBytes (over 10.5 million files) of data and products from the CDDIS each month. The requirements of analysts have evolved since the start of the CDDIS; the specialized nature of the system accommodates the enhancements required to support diverse data sets and user needs. This paper discusses the CDDIS. including background information about the system and its. user communities. archive contents. available metadata, and future plans.

Noll. Carey E.↗

The International Space Station: New Capabilities for Disaster Response and Humanitarian Aid

The International Space Station (ISS) has been acquiring Earth imagery since 2000, primarily in the form of astronaut photography using hand-held film and digital cameras. Recent additions of more sophisticated multispectral and hyperspectral sensor systems have expanded both the capabilities and relevance of the ISS to basic research, applied Earth science, and development of new sensor technologies. Funding opportunities established within NASA, the US National Laboratories and the international partner organizations have generated instrument proposals that will further enhance these capabilities. With both internal and external sensor location options, and the availability of both automated and human-tended operational environments, the ISS is a unique platform within the constellation of Earth-observing satellites currently in orbit. Current progress and challenges associated with development of ISS terrestrial remote sensing capabilities in the area of disaster response and support of relief efforts will be presented. The ISS orbit allows for imaging of the Earth's surface at varying times of day and night, providing opportunities for data collection over approximately 95% of the populated regions. These opportunities are distinct from--yet augment--the data collection windows for the majority of sensors on polar-orbiting satellites. In addition to this potential for "being in the right place at the right time" to collect critical information on an evolving disaster, the presence of a human crew also allows for immediate recognition of an event from orbit, notification of relevant organizations on the ground, and re-tasking of available remote sensing resources to support humanitarian response and relief efforts. Challenges to establishing an integrated response capability are both technical (coordination of sensor targeting and data collection, rapid downlink and posting of data to a central accessible hub, timely generation and distribution of relevant data products) and operational (notification and engagement of sensor support teams, international partner agency sanction of astronaut support activities). To better collaborate on common issues and strengthen applications, including using the data to support disaster response, we established an ISS Program Science Forum Working Group for Earth Observations comprised of representatives from the international partner agencies. This international forum welcomes input and support from relevant United Nations task groups regarding our disaster response and humanitarian aid to enable development of the ISS capabilities in this area for greatest value to the international community.

Stefanov, William↗

The GLAS Science Algorithm Software (GSAS) Detailed Design Document Version 6

The Geoscience Laser Altimeter System (GLAS) is the primary instrument for the ICESat (Ice, Cloud and Land Elevation Satellite) laser altimetry mission. ICESat was the benchmark Earth Observing System (EOS) mission for measuring ice sheet mass balance, cloud and aerosol heights, as well as land topography and vegetation characteristics. From 2003 to 2009, the ICESat mission provided multi-year elevation data needed to determine ice sheet mass balance as well as cloud property information, especially for stratospheric clouds common over polar areas. It also provided topography and vegetation data around the globe, in addition to the polar-specific coverage over the Greenland and Antarctic ice sheets.This document describes the detailed design of GLAS Science Algorithm Software (GSAS). The GSAS is used to create the ICESat GLAS standard data products. The National Snow and Ice Data Center (NSDIC) distribute these products. The document contains descriptions, flow charts, data flow diagrams, and structure charts for each major component of the GSAS. The purpose of this document is to present the detailed design of the GSAS. It is intended as a reference source to assist the maintenance programmer in making changes that fix or enhance the documented software.

Lee, Jeffrey E.↗

Limiting Data Friction by Reducing Data Download Using Spatiotemporally Aligned Data Organization Through STARE

Current data processing practice limits the volume and variety of relevant geoscience data that can practically be applied to important problems. File archives in centralized data centers are the principal means by which Earth Science data are accessed. This approach, however, requires laborious search, retrieval, and eventual customization/adaptation for the data to be used. Such fractionation makes it even more difficult to share outcomes, i.e. research artifacts and data products, hampering reusability and repeatability, since end users generally have their own research agenda and preferences as well as scarce resources. Thus, while finding and downloading data files from central data centers are already costly for end users working in their own field, using data products from other disciplines rapidly becomes prohibitive. This curtails scientific productivity, limits avenues of study, and endangers quality and reproducibility. The Spatio-Temporal Adaptive Resolution Encoding (STARE) is a unifying scheme that facilitates the indexing, access, and fusion of diverse Earth Science data. STARE implements an innovative encoding of geo-spatiotemporal information, originally developed for aligning datasets with diverse spatiotemporal characteristics in an array database. The spatial component of STARE recursively quadfurcates a root polyhedron, producing a hierarchical scheme for addressing geographic locations and regions. The temporal component of STARE uses conventional date-time units as an indexing hierarchy. The additional encoding of spatial and temporal resolution information in STARE enables comparisons and conditional selections across diverse datasets. Moreover, spatiotemporal set-operations, e.g. union and intersection, are mapped to efficient integer operations with STARE. Applied to existing data models (point, grid, spacecraft swath) and corresponding granules, STARE indexes provide a streamlined description usable as geo-spatiotemporal metadata. When coupled with large scale, distributed hardware and software, STARE-based data access reduces pre-analysis data preparation costs by offering a convenient means to align different datasets spatiotemporally without specialized effort in parallel computing or distributed data management.

Kuo, Kwo-Sen↗

Coefficients for calculating thermodynamic and transport properties of individual species

Libraries of thermodynamic data and transport properties are given for individual species in the form of least-squares coefficients. Values of C(sup 0)(sub p)(T), H(sup 0)(T), and S(sup 0)(T) are available for 1130 solid, liquid, and gaseous species. Viscosity and thermal conductivity data are given for 155 gases. The original C(sup 0)(sub p)(T) values were fit to a fourth-order polynomial with integration constants for H(sup 0)(T) and S(sup 0)(T). For each species the integration constant for H(sup 0)(T) includes the heat of formation. Transport properties have a different functional form. The temperature range for most of the data is 300 to 5000 K, although some of the newer thermodynamic data have a range of 200 to 6000 K. Because the species are mainly possible products of reaction, the data are useful for chemical equilibrium and kinetics computer codes. Much of the data has been distributed for several years with the NASA Lewis equilibrium program CET89. The thermodynamic properties of the reference elements were updated along with about 175 species that involve the elements carbon, hydrogen, oxygen, and nitrogen. These sets of data will be distributed with the NASA Lewis personal computer program for calculating chemical equilibria, CETPC.

Mcbride, Bonnie J.↗

Optimal Sensor Mobility Design for Target Tracking with Distributed Sensing, Communication and Computing Infrastructure

The paper presents an airborne target tracking approach with data fusion from distributed stationary and mobile sensor network transmitted through a wireless/wired communication network and using a distributed computing infrastructure. To obtain high quality measurements, sensor flight platforms' positions and orientations are optimized with respect to the available target's position and velocity estimates, and a formation control strategy is applied to derive desired trajectories for the flight platforms. As sensors move, the communication network topology switching is determined using the worst-case approach to handle uncertainties in the target's and sensors' positions, which alters communication delays for sensors' data transmission to computing centers. An optimal data migration algorithm is periodically applied to determine these communication delays for each sensor and the optimal location with minimum end-to-end latency for the target tracking algorithm execution, which is based on adaptive information fusion from multi-modal mobile and stationary sensors inside an Extended Kalman Filter framework. The approach is validated in a desktop simulation environment using synthetic sensor data generated for a simulated target's flight.

Distributed sensing↗

The Impact of Dimensionality Reduction of Ion Counts Distributions on Preserving Moments, With Applications to Data Compression

The field of space physics has a long history of utilizing dimensionality reduction methods to distill data, including but not limited to spherical harmonics, the Fourier Transform, and the wavelet transform. Here, we present a technique for performing dimensionality reduction on ion counts distributions from the Multiscale Mission/Fast Plasma Investigation (MMS/FPI) instrument using a data-adaptive method powered by neural networks. This has applications to both feeding low-dimensional parameterizations of the counts distributions into other machine learning algorithms, and the problem of data compression to reduce transmission volume for space missions. The algorithm presented here is lossy, and in this work, we present the technique of validating the reconstruction performance with calculated plasma moments under the argument that preserving the moments also preserves fluid-level physics, and in turn a degree of scientific validity. The method presented here is an improvement over other lossy compressions in loss-tolerant scenarios like the Multiscale Mission/Fast Plasma Investigation Fast Survey or in non-research space weather applications.

D. da Silva↗

Determination of the horizontal and vertical distribution of clouds from infrared satellite sounding data

A numerical algorithm, based on a physical inversion of the radiative transfer equation, is developed to retrieve the global distribution of the horizontal cloud cover, the cloud-top pressure levels and their temperature. The algorithm makes use of infrared and microwave temperature sounding data to derive the clear-column vertical temperature profiles and then uses the same infrared sounding data to obtain the corresponding cloud parameters. Experimental verification of this method is carried out using data from the High resolution Infrared Sounder (HIRS) and the Microwave Sounding Unit (MSU) operating on the NOAA weather satellite system.

Chahine, M. T.↗

Magnetic Repeat Station Data

The nature, purpose, availability and distribution of magnetic repeat stations data are reviewed. Attention is paid to how repeat station data are obtained, sources of errors and limitations on accuracy. Repeat station results cannot achieve the accuracy of magnetic observatory estimates of the secular variation, but are, nevertheless, essential for improving the limited spatial coverage provided by observatories. The lack of appropriate standards and reporting procedures have meant that most global field molders have made little, or no, use of repeat data. Partly to rectify this problem, IAGA Working Group V-4 has instigated a scheme for systematic reporting and classification of magnetic repeat station data. The scheme will help to ensure that proper use is made of the wealth of repeat data that is available, and will also promote better observational practices.

Barton, C. E.↗

Spherical Harmonic Analysis of Particle Velocity Distribution Function: Comparison of Moments and Anisotropies using Cluster Data

This paper presents a spherical harmonic analysis of the plasma velocity distribution function using high-angular, energy, and time resolution Cluster data obtained from the PEACE spectrometer instrument to demonstrate how this analysis models the particle distribution function and its moments and anisotropies. The results show that spherical harmonic analysis produced a robust physical representation model of the velocity distribution function, resolving the main features of the measured distributions. From the spherical harmonic analysis, a minimum set of nine spectral coefficients was obtained from which the moment (up to the heat flux), anisotropy, and asymmetry calculations of the velocity distribution function were obtained. The spherical harmonic method provides a potentially effective "compression" technique that can be easily carried out onboard a spacecraft to determine the moments and anisotropies of the particle velocity distribution function for any species. These calculations were implemented using three different approaches, namely, the standard traditional integration, the spherical harmonic (SPH) spectral coefficients integration, and the singular value decomposition (SVD) on the spherical harmonic methods. A comparison among the various methods shows that both SPH and SVD approaches provide remarkable agreement with the standard moment integration method.

Gurgiolo, Chris↗

Distribution of Snow and Maximum Snow Water Equivalent Obtained by LANDSAT Data and Degree Day Method

Maximum snow water equivalence and snowcover distribution are estimated using several LANDSAT data taken in snowmelting season over a four year period. The test site is Okutadami-gawa Basin located in the central position of Tohoku-Kanto-Chubu District. The year to year normalization for snowmelt volume computation on the snow line is conducted by year to year correction of degree days using the snowcover percentage within the test basin obtained from LANDSAT data. The maximum snow water equivalent map in the test basin is generated based on the normalized snowmelt volume on the snow line extracted from four LANDSAT data taken in a different year. The snowcover distribution on an arbitrary day in snowmelting of 1982 is estimated from the maximum snow water equivalent map. The estimated snowcover is compared with the snowcover area extracted from NOAA-AVHRR data taken on the same day. The applicability of the snow estimation using LANDSAT data is discussed.

Takeda, K.↗

Quantitative suspended sediment mapping using aircraft remotely sensed multispectral data

Suspended sediment is an important environmental parameter for monitoring water quality, water movement, and land use. Quantitative suspended sediment determinations were made from analysis of aircraft remotely sensed multispectral digital data. A statistical analysis and derived regression equation were used to determine and plot quantitative suspended sediment concentration contours in the tidal James River, Virginia, on May 28, 1974. From the analysis, a single band, Band 8 (0.70-0.74 microns), was adequate for determining suspended sediment concentrations. A correlation coefficient of 0.89 was obtained with a mean inaccuracy of 23.5 percent for suspended sediment concentrations up to about 50 mg/l. Other water quality parameters - secchi disc depth and chlorophyll - also had high correlations with the remotely sensed data. Particle size distribution had only a fair correlation with the remotely sensed data.

Johnson, R. W.↗