Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

An automatic editing algorithm for GPS data

An algorithm has been developed to edit automatically Global Positioning System data such that outlier deletion, cycle slip identification, and correction are independent of clock instability, selective availability, receiver-satellite kinematics, and tropospheric conditions. This algorithm, called TurboEdit, operates on undifferenced, dual frequency carrier phase data, and requires the use of P code pseudorange data and a smoothly varying ionospheric electron content. TurboEdit was tested on the large data set from the CASA Uno experiment, which contained over 2500 cycle slips.Analyst intervention was required on 1 percent of the station-satellite passes, almost all of these problems being due to difficulties in extrapolating variations in the ionospheric delay. The algorithm is presently being adapted for real time data editing in the Rogue receiver for continuous monitoring applications.

Blewitt, Geoffrey↗
NASA NTRS1991

Computing the Lyapunov spectrum of a dynamical system from an observed time series

The paper examines the problem of accurately determining, from an observed time series, the Liapunov exponents for the dynamical system generating the data. It is shown that, even with very large data sets, it is clearly advantageous to utilize local neighborhood-to-neighborhood mappings with higher-order Taylor series rather than just local linear maps. This procedure is demonstrated on the Henon and Ikeda maps of the plane itself, the Lorenz system of three ordinary differential equations, and the Mackey-Glass delay differential equation.

Brown, Reggie↗
NASA NTRS1992

IMF draping around the geotail - IMP 8 observations

The draping pattern for the full range of IMF directions is mapped in the GSM yz-plane using a large data set for studying magnetic field draping around the tail. Based on the maps, it is concluded that the dominant pattern is draping as found by Ohtani and Kokubun (1991) and Sanchez and Siscoe (1990). A new finding is that the draping pattern is rotated relative to the plane formed by the IMF and the aberrated x-axis, with the degree of rotation varying from zero for strongly northward and southward IMF to a peak of 17 deg for moderately southward IMF. It is also found that the tail radius is bigger for southward IMF than for northward IMF.

Kaymaz, Zerefsan↗
NASA NTRS1992

Materials surface contamination analysis

The original research objective was to demonstrate the ability of optical fiber spectrometry to determine contamination levels on solid rocket motor cases in order to identify surface conditions which may result in poor bonds during production. The capability of using the spectral features to identify contaminants with other sensors which might only indicate a potential contamination level provides a real enhancement to current inspection systems such as Optical Stimulated Electron Emission (OSEE). The optical fiber probe can easily fit into the same scanning fixtures as the OSEE. The initial data obtained using the Guided Wave Model 260 spectrophotometer was primarily focused on determining spectra of potential contaminants such as HD2 grease, silicones, etc. However, once we began taking data and applying multivariate analysis techniques, using a program that can handle very large data sets, i.e., Unscrambler 2, it became apparent that the techniques also might provide a nice scientific tool for determining oxidation and chemisorption rates under controlled conditions. As the ultimate power of the technique became recognized, considering that the chemical system which was most frequently studied in this work is water + D6AC steel, we became very interested in trying the spectroscopic techniques to solve a broad range of problems. The complexity of the observed spectra for the D6AC + water system is due to overlaps between the water peaks, the resulting chemisorbed species, and products of reaction which also contain OH stretching bands. Unscrambling these spectral features, without knowledge of the specific species involved, has proven to be a formidable task.

Workman, Gary L.↗
NASA NTRS1993

The analytical representation of viscoelastic material properties using optimization techniques

This report presents a technique to model viscoelastic material properties with a function of the form of the Prony series. Generally, the method employed to determine the function constants requires assuming values for the exponential constants of the function and then resolving the remaining constants through linear least-squares techniques. The technique presented here allows all the constants to be analytically determined through optimization techniques. This technique is employed in a computer program named PRONY and makes use of commercially available optimization tool developed by VMA Engineering, Inc. The PRONY program was utilized to compare the technique against previously determined models for solid rocket motor TP-H1148 propellant and V747-75 Viton fluoroelastomer. In both cases, the optimization technique generated functions that modeled the test data with at least an order of magnitude better correlation. This technique has demonstrated the capability to use small or large data sets and to use data sets that have uniformly or nonuniformly spaced data pairs. The reduction of experimental data to accurate mathematical models is a vital part of most scientific and engineering research. This technique of regression through optimization can be applied to other mathematical models that are difficult to fit to experimental data through traditional regression techniques.

Hill, S. A.↗
NASA NTRS1993

Digital mammography, cancer screening: Factors important for image compression

The use of digital mammography for breast cancer screening poses several novel problems such as development of digital sensors, computer assisted diagnosis (CAD) methods for image noise suppression, enhancement, and pattern recognition, compression algorithms for image storage, transmission, and remote diagnosis. X-ray digital mammography using novel direct digital detection schemes or film digitizers results in large data sets and, therefore, image compression methods will play a significant role in the image processing and analysis by CAD techniques. In view of the extensive compression required, the relative merit of 'virtually lossless' versus lossy methods should be determined. A brief overview is presented here of the developments of digital sensors, CAD, and compression methods currently proposed and tested for mammography. The objective of the NCI/NASA Working Group on Digital Mammography is to stimulate the interest of the image processing and compression scientific community for this medical application and identify possible dual use technologies within the NASA centers.

Clarke, Laurence P.↗
NASA NTRS1993

How to get unlimited observing time on a 4 metre telescope

As the astronomical community moves ever more towards fewer and larger telescopes it is not just desirable but essential to make the maximum possible use of these new facilities. The Hitchhiker parallel CCD camera has been specially designed to increase the scientific output of a large telescope by imaging the off-axis field of view. The large data set collected by this instrument consists of deep CCD multicolor data of the distant Universe and is extremely well suited to the study of faint galaxies and their evolution, as well as other areas. The instrument's design and some of its projects are briefly discussed below and demonstrates the scientific value such instruments could have if incorporated on all new telescopes.

Driver, S. P.↗
NASA NTRS1991

Information technologies for astrophysics circa 2001

It is easy to extrapolate current trends to see where technologies relating to information systems in astrophysics and other disciplines will be by the end of the decade. These technologies include miniaturization, multiprocessing, software technology, networking, databases, graphics, pattern computation, and interdisciplinary studies. It is less easy to see what limits our current paradigms place on our thinking about technologies that will allow us to understand the laws governing very large systems about which we have large data sets. Three limiting paradigms are as follows: saving all the bits collected by instruments or generated by supercomputers; obtaining technology for information compression, storage, and retrieval off the shelf; and the linear model of innovation. We must extend these paradigms to meet our goals for information technology at the end of the decade.

Denning, Peter J.↗
NASA NTRS1991

The manifold of globular clusters

A multivariate statistical analysis of a large data set on the Galactic globular clusters indicates that at least 4 (possibly 5 or 6) parameters are needed in order to describe fully the global properties of these objects. Some nontrivial correlations are present in the data, and are described in the text. One of them is the scaling relation between the luminosity and the central velocity dispersion, whose possible physical origin is briefly discussed. Many of the systematic trends found in the data suggest that dynamical effects played an important or even a dominant role in determining the present-day global properties of globular clusters.

Djorgovski, S.↗
NASA NTRS1985

Distribution of atmospheric aerosols and CO2 lidar backscatter simulation

Development of a Global Wind Measurement Satellite System (WINDSAT) (NOAA, 1981) requires a knowledge of the global characteristics of the free tropospheric and lower stratospheric aerosol. In particular, there is a need to document the behavior of the aerosol backscattering function, at CO2 laser wavelengths, beta sub CO2, as a function of space and time. There is, however, a relative lack of data for the free troposphere, particularly over the remoter regions of the globe, as compared with that for the boundary layer and the stratosphere. Moreover, because of variations in concentration that occur as a function of space and time, large data sets are required to obtain meaningful averages. A recent study by Kent et al. (1985) uses three distinct tropospheric aerosol data sets in order to obtain an improved global model of the general aerosol characteristics, including variation of beta sub CO2 with latitude, season, and altitude. The more important findings are summarized.

Kent, G. S.↗
NASA NTRS1993

Clementine: Anticipated scientific datasets from the Moon and Geographos

The Clementine spacecraft mission is designed to test the performance of new lightweight and low-power detectors developed at the Lawrence Livermore National Laboratory (LLNL) for the Strategic Defense Initiative Office (SDIO). A secondary objective of the mission is to acquire useful scientific data, principally of the Moon and the near-Earth asteroid Geographos. The spacecraft will be in an elliptical polar orbit about the Moon for about 2 months beginning in February of 1994 and it will fly by Geographos on August 31. Clementine will carry seven detectors each weighing less than about 1 kg: two Star Trackers wide-angle uv/vis wide-angle Short Wavelength IR (SWIR) Long-Wavelength IR (LWIR) and LIDAR (Laser Image Detection And Ranging) narrow-angle imaging and ranging. Additional presentations about the mission detectors and related science issues are in this volume. If fully successful Clementine will return about 3 million lunar images, a dataset with nearly as many bits of data (uncompressed) as the first cycle of Magellan and more than 5000 images of Geographos. The complete and efficient analysis of such large data sets requires systematic processing efforts. Described below are concepts for two such efforts for the Clementine mission: global multispectral imaging of the Moon and videos of the Geographos flyby. Other anticipated datasets for which systematic processing might be desirable include multispectral observations of Earth; LIDAR altimetry of the Moon with high-resolution imaging along each ground track; high-resolution LIDAR color along each lunar ground track which could be used to identify potential titanium-rich deposits at scales of a few meters; and thermal IR imaging along each lunar ground track (including nighttime observations near the poles).

Mcewen, A. S.↗
NASA NTRS1992

An IDL-based analysis package for COBE and other skycube-formatted astronomical data

UIMAGE is a data analysis package written in IDL for the Cosmic Background Explorer (COBE) project. COBE has extraordinarily stringent accuracy requirements: 1 percent mid-infrared absolute photometry, 0.01 percent submillimeter absolute spectrometry, and 0.0001 percent submillimeter relative photometry. Thus, many of the transformations and image enhancements common to analysis of large data sets must be done with special care. UIMAGE is unusual in this sense in that it performs as many of its operations as possible on the data in its native format and projection, which in the case of COBE is the quadrilateralized sphereical cube ('skycube'). That is, after reprojecting the data, e.g., onto an Aitoff map, the user who performs an operation such as taking a crosscut or extracting data from a pixel is transparently acting upon the skycube data from which the projection was made, thereby preserving the accuracy of the result. Current plans call for formatting external data bases such as CO maps into the skycube format with a high-accuracy transformation, thereby allowing Guest Investigators to use UIMAGE for direct comparison of the COBE maps with those at other wavelengths from other instruments. It is completely menu-driven so that its use requires no knowledge of IDL. Its functionality includes I/O from the COBE archives, FITS files, and IDL save sets as well as standard analysis operations such as smoothing, reprojection, zooming, statistics of areas, spectral analysis, etc. One of UIMAGE's more advanced and attractive features is its terminal independence. Most of the operations (e.g., menu-item selection or pixel selection) that are driven by the mouse on an X-windows terminal are also available using arrow keys and keyboard entry (e.g., pixel coordinates) on VT200 and Tektronix-class terminals. Even limited grey scales of images are available this way. Obviously, image processing is very limited on this type of terminal, but it is nonetheless surprising how much analysis can be done on that medium. Such flexibility has the virtue of expanding the user community to those who must work remotely on non-image terminals, e.g., via modem.

Ewing, J. A.↗
NASA NTRS1993

Investigation of spectral analysis techniques for randomly sampled velocimetry data

It is well known that velocimetry (LV) generates individual realization velocity data that are randomly or unevenly sampled in time. Spectral analysis of such data to obtain the turbulence spectra, and hence turbulence scales information, requires special techniques. The 'slotting' technique of Mayo et al, also described by Roberts and Ajmani, and the 'Direct Transform' method of Gaster and Roberts are well known in the LV community. The slotting technique is faster than the direct transform method in computation. There are practical limitations, however, as to how a high frequency and accurate estimate can be made for a given mean sampling rate. These high frequency estimates are important in obtaining the microscale information of turbulence structure. It was found from previous studies that reliable spectral estimates can be made up to about the mean sampling frequency (mean data rate) or less. If the data were evenly samples, the frequency range would be half the sampling frequency (i.e. up to Nyquist frequency); otherwise, aliasing problem would occur. The mean data rate and the sample size (total number of points) basically limit the frequency range. Also, there are large variabilities or errors associated with the high frequency estimates from randomly sampled signals. Roberts and Ajmani proposed certain pre-filtering techniques to reduce these variabilities, but at the cost of low frequency estimates. The prefiltering acts as a high-pass filter. Further, Shapiro and Silverman showed theoretically that, for Poisson sampled signals, it is possible to obtain alias-free spectral estimates far beyond the mean sampling frequency. But the question is, how far? During his tenure under 1993 NASA-ASEE Summer Faculty Fellowship Program, the author investigated from his studies on the spectral analysis techniques for randomly sampled signals that the spectral estimates can be enhanced or improved up to about 4-5 times the mean sampling frequency by using a suitable prefiltering technique. But, this increased bandwidth comes at the cost of the lower frequency estimates. The studies further showed that large data sets of the order of 100,000 points, or more, high data rates, and Poisson sampling are very crucial for obtaining reliable spectral estimates from randomly sampled data, such as LV data. Some of the results of the current study are presented.

Sree, Dave↗
NASA NTRS1994

Magnetospheric-ionospheric Poynting flux

Over the past three years of funding SRI, in collaboration with the University of Texas at Dallas, has been involved in determining the total electromagnetic energy flux into the upper atmosphere from DE-B electric and magnetic field measurements and modeling the electromagnetic energy flux at high latitudes, taking into account the coupled magnetosphere-ionosphere system. This effort has been very successful in establishing the DC Poynting flux as a fundamental quantity in describing the coupling of electromagnetic energy between the magnetosphere and ionosphere. The DE-B satellite electric and magnetic field measurements were carefully scrutinized to provide, for the first time, a large data set of DC, field-aligned, Poynting flux measurement. Investigations describing the field-aligned Poynting flux observations from DE-B orbits under specific geomagnetic conditions and from many orbits were conducted to provide a statistical average of the Poynting flux distribution over the polar cap. The theoretical modeling effort has provided insight into the observations by formulating the connection between Poynting's theorem and the electromagnetic energy conversion processes that occur in the ionosphere. Modeling and evaluation of these processes has helped interpret the satellite observations of the DC Poynting flux and improved our understanding of the coupling between the ionosphere and magnetosphere.

Thayer, Jeffrey P.↗
NASA NTRS1994

Parallelization and visual analysis of multidimensional fields: Application to ozone production, destruction, and transport in three dimensions

Atmospheric modeling is a grand challenge problem for several reasons, including its inordinate computational requirements and its generation of large amounts of data concurrent with its use of very large data sets derived from measurement instruments like satellites. In addition, atmospheric models are typically run several times, on new data sets or to reprocess existing data sets, to investigate or reinvestigate specific chemical or physical processes occurring in the earth's atmosphere, to understand model fidelity with respect to observational data, or simply to experiment with specific model parameters or components.

Schwan, Karsten↗
NASA NTRS1994

A land-surface Testbed for EOSDIS

The main objective of the Testbed project was to deliver satellite images via the Internet to scientific and educational users free of charge. The main method of operations was to store satellite images on a low cost tape library system, visually browse the raw satellite data, access the raw data filed, navigate the imagery through 'C' programming and X-Windows interface software, and deliver the finished image to the end user over the Internet by means of file transfer protocol methods. The conclusion is that the distribution of satellite imagery by means of the Internet is feasible, and the archiving of large data sets can be accomplished with low cost storage systems allowing multiple users.

Emery, William↗
NASA NTRS1994

Unstructured grids on SIMD torus machines

Unstructured grids lead to unstructured communication on distributed memory parallel computers, a problem that has been considered difficult. Here, we consider adaptive, offline communication routing for a SIMD processor grid. Our approach is empirical. We use large data sets drawn from supercomputing applications instead of an analytic model of communication load. The chief contribution of this paper is an experimental demonstration of the effectiveness of certain routing heuristics. Our routing algorithm is adaptive, nonminimal, and is generally designed to exploit locality. We have a parallel implementation of the router, and we report on its performance.

Bjorstad, Petter E.↗
NASA NTRS1993

Synergy between optical and microwave remote sensing to derive soil and vegetation parameters from MAC Europe 1991 Experiment

The ability of remote sensing for monitoring vegetation density and soil moisture for agricultural applications is extensively studied. In optical bands, vegetation indices (NDVI, WDVI) in visible and near infrared reflectances are related to biophysical quantities as the leaf area index, the biomass. In active microwave bands, the quantitative assessment of crop parameters and soil moisture over agricultural areas by radar multiconfiguration algorithms remains prospective. Furthermore the main results are mostly validated on small test sites, but have still to be demonstrated in an operational way at a regional scale. In this study, a large data set of radar backscattering has been achieved at a regional scale on a French pilot watershed, the Orgeval, along two growing seasons in 1988 and 1989 (mainly wheat and corn). The radar backscattering was provided by the airborne scatterometer ERASME, designed at CRPE, (C and X bands and HH and VV polarizations). Empirical relationships to estimate water crop and soil moisture over wheat in CHH band under actual field conditions and at a watershed scale are investigated. Therefore, the algorithms developed in CHH band are applied for mapping the surface conditions over wheat fields using the AIRSAR and TMS images collected during the MAC EUROPE 1991 experiment. The synergy between optical and microwave bands is analyzed.

Taconet, O.↗