Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

ER-2 Observations of Precipitation Systems During TRMM-LBA

The NASA ER-2 performed numerous flights over precipitation systems in Rondonia, Brazil. The ER-2 carried a payload including the ER-2 Doppler Radar (EDOP), the Advanced Microwave Precipitation Radiometer (AMPR), the Lightning Instrument Package, and other instruments. This presentation will overview the types of data sets collected during TRMM-LBA (Tropical Rainfall Measuring Mission Satellite-Large Scale Biosphere Atmosphere Experiment in Amazonia) with particular emphasis on EDOP measurements. Numerous cases of convection ranging from weak to very intense, were overflown by the ER-2. Two TRMM overpasses were coincident with ER-2 flights which allowed for intercomparisons between the Precipitation Radiometer (PR), EDOP, and the S-POL (S-band Polarimetric Radar) and TOGA (Tropical Oceans and Global Atmosphere) ground-based radars. Preliminary results from this comparison will be presented as well as initial selection of case studies and efforts involving vertical motions in convection.

Heymsfield, Gerald↗

Electrodynamics of the middle atmosphere: Superpressure balloon program

In this experiment a comprehensive set of electrical parameters were measured during eight long duration flights in the southern hemisphere stratosphere. These flight resulted in the largest data set ever collected from the stratosphere. The stratosphere has never been electrodynamically sampled in the systematic manner before. New discoveries include short term variability in the planetary scale electric current system, the unexpected observation of stratospheric conductivity variations over thunderstorms and the observation of direct stratospheric conductivity variations following a relatively small solar flare. Major statistical studies were conducted of the large scale current systems, the stratospheric conductivity and the neutral gravity waves (from pressure and temperature data) using the entire data set.

Holzworth, Robert H.↗

Analysis of ALTAIR 1998 Meteor Radar Data

We describe a new analysis of a set of 32 UHF meteor radar traces recorded with the 422 MHz ALTAIR radar facility in November 1998. Emphasis is on the velocity measurements, and on inferences that can be drawn from them regarding the meteor masses and mass densities. We find that the velocity vs altitude data can be fitted as quadratic functions of the path integrals of the atmospheric densities vs distance, and deceleration rates derived from those fits all show the expected behavior of increasing with decreasing altitude. We also describe a computer model of the coupled processes of collisional heating, radiative cooling, evaporative cooling and ablation, and deceleration - for meteors composed of defined mixtures of mineral constituents. For each of the cases in the data set we ran the model starting with the measured initial velocity and trajectory inclination, and with various trial values of the quantity mPs 2 (the initial mass times the mass density squared), and then compared the computed deceleration vs altitude curves vs the measured ones. In this way we arrived at the best-fit values of the mPs 2 for each of the measured meteor traces. Then further, assuming various trial values of the density Ps, we compared the computed mass vs altitude curves with similar curves for the same set of meteors determined previously from the measured radar cross sections and an electrostatic scattering model. In this way we arrived at estimates of the best-fit mass densities Ps for each of the cases. Keywords meteor ALTAIR radar analysis 1 Introduction This paper describes a new analysis of a set of 422 MHz meteor scatter radar data recorded with the ALTAIR High-Power-Large-Aperture radar facility at Kwajalein Atoll on 18 November 1998. The exceptional accuracy/precision of the ALTAIR tracking data allow us to determine quite accurate meteor trajectories, velocities and deceleration rates. The measurements and velocity/deceleration data analysis are described in Sections II and III. The main point of this paper is to use these deceleration rate data, together with results from a computer model, to determine values of the quantities mPs 2 (the meteor mass times its material density squared); and further, by combining these m s 2 values with meteor mass estimates for the same set of meteors determined separately from measured radar scattering

Zinn, J.↗

Satellite Data Sets in the Polar Regions

We have generated about two decades of consistently derived geophysical parameters in the polar regions. The key parameters are sea ice concentration, surface temperature, albedo, and cloud cover statistics. Sea ice concentrations were derived from the Scanning Multichannel Microwave Radiometer (SMMR) data and the Special Scanning Cl Microwave Imager (SSM/I) data from several platforms using the enhanced Bootstrap Algorithm for the period 1978 through 1999. The new algorithm reduces the errors associated with spatial and temporal variations in the emissivity and surface temperatures of sea ice. Also, bad data at ocean/land interfaces are identified and deleted in an unsupervised manner. Surface ice temperature, albedo and cloud cover statistics are derived simultaneously from the Advanced Very High Resolution Radiometer (AVHRR) data from 1981 through 1999 and mapped at a higher resolution but the same format as the ice concentration data. The technique makes use these co-registered ice concentration maps to enable cloud masking to be done separately for open ocean, sea ice and land areas. The effect of inversion is minimized by taking into consideration the expected changes in the effect of inversion with altitude, especially in the Antarctic. A technique for ice type regional classification has also been developed using multichannel cluster analysis and a neural network. This provide a means to identify large areas of thin ice, first year ice, and older ice types. The data sets have been shown to be coherent with each other and provide a powerful tool for in depth studies of the currently changing Arctic and Antarctic environment.

Comiso, Josefino C.↗

Distributed Monitoring of the R(sup 2) Statistic for Linear Regression

The problem of monitoring a multivariate linear regression model is relevant in studying the evolving relationship between a set of input variables (features) and one or more dependent target variables. This problem becomes challenging for large scale data in a distributed computing environment when only a subset of instances is available at individual nodes and the local data changes frequently. Data centralization and periodic model recomputation can add high overhead to tasks like anomaly detection in such dynamic settings. Therefore, the goal is to develop techniques for monitoring and updating the model over the union of all nodes data in a communication-efficient fashion. Correctness guarantees on such techniques are also often highly desirable, especially in safety-critical application scenarios. In this paper we develop DReMo a distributed algorithm with very low resource overhead, for monitoring the quality of a regression model in terms of its coefficient of determination (R2 statistic). When the nodes collectively determine that R2 has dropped below a fixed threshold, the linear regression model is recomputed via a network-wide convergecast and the updated model is broadcast back to all nodes. We show empirically, using both synthetic and real data, that our proposed method is highly communication-efficient and scalable, and also provide theoretical guarantees on correctness.

Bhaduri, Kanishka↗

SPARC Intercomparison of Middle Atmosphere Climatologies

This atlas presents detailed incomparisons of several climatological wind and temperature data sets which cover the middle atmosphere (over altitudes approx. 10-80 km). A number of middle atmosphere climatologies have been developed in the research community based on a variety of meteorological analyses and satellite data sets. Here we present comparisons between these climatological data sets for a number of basic circulation statistics, such as zonal mean temperature, winds and eddy flux statistics. Special attention is focused on tropical winds and temperatures, where large differences exist among separate analyses. We also include comparisons between the global climatologies and historical rocketsonde wind and temperature measurements, and also with more recent lidar temperature data. These comparisons highlight differences and uncertainties in contemporary middle atmosphere data sets, and allow biases in particular analyses to be isolated. In addition, a brief atlas of zonal mean temperature and wind statistics is provided to highlight data availability and as a quick-look reference. This technical report is intended as a companion to the climatological data sets held in archive at the SPARC Data Center (http://www.sparc.sunysb.edu).

Randel, William↗

Online mass storage system detailed requirements document

The requirements for an online high density magnetic tape data storage system that can be implemented in a multipurpose, multihost environment is set forth. The objective of the mass storage system is to provide a facility for the compact storage of large quantities of data and to make this data accessible to computer systems with minimum operator handling. The results of a market survey and analysis of candidate vendor who presently market high density tape data storage systems are included.

Source record↗

Crustal dynamics project data analysis, 1987. Volume 2: Mobile VLBI geodetic results, 1982-1986

The Goddard VLBI group reports the results of analyzing 101 Mark III data sets acquired from mobile observing sites through the end of 1986 and available to the Crustal Dynamics Project. The fixed VLBI observations at Hat Creek, Ft. Davis, Mojave, and OVRO are included as they participate heavily in the mobile schedules. One large solution GLB171 was used to obtain baseline length and transverse evolutions. Radio source positions were estimated globally, while nutation offsets were estimated from each data set. The results include 28 mobile sites.

Ma, C.↗

Isotropization and Evolution of Energy-Containing Eddies in Solar Wind Turbulence: Parker Solar Probe, Helios 1, ACE, WIND, and Voyager 1

We examine the radial evolution of correlation lengths perpendicular (l^ C) and parallel (  lC) to the magnetic-field direction, computed from solar wind magnetic-field data measured by Parker Solar Probe (PSP) during its first eight orbits, Helios 1, Advanced Composition Explorer (ACE), WIND, and Voyager 1 spacecraft. Correlation lengths are grouped by an interval’s alignment angle; the angle between the magnetic-field and solar wind velocity vectors (ΘBV). Parallel and perpendicular angular channels correspond to angles 0° < ΘBV < 40° and 50° < ΘBV < 90°, respectively. We observe an anisotropy in the inner heliosphere within 0.40 au, with  l l »^ 0.75 C C at 0.10 au. This anisotropy reduces with increasing heliocentric distance and the correlation lengths roughly isotropize within 1 au. Results from ACE and WIND support a reversal of the anisotropy, such that  l l »^ 1.29 C C at 1 au. The ratio does not appear to change significantly beyond 1 au, although the small number of parallel intervals in the Voyager data set precludes unambiguous conclusions from being drawn. This study provides insights regarding the radial evolution of the large, most energetic interacting turbulent fluctuations in the heliosphere. We also emphasize the importance of tracking the changes in sampling direction in PSP measurements as the spacecraft approaches the Sun, when using these data to study the radial evolution of turbulence. This can prove to be vital in understanding the more complex dynamics of the solar wind in the inner heliosphere and can assist in improving related simulations.

Manuel Enrique Cuesta↗

Decision net, directed graph, and neural net processing of imaging spectrometer data

A decision-net solution involving a novel hierarchical classifier and a set of multiple directed graphs, as well as a neural-net solution, are respectively presented for large-class problem and mixture problem treatments of imaging spectrometer data. The clustering method for hierarchical classifier design, when used with multiple directed graphs, yields an efficient decision net. New directed-graph rules for reducing local maxima as well as the number of perturbations required, and the new starting-node rules for extending the reachability and reducing the search time of the graphs, are noted to yield superior results, as indicated by an illustrative 500-class imaging spectrometer problem.

Casasent, David↗

Global digital data sets of soil type, soil texture, surface slope and other properties: Documentation of archived data tape

The file structure and coding of four soils data sets derived from the Zobler (1986) world soil file is described. The data were digitized on a one-degree square grid. They are suitable for large-area studies such as climate research with general circulation models, as well as in forestry, agriculture, soils, and hydrology. The first file is a data set of codes for soil unit, land-ice, or water, for all the one-degree square cells on Earth. The second file is a data set of codes for texture, land-ice, or water, for the same soil units. The third file is a data set of codes for slope, land-ice, or water for the same units. The fourth file is the SOILWRLD data set, containing information on soil properties of land cells of both Matthews' and Food and Agriculture Organization (FAO) sources. The fourth file reconciles land-classification differences between the two and has missing data filled in.

Staub, B.↗

A VLSI chip set for real time vector quantization of image sequences

The architecture and implementation of a VLSI chip set that vector quantizes (VQ) image sequences in real time is described. The chip set forms a programmable Single-Instruction, Multiple-Data (SIMD) machine which can implement various vector quantization encoding structures. Its VQ codebook may contain unlimited number of codevectors, N, having dimension up to K = 64. Under a weighted least squared error criterion, the engine locates at video rates the best code vector in full-searched or large tree searched VQ codebooks. The ability to manipulate tree structured codebooks, coupled with parallelism and pipelining, permits searches in as short as O (log N) cycles. A full codebook search results in O(N) performance, compared to O(KN) for a Single-Instruction, Single-Data (SISD) machine. With this VLSI chip set, an entire video code can be built on a single board that permits realtime experimentation with very large codebooks.

Baker, Richard L.↗

Microwave Satellite Data for Hydrologic Modeling in Ungauged Basins

An innovative flood-prediction framework is developed using Tropical Rainfall Measuring Mission precipitation forcing and a proxy for river discharge from the Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E) onboard the National Aeronautics and Space Administration's Aqua satellite. The AMSR-E-detected water surface signal was correlated with in situ measurements of streamflow in the Okavango Basin in Southern Africa as indicated by a Pearson correlation coefficient of 0.90. A distributed hydrologic model, with structural data sets derived from remote-sensing data, was calibrated to yield simulations matching the flood frequencies from the AMSR-E-detected water surface signal. Model performance during a validation period yielded a Nash-Sutcliffe efficiency of 0.84. We concluded that remote-sensing data from microwave sensors could be used to supplement stream gauges in large sparsely gauged or ungauged basins to calibrate hydrologic models. Given the global availability of all required data sets, this approach can be potentially expanded to improve flood monitoring and prediction in sparsely gauged basins throughout the world

Distributed hydrologic modeling↗

Detectability of geothermal areas using Skylab X-5 data

The results are presented of a study which was undertaken to determine if data from a single near-noon pass of Skylab could be used to detect geothermal areas. The size and temperature requirements for a geothermally heated area to be seen by Skylab S-192 MSS X-5 thermal sensor were calculated. This sensor obtained thermal data with the highest spatial resolution of any nonmilitary satellite system. Only very large hot areas could be expected to be unambiguously recognized with a single data set from this instrument. The study area chosen was The Geysers geothermal field in Sonoma County, California, the only geothermal area of significant size scanned by Skylab. Unfortunately, 95% of the Skylab thermal channel data was acquired within 3 hours of local noon. For The Geysers area only daytime X-5 data were available. An analysis of the thermal channel data (10.2 to 12.5 um) revealed that ground temperatures determined by Skylab were normally distributed. No anomalous hot spots were apparent. Computer enhancement techniques were used to delineate the hottest 100 and 300 ground areas (pixel, 75 m by 75 m) within the study region. It was found that the Skylab MSS with the X-5 thermal detector does not have sufficient spatial resolution to locate unambiguously from daytime data any but the largest and hottest convectively created geothermal features, which in general are prominent enough to have been previously recognized.

Siegal, B. S.↗

Zonal average earth radiation budget measurements from satellites for climate studies

Data from 29 months of satellite radiation budget measurements, taken intermittently over the period 1964 through 1971, are composited into mean month, season and annual zonally averaged meridional profiles. Individual months, which comprise the 29 month set, were selected as representing the best available total flux data for compositing into large scale statistics for climate studies. A discussion of spatial resolution of the measurements along with an error analysis, including both the uncertainty and standard error of the mean, are presented.

Ellis, J. S.↗

Electron and ion density depletions measured in the STS-3 orbiter wake

The third Space Shuttle flight on Columbia carried instrumentation to measure thermal plasma density and temperature. Two separate investigations, the Plasma Diagnostics Package (PDP) and the Vehicle Charging and Potential Experiment (VCAP), carried a Langmuir Probe, and the VCAP also included a Spherical Retarding Potential Analyzer (SRPA). Only those measurements made while the PDP is in the payload bay are discussed here since the VCAP instrumentation remains in the payload bay at all times and the two measurements are compared. The wake behind a large structure (in this case the Space Shuttle Orbiter) flying through the ionospheric plasma is discussed. Much theoretical work was done regarding plasma wakes. The instrumentation on this mission gives the first data taken with a large vehicle in the ionospheric laboratory. First, the PDP Langmuir Probe and its data set will be presented, then the VCAP Langmuir Probe and SRPA with associated data. The agreement between the two data sets is discussed and then followed by some other PDP data which infers an even lower wake density.

Murphy, G. B.↗

Artificial Intelligence Controls Tape-Recording Sequence

Developmental expert-system computer program intended to schedule recording of large amounts of data on limited amount of magnetic tape. Schedules recording using two sets of rules. First set incorporates knowledge of locations for recording of new data. Second set incorporates knowledge about issuing commands to recorder. Designed primarily for use on Voyager Spacecraft, also applicable to planning and sequencing in industry.

Schwuttke, Ursula M.↗

Data management for community research projects: A JGOFS case study

Since the mid 1980s, much of the marine science research effort in the United Kingdom has been focused into large scale collaborative projects involving public sector laboratories and university departments, termed Community Research Projects. Two of these, the Biogeochemical Ocean Flux Study (BOFS) and the North Sea Project incorporated large scale data collection to underpin multidisciplinary modeling efforts. The challenge of providing project data sets to support the science was met by a small team within the British Oceanographic Data Centre (BODC) operating as a topical data center. The role of the data center was to both work up the data from the ship's sensors and to combine these data with sample measurements into online databases. The working up of the data was achieved by a unique symbiosis between data center staff and project scientists. The project management, programming and data processing skills of the data center were combined with the oceanographic experience of the project communities to develop a system which has produced quality controlled, calibrated data sets from 49 research cruises in 3.5 years of operation. The data center resources required to achieve this were modest and far outweighed by the time liberated in the scientific community by the removal of the data processing burden. Two online project databases have been assembled containing a very high proportion of the data collected. As these are under the control of BODC their long term availability as part of the UK national data archive is assured. The success of the topical data center model for UK Community Research Project data management has been founded upon the strong working relationships forged between the data center and project scientists. These can only be established by frequent personal contact and hence the relatively small size of the UK has been a critical factor. However, projects covering a larger, even international scale could be successfully supported by a network of topical data centers managing online databases which are interconnected by object oriented distributed data management systems over wide area networks.

Lowry, Roy K.↗