Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed databases”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

High-performance mass storage system for workstations

Reduced Instruction Set Computer (RISC) workstations and Personnel Computers (PC) are very popular tools for office automation, command and control, scientific analysis, database management, and many other applications. However, when using Input/Output (I/O) intensive applications, the RISC workstations and PC's are often overburdened with the tasks of collecting, staging, storing, and distributing data. Also, by using standard high-performance peripherals and storage devices, the I/O function can still be a common bottleneck process. Therefore, the high-performance mass storage system, developed by Loral AeroSys' Independent Research and Development (IR&D) engineers, can offload a RISC workstation of I/O related functions and provide high-performance I/O functions and external interfaces. The high-performance mass storage system has the capabilities to ingest high-speed real-time data, perform signal or image processing, and stage, archive, and distribute the data. This mass storage system uses a hierarchical storage structure, thus reducing the total data storage cost, while maintaining high-I/O performance. The high-performance mass storage system is a network of low-cost parallel processors and storage devices. The nodes in the network have special I/O functions such as: SCSI controller, Ethernet controller, gateway controller, RS232 controller, IEEE488 controller, and digital/analog converter. The nodes are interconnected through high-speed direct memory access links to form a network. The topology of the network is easily reconfigurable to maximize system throughput for various applications. This high-performance mass storage system takes advantage of a 'busless' architecture for maximum expandability. The mass storage system consists of magnetic disks, a WORM optical disk jukebox, and an 8mm helical scan tape to form a hierarchical storage structure. Commonly used files are kept in the magnetic disk for fast retrieval. The optical disks are used as archive media, and the tapes are used as backup media. The storage system is managed by the IEEE mass storage reference model-based UniTree software package. UniTree software will keep track of all files in the system, will automatically migrate the lesser used files to archive media, and will stage the files when needed by the system. The user can access the files without knowledge of their physical location. The high-performance mass storage system developed by Loral AeroSys will significantly boost the system I/O performance and reduce the overall data storage cost. This storage system provides a highly flexible and cost-effective architecture for a variety of applications (e.g., realtime data acquisition with a signal and image processing requirement, long-term data archiving and distribution, and image analysis and enhancement).

Chiang, T.↗
NASA NTRS1993

Automatic detection of mass-resolved ion conics

A processing algorithm to automatically detect a specific type of ion distribution (called the ion conic distribution) in data obtained from a space-based mass spectrometer has been devised. Automation of this task is necessary due to the sparseness of conic events within the very large databases typical of space plasma instruments. This paper reports on the algorithm used to perform this automated analysis, along with a description of the methods used to verify the algorithm and a summary of initial results on the characterization of the near-earth space plasma.

Doherty, Mark F.↗
NASA NTRS1994

An incremental database access method for autonomous interoperable databases

We investigated a number of design and performance issues of interoperable database management systems (DBMS's). The major results of our investigation were obtained in the areas of client-server database architectures for heterogeneous DBMS's, incremental computation models, buffer management techniques, and query optimization. We finished a prototype of an advanced client-server workstation-based DBMS which allows access to multiple heterogeneous commercial DBMS's. Experiments and simulations were then run to compare its performance with the standard client-server architectures. The focus of this research was on adaptive optimization methods of heterogeneous database systems. Adaptive buffer management accounts for the random and object-oriented access methods for which no known characterization of the access patterns exists. Adaptive query optimization means that value distributions and selectives, which play the most significant role in query plan evaluation, are continuously refined to reflect the actual values as opposed to static ones that are computed off-line. Query feedback is a concept that was first introduced to the literature by our group. We employed query feedback for both adaptive buffer management and for computing value distributions and selectivities. For adaptive buffer management, we use the page faults of prior executions to achieve more 'informed' management decisions. For the estimation of the distributions of the selectivities, we use curve-fitting techniques, such as least squares and splines, for regressing on these values.

Roussopoulos, Nicholas↗
NASA NTRS2002

An Aeroacoustic Study of a Leading Edge Slat Configuration

Aeroacoustic evaluations of high-lift devices have been carried out in the Quiet Flow Facility of the NASA Langley Research Center. The present paper describes detailed flow and acoustic measurements that have been made in order to better understand the noise generated from airflow over a wing leading edge slat configuration, and to possibly predict and reduce this noise source. The acoustic database is obtained by a moveable Small Aperture Directional Array of microphones designed to electronically steer to different portions of models under study. The slat is shown to be a uniform distributed noise source. The data was processed such that spectra and directivity were determined with respect to a one-foot span of slat. The spectra are normalized in various fashions to demonstrate slat noise character. In order to equate portions of the spectra to different slat noise components, trailing edge noise predictions using measured slat boundary layer parameters as inputs are compared to the measured slat noise spectra.

Mendoza, J. M.↗
NASA NTRS2005

Lessons Learned From Developing Three Generations of Remote Sensing Science Data Processing Systems

The Biospheric Information Systems Branch at NASA s Goddard Space Flight Center has developed three generations of Science Investigator-led Processing Systems for use with various remote sensing instruments. The first system is used for data from the MODIS instruments flown on NASA s Earth Observing Systems @OS) Terra and Aqua Spacecraft launched in 1999 and 2002 respectively. The second generation is for the Ozone Measuring Instrument flying on the EOS Aura spacecraft launched in 2004. We are now developing a third generation of the system for evaluation science data processing for the Ozone Mapping and Profiler Suite (OMPS) to be flown by the NPOESS Preparatory Project (NPP) in 2006. The initial system was based on large scale proprietary hardware, operating and database systems. The current OMI system and the OMPS system being developed are based on commodity hardware, the LINUX Operating System and on PostgreSQL, an Open Source RDBMS. The new system distributes its data archive across multiple server hosts and processes jobs on multiple processor boxes. We have created several instances of this system, including one for operational processing, one for testing and reprocessing and one for applications development and scientific analysis. Prior to receiving the first data from OMI we applied the system to reprocessing information from the Solar Backscatter Ultraviolet (SBUV) and Total Ozone Mapping Spectrometer (TOMS) instruments flown from 1978 until now. The system was able to process 25 years (108,000 orbits) of data and produce 800,000 files (400 GiB) of level 2 and level 3 products in less than a week. We will describe the lessons we have learned and tradeoffs between system design, hardware, operating systems, operational staffing, user support and operational procedures. During each generational phase, the system has become more generic and reusable. While the system is not currently shrink wrapped we believe it is to the point where it could be readily adopted, with substantial cost savings, for other similar tasks.

Tilmes, Curt↗
NASA NTRS2008

Grants Document-Generation System

The Grants Document-Generation System (GDGS) software allows the generation of official grants documents for distribution to the appropriate parties. The documents are created after the selection and entry of specific data elements and clauses. GDGS is written in Cold Fusion that resides on an SQL2000 database and is housed on-site at Goddard Space Flight Center. It includes access security written around GSFC's (Goddard Space Flight Center's) LIST system, and allows for the entry of Procurement Request information necessary for the generation of the resulting Grant Award.

Hairell, Terri↗
NASA NTRS2011

Integration of Dust Prediction Systems and Vegetation Phenology to Track Pollen for Asthma Alerts in Public Health

Pollen can be transported great distances. Van de Water et. al., 2003 reported Juniperus pollen, a significant aeroallergen was transported 200-600 km. Hence local observations of plant phenology may not be consistent with the timing and source of pollen collected by pollen sampling instruments. The DREAM (Dust REgional Atmospheric Model, Yin 2007) is a verified model for atmospheric dust transport modeling using MODIS data products to identify source regions and quantities of dust (Yin 2007). The use of satellite data products for studying phenology is well documented (White and Nemani 2006). We are modifying the DREAM model to incorporate pollen transport. The linkages already exist with DREAM through PHAiRS (Public Health Applications in remote Sensing) to the public health community. This linkage has the potential to fill this data gap so that health effects of pollen can better be tracked for linkage with health outcome data including asthma, respiratory effects, myocardial infarction, and lost work days. DREAM is based on the SKIRON/Eta modeling system and the Eta/NCEP regional atmospheric model. The dust modules of the entire system incorporate the state of the art parameterizations of all the major phases of the atmospheric dust life such as production, diffusion, advection, and removal. These modules also include effects of the particle size distribution on aerosol dispersion. The dust production mechanism is based on the viscous/turbulent mixing, shear-free convection diffusion, and soil moisture. In addition to these sophisticated mechanisms, very high resolution databases, including elevation, soil properties, and vegetation cover are utilized. The DREAM model was modified to use pollen sources instead of dust (PREAM). Pollen release will be estimated based on satellite-derived phenology of Juniperus spp. communities. The MODIS surface reflectance product (MOD09) will provide information on the start of the plant growing season, growth stage, peak greenness, dry-down and pollen release. Ground based observational records of pollen release timing and quantities will be used as verification. Techniques developed using MOD09 surface reflectance products will be directly applicable to the next generation sensors such as VIIRS. The resulting deterministic model for predicting and simulating pollen emission and downwind concentration to study details of phenology and meteorology and their dependencies. This information will be used to support the Centers for Disease Control and Prevention (CDC)'s National Environmental Public Health Tracking Program (EPHT) and the State of New Mexico environmental public health decision support for asthma and allergies alerts

Luvall, Jeffrey C.↗
NASA NTRS2024

Northern Rockies Ecological Conservation: Leveraging Earth Observations to Monitor and Predict Populations of Federally Threatened Whitebark Pine (Pinus albicaulis) across the Intermountain West

Whitebark pine (WBP; Pinus albicaulis) is an ecologically important species in North America. As a federally listed threatened species, an understanding of WBP habitat, distribution, and health is important for the natural resource managers of the National Park Service, United States Forest Service, Bureau of Land Management, Fish and Wildlife Service, and non-profit organizations such as the Whitebark Pine Ecosystem Foundation. Previous attempts to develop models of WBP habitat suitability and distribution lack confidence in their validity and integrity for these organizations. The updated models of habitat suitability and distribution developed by this study would provide managers with a capability to be employed in the conservation and future research direction for WBP. Thus, we developed a habitat suitability model of WBP at a high spatial resolution (Landsat 9 Operational Land Image-2, National Land Cover Database, NASA Shuttle Radar Topography Mission; 30m pixels) using a generalized logistic regression with an area under the curve value of 0.754. We extracted spectral reflectance signatures from overlapped ground sample points and Sentinel-2 Multispectral Instrument. The spectral signature analysis indicates WBP is separable from other tree species. We also utilized a visual validation approach and random forest (RF) modeling to separate WBP from limber pine. Through visual validation the RF classifier successfully identified 8out of 10 WBP trees gathered through ground truth points. Additionally, we achieved an overall accuracy of 91%in our confusion matrix for the distribution model using a dependent validation approach. The derived products from this study allow project partners to assess current suitable habitat and apparent health status in areas of identified WBP occurrence, providing data to aid future research regarding WBP health.

Sentinel-2↗
NASA NTRS1990

Using CLIPS in a distributed system: The Network Control Center (NCC) expert system

This paper describes an intelligent troubleshooting system for the Help Desk domain. It was developed on an IBM-compatible 80286 PC using Microsoft C and CLIPS and an AT&T 3B2 minicomputer using the UNIFY database and a combination of shell script, C programs and SQL queries. The two computers are linked by a lan. The functions of this system are to help non-technical NCC personnel handle trouble calls, to keep a log of problem calls with complete, concise information, and to keep a historical database of problems. The database helps identify hardware and software problem areas and provides a source of new rules for the troubleshooting knowledge base.

Wannemacher, Tom↗
NASA NTRS1998

Parallel and Distributed System Simulation

This exploratory study initiated our research into the software infrastructure necessary to support the modeling and simulation techniques that are most appropriate for the Information Power Grid. Such computational power grids will use high-performance networking to connect hardware, software, instruments, databases, and people into a seamless web that supports a new generation of computation-rich problem solving environments for scientists and engineers. In this context we looked at evaluating the NetSolve software environment for network computing that leverages the potential of such systems while addressing their complexities. NetSolve's main purpose is to enable the creation of complex applications that harness the immense power of the grid, yet are simple to use and easy to deploy. NetSolve uses a modular, client-agent-server architecture to create a system that is very easy to use. Moreover, it is designed to be highly composable in that it readily permits new resources to be added by anyone willing to do so. In these respects NetSolve is to the Grid what the World Wide Web is to the Internet. But like the Web, the design that makes these wonderful features possible can also impose significant limitations on the performance and robustness of a NetSolve system. This project explored the design innovations that push the performance and robustness of the NetSolve paradigm as far as possible without sacrificing the Web-like ease of use and composability that make it so powerful.

Dongarra, Jack↗
NASA NTRS2004

Precipitation and Latent Heating Distributions from Satellite Passive Microwave Radiometry: Method and Uncertainties - Part 1

A revised Bayesian algorithm for estimating surface rain rate, convective rain proportion, and latent heating/drying profiles from satellite-borne passive microwave radiometer observations over ocean backgrounds is described. The algorithm searches a large database of cloud-radiative model simulations to find cloud profiles that are radiatively consistent with a given set of microwave radiance measurements. The properties of these radiatively consistent profiles are then composited to obtain best estimates of the observed properties. The revised algorithm is supported by an expanded and more physically consistent database of cloud-radiative model simulations. The algorithm also features a better quantification of the convective and non-convective contributions to total rainfall, a new geographic database, and an improved representation of background radiances in rain-free regions. Bias and random error estimates are derived from applications of the algorithm to synthetic radiance data, based upon a subset of cloud resolving model simulations, and from the Bayesian formulation itself. Synthetic rain rate and latent heating estimates exhibit a trend of high (low) bias for low (high) retrieved values. The Bayesian estimates of random error are propagated to represent errors at coarser time and space resolutions, based upon applications of the algorithm to TRMM Microwave Imager (TMI) data. Errors in instantaneous rain rate estimates at 0.5 deg resolution range from approximately 50% at 1 mm/h to 20% at 14 mm/h. These errors represent about 70-90% of the mean random deviation between collocated passive microwave and spaceborne radar rain rate estimates. The cumulative algorithm error in TMI estimates at monthly, 2.5 deg resolution is relatively small (less than 6% at 5 mm/day) compared to the random error due to infrequent satellite temporal sampling (8-35% at the same rain rate).

Olson, William S.↗
NASA NTRS1998

Spatial Distribution of Ionospheric Plasma and Field Structures in the High-Latitude F Region

Ion density and velocity measurements from the Dynamics Explorer 2 (DE 2) spacecraft are used to obtain the average magnetic local time versus invariant latitude distribution of irregularities in the high-latitude F region ionosphere. To study the small-scale structure and its relationship to background conditions in the ionosphere, we have formed a reduced database using 2-s (approx. = 16 km) segments of the ion density and velocity data. The background gradients associated with each 2-s segment and the spectral characteristics, such as power at 6 Hz (approx. = 1.3 km) and spectral index, are among the reduced parameters used in this study. The relationship between the observed plasma structure and its motion is complex and dependent on the externally applied fields as well as locally generated plasma structure. The evolution of plasma structures also depends critically on the conductivity of the underlying ionosphere. Observations indicate an enhancement of irregularity amplitudes in two spatially isolated regions in both the ion density and the velocity. Convective properties seem to play a more important role in winter hemisphere where smaller-scale structures are maintained outside the source regions. (Delta)V irregularity amplitudes are enhanced in the cusp and the polar cap during northward interplanetary magnetic field regardless of season. The power in (Delta)V is usually higher than that associated with local polarization electric fields, suggesting that the observed structure in (Delta)N/N is strongly influenced by (Delta)V structure applied to large density gradients.

Kivanc, O.↗
NASA NTRS2002

Aeroacoustic Measurements of a Wing/Slat Model

Aeroacoustic evaluations of high-lift devices have been carried out in the Quiet Flow Facility of the NASA Langley Research Center. The present paper deals with detailed flow and acoustic measurements that have been made to understand, and to possibly predict and reduce, the noise from a wing leading edge slat configuration. The acoustic database is obtained by a moveable Small Aperture Directional Array (SADA) of microphones designed to electronically steer to different portions of models under study. The slat is shown to be a uniform distributed noise source. The data was processed such that spectra and directivity were determined with respect to a one-foot span of slat. The spectra are normalized in various fashions to demonstrate slat noise character. In order to equate portions of the spectra to different slat noise components, trailing edge noise predictions using measured slat boundary layer parameters as inputs are compared to the measured slat noise spectra.

Mendoza, Jeff M.↗
NASA NTRS2022

Implementation of a Discrete Dipole Approximation Scattering Database into Community Radiative Transfer Model

The Community Radiative Transfer Model (CRTM) is a fast model that requires bulk optical properties of hydrometeors in the form of lookup tables to simulate all-sky satellite radiances. Current cloud scattering lookup tables of CRTM were generated using the Mie-Lorenz theory thus assuming spherical shapes for all frozen habits, while actual clouds contain frozen hydrometeors with different shapes. The Discrete Dipole Approximation (DDA) technique is an effective technique for simulating the optical properties of non-spherical hydrometeors in the microwave region. This paper discusses the implementation and validation of a comprehensive DDA cloud scattering database into CRTM for the microwave frequencies. The original DDA database assumes total random orientation in the calculation of single scattering properties. The mass scattering parameters required by CRTM were then computed from single scattering properties and water content dependent particle size distributions. The new lookup tables eliminate the requirement for providing the effective radius as input to CRTM by using the cloud water content for the mass dimension. A collocated dataset of short-term forecasts from Integrated Forecast System of the European Centre for Medium-Range Weather Forecasts and satellite microwave data was used for the evaluation of results. The results overall showed that the DDA lookup tables, in comparison with the Mie tables, greatly reduce the differences among simulated and observed values. The Mie lookup tables especially introduce excessive scattering for the channels operating below 90 GHz and low scattering for the channels above 90 GHz.

Discrete dipole↗
NASA NTRS2016

Storage of Physical Sample Metadata in the Astrobiology Habitable Environments Database (AHED)

The National Aeronautics and Space Administration has begun an effort to store, curate, and publish information about physical samples collected and analyzed in conjunction with NASA-funded astrobiology research. Astrobiology is a multidisciplinary area of scientific research being conducted by collaborating teams of biologists, chemists, geologists, atmospheric scientists, oceanographers, astrophysicists, astronomers, and other specialists. Astrobiology studies the origin, evolution, and distribution of life in the Universe. NASA uses the results of astrobiology research to focus its future missions on targets of opportunity for the discovery of life off Earth. Astrobiology researchers conduct both field-based and laboratory-based research, during which physical samples are collected, processed, and catalogued. The cataloguing practices employed by different teams of astrobiologists vary widely, and there are no specific standards available to guide the collection and recording of astrobiology sample data. The disparity in data collection approaches and the lack of a centralized sample repository makes it difficult for astrobiology teams to share data and benefit from resultant synergies.To facilitate data sharing within the astrobiology community, NASA is developing a prototype database the Astrobiology Habitable Environments Database (AHED) and an associated set of data collection templates. The database will store information about samples, along with associated measurements and analyses, including information about biological cultures enriched or isolated from samples, and the results of analyses performed on the samples (e.g., via spectrography, microscopy, etc.). In addition, the system will store contextual information about field sites where samples were collected, the instruments or equipment used for analysis, and people and institutions involved in their collection. AHED is being implemented on top of Open Data Repository's Data Publisher [1], an open source software platform for the publication of scientific datasets. The data collection templates under development represent an initial attempt to propose a set of metadata for capture and storage within AHED. The design of these templates is being conducted by a consolidated group of astrobiologists from active research teams at NASA Ames Research Center, assisted by data science and software engineering specialists. These initial templates must be vetted with the broader astrobiology community through a defined process to ensure that they meet community needs. Each template captures a different type of data collection record. For each template, we are developing a list of fields to be captured, including a set of required entry fields, a set of recommended but optional fields, and a set of discretionary fields. A datatype selected from a variety of text and numeric types is specified for each field. Included is a 'choice' type that restricts user input to an enumerated list of values. Many of the fields and field values capture information of particular interest to the astrobiology community, and are intended to facilitate search and retrieval of relevant data across multiple datasets.

Keller, Rich↗
NASA NTRS2006

Precipitation and Latent Heating Distributions from Satellite Passive Microwave Radiometry: Improved Method and Uncertainties - Part 1

A revised Bayesian algorithm for estimating surface rain rate, convective rain proportion, and latent heating profiles from satellite-borne passive microwave radiometer observations over ocean backgrounds is described. The algorithm searches a large database of cloud-radiative model simulations to find cloud profiles that are radiatively consistent with a given set of microwave radiance measurements. The properties of these radiatively consistent profiles are then composited to obtain best estimates of the observed properties. The revised algorithm is supported by an expanded and more physically consistent database of cloud-radiative model simulations. The algorithm also features a better quantification of the convective and nonconvective contributions to total rainfall, a new geographic database, and an improved representation of background radiances in rain-free regions. Bias and random error estimates are derived from applications of the algorithm to synthetic radiance data, based upon a subset of cloud-resolving model simulations, and from the Bayesian formulation itself. Synthetic rain-rate and latent heating estimates exhibit a trend of high (low) bias for low (high) retrieved values. The Bayesian estimates of random error are propagated to represent errors at coarser time and space resolutions, based upon applications of the algorithm to TRMM Microwave Imager (TMI) data. Errors in TMI instantaneous rain-rate estimates at 0.5 -resolution range from approximately 50% at 1 mm/h to 20% at 14 mm/h. Errors in collocated spaceborne radar rain-rate estimates are roughly 50%-80% of the TMI errors at this resolution. The estimated algorithm random error in TMI rain rates at monthly, 2.5deg resolution is relatively small (less than 6% at 5 mm day.1) in comparison with the random error resulting from infrequent satellite temporal sampling (8%-35% at the same rain rate). Percentage errors resulting from sampling decrease with increasing rain rate, and sampling errors in latent heating rates follow the same trend. Averaging over 3 months reduces sampling errors in rain rates to 6%-15% at 5 mm day.1, with proportionate reductions in latent heating sampling errors.

Olson, William S.↗
NASA NTRS1982

Advances in information extraction techniques

Sundry recent developments are presented which show some potential for affecting the automatic extraction of information from remotely sensed data. Pattern representations more abstract than Euclidean vector spaces offer some hope of unifying structural and decision theoretical approaches. The estimation of expected classification error rates is becoming more sophisticated and rigorous, but useful finite-sample results for nonparametric distributions appear unobtainable. Focus on computational complexity allows comparison of algorithms, while software engineering techniques reduce the effort necessary to develop and maintain complex image processing systems. Advances in computer systems architecture, commercial database technology, and man-machine communications should be closely monitored by the remote sensing community. A NASA-sponsored recommendation for research directions in mathematical pattern recognition are offered.

Nagy, G.↗
NASA NTRS1988

A survey of IRAS data on 41 classical novae

The IRAS database has been searched for detections of 41 classical novae using coadditions of survey scans; 15 were detected. IRAS temporal observations of novae in outburst are discussed. The observed long-wavelength infrared distributions of DQ Her, and possibly HR Del, can be explained by emission from small (a of about 0.1 microns) dust grains heated by the central object. An alternative explanation for the energy distributions of DQ Her and HR Del is emission from fine-structure lines. FH Ser and LW Ser display energy distributions that have color temperatures much too hot to be due to heating of dust by the central source in any plausible scenario. Line emission is probably the best explanation of their observed energy distributions. The novae NQ Vul and LV Vul have energy distributions that may be contaminated by emission from galactic cirrus. The unusual object PL 1547.3-5612 exhibits an energy distribution that does not resemble those of planetary nebulae or other novae detected in this sample. An IRAS low-resolution spectrum of RR Tel shows the 10-micron silicate emission feature.

Harrison, T. E.↗