SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

All sources NASA NTRS DOE OSTI

NASA NTRS1989

An inventory of four-dimensional data sets for the earth sciences

The wide variety of data available to the diligent researcher and the myriad paths to obtaining it are emphasized. This inventory is an attempt to make accessible much of the four-dimensional data available in the world. In this quick-look catalog are listed separate data sets (Data Sets sections), sources of data including centers and large data bases (Sources section), and some data expected to be available in the future (Future Data section). In the Data Sets section, individual data sets are arranged alphabetically by institution, with those archived in the U.S.A. listed first, followed by those found elsewhere. The Sources section includes large data bases, centers, and directories. Sources are arranged alphabetically by country. This section is followed by a Future Data section which is a collection of data sets, experiments, and other future developments of which we are cognizant. A collection of further information and order blanks provided by some of the archiving institutions are presented in the appendix.

Gregory, Terri↗

NASA NTRS2004

Mass and Ozone Fluxes from the Lowermost Stratosphere

Net mass flux from the stratosphere to the troposphere can be computed from the heating rate along the 380K isentropic surface and the time rate of change of the mass of the lowermost stratosphere (the region between the tropopause and the 380K isentrope). Given this net mass flux and the cross tropopause diabatic mass flux, the residual adiabatic mass flux across the tropopause can also be estimated. These fluxes have been computed using meteorological fields from a free-running general circulation model (FVGCM) and two assimilation data sets, FVDAS, and UKMO. The data sets tend to agree that the annual average net mass flux for the Northern Hemisphere is about 1P10 kg/s. There is less agreement on the southern Hemisphere flux that might be half as large. For all three data sets, the adiabatic mass flux is computed to be from the upper troposphere into the lowermost stratosphere. This flux will dilute air entering from higher stratospheric altitudes. The mass fluxes are convolved with ozone mixing ratios from the Goddard 3D CTM (which uses the FVGCM) to estimate the cross-tropopause transport of ozone. A relatively large adiabatic flux of tropospheric ozone from the tropical upper troposphere into the extratropical lowermost stratosphere dilutes the stratospheric air in the lowermost stratosphere. Thus, a significant fraction of any measured ozone STE may not be ozone produced in the higher Stratosphere. The results also illustrate that the annual cycle of ozone concentration in the lowermost stratosphere has as much of a role as the transport in the seasonal ozone flux cycle. This implies that a simplified calculation of ozone STE mass from air mass and a mean ozone mixing ratio may have a large uncertainty.

Schoeberl, Mark R.↗

NASA NTRS2014

Constructing the "Best" Reliability Data for the Job

Modern business and technical decisions are based on the results of analyses. When considering assessments using "reliability data", the concern is how long a system will continue to operate as designed. Generally, the results are only as good as the data used. Ideally, a large set of pass/fail tests or observations to estimate the probability of failure of the item under test would produce the best data. However, this is a costly endeavor if used for every analysis and design. Developing specific data is costly and time consuming. Instead, analysts rely on available data to assess reliability. Finding data relevant to the specific use and environment for any project is difficult, if not impossible. Instead, we attempt to develop the "best" or composite analog data to support our assessments. One method used incorporates processes for reviewing existing data sources and identifying the available information based on similar equipment, then using that generic data to derive an analog composite. Dissimilarities in equipment descriptions, environment of intended use, quality and even failure modes impact the "best" data incorporated in an analog composite. Once developed, this composite analog data provides a "better" representation of the reliability of the equipment or component can be used to support early risk or reliability trade studies, or analytical models to establish the predicted reliability data points. Data that is more representative of reality and more project specific would provide more accurate analysis, and hopefully a better final decision.

DeMott, D. L.↗

NASA NTRS2014

Constructing the Best Reliability Data for the Job

Kleinhammer, R. K.↗

NASA NTRS1993

A pattern recognition system for locating small volvanoes in Magellan SAR images of Venus

The Magellan data set constitutes an example of the large volumes of data that today's instruments can collect, providing more detail of Venus than was previously available from Pioneer Venus, Venera 15/16, or ground-based radar observations put together. However, data analysis technology has not kept pace with data collection and storage technology. Due to the sheer size of the data, complete and comprehensive scientific analysis of such large volumes of image data is no longer feasible without the use of computational aids. Our progress towards developing a pattern recognition system for aiding in the detection and cataloging of small-scale natural features in large collections of images is reported. Combining classical image processing, machine learning, and a graphical user interface, the detection of the 'small-shield' volcanoes (less than 15km in diameter) that constitute the most abundant visible geologic feature in the more that 30,000 synthetic aperture radar (SAR) images of the surface of Venus are initially targeted. Our eventual goal is to provide a general, trainable tool for locating small-scale features where scientists specify what to look for simply by providing examples and attributes of interest to measure. This contrasts with the traditional approach of developing problem specific programs for detecting Specific patterns. The approach and initial results in the specific context of locating small volcanoes is reported. It is estimated, based on extrapolating from previous studies and knowledge of the underlying geologic processes, that there should be on the order of 10(exp 5) to 10(exp 6) of these volcanoes visible in the Magellan data. Identifying and studying these volcanoes is fundamental to a proper understanding of the geologic evolution of Venus. However, locating and parameterizing them in a manual manner is forbiddingly time-consuming. Hence, the development of techniques to partially automate this task were undertaken. The primary constraints for this particular problem are that the method must be reasonably robust and fast. Unlike most geological features, the small volcanoes of Venus can be ascribed to a basic process that produces features with a short list of readily defined characteristics differing significantly from other surface features on Venus. For pattern recognition purposes the relevant criteria include (1) a circular planimetric outline, (2) known diameter frequency distribution from preliminary studies, (3) a limited number of basic morphological shapes, and (4) the common occurrence of a single, circular summit pit at the center of the edifice.

Burl, M. C.↗

NASA NTRS1985

A diagnostic study of eddy-mean flow interactions during FGGE SOP-1

Eliassen-Palm (EP) diagrams have been shown to be very useful diagnostics in both the troposphere and the stratosphere. However, the idea that the EP flux divergence is the sole forcing of the mean wind by the eddies can be misleading. A time series of the time rate of change of the zonal mean wind and the EP flux divergence shows that the two quantities were not well correlated during the FGGE special observing period (SOP-1, winter 1979). Calculation of the residual in the zonal momentum equation reveals that considerable negative acceleration (drag) is required to complete the momentum balance in some regions. This residual indicates that not all terms are well represented in atmospheric data sets, and may be largely due to the breaking of vertically propagating gravity waves near the tropopause. Eliassen-Palm diagrams are presented for the FGGE data, as well as Oort's 11-year climatology. The Oort EP diagrams serve as a standard with which to compare other EP diagrams. The FGGE year is shown to be very similar to climatology. A consistent method of displaying the EP flux vectors and divergence is suggested, which has advantages over previous methods.

Baldwin, M. P.↗

NASA NTRS1978

NASA and the U.S. climate program - A problem in data management

NASA's contribution to the total data base for the National Climate Plan will be to produce climate data sets from its experimental space observing systems and to maximize the value of these data for climate analysis and prediction. Validated data sets will be provided to NOAA for inclusion into their overall diagnostic data base. NASA data management for the Climate Plan will involve: (1) cataloging and retrieval of large integrated and distributed data sets upon user demand, and (2) the storage equivalent of 100,000 digital data tapes. It will be the largest, most complex data system ever developed by NASA

Quann, J. J.↗

NASA NTRS2000

Interactive Computer Graphics

Aerospace data analysis tools that significantly reduce the time and effort needed to analyze large-scale computational fluid dynamics simulations have emerged this year. The current approach for most postprocessing and visualization work is to explore the 3D flow simulations with one of a dozen or so interactive tools. While effective for analyzing small data sets, this approach becomes extremely time consuming when working with data sets larger than one gigabyte. An active area of research this year has been the development of data mining tools that automatically search through gigabyte data sets and extract the salient features with little or no human intervention. With these so-called feature extraction tools, engineers are spared the tedious task of manually exploring huge amounts of data to find the important flow phenomena. The software tools identify features such as vortex cores, shocks, separation and attachment lines, recirculation bubbles, and boundary layers. Some of these features can be extracted in a few seconds; others take minutes to hours on extremely large data sets. The analysis can be performed off-line in a batch process, either during or following the supercomputer simulations. These computations have to be performed only once, because the feature extraction programs search the entire data set and find every occurrence of the phenomena being sought. Because the important questions about the data are being answered automatically, interactivity is less critical than it is with traditional approaches.

Kenwright, David↗

NASA NTRS1994

The Rings Node for the Planetary Data System

The Planetary Data System's Rings Node is devoted to the archiving and distributing of scientific data sets relevant to planetary ring systems. The two major classes of ring data are images and occultation profiles, although a variety of additional data types (e.g. spectra, particle absorption signatures, etc.) are also of interest. A large fraction of our data sets are from the Voyager missions to the outer planets, but Earth-based and Hubble Space Telescope data sets are also represented. Archiving work often includes re-formatting the data into standardized formats and reconstructing some of the data processing steps. The Rings Node also performs a variety of services to support research into these data sets. These services include developing on-line catalogs and information systems, filling orders for data, developing software tools, and coordinating special observing campaigns.

Showalter, Mark R.↗

NASA NTRSDate not supplied

Science Workflows using Kamodo

Kamodo is a powerful python software package based on data functionalization. Once a given data set is functionalized, a large variety of capabilities are easily accessible in Kamodo, including unit conversions, custom analysis via function composition, interactive publication quality visualizations, and LaTeX encoding. The entirety of capabilities available in Kamodo are easily applied to both simulated and observed data across the multiple domains of Heliophysics and even in other disciplines. This work includes a variety of science workflows using Kamodo in combination with other resources, including with other python software packages, that expand the utility of Kamodo even further. These workflows include model-data comparisons, ensemble modeling examples, satellite mission planning examples, and other applications, all of which are freely available on CCMC’s Kamodo Github page for the community to adapt to their own uses (https://github.com/nasa/Kamodo). We invite the community to use these workflows and to contribute their own to share.

software↗

NASA NTRSDate not supplied

Science Workflows using Kamodo

python↗

NASA NTRS1982

The SEASAT Synthetic Aperture Radar - Engineering performance evaluation

Results are presented for a study conducted in order to characterize the quality and consistency of the SEASAT Synthetic Aperture Radar image data set. The study evaluated a large spectrum of parameters, including the resolution, position location accuracy, and the amplitude calibration of the imagery produced from the raw data by processors at several institutions. It is demonstrated that this data set can be used to obtain resolution up to the theoretical limit of 6 m x 21 m, absolute position location to within 200 m, and relative calibration of the image data to within + or - 2 dB.

Held, D. N.↗

NASA NTRS1995

Link Winds: A visual data analysis system and its application to the atmospheric ozone depletion problem

The Linked Windows Interactive Data System (LinkWinds) is a prototype visual data exploration system resulting from a NASA Jet Propulsion Laboratory (JPL) program of research into the application of graphical methods for rapidly accessing, displaying, and analyzing large multi variate multidisciplinary data sets. Running under UNIX it is an integrated multi-application executing environment using a data-linking paradigm to dynamically interconnect and control multiple windows containing a variety of displays and manipulators. This paradigm, resulting in a system similar to a graphical spreadsheet, is not only a powerful method for organizing large amounts of data for analysis, but leads to a highly intuitive, easy-to-learn user interface. It provides great flexibility in rapidly interacting with large masses of complex data to detect trends, correlations, and anomalies. The system, containing an expanding suite of non-domain-specific applications, provides for the ingestion of a variety of data base formats and hard -copy output of all displays. Remote networked workstations running LinkWinds may be interconnected, providing a multiuser science environment (MUSE) for collaborative data exploration by a distributed science team. The system is being developed in close collaboration with investigators in a variety of science disciplines using both archived and real-time data. It is currently being used to support the Microwave Limb Sounder (MLS) in orbit aboard the Upper Atmosphere Research Satellite (UARS). This paper describes the application of LinkWinds to this data to rapidly detect features, such as the ozone hole configuration, and to analyze correlations between chemical constituents of the atmosphere.

Jacobson, Allan S.↗

NASA NTRS1985

The primary composition beyond 10 to the 5th power GeV as deduced from high energy hadrons and muons in air showers

Data obtained from a large set of air shower simulation calculations with use of highly refined hadronic interaction and shower simulation model are presented, in an attempt to solve the problem of primary chemical composition beyond 100,000 GeV total energy. It is rated that high energy hadrons in air showers offer a rather unique primary mass signature and show that the interpretation of high energy muon data is much more ambiguous. Predictions are compared with experimental data.

Grieder, P. K. F.↗

NASA NTRS2005

Tools and Data Services from the NASA Earth Satellite Observations for Climate Applications

Climate science and applications require access to vast amounts of archived high quality data, software tools and services for data manipulation and information extraction. These on the other hand require gaining detailed understanding of the data's internal structure and physical implementation to data reduction, combination and data product production. This time-consuming task must be undertaken before the core investigation can begin and is an especially difficult challenge when science objectives require users to deal with large multi-sensor data sets of different formats, structures, and resolutions. In order to address these issues the Goddard Space Flight Center (GSFC) Earth Sciences (GES), Data and Information Service Center (DISC) Distributed Active Archive Center (DAAC) has made great progress in facilitating science and applications research by developing innovative tools and data services applied to the Earth sciences atmospheric and climate data. The GES/DISC/DAAC has successfully implemented and maintained a long-term climate satellite data archive and developed tools and services to a variety of atmospheric science missions including AIRS, AVHRR, MODIS, SeaWiFS, SORCE, TOMS, TOVS, TRMM, and UARS and Aura instruments providing researchers with excellent opportunities to acquire accurate and continuous atmospheric measurements. Since the number of climate science products from these various missions is steadily increasing as a result of more sophisticated sensors and new science algorithms, the main challenge for data centers like the GES/DISC/DAAC is to guide users through the variety of data sets and products, provide tools to visualize and reduce the volume of the data and secure uninterrupted and reliable access to data and related products. This presentation will describe the effort at the GES/DISC/DAAC to build a bridge between multi-sensor data and the effective scientific use of the data, with an emphasis on the heritage satellite observations and science products for climate applications. The intent is to inform users of the existence of this large collection of data and products; suggest starting points for cross-platform science projects and data mining activities and provide data services and tools information. More information about the GES/DISC/DAAC satellite data and products, tools, and services can be found at http://daac.gsfc.nasa.gov.

Vicente, Gilberto A.↗

NASA NTRS1988

Measuring the topology of large-scale structure in the universe

An algorithm for quantitatively measuring the topology of large-scale structure has now been applied to a large number of observational data sets. The present paper summarizes and provides an overview of some of these observational results. On scales significantly larger than the correlation length, larger than about 1200 km/s, the cluster and galaxy data are fully consistent with a sponge-like random phase topology. At a smoothing length of about 600 km/s, however, the observed genus curves show a small shift in the direction of a meatball topology. Cold dark matter (CDM) models show similar shifts at these scales but not generally as large as those seen in the data. Bubble models, with voids completely surrounded on all sides by wall of galaxies, show shifts in the opposite direction. The CDM model is overall the most successful in explaining the data.

Gott, J. Richard, III↗

NASA NTRS1992

The JGOFS North Atlantic Bloom Experiment: An overview

The North Atlantic Bloom Experiment (NABE) of JGOFS presents a unique opportunity and challenge to the data management community because of the diversity and large size of biogeochemical data sets collected. NABE was a pilot study for JGOFS and has also served as a pilot study within the U.S. NODC for management and archiving of the data sets. Here I present an overview to some of the scientific results of NABE, which will be published as an Introduction to a special volume of NABE results in Deep-Sea Research later this year. An overview of NABE data management is given elsewhere in the present report. This is the first collection of papers from the Joint Global Ocean Flux Study (JGOFS). Formed as an international program in 1987, JGOFS has four principal elements: modelling and data management, multidisciplinary regional process studies, a global survey of biogeochemical properties and long-term time series observatories. In 1989-1990 JGOFS conducted a pilot process study of the spring phytoplankton bloom, the North Atlantic Bloom Experiment (NABE). JGOFS decided to conduct a large scale, internationally-coordinated pilot study in the North Atlantic because of its proximity to the founding nations of the project, the size and predictability of the bloom and its fundamental impact on ocean bio-geochemistry (Billett et al., 1983; Watson and Whitfield, 1985; Pfannkuche, 1992). In 1989, six research vessels from Canada, Germany, The Netherlands, the United Kingdom and the USA and over 200 scientists and students from more than a dozen nations participated in NABE. Some of their initial results are reported in this volume.

Ducklow, Hugh W.↗

NASA NTRS2005

NASA GES DISC On-line Visualization and Analysis System for Gridded Remote Sensing Data

The ability to use data stored in the current NASA Earth Observing System (EOS) archives for studying regional or global phenomena is highly dependent on having a detailed understanding of the data's internal structure and physical implementation. Gaining this understanding and applying it to data reduction is a time-consuming task that must be undertaken before the core investigation can begin. This is an especially difficult challenge when science objectives require users to deal with large multi-sensor data sets that are usually of different formats, structures, and resolutions. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has taken a major step towards meeting this challenge by developing an infrastructure with a Web interface that allows users to perform interactive analysis online without downloading any data, the GES-DISC Interactive Online Visualization and Analysis Infrastructure or "Giovanni." Giovanni provides interactive, online, analysis tools for data users to facilitate their research. There have been several instances of this interface created to serve TRMM users, Aerosol scientists, Ocean Color and Agriculture applications users. The first generation of these tools support gridded data only. The user selects geophysical parameters, area of interest, time period; and the system generates an output on screen in a matter of seconds. The currently available output options are: Area plot averaged or accumulated over any available data period for any rectangular area; Time plot time series averaged over any rectangular area; Hovmoller plots image view of any longitude-time and latitude-time cross sections; ASCII output for all plot types; Image animation for area plot. Another analysis suite deals with parameter intercomparison: scatter plots, temporal correlation maps, GIs-compatible outputs, etc. This allow user to focus on data content (i.e. science parameters) and eliminate the need for expensive learning, development and processing tasks that are redundantly incurred by an archive's user community. The current implementation utilizes the GrADS-DODS Server (GDS), and provides subsetting and analysis services across the Internet for any GrADS-readable dataset. The subsetting capability allows users to retrieve a specified temporal and/or spatial subdomain from a large dataset, eliminating the need to download everything simply to access a small relevant portion of a dataset. The analysis capability allows users to retrieve the results of an operation applied to one or more datasets on the server. We use this approach to read pre-processed binary files and/or to read and extract the needed parts directly from HDF or HDF-EOS files. These subsets then serve as inputs into GrADS analysis scripts. It can be used in a wide variety of Earth science applications: climate and weather events study and monitoring; modeling. It can be easily configured for new applications.

Leptoukh, Gregory G.↗