SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

NASA NTRS1990

New interplanetary proton fluence model

A new predictive engineering model for the interplanetary fluence of protons with above 10 MeV and above 30 MeV is described. The data set used is a combination of observations made from the earth's surface and from above the atmosphere between 1956 and 1963 and observations made from spacecraft in the vicinity of earth between 1963 and 1985. The data cover a time period three times as long as the period used in earlier models. With the use of this data set the distinction between 'ordinary proton events' and 'anomalously large events' made in earlier work disappears. This permitted the use of statistical analysis methods developed for 'ordinary events' on the entire data set. The greater than 10 MeV fluences at 1 AU calculated with the new model are about twice those expected on the basis of models now in use. At energies above 30 MeV, the old and new models agree. In contrast to earlier models, the results do not depend critically on the fluence from any one event and are independent of sunspot number. Mission probability curves derived from the fluence distribution are presented.

Feynman, Joan↗

NASA NTRS1984

A statistical evaluation and comparison of VISSR Atmospheric Sounder (VAS) data and corresponding rawinsonde measurements

Three mesoscale sounding data sets from the VISSR Atmospheric Sounder (VAS) produced using different retrieval techniques were evaluated of corresponding ground truth rawinsonde data for 6-7 March 1982. Mean, standard deviations, and RMS differences between the satellite and rawinsonde parameters were calculated over gridded fields in central Texas and Oklahoma. Large differences exist between each satellite data set and the ground truth data. Biases in the satellite temperature and moisture profiles seem extremely dependent upon the three dimensional structure of the atmosphere and range from 1 deg to 3 deg C for temperature and 3 deg to 6 deg C for dewpoint temperature. Atmospheric gradients of basic and derived parameters determined from the VAS data sets produced an adequate representation of the mesoscale environment but their magnitudes were often reduced by 30 to 50%.

Source record↗

NASA NTRS2003

A method of hidden Markov model optimization for use with geophysical data sets

Geophysics research has been faced with a growing need for automated techniques with which to process large quantities of data. A successful tool must meet a number of requirements: it should be consistent, require minimal parameter tuning, and produce scientifically meaningful results in reasonable time. We introduce a hidden Markov model (HMM)-based method for analysis of geophysical data sets that attempts to address these issues.

Markov model optimization geophysical data sets↗

NASA NTRS2004

Robust Requirements Tracing via Internet Search Technology: Improving an IV and V Technique

There are three major objectives to this phase of the work. (1) Improvement of Information Retrieval (IR) methods for Independent Verification and Validation (IV&V) requirements tracing. Information Retrieval methods are typically developed for very large (order of millions - tens of millions and more documents) document collections and therefore, most successfully used methods somewhat sacrifice precision and recall in order to achieve efficiency. At the same time typical IR systems treat all user queries as independent of each other and assume that relevance of documents to queries is subjective for each user. The IV&V requirements tracing problem has a much smaller data set to operate on, even for large software development projects; the set of queries is predetermined by the high-level specification document and individual requirements considered as query input to IR methods are not necessarily independent from each other. Namely, knowledge about the links for one requirement may be helpful in determining the links of another requirement. Finally, while the final decision on the exact form of the traceability matrix still belongs to the IV&V analyst, his/her decisions are much less arbitrary than those of an Internet search engine user. All this suggests that the information available to us in the framework of the IV&V tracing problem can be successfully leveraged to enhance standard IR techniques, which in turn would lead to increased recall and precision. We developed several new methods during Phase II; (2) IV&V requirements tracing IR toolkit. Based on the methods developed in Phase I and their improvements developed in Phase II, we built a toolkit of IR methods for IV&V requirements tracing. The toolkit has been integrated, at the data level, with SAIC's SuperTracePlus (STP) tool; (3) Toolkit testing. We tested the methods included in the IV&V requirements tracing IR toolkit on a number of projects.

Hayes, Jane↗

NASA NTRS1993

Development, refinement, and testing of a short term solar flare prediction algorithm

Progress toward performance of the tasks and accomplishing the goals set forth in the two year Research Grant included primarily analysis of digital data sets and determination of methodology associated with the analysis of the very large, unique, and complex collection of digital solar magnetic field data. The treatment of each magnetogram as a unique set of data requiring special treatment was found to be necessary. It is determined that a person familiar with the data, the analysis system, and logical, coherent outcome of the analysis must conduct each analysis, and interact with the analysis program(s) significantly sometimes many iterations for successful calibration and analysis of the data set. With this interaction, the data sets yield valuable, coherent analyses. During this period, it was also decided that only data sets taken inside heliographic longitudes (Central Meridian Distance) East and West 30 degrees (within 30 degrees of the Central Meridian of the Sun). If the total data set is then found to be numerically inadequate for the final analysis, 30 - 45 degrees Central Meridian Distance data will then be analyzed. The Optical Data storage system (MSFC observatory) was found appropriate for use both in intermediate storage of the data (preliminary to analysis), and for storage of the analyzed data sets for later parametric extraction.

Smith, Jesse B., Jr.↗

NASA NTRS2012

DDS-Suite - A Dynamic Data Acquisition, Processing, and Analysis System for Wind Tunnel Testing

Wind Tunnels have optimized their steady-state data systems for acquisition and analysis and even implemented large dynamic-data acquisition systems, however development of near real-time processing and analysis tools for dynamic-data have lagged. DDS-Suite is a set of tools used to acquire, process, and analyze large amounts of dynamic data. Each phase of the testing process: acquisition, processing, and analysis are handled by separate components so that bottlenecks in one phase of the process do not affect the other, leading to a robust system. DDS-Suite is capable of acquiring 672 channels of dynamic data at rate of 275 MB / s. More than 300 channels of the system use 24-bit analog-to-digital cards and are capable of producing data with less than 0.01 of phase difference at 1 kHz. System architecture, design philosophy, and examples of use during NASA Constellation and Fundamental Aerodynamic tests are discussed.

Burnside, Jathan J.↗

NASA NTRS1994

Recovering the real density field of galaxies from redshift space

This paper proposes a number of methods for recovering the true, real-space large-scale density distributions from redshift data sets. On the largest scales, the effects of peculiar velocities is to compress the galaxy clustering along the line of sight and consequently the density gradient in the radial direction is enhanced in comparison with the density gradient perpendicular to the line of sight. We calculate the relation between the density gradients in real and redshift space in the linear regime and show that it is a simple function of the density parameter, Omega. By considering the anisotropy of density gradients in redshift space it is possible, in principle, to obtain information about the value of Omega. Using N-body simulations we examine different methods for correcting the effects of large-scale velocities to obtain the true density distributions. We derive the peculiar velocity field from the redshift data and iterate to place each galaxy at a distance consistent with its measured redshift and its derived velocity. Linear theory, as well as second-order solutions for the peculiar velocity field are tested. The density distributions in low-density regions predicted by both linear theory and second-order theory are similar, and in good agreement with the true density field in the simulation. The use of the second-order corrections improves the prediction of the density field in high-density regions.

Gramann, Mirt↗

NASA NTRS2012

Large Terrain Continuous Level of Detail 3D Visualization Tool

This software solved the problem of displaying terrains that are usually too large to be displayed on standard workstations in real time. The software can visualize terrain data sets composed of billions of vertices, and can display these data sets at greater than 30 frames per second. The Large Terrain Continuous Level of Detail 3D Visualization Tool allows large terrains, which can be composed of billions of vertices, to be visualized in real time. It utilizes a continuous level of detail technique called clipmapping to support this. It offloads much of the work involved in breaking up the terrain into levels of details onto the GPU (graphics processing unit) for faster processing.

Myint, Steven↗

NASA NTRS1997

Applications of Data Assimilation to Analysis of the Ocean on Large Scales

It is commonplace to begin talks on this topic by noting that oceanographic data are too scarce and sparse to provide complete initial and boundary conditions for large-scale ocean models. Even considering the availability of remotely-sensed data such as radar altimetry from the TOPEX and ERS-1 satellites, a glance at a map of available subsurface data should convince most observers that this is still the case. Data are still too sparse for comprehensive treatment of interannual to interdecadal climate change through the use of models, since the new data sets have not been around for very long. In view of the dearth of data, we must note that the overall picture is changing rapidly. Recently, there have been a number of large scale ocean analysis and prediction efforts, some of which now run on an operational or at least quasi-operational basis, most notably the model based analyses of the tropical oceans. These programs are modeled on numerical weather prediction. Aside from the success of the global tide models, assimilation of data in the tropics, in support of prediction and analysis of seasonal to interannual climate change, is probably the area of large scale ocean modeling and data assimilation in which the most progress has been made. Climate change is a problem which is particularly suited to advanced data assimilation methods. Linear models are useful, and the linear theory can be exploited. For the most part, the data are sufficiently sparse that implementation of advanced methods is worthwhile. As an example of a large scale data assimilation experiment with a recent extensive data set, we present results of a tropical ocean experiment in which the Kalman filter was used to assimilate three years of altimetric data from Geosat into a coarsely resolved linearized long wave shallow water model. Since nonlinear processes dominate the local dynamic signal outside the tropics, subsurface dynamical quantities cannot be reliably inferred from surface height anomalies. Because of its potential for large scale synoptic coverage of the deep ocean, acoustic travel time data should be a natural complement to satellite altimetry. Satellite data give us vertical integrals associated with thermodynamic and dynamic processes.

Miller, Robert N.↗

NASA NTRS2003

Global Lightning Activity

Our knowledge of the global distribution of lightning has improved dramatically since the 1995 launch of the Optical Transient Detector (OTD) followed in 1997 by the launch of the Lightning Imaging Sensor (LIS). Together, these instruments have generated a continuous seven-year record of global lightning activity. These lightning observations have provided a new global perspective on total lightning activity. For the first time, total lightning activity (CG and IC) has been observed over large regions with high detection efficiencies and accurate geographic location. This has produced new insights into lightning distributions, times of occurrence and variability. It has produced a revised global flash rate estimate (46 flashes per second) and has lead to a new realization of the significance of total lightning activity in severe weather. Accurate flash rate estimates are now available for large areas of the earth (+/- 72deg latitude) Ocean-land contrasts as a function of season are clearly revealed, as are orographic effects and seasonal and interannual variability. The data set indicates that air mass thunderstorms, not large storm systems dominate global activity. The ability of LIS and OTD to detect total lightning has lead to improved insight into the correlation between lightning and storm development. The relationship between updraft development and lightning activity is now well established and presents an opportunity for providing a new mechanism for remotely monitoring storm development. In this concept, lightning would serve as a surrogate for updraft velocity. It is anticipated hat this capability could lead to significantly improved severe weather warning times and reduced false warning rates.

Christian, Hugh↗

NASA NTRS2026

Modeling Large Dust Aerosols in the Community Earth System Model Version 2 (CESM2)

Dust aerosols have a wide size distribution from less than 0.1 to over 100 μm and dominate Earth's atmospheric aerosol mass. However, most Earth system models (ESMs) inadequately represent dust aerosols larger than 10 μm in diameter, limiting the accuracy of the simulated dust cycle and climate impacts. Here, we introduce a new modeling framework that captures the full observed size distribution of dust aerosols, incorporating recent advances into a mineral-resolved version of the Community ESM, while addressing known issues in previous versions. Comprehensive evaluation against diverse observations of bulk dust and component minerals demonstrates that the model reproduces the observed dust cycle across particle sizes. Incorporating the previously unrepresented large-dust fractions substantially alters dust budget estimates, highlighting potential changes in simulated climate impacts and underscoring the importance of comprehensive size-resolved dust modeling. Despite these advancements, uncertainties persist. Our results indicate that a size-dependent reduction in settling velocity is required to reproduce the observed dust size distribution downwind of source regions. Specifically, in the new model, the gravitational settling velocity of dust particles larger than 10 μm in diameter must be reduced by as much as 85% to achieve agreement with observations. This empirical reduction serves as a constraint on physics-based models of dust settling. Future developments should address misrepresented physical processes that hinder accurate modeling of the large dust aerosol transport. Expanding observational data sets covering the full-size distribution is also essential to better constrain the dust cycle and improve the representation of dust optical properties and climate effects.

mineral dust↗

NASA NTRS1995

Comparison of cloud fields from atmospheric general circulation model, in situ and satellite measurements

This paper focuses on the comparison of cloud amounts derived from an atmospheric general circulation model (AGCM), Satellite-observed clouds, and Ground-based cloud observations. Unlike Earth Radiation Budget Experiment (ERBE)-type comparisons it does not mix potential errors in the cloud amount with those in the radiation code embedded in the model. Long term cloud climatologies were used to compare global cloud amounts and regional seasonal cycles. The AGCM successfully reproduced the signatures of the warm pool and North Pacific seasonal cycle cloudiness but failed in the low stratus region off the coast of South America, a known problem for AGCMs. The data sets also reproduced the anomaly signature associated with El Nino in the warm pool region, but the model amounts were lower. Global results had a similar success rate, with the model generally producing lower total cloud compared to the satellite and in situ measurements. To compare cloud vertical distributions the cloud height may need to be validated using the corresponding radiation fields. Unfortunately there were also some large discrepancies between the two observed cloud data sets. While tremendously improved over the last decade the character of the observed cloud data sets, must be substantially enhanced before they will be useful in validating AGCMs by any but the crudest levels of comparison.

Haskins, Robert D.↗

NASA NTRS1991

Effects of satellite data resolution on measuring the space/time variations of surfaces and clouds

The correlated distributions of satellite-measured visible and infrared radiances, caused by spatial and temporal variations in clouds and surfaces, have been found to be characteristic of the major climate regimes and can be described by the attributes of bidimensional and monodimensional histograms and time-composite images. Most of the variability of both the surfaces and clouds is found to occur at scales larger than the minimum resolved by satellite imagery. Since satellite imaging data sets are difficult to analyze because of their large volumes, many studies reduce the volume by various sampling or averaging schemes. The effects of data resolution and sampling on the radiance histogram statistics and on the time-composite image characteristics are examined. In particular, the sampling strategy used by the International Satellite Cloud Climatology Project is tested. This sampling strategy is found to preserve the statistics of smaller cloud variations for most regions, with the exception of very rare events, if they are accumulated over large enough areas (at least 500 km in dimension) and long enough time periods (at least one month).

Seze, Genevieve↗

NASA NTRS1994

Assessment of climate variability of the Greenland Ice Sheet: Integration of in situ and satellite data

The proposed research involves the application of multispectral satellite data in combination with ground truth measurements to monitor surface properties of the Greenland Ice Sheet which are essential for describing the energy and mass of the ice sheet. Several key components of the energy balance are parameterized using satellite data and in situ measurements. The analysis will be done for a ten year time period in order to get statistics on the seasonal and interannual variations of the surface processes and the climatology. Our goal is to investigate to what accuracy and over what geographic areas large scale snow properties and radiative fluxes can be derived based upon a combination of available remote sensing and meteorological data sets. Operational satellite sensors are calibrated based on ground measurements and atmospheric modeling prior to large scale analysis to ensure the quality of the satellite data. Further, several satellite sensors of different spatial and spectral resolution are intercompared to access the parameter accuracy. Proposed parameterization schemes to derive key component of the energy balance from satellite data are validated. For the understanding of the surface processes a field program was designed to collect information on spectral albedo, specular reflectance, soot content, grain size and the physical properties of different snow types. Further, the radiative and turbulent fluxes at the ice/snow surface are monitored for the parameterization and interpretation of the satellite data. The expected results include several baseline data sets of albedo, surface temperature, radiative fluxes, and different snow types of the entire Greenland Ice Sheet. These climatological data sets will be of potential use for climate sensitivity studies in the context of future climate change.

Steffen, K.↗

NASA NTRS1983

Magnetospheric and interplanetary physics 1979-1982

Major trends in the study of magnetospheric and interplanetary physics during the 1979-1982 period are surveyed. Topics discussed include the exploration of the Saturnian and Jovian magnetospheres by Voyagers 1 and 2, the behavior of different ions in the earth magnetosphere, auroral kilometric radiation, computer modeling of global magnetospheric MHD flow, the magnetic substorm, the quiet state, the earth's bow shock, the heliospheric current sheet, and new techniques such as electron beam experiments, 'active' injection experiments, auroral radars, and observations of the earth's distant magnetic tail. The future of this area of research is seen in the combination of data from different spacecraft and ground observations in a single correlated data set, and in the consolidation of past gains by analysis of the large data backlog, while a small number of new missions goes forward.

Stern, D. P.↗

NASA NTRS1987

Color graphics techniques for shaded surface displays of aerodynamic flowfield parameters

A variety of algorithms are presented that are useful in the color graphics displays of large sets of three-dimensional aerodynamic data. These methods augment established techniques for rapidly and interactively reviewing an assortment of smooth-shaded, color-coded illustrations for experimental and computational distributions of both scalar and vector quantities.

Weston, Robert P.↗

NASA NTRS1994

Robotic tape library system level testing at NSA: Present and planned

In the present of declining Defense budgets, increased pressure has been placed on the DOD to utilize Commercial Off the Shelf (COTS) solutions to incrementally solve a wide variety of our computer processing requirements. With the rapid growth in processing power, significant expansion of high performance networking, and the increased complexity of applications data sets, the requirement for high performance, large capacity, reliable and secure, and most of all affordable robotic tape storage libraries has greatly increased. Additionally, the migration to a heterogeneous, distributed computing environment has further complicated the problem. With today's open system compute servers approaching yesterday's supercomputer capabilities, the need for affordable, reliable secure Mass Storage Systems (MSS) has taken on an ever increasing importance to our processing center's ability to satisfy operational mission requirements. To that end, NSA has established an in-house capability to acquire, test, and evaluate COTS products. Its goal is to qualify a set of COTS MSS libraries, thereby achieving a modicum of standardization for robotic tape libraries which can satisfy our low, medium, and high performance file and volume serving requirements. In addition, NSA has established relations with other Government Agencies to complete this in-house effort and to maximize our research, testing, and evaluation work. While the preponderance of the effort is focused at the high end of the storage ladder, considerable effort will be extended this year and next at the server class or mid range storage systems.

Shields, Michael F.↗

NASA NTRS1996

Processing Satellite Images on Tertiary Storage: A Study of the Impact of Tile Size on Performance

Before raw data from a satellite can be used by an Earth scientist, it must first undergo a number of processing steps including basic processing, cleansing, and geo-registration. Processing actually expands the volume of data collected by a factor of 2 or 3 and the original data is never deleted. Thus processing and storage requirements can exceed 2 terrabytes/day. Once processed data is ready for analysis, a series of algorithms (typically developed by the Earth scientists) is applied to a large number of images in a data set. The focus of this paper is how best to handle such images stored on tape using the following assumptions: (1) all images of interest to a scientist are stored on a single tape, (2) images are accessed and processed in the order that they are stored on tape, and (3) the analysis requires access to only a portion of each image and not the entire image.

Yu, JieBing↗