Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Water-ice and water-updraft relationships near -10 C within populations of Florida cumuli

Evidence is presented for a sequential development of cloud water, rainwater, graupel, and crystalline ice with the aging of the cloud. This evidence is based on in-cloud microphysical data set collected in Florida convective towers that were penetrated close to their tops near -10 C; the very rapid onset of graupel that appears on repeat penetrations of some towers is of particular interest. A separate data set shows a large scatter in the relationship between the maximum value of cloud water and vertical velocity which indicates that measurements of cloud water can be misleading as an indication of growth activity. The sequential pass data showing the evolution of ice and water are consistent with a rime-splintering, secondary ice production hypothesis.

Sax, R. I.↗

RACORO Continental Boundary Layer Cloud Investigations: 1. Case Study Development and Ensemble Large-Scale Forcings

Observation-based modeling case studies of continental boundary layer clouds have been developed to study cloudy boundary layers, aerosol influences upon them, and their representation in cloud- and global-scale models. Three 60 h case study periods span the temporal evolution of cumulus, stratiform, and drizzling boundary layer cloud systems, representing mixed and transitional states rather than idealized or canonical cases. Based on in situ measurements from the Routine AAF (Atmospheric Radiation Measurement (ARM) Aerial Facility) CLOWD (Clouds with Low Optical Water Depth) Optical Radiative Observations (RACORO) field campaign and remote sensing observations, the cases are designed with a modular configuration to simplify use in large-eddy simulations (LES) and single-column models. Aircraft measurements of aerosol number size distribution are fit to lognormal functions for concise representation in models. Values of the aerosol hygroscopicity parameter, kappa, are derived from observations to be approximately 0.10, which are lower than the 0.3 typical over continents and suggestive of a large aerosol organic fraction. Ensemble large-scale forcing data sets are derived from the ARM variational analysis, European Centre for Medium-Range Weather Forecasts, and a multiscale data assimilation system. The forcings are assessed through comparison of measured bulk atmospheric and cloud properties to those computed in "trial" large-eddy simulations, where more efficient run times are enabled through modest reductions in grid resolution and domain size compared to the full-sized LES grid. Simulations capture many of the general features observed, but the state-of-the-art forcings were limited at representing details of cloud onset, and tight gradients and high-resolution transients of importance. Methods for improving the initial conditions and forcings are discussed. The cases developed are available to the general modeling community for studying continental boundary clouds.

Boundary layers↗

Correlations of Prompt and Afterglow Emission in Swift Long and Short Gamma Ray Bursts

Correlation studies of prompt and afterglow emissions from gamma-ray bursts (GRBs) between different spectral bands has been difficult to do in the past because few bursts had comprehensive and intercomparable afterglow measurements. In this paper we present a large and uniform data set for correlation analysis based on bursts detected by the Swift mission. For the first time, short and long bursts can be analyzed and compared. It is found for both classes that the optical, X-ray and gamma-ray emissions are linearly correlated, but with a large spread about the correlation line; stronger bursts tend to have brighter afterglows, and bursts with brighter X-ray afterglow tend to have brighter optical afterglow. Short bursts are, on average, weaker in both prompt and afterglow emissions. No short bursts are seen with extremely low optical to X-ray ratio as occurs for 'dark' long bursts. Although statistics are still poor for short bursts, there is no evidence yet for a subgroup of short bursts with high extinction as there is for long bursts. Long bursts are detected in the dark category at the same fraction as for pre-Swift bursts. Interesting cases are discovered of long bursts that are detected in the optical, and yet have low enough optical to X-ray ratio to be classified as dark. For the prompt emission, short and long bursts have different average tracks on flux vs fluence plots. In Swift, GRB detections tend to be fluence limited for short bursts and flux limited for long events.

Gehrel, Neil↗

Development of Monte Carlo Capability for Orion Parachute Simulations

Parachute test programs employ Monte Carlo simulation techniques to plan testing and make critical decisions related to parachute loads, rate-of-descent, or other parameters. This paper describes the development and use of a MATLAB-based Monte Carlo tool for three parachute drop test simulations currently used by NASA. The Decelerator System Simulation (DSS) is a legacy 6 Degree-of-Freedom (DOF) simulation used to predict parachute loads and descent trajectories. The Decelerator System Simulation Application (DSSA) is a 6-DOF simulation that is well suited for modeling aircraft extraction and descent of pallet-like test vehicles. The Drop Test Vehicle Simulation (DTVSim) is a 2-DOF trajectory simulation that is convenient for quick turn-around analysis tasks. These three tools have significantly different software architectures and do not share common input files or output data structures. Separate Monte Carlo tools were initially developed for each simulation. A recently-developed simulation output structure enables the use of the more sophisticated DSSA Monte Carlo tool with any of the core-simulations. The task of configuring the inputs for the nominal simulation is left to the existing tools. Once the nominal simulation is configured, the Monte Carlo tool perturbs the input set according to dispersion rules created by the analyst. These rules define the statistical distribution and parameters to be applied to each simulation input. Individual dispersed parameters are combined to create a dispersed set of simulation inputs. The Monte Carlo tool repeatedly executes the core-simulation with the dispersed inputs and stores the results for analysis. The analyst may define conditions on one or more output parameters at which to collect data slices. The tool provides a versatile interface for reviewing output of large Monte Carlo data sets while preserving the capability for detailed examination of individual dispersed trajectories. The Monte Carlo tool described in this paper has proven useful in planning several Crew Exploration Vehicle parachute tests.

Moore, James W.↗

Large-scale inhomogeneities and galaxy statistics

The density fluctuations associated with the formation of large-scale cosmic pancake-like and filamentary structures are evaluated using the Zel'dovich approximation for the evolution of nonlinear inhomogeneities in the expanding universe. It is shown that the large-scale nonlinear density fluctuations in the galaxy distribution due to pancakes modify the standard scale-invariant correlation function xi(r) at scales comparable to the coherence length of adiabatic fluctuations. The typical contribution of pancakes and filaments to the J3 integral, and more generally to the moments of galaxy counts in a volume of approximately (15-40 per h Mpc)exp 3, provides a statistical test for the existence of large scale inhomogeneities. An application to several recent three dimensional data sets shows that despite large observational uncertainties over the relevant scales characteristic features may be present that can be attributed to pancakes in most, but not all, of the various galaxy samples.

Schaeffer, R.↗

Are Planetary Regolith Particles Back Scattering? Response to a Paper by M. Mishchenko

In a recent paper Mishchenko asserts that soil particles are strongly forward scattering, whereas particles on the surfaces of objects in the solar system have been inferred to be back scattering. Mishchenko suggests that this apparent discrepancy is an artifact caused by using an approximate light scattering model to analyse the data, and that planetary regolith particles are actually strong forward scatterers. The purpose of the present paper is to point out the errors in Mishchenko's paper and to show from both theoretical arguments and experimental data that inhomogencous composite particles which are large compared to the wavelength of visible light, such as rock fragments and agglutinates, can be strongly back scattering and are the fundamental scatterers in media composed of them. Such particles appear to be abundant in planetary regoliths and can account for the back scattering character of the surfaces of many bodies in the solar system. If the range of phase angles covered by a data set is insufficient, serious errors in retrieving the particle scattering properties can result whether an exact or approximate scattering model is used. However, if the data set includes both large and small phase angles, approximate regolith scattering models can correctly retrieve the sign of the particle scattering asymmetry.

Hapke, Bruce↗

Validation of Satellite Retrieved Land Surface Variables

The effective use of satellite observations of the land surface is limited by the lack of high spatial resolution ground data sets for validation of satellite products. Recent large scale field experiments include FIFE, HAPEX-Sahel and BOREAS which provide us with data sets that have large spatial coverage and long time coverage. It is the objective of this paper to characterize the difference between the satellite estimates and the ground observations. This study and others along similar lines will help us in utilization of satellite retrieved data in large scale modeling studies.

Lakshmi, Venkataraman↗

Validation of Satellite Retrieved Land Surface Variables

The effective use of satellite observations of the land surface is limited by the lack of high spatial resolution ground data sets for validation of satellite products. Recent large scale field experiments include FIFE, HAPEX-Sahel and BOREAS which provide us with data sets that have large spatial coverage and long time coverage. It is the objective of this paper to characterize the difference between the satellite estimates and the ground observations. This study and others along similar lines will help us in utilization of satellite retrieved data in large scale modeling studies.

Lakshmi, Venkataraman↗

Data management in NOAA

The NOAA archives contain 150 terabytes of data in digital form, most of which are the high volume GOES satellite image data. There are 630 data bases containing 2,350 environmental variables. There are 375 million film records and 90 million paper records in addition to the digital data base. The current data accession rate is 10 percent per year and the number of users are increasing at a 10 percent annual rate. NOAA publishes 5,000 publications and distributes over one million copies to almost 41,000 paying customers. Each year, over six million records are key entered from manuscript documents and about 13,000 computer tapes and 40,000 satellite hardcopy images are entered into the archive. Early digital data were stored on punched cards and open reel computer tapes. In the late seventies, an advanced helical scan technology (AMPEX TBM) was implemented. Now, punched cards have disappeared, the TBM system was abandoned, most data stored on open reel tapes have been migrated to 3480 cartridges, many specialized data sets were distributed on CD ROM's, special archives are being copied to 12 inch optical WORM disks, 5 1/4 inch magneto-optical disks were employed for workstation applications, and 8 mm EXABYTE tapes are planned for major data collection programs. The rapid expansion of new data sets, some of which constitute large volumes of data, coupled with the need for vastly improved access mechanisms, portability, and improved longevity are factors which will influence NOAA's future systems approaches for data management.

Callicott, William M.↗

Stochastic Verification by Analysis for Autonomous Systems Management Architecture (ASMA)

The Gateway Vehicle Systems Manager (VSM) is the top-level of a distributed, hierarchical software control system. VSM is data-driven and will make decisions related to mission, fault, resource management and vehicle control. These attributes combined with a high degree of autonomy make it susceptible to emergent behavior. In order to achieve the high level of confidence needed in this critical system, the VSM team has developed a multifaceted verification strategy employing traditional verification techniques, simulation, model checking, and runtime verification. Individual algorithms are verified using conventional testing and model checking using assume-guarantee contracts. A discrete event-based simulation approach is being developed to verify timelines. This presentation describes an enhancement to the verification approach using analysis to enhance system robustness by detecting and resolving the potential for emergent behavior. The verification by analysis employs a Software in the Loop (SITL) environment with real flight software executing on emulated processors, simulations of vehicle subsystems, flight dynamics, and human inputs. Since the possible input space and configuration data set are too large for exhaustive testing, a Monte Carlo approach is used to cover feasible scenarios, augmented with corner cases and known higher-risk scenarios. A key problem in using Monte Carlo-based system verification is evaluating test results to ensure that system behavior is correct. The presentation describes the approach the VSM team uses to monitor behavior for compliance with predetermined boundaries and to identify anomalous behavior for further analysis. This presentation describes the multi-level systems approach to verification, and the simulation-based layer that covers the feasible state space: 1. Overview of the Gateway VSM 2. Special challenges due to heterogeneous, hierarchical architecture 3. Modeling and simulation environment using flight software and system simulations 4. Developing input sets to ensure state-space coverage 5. Developing model and data configuration sets to ensure model coverage 6. Interpreting results without predetermined outcomes 7. Lessons learned and future work

Verification and Validation↗

Advances in Hyperspectral Image Classification Methods for Vegetation and Agricultural Cropland Studies

Hyperspectral data are becoming more widely available via sensors on airborne and unmanned aerial vehicle (UAV) platforms, as well as proximal platforms. While space-based hyperspectral data continue to be limited in availability, multiple spaceborne Earth-observing missions on traditional platforms are scheduled for launch, and companies are experimenting with small satellites for constellations to observe the Earth, as well as for planetary missions. Land cover mapping via classification is one of the most important applications of hyperspectral remote sensing and will increase in significance as time series of imagery are more readily available. However, while the narrow bands of hyperspectral data provide new opportunities for chemistry-based modeling and mapping, challenges remain. Hyperspectral data are high dimensional, and many bands are highly correlated or irrelevant for a given classification problem. For supervised classification methods, the quantity of training data is typically limited relative to the dimension of the input space. The resulting Hughes phenomenon, often referred to as the curse of dimensionality, increases potential for unstable parameter estimates, overfitting, and poor generalization of classifiers. This is particularly problematic for parametric approaches such as Gaussian maximum likelihood–based classifiers that have been the backbone of pixel-based multispectral classification methods. This issue has motivated investigation of alternatives, including regularization of the class covariance matrices, ensembles of weak classifiers, development of feature selection and extraction methods, adoption of nonparametric classifiers, and exploration of methods to exploit unlabeled samples via semi-supervised and active learning. Data sets are also quite large, motivating computationally efficient algorithms and implementations. This chapter provides an overview of the recent advances in classification methods for mapping vegetation using hyperspectral data. Three data sets that are used in the hyperspectral classification literature (e.g., Botswana Hyperion satellite data and AVIRIS airborne data over both Kennedy Space Center and Indian Pines) are described in Section 3.2 and used to illustrate methods described in the chapter. An additional high-resolution hyperspectral data set acquired by a SpecTIR sensor on an airborne platform over the Indian Pines area is included to exemplify the use of new deep learning approaches, and a multiplatform example of airborne hyperspectral data is provided to demonstrate transfer learning in hyperspectral image classification. Classical approaches for supervised and unsupervised feature selection and extraction are reviewed in Section 3.3. In particular, nonlinearities exhibited in hyperspectral imagery have motivated development of nonlinear feature extraction methods in manifold learning, which are outlined in Section 3.3.1.4. Spatial context is also important in classification of both natural vegetation with complex textural patterns and large agricultural fields with significant local variability within fields. Approaches to exploit spatial features at both the pixel level (e.g., co-occurrence–based texture and extended morphological attribute profiles [EMAPs]) and integration of segmentation approaches (e.g., HSeg) are discussed in this context in Section 3.3.2. Recently, classification methods that leverage nonparametric methods originating in the machine learning community have grown in popularity. An overview of both widely used and newly emerging approaches, including support vector machines (SVMs), Gaussian mixture models, and deep learning based on convolutional neural networks is provided in Section 3.4. Strategies to exploit unlabeled samples, including active learning and metric learning, which combine feature extraction and augmentation of the pool of training samples in an active learning framework, are outlined in Section 3.5. Integration of image segmentation with classification to accommodate spatial coherence typically observed in vegetation is also explored, including as an integrated active learning system. Exploitation of multisensor strategies for augmenting the pool of training samples is investigated via a transfer learning framework in Section 3.5.1.2. Finally, we look to the future, considering opportunities soon to be provided by new paradigms, as hyperspectral sensing is becoming common at multiple scales from ground-based and airborne autonomous vehicles to manned aircraft and space-based platforms.

Pasolli, Edoardo↗

Satellite observed thermodynamics during FGGE

During the First Global Atmospheric Research Program (GARP) Global Experiment (FGGE), determinations of temperature and moisture were made from TIROS-N and NOAA-6 satellite infrared and microwave sounding radiance measurements. The data were processed by two methods differing principally in their horizontal resolution. At the National Earth Satellite Service (NESS) in Washington, D.C., the data were produced operationally with a horizontal resolution of 250 km for inclusion in the FGGE Level IIb data sets for application to large-scale numerical analysis and prediction models. High horizontal resolution (75 km) sounding data sets were produced using man-machine interactive methods for the special observing periods of FGGE at the NASA/Goddard Space Flight Center and archived as supplementary Level IIb. The procedures used for sounding retrieval and the characteristics and quality of these thermodynamic observations are given.

Smith, W. L.↗

Autoregressive modeling for the spectral analysis of oceanographic data

Over the last decade there has been a dramatic increase in the number and volume of data sets useful for oceanographic studies. Many of these data sets consist of long temporal or spatial series derived from satellites and large-scale oceanographic experiments. These data sets are, however, often 'gappy' in space, irregular in time, and always of finite length. The conventional Fourier transform (FT) approach to the spectral analysis is thus often inapplicable, or where applicable, it provides questionable results. Here, through comparative analysis with the FT for different oceanographic data sets, the possibilities offered by autoregressive (AR) modeling to perform spectral analysis of gappy, finite-length series, are discussed. The applications demonstrate that as the length of the time series becomes shorter, the resolving power of the AR approach as compared with that of the FT improves. For the longest data sets examined here, 98 points, the AR method performed only slightly better than the FT, but for the very short ones, 17 points, the AR method showed a dramatic improvement over the FT. The application of the AR method to a gappy time series, although a secondary concern of this manuscript, further underlines the value of this approach.

Gangopadhyay, Avijit↗

The attenuation of Love waves and toroidal oscillations of the earth.

An attempt has been made to invert a large set of attenuation data for Love waves and toroidal oscillations in the earth, using a recent method by Backus and Gilbert. The difficulty in finding an acceptable model of internal friction which explains the data, under the assumption that the internal friction is independent of frequency, casts doubt on the validity of this assumption. A frequency-dependent model of internal friction is presented which is in good agreement with the seismic data and with recent experimental measurements of attenuation in rocks.

Jackson, D. D.↗

Elemental composition of suspended particulates as functions of space and time in Cleveland, Ohio

An approach to the analysis of a very large elemental concentration data set. The particular data considered was generated by instrumental neutron activation and emission spectroscopy analyses of over 750 24-hour ambient air particulate samples collected at 16 sites in Cleveland, Ohio, during the 15 months from August 1971 thru October 1972. Examples are presented that show the use of multiple approaches to interpreting the data, including pairwise correlation statistics, selective data plotting and cluster analysis.

Neustadter, H. E.↗

Closure and ratio correlation analysis of lunar chemical and grain size data

Major element and major element plus trace element analyses were selected from the lunar data base for Apollo 11, 12 and 15 basalt and regolith samples. Summary statistics for each of the six data sets were compiled, and the effects of closure on the Pearson product moment correlation coefficient were investigated using the Chayes and Kruskal approximation procedure. In general, there are two types of closure effects evident in these data sets: negative correlations of intermediate size which are solely the result of closure, and correlations of small absolute value which depart significantly from their expected closure correlations which are of intermediate size. It is shown that a positive closure correlation will arise only when the product of the coefficients of variation is very small (less than 0.01 for most data sets) and, in general, trace elements in the lunar data sets exhibit relatively large coefficients of variation.

Butler, J. C.↗

Number of signatures necessary for accurate classification

This paper presents a procedure for determining the number of signatures to use in classifying multispectral scanner data. A large initial set of signatures is obtained by clustering the training points within each category (such as 'wheat' or 'other') to be recognized. These clusters are then combined into broader signatures by a program that considers each pair of signatures within a category, combines the best pair in the light of certain criteria, saves the combined signature and repeats the procedure until there is one signature for each category. The result is a collection of sets of signatures, one set for each number between the number of initial clusters and the number of categories. With the aid of statistics such as an estimate of the probability of misclassification between categories, the user can choose the smallest set satisfying his requirements for classification accuracy.

Richardson, W.↗

Lunar electrical conductivity and magnetic permeability

Improved analytical techniques are applied to a large Apollo magnetometer data set to yield values of electroconductivity, temperature, magnetic permeability, and iron abundance. Average bulk electroconductivity of the moon is calculated to be .0007 mho/m; a rapid increase with depth to about .003 mho/m within 250 km is indicated. The temperature profile, obtained from the electroconductivity profile for olivine, indicates high lunar temperatures at relatively shallow depths. Magnetic permeability of the moon relative to its environment is calculated to be 1.008 plus or minus .005; a permeability relative to free space of 1.012 plus 0.011, minus 0.008 is obtained. Lunar iron abundances corresponding to this permeability value are 2.5 plus 2.3, minus 1.7 wt% free iron and 5.0-13.5 wt% total iron for a moon composed of a combination of free iron, olivine, and orthopyroxene.

Dyal, P.↗