SEARCH · Engineering Papers

Results for “data analysis methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Generalized Canonical Polyadic Tensor Decomposition

Tensor decomposition is a fundamental unsupervised machine learning method in data science, with applications including network analysis and sensor data processing. This work develops a generalized canonical polyadic (GCP) low-rank tensor decomposition that allows other loss functions besides squared error. For instance, we can use logistic loss or Kullback--Leibler divergence, enabling tensor decomposition for binary or count data. We present a variety of statistically motivated loss functions for various scenarios. We provide a generalized framework for computing gradients and handling missing data that enables the use of standard optimization methods for fitting the model. Furthermore, we demonstrate the flexibility of the GCP decomposition on several real-world examples including interactions in a social network, neural activity in a mouse, and monthly rainfall measurements in India.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1983

Characterization of ceramic powders by an X-ray measuring method

X-ray line broadening analysis gives quantitative data on structural changes of ceramic powders after different processing steps. Various Al2O3 powders were investigated and the following points are discussed on the basis of these results: X-ray line broadening analysis, structural changes during grinding, structural changes during annealing, influence of structural properties on sintering behavior and application of line broadening analysis to quality control of powders.

Ziegler, B.↗

NASA NTRS1991

Doppler indices of gas phase formation in hypobaric environments: Time-intensity analysis

A semi-quantitative method to analyze decompression data is described. It possesses the advantage that it allows a graded response to decompression rather than the dichotomous response generally employed. A generalized critical volume (C-V), or stoichiometric time-dependent equilibrium model is examined that relates the constant of the equation P sub i equals m P sub f plus b to variable tissue supersaturation and gas washout terms. The effects of the tissue ratio on gas phase formation indicate that a decreased ratio yields fewer individuals with Doppler detectable gas bubbles, but those individuals still present with Spencer Grade 3 or 4. This might indicate a local collapse of tissue saturation. The individuals with Grade 3 or 4 could be at risk for type 2 decompression sickness by transpulmonic arterialization. The primary regulator of the problems of decompression sickness is the reduction of local supersaturation, presumably governed by the presence and number of gas micronuclei. It is postulated that a reduction in these nuclei will favor a low incidence of decompression sickness in microgravity secondary to hypokinesia and adynamia.

Powell, Michael R.↗

NASA NTRS2002

Development of an Efficient Binaural Simulation for the Analysis of Structural Acoustic Data

Binaural or "virtual acoustic" representation has been proposed as a method of analyzing acoustic and vibroacoustic data. Unfortunately, this binaural representation can require extensive computer power to apply the Head Related Transfer Functions (HRTFs) to a large number of sources, as with a vibrating structure. This work focuses on reducing the number of real-time computations required in this binaural analysis through the use of Singular Value Decomposition (SVD) and Equivalent Source Reduction (ESR). The SVD method reduces the complexity of the HRTF computations by breaking the HRTFs into dominant singular values (and vectors). The ESR method reduces the number of sources to be analyzed in real-time computation by replacing sources on the scale of a structural wavelength with sources on the scale of an acoustic wavelength. It is shown that the effectiveness of the SVD and ESR methods improves as the complexity of the source increases. In addition, preliminary auralization tests have shown that the results from both the SVD and ESR methods are indistinguishable from the results found with the exhaustive method.

Lalime, Aimee L.↗

DOE OSTI2023

Dimensionality reduction using elastic measures

With the recent surge in big data analytics for hyperdimensional data, there is a renewed interest in dimensionality reduction techniques. In order for these methods to improve performance gains and understanding of the underlying data, a proper metric needs to be identified. This step is often overlooked, and metrics are typically chosen without consideration of the underlying geometry of the data. Here, in this paper, we present a method for incorporating elastic metrics into the t-distributed stochastic neighbour embedding (t-SNE) and Uniform Manifold Approximation and Projection (UMAP). We apply our method to functional data, which is uniquely characterized by rotations, parameterization and scale. If these properties are ignored, they can lead to incorrect analysis and poor classification performance. Through our method, we demonstrate improved performance on shape identification tasks for three benchmark data sets (MPEG-7, Car data set and Plane data set of Thankoor), where we achieve 0.77, 0.95 and 1.00 F1 score, respectively.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2011

Determining the Optimal Number of Clusters with the Clustergram

Cluster analysis aids research in many different fields, from business to biology to aerospace. It consists of using statistical techniques to group objects in large sets of data into meaningful classes. However, this process of ordering data points presents much uncertainty because it involves several steps, many of which are subject to researcher judgment as well as inconsistencies depending on the specific data type and research goals. These steps include the method used to cluster the data, the variables on which the cluster analysis will be operating, the number of resulting clusters, and parts of the interpretation process. In most cases, the number of clusters must be guessed or estimated before employing the clustering method. Many remedies have been proposed, but none is unassailable and certainly not for all data types. Thus, the aim of current research for better techniques of determining the number of clusters is generally confined to demonstrating that the new technique excels other methods in performance for several disparate data types. Our research makes use of a new cluster-number-determination technique based on the clustergram: a graph that shows how the number of objects in the cluster and the cluster mean (the ordinate) change with the number of clusters (the abscissa). We use the features of the clustergram to make the best determination of the cluster-number.

Fluegemann, Joseph K.↗

NASA NTRS1984

Study of the system of middle atmosphere-ionosphere using remote-sensing data

In the present investigation, the methods of statistical spectral analysis are employed for a study of the quasi-periodic changes of state parameters of the middle atmosphere and the ionosphere, taking into account oscillations with periods of several days. The considered oscillations are typical for planetary waves. The theory and empirical findings regarding transient planetary waves are utilized as a basis for the concepts employed in the data analysis and for the interpretation of the results. The results of the investigation show a presence of coherent variations in the time series of radiation density measurements and other state parameters for the middle atmosphere and the ionosphere. The existence of presumably dynamic coupling processes can be recognized in oscillations with periods of about 16 or 5 days.

Hass, H.↗

NASA NTRS1984

Towards the objective analysis of clouds from satellite imagery data

It is suspected that clouds play a major role in climate dynamics. However, conclusive studies regarding the effects related to the cloud cover appear difficult because there is a lack of objective data. The present investigation is concerned with an objective scheme for deriving clouds and their properties from satellite imagery data for the oceans. The objective analysis makes use of the spatial coherence method for retrieving cloud cover from satellite imagery data. This method has advantages over other techniques often applied to imagery data. It is not necessary that clouds fill completely the observing instrument's field-of-view, and a priori or satellite derived knowledge of the cloud radiative properties is not needed.

Coakley, J. A., Jr.↗

DOE OSTI2024

Positron emission tomography harmonization in the Alzheimer's Disease Neuroimaging Initiative: A scalable and rigorous approach to multisite amyloid and tau quantification

Abstract INTRODUCTION A key goal of the Alzheimer's Disease NeuroImaging Initiative (ADNI) positron emission tomography (PET) Core is to harmonize quantification of β‐amyloid (Aβ) and tau PET image data across multiple scanners and tracers. METHODS We developed an analysis pipeline (Berkeley PET Imaging Pipeline, B‐PIP) for ADNI Aβ and tau PET images and applied it to PET data from other multisite studies. Steps include image pre‐processing, refacing, magnetic resonance imaging (MRI)/PET co‐registration, visual quality control (QC), quantification of tracer uptake, and standardization of Aβ and tau standardized uptake value ratios (SUVrs) across tracers. RESULTS Measurements from 10,105 cross‐sectional and longitudinal Aβ and tau PET scans acquired in several studies between 2010 and 2024 can be processed, harmonized, and directly merged across tracers and cohorts. DISCUSSION The B‐PIP developed in ADNI is a scalable image harmonization approach used in several observational studies and clinical trials that facilitates rigorous Aβ and tau PET quantification and data sharing. Highlights Quantitative results from ADNI Aβ and tau PET data are generated using a rigorous, scalable image processing pipeline This pipeline has been applied to PET data from several other large, multisite studies and trials Quantitative outcomes are harmonizable across studies and are shared with the scientific community

Neurosciences & Neurology↗

NASA NTRS1994

The Influence of Sound Cues on the Maintenance of Temporal Organization in the Sprague-Dawley Rat

Temporal organization is a fundamental property of living matter. From single cells to complex animals including man, most physiological systems undergo daily periodic changes in concert with environmental cues (e.g., light, temperature etc.). It is known that pulsed Environmental synchronizers, zeitgebers, (e.g. light) can modify rhythm parameters. Rhythm stability is a necessary requirement for most animal experiments. The extent to which sound can influence the circadian system of laboratory rats is poorly understood. This has implications to animal habitats in the novel environments of the Space-Laboratory or Space Station. A series of three white noise (88+/-0.82 db) zeitgeber experiments were conducted (n=6/experiment).The sound cue was introduced in the circadian free-running phase (DD-NQ) and in one additional case sound was added to the usual photoperiod (12L:12D) to determine masking effects. Circadian rhythm parameters of drinking frequency, feeding frequency, and gross locomotor activity were continuously monitored. Data analysis for these studies included macroscopic and microscopic methods. Raster plots to visually detect entrainment versus free-running period, were plotted for each animal, for all three parameters, during all sound perturbation tested. These data were processed through a series of detrending (robust locally weighted regression analyses) and complex demodulation analyses. In summary, these findings show that periodic "white" noise "influences" the rats circadian system but does not "entrain" the feeding, drinking or locomotor activity rhythms.

Winget, C. M.↗

DOE OSTI2023

Stakeholder analysis for designing an urban air quality data governance ecosystem in smart cities

Cities, the world over, are fuelling economic growth. At the same time, rapid urbanization is a root cause of serious environmental damage. Recent WHO global air pollution guidelines highlight air pollution as a critical environmental threat along with climate change. To address these threats, smart cities and clean air programs are on a rise. In smart cities, data and Information and Communication Technologies (ICT) are major drivers of city transformations. The 4th Industrial Revolution (4IR) technologies such as the Internet of Things (IoT), big data, artificial intelligence (AI), and cloud computing have the potential to accelerate these transformations toward urban resilience. However, the success of smart cities and clean air programs depends on cohesive multi-sector stakeholder contributions. This study conducted interdisciplinary participative stakeholder analysis to understand the data, and sectorial challenges, to outline the technological opportunities to facilitate clean air programs in Indian smart cities. The research highlights gaps due to siloed stakeholder operations, lack of data calibration, non-alignment of smart city and air quality management services, non-availability of health exposure data, and difficulty in translating scientific data into implementable actions. Stakeholders expressed potential ‘fit for the purpose’ use of IoT devices, satellites, smartphones, and mobility data augmented by AI methods in bridging these gaps. In conclusion, the analysis points toward a need to develop an easily accessible and ubiquitous urban data governance ecosystem enabling seamless cross-sector data exchanges to build trusting relationships among the stakeholders across the air quality management value chain.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Performance Prediction of Big Data Transfer Through Experimental Analysis and Machine Learning

Big data transfer in next-generation scientific ap- plications is now commonly carried out over connections with guaranteed bandwidth provisioned in High-performance Net- works (HPNs) through advance bandwidth reservation. To use HPN resources efficiently, provisioning agents need to carefully schedule data transfer requests and allocate appropriate band- widths. Such reserved bandwidths, if not fully utilized by the requesting user, could be simply wasted or cause extra overhead and complexity in management due to exclusive access. This calls for the capability of performance prediction to reserve bandwidth resources that match actual needs. Towards this goal, we employ machine learning algorithms to predict big data transfer perfor- mance based on extensive performance measurements, which are collected over a span of several years from a large number of data transfer tests using different protocols and toolkits between various end sites on several real-life physical or emulated HPN testbeds. We first identify a comprehensive list of attributes involved in a typical big data transfer process, including end host system configurations, network connection properties, and control parameters of data transfer methods. We then conduct an in-depth exploratory analysis of their impacts on application- level throughput, which provides insights into big data transfer performance and motivates the use of machine learning. We also investigate the applicability of machine learning algorithms and derive their general performance bounds for performance prediction of big data transfer in HPNs. Experimental results show that, with appropriate data preprocessing, the proposed machine learning-based approach achieves 95% or higher pre- diction accuracy in up to 90% of the cases with very noisy real-life performance measurements.

Yun, Daqing↗

NASA NTRS1975

Computer-aided analysis of Skylab scanner data for land use mapping, forestry and water resource applications

Skylab data were obtained over a mountainous test site containing a complex association of cover types and rugged topography. The application of computer-aided analysis techniques to the multispectral scanner data produced a number of significant results. Techniques were developed to digitally overlay topographic data (elevation, slope, and aspect) onto the S-192 MSS data to provide a method for increasing the effectiveness and accuracy of computer-aided analysis techniques for cover type mapping. The S-192 MSS data were analyzed using computer techniques developed at Laboratory for Applications of Remote Sensing (LARS), Purdue University. Land use maps, forest cover type maps, snow cover maps, and area tabulations were obtained and evaluated. These results compared very well with information obtained by conventional techniques. Analysis of the spectral characteristics of Skylab data has conclusively proven the value of the middle infrared portion of the spectrum (about 1.3-3.0 micrometers), a wavelength region not previously available in multispectral satellite data.

Hoffer, R. M.↗

NASA NTRS1989

Instrumental and atmospheric background lines observed by the SMM gamma-ray spectrometer

Preliminary identifications of instrumental and atmospheric background lines detected by the gamma-ray spectrometer on NASA's Solar Maximum Mission satellite (SMM) are presented. The long-term and stable operation of this experiment has provided data of high quality for use in this analysis. Methods are described for identifying radioactive isotopes which use their different decay times. Temporal evolution of the features are revealed by spectral comparisons, subtractions, and fits. An understanding of these temporal variations has enabled the data to be used for detecting celestial gamma-ray sources.

Share, G. H.↗

NASA NTRSDate not supplied

Evaluating Faulty State Occurrence in Wildfire UAS Missions Using Markov Chains

As autonomous technology advances, unmanned aircraft systems are increasingly integrated into emergency response missions, such as wildfire response. These systems must be be safe with less risk than non-autonomous counter parts, yet quantifying the risk associated with present-day and future systems conventionally relies solely on expert opinion and little data. Instead, combining narrative mishap reports with probabilistic analysis can provide a method for evolutionary and timely risk analysis. In this paper, we present a framework for a data-driven probabilistic risk assessment style analysis, where hazard events and rates originate from documented UAS mishaps. The framework is applied to a UAS mapping mission in wildfire response, including a fault tree analysis, event tree analysis, and probabilistic analysis using Markov Chains. The analysis provides an enumeration of hazards in the system, hazard events that can lead to faults, the probability of a mission experiencing any fault, the probability of experiencing a specific fault, and the expected time spent until faulty states occur in present-day operations.

risk analysis↗

NASA NTRSDate not supplied

Evaluating Faulty State Occurrence in Wildfire UAS Missions Using Markov Chains

risk analysis↗

NASA NTRS1993

Objective determination of image end-members in spectral mixture analysis of AVIRIS data

Spectral mixture analysis has been shown to be a powerful, multifaceted tool for analysis of multi- and hyper-spectral data. Applications of AVIRIS data have ranged from mapping soils and bedrock to ecosystem studies. During the first phase of the approach, a set of end-members are selected from an image cube (image end-members) that best account for its spectral variance within a constrained, linear least squares mixing model. These image end-members are usually selected using a priori knowledge and successive trial and error solutions to refine the total number and physical location of the end-members. However, in many situations a more objective method of determining these essential components is desired. We approach the problem of image end-member determination objectively by using the inherent variance of the data. Unlike purely statistical methods such as factor analysis, this approach derives solutions that conform to a physically realistic model.

Tompkins, Stefanie↗

NASA NTRS1988

Use of VAS data to diagnose the mesoscale environment of convective storms

The utility of VISSR Atmospheric Sounder (VAS) retrieval datasets for mesoscale analysis is explored. A detailed mesoscale air mass analysis method is presented in which VAS soundings, satellite imagery, and conventional surface data are used to diagnose mesoscale differences in air mass character. Comparisons are made with radiosonde observations of the same air mass differences. A mesoscale air mass analysis is presented with a discussion of the role that the various air masses play in subsequent convective development. In a second technique, several VAS-derived thermodynamic parameters, such as positive and negative buoyant energy, are shown to be well suited to operational forecasting of convective storm development and evolution. The derivation of these parameters and their applications in forecasting are illustrated.

Zehr, Raymond M.↗