Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Dimensionality reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Multispectral combination and display of ERTS-1 data

A significant problem in the use of ERTS-1 data is the extraction of information pertinent to each application and the presentation of that information in a form most suitable to users. When the information is to be displayed for visual study by an observer, the problem can be reduced to two steps: (1) Dimensionality reduction, an objective procedure which attempts to preserve most of the ERTS-1 information in a smaller number of components. (2) Display of the reduced number of components for optimum visibility by an observer. A specific dimensionality reduction technique has been applied to ERTS-1 data for several geographical areas in California and distinct types of earth resources. In the display of the reduced number of components, consideration has to be given to properties of the human visual system and the statistics of the data to be displayed. Previous work on digital image enhancement was applied to this problem to generate color composites which contain and display most of the information provided by the ERTS-1 sensors. Results of this approach were interesting, both in terms of the small mean-square caused by the dimensionality reduction, as well as for the examples of enhanced images that have been obtained.

Algazi, V. R.

Reduced Dimensionality Analysis of TEMPO Ozone Profile Retrievals Using the Compact Phase Space (CPSR) Algorithm

TEMPO ozone (O 3 ) profile retrievals are expected to have fidelity in the troposphere due the sensitivities of the associated averaging kernels. However, those averaging kernels are severely rank deficiency meaning that a visual inspection of the vertical structure of the averaging kernel profile sensitivities is misleading due linear dependencies in the profile. The Compact Phase Space Retrieval (CPSR) algorithm use singular value decompositions of the averaging kernels and the ‘compressed’ retrieval solution error covariance to project the transformed averaging kernels into a space that removes the linear dependencies and accounts for the solution error uncertainties. In this oral presentation and poster, we apply the CPSR dimensional reduction analysis to TEMPO and TROPOMI O 3 profile retrievals for 13:45 UTC March 29, 2024 to study the phase space characteristics of the transformed averaging kernels as a function of latitude for North America. Our results show that TEMPO generally has more phase space vertical structure in the troposphere than TROPOMI. TEMPO has four to five dominant modes, and TROPOMI has five to six dominant modes. That means that dimensional reduction can reduce the TEMPO resource requirements by ~77% and the TROPOMI requirements by ~81%. Finally, we found that after removing linear dependences and after accounting for solution uncertainties TEMPO still has sensitivities throughout the troposphere.

TEMPO

High dimensional feature reduction via projection pursuit

The recent development of more sophisticated remote sensing systems enables the measurement of radiation in many more spectral intervals than previously possible. An example of that technology is the AVIRIS system, which collects image data in 220 bands. As a result of this, new algorithms must be developed in order to analyze the more complex data effectively. Data in a high dimensional space presents a substantial challenge, since intuitive concepts valid in a 2-3 dimensional space to not necessarily apply in higher dimensional spaces. For example, high dimensional space is mostly empty. This results from the concentration of data in the corners of hypercubes. Other examples may be cited. Such observations suggest the need to project data to a subspace of a much lower dimension on a problem specific basis in such a manner that information is not lost. Projection Pursuit is a technique that will accomplish such a goal. Since it processes data in lower dimensions, it should avoid many of the difficulties of high dimensional spaces. In this paper, we begin the investigation of some of the properties of Projection Pursuit for this purpose.

Jimenez, Luis

Artificial Intelligence Medical Support for Long-Duration Space Missions

We envision an artificial intelligence (AI) based system that will provide support and recommendations to the crew medical officer (CMO) and ground flight surgeon during long-duration space missions. Such a system would be pretrained on the knowledgebase of clinical knowledge on Earth, minimizing the amount of Earth data that needs to be transferred into space. Then during deployment, the system would be constantly refined through active learning from diverse streams of data from sensors in the spacecraft, data collected daily from individual astronauts, and human-in-the-loop feedback from the crew. The model could be interrogated for predictions and recommendations on personalized crew health based on the overall status of the spacecraft, medicinal stores, and status of other crew members. Adaptation techniques would be used to incorporate spaceflight data that have very different distributions from the training data due to the extreme environment. Edge computing and the most advanced neuromorphic processing would enable computation in scenarios with low power and bandwidth, while dimensionality reduction would be employed to ensure that the input data streams from spaceflight are as small as possible. In order to realize this long-term vision, several hardware and software aspects need to be developed and assembled. First, models pretrained on Earth biomedical data would need to be evaluated for predictive accuracy, and the best one selected. That model would need to be adapted to learn from diverse, sparse, and inconsistently measured data streams, as well as human-in-the-loop feedback. A data integration, standardization, and dimensionality reduction methodology would need to be developed to handle all data types and feed them into the model. Once the software and data infrastructure is developed, it would need to be integrated with small footprint compute processors and tested in high-radiation, high-vibration, unregulated temperature situations. As a short-term goal, we recommend to focus on the development of the data and model software structure. Several large language models (LLM) already exist that have been trained on Earth biomedical and clinical knowledgebases, including BioMedLLM, Med-PaLM, SPOKE LLM, and Foresight. These models need to be evaluated for accuracy and the best one chosen for a proof-of-concept structure, while maintaining awareness of the accelerating AI field and incorporating any newly improved model architectures as needed. Then, we recommend to develop a database of synthetic data types to mimic the diverse data streams that are expected in a long-duration space mission. This should include environmental and microbial data from the spacecraft, non-invasive data from wearables and point-of-care devices employed by astronauts, and more invasive molecular and physiological monitoring of clinical and biomarker data from astronauts. The data standardization methodology should be developed, and these data streams used to refine the clinical LLM. Several scenarios should be developed that could plausibly come up in a long-duration space mission, and changes or aberrations introduced to the data at specific times to mimic these scenarios. Then, question and answer tasks should be designed to interrogate the model for predictions and recommendations, with acceptable answers already identified.

Artificial Intelligence

Predicting the Seawater Chemistry of an Ocean World Using Machine Learning on Isotopic Measurements of Volatile CO2

Introduction: Given the long time intervals required for data transmission to and from ocean worlds targets, low bandwidth for data transmission, time required for data processing and analysis, and potentially extreme radiation environments (e.g., Europa), it is clear that ocean worlds missions will need more autonomous flight instruments and software in order to achieve established science goals. Protracted time intervals for data analysis (e.g., Europa Lander) strongly motivates the development of rapid, consistent and streamlined methods for interpreting data from flight mass spectrometers to e.g., determine how mass spectra from a plume or surface liquid/ice relates to the surface/subsurface. Since mass spectrometry also has the potential to correctly identify biosignatures[1], it is imperative that such methods for interpreting data are consistent and accurate. We used 848 isotope ratio mass spectra from laboratory analyses of CO2 that interacted with ocean worlds-relevant seawaters as a ‘training’ dataset for ‘unsupervised’ machine learning. In unsupervised learning, characteristics of the data are not labeled or linked, and any similarities found only result from the neural network. CO2 isotopologues analyzed for this dataset mimic the remote measurements of CO2 by a flight mass spectrometer, and are detailed in Theiling [2]. From this dataset, we used measured features of the spectra, such as retention time, intensity, and (isotopologue) mass ratios as inputs for our autoencoder neural network. Our neural network was trained to find similarities in these and other spectral features for seawaters of a particular composition and amount of initial CO2. Successful training then created an output of these similarities for various seawaters, which included MgSO4, Na2SO4, NaCl, MgCl2, KCl, and NaHCO3, and combinations of these salts. We then applied dimensionality reduction techniques such as Principal Component Analysis (PCA), T-Distributed Stochastic Neighbor Embedding (TSNE), and Uniform Manifold Approximation and Projection (UMAP) to demonstrate latent data features as a two-dimensional projection in a unitless, high-dimensional space. In this projection, a data point represents the combined effect of spectral features such as intensity, retention time, and isotope ratio. Our initial UMAP demonstrates data clustering (organization of the data by the neural network) based on the amount of CO2 that had initially interacted with each seawater. Further training using more ‘supervised’ learning techniques demonstrate strong clustering of preliminary data based on initial CO2 concentration, seawater chemical composition, and ionic strength (salinity). Our preliminary work therefore suggests that machine learning has the potential to identify compositional variants of an ocean world seawater based on mass spectra from volatile CO2 measurements. Acknowledgments: This work was funded through a Strategic Task Group at NASA Goddard Space Flight Center. The training dataset was collected through funding from the Oklahoma Space Grant Consortium. References: [1] Pappalardo, R. et al. (2013) Astrobiology, 13, 740–773. [2] Theiling (2020) Icarus, 114216.

Europa

Neural Network Machine Learning and Dimension Reduction for Data Visualization

Neural network machine learning in computer science is a continuously developing field of study. Although neural network models have been developed which can accurately predict a numeric value or nominal classification, a general purpose method for constructing neural network architecture has yet to be developed. Computer scientists are often forced to rely on a trial-and-error process of developing and improving accurate neural network models. In many cases, models are constructed from a large number of input parameters. Understanding which input parameters have the greatest impact on the prediction of the model is often difficult to surmise, especially when the number of input variables is very high. This challenge is often labeled the "curse of dimensionality" in scientific fields. However, techniques exist for reducing the dimensionality of problems to just two dimensions. Once a problem's dimensions have been mapped to two dimensions, it can be easily plotted and understood by humans. The ability to visualize a multi-dimensional dataset can provide a means of identifying which input variables have the highest effect on determining a nominal or numeric output. Identifying these variables can provide a better means of training neural network models; models can be more easily and quickly trained using only input variables which appear to affect the outcome variable. The purpose of this project is to explore varying means of training neural networks and to utilize dimensional reduction for visualizing and understanding complex datasets.

Liles, Charles A.

150 Shades of Green: Using the Full Spectrum of Remote Sensing Reflectance to Elucidate Color Shifts in the Ocean

This article proposes a simple and intuitive classification system by which to define full spectral remote sensing reflectance (Rrs(λ)) data with a quantitative output that enables a more manageable handling of spectral information for aquatic science applications. The weighted harmonic mean of the Rrs(λ) wavelengths outputs an Apparent Visible Wavelength (in units of nanometers), representing a one-dimensional geophysical metric of color that is inherently correlated to spectral shape. This dimensionality reduction of spectral information combined with the output along a continuum of wavelength values offers a robust and user-friendly means to describe and analyze spectral Rrs(λ) in terms of spatial and temporal trends and variability. The uncertainty in the algorithm's estimation of spectral shape is demonstrated on a global scale, in addition to the utility of the algorithm to discern spectral-spatial-temporal trends in the ocean, on a per-pixel basis for the entire 22 year continuous ocean color (SeaWiFS and MODIS-Aqua) time-series. This technique can be applied to datasets of varying multi- and hyper-spectral resolutions, providing continuity between heritage and future satellite sensors, and further enabling an effective means of elucidating similarities or differences in complex spectral signatures within the constraints of two dimensions. This straightforward means of conceptualizing multi-dimensional variability can help maximize the potential of the spectral information embedded in remote sensing data.

ocean color

A dimensionality reducing model for distributed filtering.

An approach is made to filtering of two-dimensional steady-state problems based on the notion of nearest neighbor interaction, i.e., at a given point in the spatial grid, the value at the variable of interest can be assumed to depend only on the values at adjacent grid points. It is shown that for linear steady-state problems significant dimensionality reductions can be accomplished. It was possible to achieve the desired results using a small amount of computer time and without getting into stability difficulties.

Angel, E.

A nearest neighbors approach to multidimensional filtering.

The concept of nearest neighbor interaction is applied as a basis for data filtering in two-dimensional steady state problems. A steady state process represented by a potential equation with additive white noise is used to illustrate the application of this concept. It is demonstrated that significant dimensionality reductions can be achieved by applying this concept to various linear steady state problems.

Angel, E.

High gas velocity burner tests on silicon carbide and silicon nitride at 1200 C

Specimens of silicon carbide and silicon nitride were exposed to a Mach one gas velocity burner simulating a turbine engine environment. Cyclic tests up to 100 hour duration were conducted at specimen temperatures of 1200 C. A specimen geometry was used that develops thermal stresses during thermal cycling in a manner similar to blades and vanes of a gas turbine engine. Materials were compared on a basis of weight change, dimensional reductions, metallography, fluorescent penetrant inspection, X-ray diffraction analyses, failure mode, and general appearance. One hot pressed SiC, one reaction sintered SiC, and three hot pressed Si3N4 specimens survived the program goal of 100 one-hour cycle exposures. Of the materials that failed to meet the program goal, thermal fatigue was identified as the exclusive failure mode.

Sanders, W. A.

Multispectral combination and display of ERTS-1 data

Standard NASA color composites combine the most relevant 3 bands from the 4 MSS bands available. An alternate approach is to extract the principal components of the data by a linear transformation of the 4 bands. This approach leads to a low dimensionality representation of ERTS-1 data with the least degradation, in the mean square sense, of the radiometric accuracy. The technique has been applied with success to ERTS-1 MSS data for several geographic areas in California. For all examples considered the mean square representation error is less than one percent. By combining this dimensionality reduction which our previous results on image enhancement for visual display, color composites are obtained which contain and display most of the information provided by the ERTS-1 sensors.

Algazi, V. R.

Behavior of ceramics at 1200 C in a simulated gas turbine environment

This report summarizes programs at the NASA Lewis Research Center evaluating several classes of commercial ceramics, in a high gas velocity burner rig simulating a gas turbine engine environment. Testing of 23 ceramics in rod geometry identified SiC and Si3N4 as outstanding in resistance to oxidation and thermal stress and identified the failure modes of other ceramics. Further testing of a group of 15 types of SiC and Si3N4 in simulated vane shape geometry has identified a hot pressed SiC, a reaction sintered SiC, and hot pressed Si3N4 as the best of that group. SiC and Si3N4 test specimens were compared on the basis of weight change, dimensional reductions, metallography, fluorescent penetrant inspection, X-ray diffraction analyses, and failure mode.

Sanders, W. A.

High gas velocity burner tests on silicon carbide and silicon nitride at 1200 C

Ten SiC materials and five Si3N4 materials were exposed in a Mach 1-gas-velocity burner simulating a gas-turbine engine environment. All materials studied are commercially available. Cyclic tests up to 100 hours' duration were conducted at specimen temperatures of 1200 C. A specimen geometry was used that develops thermal stresses during thermal cycling in a manner similar to blades and vanes of a gas turbine engine. Materials were compared on a basis of weight change, dimensional reductions, metallography, fluorescent-penetrant inspection, X-ray diffraction analyses, failure mode, and general appearance. One hot-pressed SiC, one reaction-sintered SiC, and three hot-pressed Si3N4 materials survived the program goal of 100 one-hour cycles of exposures. Of the materials that failed to meet the program goal, thermal fatigue was identified as the exclusive failure mode.

Sanders, W. A.

AHIMSA - Ad hoc histogram information measure sensing algorithm for feature selection in the context of histogram inspired clustering techniques

An algorithm is proposed for dimensionality reduction in the context of clustering techniques based on histogram analysis. The approach is based on an evaluation of the hills and valleys in the unidimensional histograms along the different features and provides an economical means of assessing the significance of the features in a nonparametric unsupervised data environment. The method has relevance to remote sensing applications.

Dasarathy, B. V.

Stability of constant gain systems with vector feedback

The state space, the controllability, and the observability concepts are discussed in connection with the proposed stability analysis which permits drastic dimensional reductions for a vector feedback problem. Any constant gain system's stability can thus be analyzed in the frequency domain with a single Nyquist plot. The analysis considers the total system with all loops closed, a disturbance vector as input, and the feedback vector as output. All constant gain systems are shown to be decomposable into stable subsystems where the degree of the decomposition determines the dimensions. The maximum decomposition results in the state-space approach which is the limit case. The method is demonstrated with the stability analysis of the pogo phenomenon, an oscillatory interaction between the propulsion and the structure of a space vehicle. This problem, with eigenvalues over a hundred, was drastically but rigorously reduced to a stability analysis of a 4x4 matrix.

Vonpragenau, G. L.

Linear feature selection with applications

Several ways in which feature selection techniques were used in LACIE are discussed. In all cases, the methods require some a priori information and assumptions; in most, the classification procedure (Bayes optimal) was chosen in advance. The transformations used for dimensionality reduction are linear, that is, the variables in feature space are always linear combinations of the original measurements. Several numerically tractable criteria developed for LACIE, which provide information about the probability of misclassification, are discussed. Recent results on linear feature selection techniques are included. Their use in LACIE is discussed. Related open questions are mentioned.

Decell, H. P., Jr.

Visual enhancement of images of natural resources: Applications in geology

The principal components technique for use in multispectral scanner LANDSAT data processing results in optimum dimensionality reduction. A powerful tool for MSS IMAGE enhancement, the method provides a maximum impression of terrain ruggedness; this fact makes the technique well suited for geological analysis.

Dejesusparada, N.

A new method for mapping multidimensional data to lower dimensions

A multispectral mapping method is proposed which is based on the new concept of BEND (Bidimensional Effective Normalised Difference). The method, which involves taking one sample point at a time and finding the interrelationships between its features, is found very economical from the point of view of storage and processing time. It has good dimensionality reduction and clustering properties, and is highly suitable for computer analysis of large amounts of data. The transformed values obtained by this procedure are suitable for either a planar 2-space mapping of geological sample points or for making grayscale and color images of geo-terrains. A few examples are given to justify the efficacy of the proposed procedure.

Gowda, K. C.