Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Dimensionality Reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Experimental Realization of One-Dimensional Helium

Abstract As the spatial dimension is lowered, locally stabilizing interactions are reduced, leading to the emergence of strongly fluctuating phases of matter without classical analogues. Realizing 1D platforms has been elusive, due to their inherent lack of stability, with a few notable exceptions such as spin chains and ultracold low-density gasses. The inability of such systems to exhibit long range order is essential to their universal description in terms of the Tomonaga-Luttinger liquid theory. Here we report on the experimental observation of a one-dimensional quantum liquid of $$^4$$ 4 He using nanoengineering to confine it within a porous material preplated with a noble gas to enhance dimensional reduction. The resulting excitations of the confined $$^4$$ 4 He, confirmed by neutron scattering, are qualitatively different than three- and two-dimensional superfluid helium, and consistent with Quantum Monte Carlo calculations. The results can be analyzed in terms of a mobile impurity in an otherwise linear Luttinger liquid allowing for the extraction of the microscopic parameters describing the emergent quantum liquid.

Sokol, Paul E.↗

Unsupervised discovery of temporal sequences in high-dimensional datasets, with applications to neuroscience

Identifying low-dimensional features that describe large-scale neural recordings is a major challenge in neuroscience. Repeated temporal patterns (sequences) are thought to be a salient feature of neural dynamics, but are not succinctly captured by traditional dimensionality reduction techniques. Here, we describe a software toolbox—called seqNMF—with new methods for extracting informative, non-redundant, sequences from high-dimensional neural data, testing the significance of these extracted patterns, and assessing the prevalence of sequential structure in data. We test these methods on simulated data under multiple noise conditions, and on several real neural and behavioral data sets. In hippocampal data, seqNMF identifies neural sequences that match those calculated manually by reference to behavioral events. In songbird data, seqNMF discovers neural sequences in untutored birds that lack stereotyped songs. Thus, by identifying temporal structure directly from neural data, seqNMF enables dissection of complex neural circuits without relying on temporal references from stimuli or behavioral outputs.

60 APPLIED LIFE SCIENCES↗

Geometric learning for computational mechanics Part II: Graph embedding for interpretable multiscale plasticity

The history-dependent behaviors of classical plasticity models are often driven by internal variables evolved according to phenomenological laws. The difficulty to interpret how these internal variables represent a history of deformation, the lack of direct measurement of these internal variables for calibration and validation, and the weak physical underpinning of those phenomenological laws have long been criticized as barriers to creating realistic models. In this work, geometric machine learning on graph data (e.g. finite element solutions) is used as a means to establish a connection between nonlinear dimensional reduction techniques and plasticity models. Geometric learning-based encoding on graphs allows the embedding of rich time-history data onto a low-dimensional Euclidean space such that the evolution of plastic deformation can be predicted in the embedded feature space. Finally, a corresponding decoder can then convert these low-dimensional internal variables back into a weighted graph such that the dominating topological features of plastic deformation can be observed and analyzed.

42 ENGINEERING↗

Two-dimensional heavy fermions in the van der Waals metal CeSiI

Heavy-fermion metals are prototype systems for observing emergent quantum phases driven by electronic interactions. A long-standing aspiration is the dimensional reduction of these materials to exert control over their quantum phases, which remains a significant challenge because traditional intermetallic heavy-fermion compounds have three-dimensional atomic and electronic structures. Here we report comprehensive thermodynamic and spectroscopic evidence of an antiferromagnetically ordered heavy-fermion ground state in CeSiI, an intermetallic comprising two-dimensional (2D) metallic sheets held together by weak interlayer van der Waals (vdW) interactions. Owing to its vdW nature, CeSiI has a quasi-2D electronic structure, and we can control its physical dimension through exfoliation. The emergence of coherent hybridization of f and conduction electrons at low temperature is supported by the temperature evolution of angle-resolved photoemission and scanning tunnelling spectra near the Fermi level and by heat capacity measurements. Electrical transport measurements on few-layer fakes reveal heavy-fermion behaviour and magnetic order down to the ultra-thin regime. Importantly, our work establishes CeSiI and related materials as a unique platform for studying dimensionally confined heavy fermions in bulk crystals and employing 2D device fabrication techniques and vdW heterostructures to manipulate the interplay between Kondo screening, magnetic order and proximity effects.

36 MATERIALS SCIENCE↗

Function Preserving Projection (FPP): A Linear Projection Technique for Visual Interpretation of High-Dimensional Functions

In this work, we propose function preserving projection (FPP), a new class of scalable linear projection techniques for finding interpretable structure in highdimensional datasets. Instead of focusing on preserving the structure of highdimensional points as traditional dimensionality reduction methods, we aim to find a 2D view of the data, in which human interpretable patterns of meaningful properties (that defined on the high-dimensional points, i.e., functions in a highdimensional domain) are revealed. Such a visual-centric approach introduces new avenues for exploratory data analysis and allows efficient implementation that provides a scalable tool for exploring potentially unknown or unexpected relationships in complex and large high-dimensional data (e.g., beyond millions of samples and tens of thousands of dimensions).

97 MATHEMATICS AND COMPUTING↗

Monitoring Fracture Saturation With Internal Seismic Sources and Twin Neural Networks

Seismic coda-wave analysis is a well-developed method for detecting subtle physical changes in complex media by measuring arrival times in the late-arriving energy from multiply scattered or reflected waves. However, a challenge arises when multiply scattered waves are not sufficiently separated in time from the direct arrivals to provide a clear coda wave train. Additional complications for monitoring changes in fracture systems arise when the signals originate from unsynchronized internal sources, such as natural or induced seismicity, from acoustic emission, or from transportable intra-fracture sources (chattering dust), that generate uncontrolled signals that vary in arrival time, amplitude and frequency content. Here, we use a twin neural network (TNN also known as a Siamese neural network) for dimensionality reduction to analyze signals from chattering dust to classify the fluid saturation state of a synthetic fracture system. The TNN with shared weights generates a low-dimensional representation of the data input by minimizing contrastive loss, serving as the input to a multiclass classifier that accurately classifies whether multiple fractures in a fracture system are fully saturated or partially saturated, or whether a change in saturation has occurred in different fractures in the system. Furthermore, these results show that information buried in unresolved codas from uncontrolled sources can be extracted using machine learning to monitor the evolution of fracture systems caused by physical and chemical processes even when the scattered and direct wave fields overlap.

58 GEOSCIENCES↗

$T\bar{T}$ in JT Gravity and BF Gauge Theory

JT gravity has a first-order formulation as a two-dimensional BF theory, which can be viewed as the dimensional reduction of the Chern-Simons description of 3d 3 d gravity. We consider {T\overbar{T}} T T ¯ -type deformations of the (0+1) ( 0 + 1 ) -dimensional dual to this 2d 2 d BF theory and interpret the deformation as a modification of the BF theory boundary conditions. The fundamental observables in this deformed BF theory, and in its 3d 3 d Chern-Simons lift, are Wilson lines and loops. In the 3d 3 d Chern-Simons setting, we study modifications to correlators involving boundary-anchored Wilson lines which are induced by a {T\overbar{T}} T T ¯ deformation on the 2d 2 d boundary; results are presented at both the classical level (using modified boundary conditions) and the quantum-mechanical level (using conformal perturbation theory). Finally, we calculate the analogous deformed Wilson line correlators in 2d 2 d BF theory below the Hagedorn temperature where the principal series dominates over the discrete series.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

In Situ Data Analysis Through Physics-informed Tensor Decompositions (LDRD Final Report)

We introduce a new low-dimensional model of high-dimensional numerical simulation data based on low-rank tensor decompositions. Our new model aims to minimize differences between the model data and simulation data as well as functions of the model data and functions of the simulation data. This novel approach to dimensionality reduction of simulation data provides a means of directly incorporating quantities of interests and invariants associated with conservation principles associated with the simulation data into the low-dimensional model, thus enabling more accurate analysis of the simulation without requiring access to the full set of high-dimensional data. Computational results of applying this approach to two standard low-rank tensor decompositions of data arising from simulation of combustion and plasma physics are presented.

97 MATHEMATICS AND COMPUTING↗

Data for Monitoring Fracture Saturation with Internal Transportable Seismic Sources and Twin Neural Networks

Seismic coda-wave analysis is a well-developed method for detecting subtle physical changes in complex media by measuring arrival times in the late-arriving energy from multiply-scattered or reflected waves. However, a challenge arises when multiply-scattered waves are not sufficiently separated in time from the direct arrivals to provide a clear coda wave train. Additional complications for monitoring changes in fracture systems arise when the signals originate from unsynchronized internal sources, such as natural induced seismicity, from acoustic emission, or from transportable intra-fracture sources (chattering dust), that generate uncontrolled signals that vary in arrival time, amplitude and frequency content. Here, we use a twin neural network (also known as a Siamese neural network) for dimensionality reduction to analyze signals from chattering dust to classify the fluid saturation state of a synthetic fracture system. The twin neural network with shared weights generates a low-dimensional representation of the data input by minimizing contrastive loss, serving as the input to a multiclass classifier that accurately classifies whether multiple fractures in a fracture system are fully saturated or partially saturated, or whether a change in saturation has occurred in different fractures in the system. These results show that information buried in unresolved codas from uncontrolled sources can be extracted using machine learning to monitor the evolution of fracture systems caused by physical and chemical processes even when the scattered and direct wave fields overlap.

58 GEOSCIENCES↗

Predicting the Seawater Chemistry of an Ocean World Using Machine Learning on Isotopic Measurements of Volatile CO2

Introduction: Given the long time intervals required for data transmission to and from ocean worlds targets, low bandwidth for data transmission, time required for data processing and analysis, and potentially extreme radiation environments (e.g., Europa), it is clear that ocean worlds missions will need more autonomous flight instruments and software in order to achieve established science goals. Protracted time intervals for data analysis (e.g., Europa Lander) strongly motivates the development of rapid, consistent and streamlined methods for interpreting data from flight mass spectrometers to e.g., determine how mass spectra from a plume or surface liquid/ice relates to the surface/subsurface. Since mass spectrometry also has the potential to correctly identify biosignatures[1], it is imperative that such methods for interpreting data are consistent and accurate. We used 848 isotope ratio mass spectra from laboratory analyses of CO2 that interacted with ocean worlds-relevant seawaters as a ‘training’ dataset for ‘unsupervised’ machine learning. In unsupervised learning, characteristics of the data are not labeled or linked, and any similarities found only result from the neural network. CO2 isotopologues analyzed for this dataset mimic the remote measurements of CO2 by a flight mass spectrometer, and are detailed in Theiling [2]. From this dataset, we used measured features of the spectra, such as retention time, intensity, and (isotopologue) mass ratios as inputs for our autoencoder neural network. Our neural network was trained to find similarities in these and other spectral features for seawaters of a particular composition and amount of initial CO2. Successful training then created an output of these similarities for various seawaters, which included MgSO4, Na2SO4, NaCl, MgCl2, KCl, and NaHCO3, and combinations of these salts. We then applied dimensionality reduction techniques such as Principal Component Analysis (PCA), T-Distributed Stochastic Neighbor Embedding (TSNE), and Uniform Manifold Approximation and Projection (UMAP) to demonstrate latent data features as a two-dimensional projection in a unitless, high-dimensional space. In this projection, a data point represents the combined effect of spectral features such as intensity, retention time, and isotope ratio. Our initial UMAP demonstrates data clustering (organization of the data by the neural network) based on the amount of CO2 that had initially interacted with each seawater. Further training using more ‘supervised’ learning techniques demonstrate strong clustering of preliminary data based on initial CO2 concentration, seawater chemical composition, and ionic strength (salinity). Our preliminary work therefore suggests that machine learning has the potential to identify compositional variants of an ocean world seawater based on mass spectra from volatile CO2 measurements. Acknowledgments: This work was funded through a Strategic Task Group at NASA Goddard Space Flight Center. The training dataset was collected through funding from the Oklahoma Space Grant Consortium. References: [1] Pappalardo, R. et al. (2013) Astrobiology, 13, 740–773. [2] Theiling (2020) Icarus, 114216.

Europa↗

Blueprints for Training Information Bottlenecks for Collider Analyses

Dimensionality reduction is a crucial aspect of data analysis in high energy physics, even if accompanied by information loss. Several methods, including histogram- and kernel-based analyses, are only computationally feasible for low-dimensional data. Furthermore, simulation models used in HEP can often only be validated for low-dimensional data. We provide several blueprints for using machine learning to create low-dimensional data representations (continuous event variables and discrete classification labels) for use in signal discovery and parameter estimation tasks. We also describe how to design the learned representation to facilitate a) searches with unknown model parameters and b) validation of simulation models in data control regions.

43 PARTICLE ACCELERATORS↗

Nonlinear vs. linear biasing in Trp-cage folding simulations

Biased simulations have great potential for the study of slow processes, including protein folding. Atomic motions in molecules are nonlinear, which suggests that simulations with enhanced sampling of collective motions traced by nonlinear dimensionality reduction methods may perform better than linear ones. In this study, we compare an unbiased folding simulation of the Trp-cage miniprotein with metadynamics simulations using both linear (principle component analysis) and nonlinear (Isomap) low dimensional embeddings as collective variables. Folding of the mini-protein was successfully simulated in 200 ns simulation with linear biasing and non-linear motion biasing. The folded state was correctly predicted as the free energy minimum in both simulations. We found that the advantage of linear motion biasing is that it can sample a larger conformational space, whereas the advantage of nonlinear motion biasing lies in slightly better resolution of the resulting free energy surface. In terms of sampling efficiency, both methods are comparable.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Identifying structural changes with unsupervised machine learning methods

In this work, unsupervised machine learning methods are used to identify structural changes using the melting point transition in classical molecular dynamics simulations as an example application of the approach. Dimensionality reduction and clustering methods are applied to instantaneous radial distributions of atomic configurations from classical molecular dynamics simulations of metallic systems over a large temperature range. Principal component analysis is used to dramatically reduce the dimensionality of the feature space across the samples using an orthogonal linear transformation that preserves the statistical variance of the data under the condition that the new feature space is linearly independent. From there, k-means clustering is used to partition the samples into solid and liquid phases through a criterion motivated by the geometry of the reduced feature space of the samples, allowing for an estimation of the melting point transition. This pattern criterion is conceptually similar to how humans interpret the data but with far greater throughput, as the shapes of the radial distributions are different for each phase and easily distinguishable by humans. The transition temperature estimates derived from this machine learning approach produce comparable results to other methods on similarly small system sizes. These results show that machine learning approaches can be applied to structural changes in physical systems.

42 ENGINEERING↗

Experimental realization of one dimensional helium

As the spatial dimension is lowered, locally stabilizing interactions are reduced, leading to the emergence of strongly fluctuating phases of matter without classical analogues. Here we report on the experimental observation of a one dimensional quantum liquid of 4 He using nanoengineering by confining it within a porous material preplated with a noble gas to enhance dimensional reduction. The resulting excitations of the confined 4 He are qualitatively different than bulk superfluid helium, and can be analyzed in terms of a mobile impurity allowing for the characterization of the emergent quantum liquid beyond the Luttinger liquid paradigm. The low dimensional helium system offers the possibility of tuning via pressure—from weakly interacting, all the way to the super Tonks-Girardeau gas of strongly interacting hard-core particles.

36 MATERIALS SCIENCE↗

Microstructural Materials Design Via Deep Adversarial Learning Methodology

Identifying the key microstructure representations is crucial for computational materials design (CMD). However, existing microstructure characterization and reconstruction (MCR) techniques have limitations to be applied for microstructural materials design. Some MCR approaches are not applicable for microstructural materials design because no parameters are available to serve as design variables, while others introduce significant information loss in either microstructure representation and/or dimensionality reduction. In this work, we present a deep adversarial learning methodology that overcomes the limitations of existing MCR techniques. In the proposed methodology, generative adversarial networks (GAN) are trained to learn the mapping between latent variables and microstructures. Thereafter, the low-dimensional latent variables serve as design variables, and a Bayesian optimization framework is applied to obtain microstructures with desired material property. Due to the special design of the network architecture, the proposed methodology is able to identify the latent (design) variables with desired dimensionality, as well as capturing complex material microstructural characteristics. The validity of the proposed methodology is tested numerically on a synthetic microstructure dataset and its effectiveness for microstructural materials design is evaluated through a case study of optimizing optical performance for energy absorption. Additional features, such as scalability and transferability, are also demonstrated in this work. In essence, the proposed methodology provides an end-to-end solution for microstructural materials design, in which GAN reduces information loss and preserves more microstructural characteristics, and the GP-Hedge optimization improves the efficiency of design exploration.

Engineering↗

A Geometry-Driven Longitudal Topic Model

A simple and scalable framework for longitudinal analysis of Twitter data is developed that combines latent topic models with computational geometric methods. Dimensionality reduction tools from computational geometry are applied to learn the intrinsic manifold on which the latent, temporal topics reside. Then shortest path distances on the manifold are used to link together these topics. The proposed framework permits visualization of the low-dimensional embedding which provides clear interpretation of the complex, high-dimensional trajectories that may exist among latent topics. Practical application of the proposed framework is demonstrated through its ability to capture and effectively visualize natural progression of latent COVID-19 related topics learned from Twitter data. Interpretability of the trajectories is achieved by comparing to real-world events. In addition, the framework permits study of spatial variation in Twitter behavior for learned topics. The analysis demonstrates that the proposed framework is able to capture granular-level impact of COVID-19 on public discussions. We end by arguing that Twitter data, when analyzed within the proposed framework, can serve as a valuable supplementary data stream for COVID-related studies.

97 MATHEMATICS AND COMPUTING↗

The Galah Survey: Classification and Diagnostics with t-SNE Reduction of Spectral Information

Galah is an ongoing high-resolution spectroscopic survey with the goal of disentangling the formation history of the Milky Way using the fossil remnants of disrupted star formation sites that are now dispersed around the Galaxy. It is targeting a randomly selected magnitude-limited ( V ≤ 14) sample of stars, with the goal of observing one million objects. To date, 300,000 spectra have been obtained. Not all of them are correctly processed by parameter estimation pipelines, and we need to know about them. We present a semi-automated classification scheme that identifies different types of peculiar spectral morphologies in an effort to discover and flag potentially problematic spectra and thus help to preserve the integrity of the survey results. To this end, we employ the recently developed dimensionality reduction technique t-SNE ( t -distributed stochastic neighbor embedding), which enables us to represent the complex spectral morphology in a two-dimensional projection map while still preserving the properties of the local neighborhoods of spectra. We find that the majority (178,483) of the 209,533 Galah spectra considered in this study represents normal single stars, whereas 31,050 peculiar and problematic spectra with very diverse spectral features pertaining to 28,579 stars are distributed into 10 classification categories: hot stars, cool metal-poor giants, molecular absorption bands, binary stars, H α /H β emission, H α /H β emission superimposed on absorption, H α /H β P-Cygni, H α /H β inverted P-Cygni, lithium absorption, and problematic. Classified spectra with supplementary information are presented in the catalog, indicating candidates for follow-up observations and population studies of the short-lived phases of stellar evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

Data-Driven Model Reduction of Multiphase Flow in a Single-Hole Automotive Injector

Fuel injector design has a substantial influence on the performance and emissions of direct injection engines. To date, large eddy simulations coupled with a single-fluidmixture modeling approach have shown great success in evaluating the complex interplay among injector design, fuel properties, and operating conditions on the injector performance. However, this simulation approach is too computationally expensive to be used by industry routinely for injector design due to the fine temporal and spatial resolution required to resolve wall-bounded flow within the injector. The work presented in this paper highlights a potential pathway to addressing this issue. To study the influence of injector design, fuel properties, and operating conditions on injector performance, large eddy simulations were performed to model the turbulent multiphase flow development through a side-oriented singlehole diesel injector. Using Latin hypercube sampling, the design space spanning a range of fuel properties, operating conditions, and needle lifts were explored. Two techniques for dimensionality reduction, namely proper orthogonal decomposition and autoencoders, were compared to evaluate their accuracy in representing the flow in a reduced dimensional space. Finally, based on the findings from this work, recommendations are provided in using machine learning approaches within the context of emulation to construct reduced-ordermodels for internal flow development relevant to automotive applications.

42 ENGINEERING↗