Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “latent feature models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Exploring Autoencoder-based Error-bounded Compression for Scientific Data

Error-bounded lossy compression is becoming an indispensable technique for the success of today's scientific projects with vast volumes of data produced during the simulations or instrument data acquisitions. Not only can it significantly reduce data size, but it also can control the compression errors based on user-specified error bounds. Autoencoder (AE) models have been widely used in image compression, but few AE-based compression approaches support error-bounding features, which are highly required by scientific applications. To address this issue, we explore using convolutional autoencoders to improve error-bounded lossy compression for scientific data, with the following three key contributions. (1) We provide an in-depth investigation of the characteristics of various autoencoder models and develop an error-bounded autoencoder-based framework in terms of the SZ model. (2) We optimize the compression quality for main stages in our designed AE-based error-bounded compression framework, fine-tuning the block sizes and latent sizes and also optimizing the compression efficiency of latent vectors. (3) We evaluate our proposed solution using five real-world scientific datasets and comparing them with six other related works. Experiments show that our solution exhibits a very competitive compression quality from among all the compressors in our tests. In absolute terms, it can obtain a much better compression quality (100%similar to 800% improvement in compression ratio with the same data distortion) compared with SZ2.1 and ZFP in cases with a high compression ratio.

Liu, Jinyang↗
DOE OSTI2026

Reconstructing Quasar Spectra and Measuring the Lyα Forest with SpenderQ

Quasar spectra carry the imprint of foreground intergalactic medium (IGM) through absorption features. In particular, absorption caused by neutral hydrogen gas, the "Lyα forest," is a key spectroscopic tracer for cosmological analyses used to measure cosmic expansion and test physics beyond the standard model. Despite their importance, current methods for measuring Lyα absorption cannot directly derive the intrinsic quasar continuum and make strong assumptions on its shape, thus distorting the measured Lyα clustering. We present SpenderQ , a ML-based approach for directly reconstructing the intrinsic quasar spectra and measuring the Lyα forest from observations. SpenderQ uses the Spender spectrum autoencoder to learn a compact and redshift-invariant latent encoding of quasar spectra, combined with an iterative procedure to identify and mask absorption regions. To demonstrate its performance, we apply SpenderQ to 400,000 synthetic quasar spectra created to validate the Dark Energy Spectroscopic Instrument Year 1 Lyα cosmological analyses. SpenderQ accurately reconstructs the true intrinsic quasar spectra, including the broad Lyβ, Lyα, SiIV, CIV, and CIII emission lines. Redward of Lyα, SpenderQ provides percent-level reconstructions of the true quasar spectra. Blueward of Lyα, SpenderQ reconstructs the true spectra to < 5%. SpenderQ reproduces the shapes of individual quasar spectra more robustly than the current state-of-the-art. We, thus, expect it will significantly reduce biases in Lyα clustering measurements and enable studies of quasars and their physical properties. SpenderQ also provides informative latent variable encodings that can be used to, e.g., classify quasars with Broad Absorption Lines. Overall, SpenderQ provides a new data-driven approach for unbiased Lyα forest measurements in cosmological, quasar, and IGM studies.

Hahn, ChangHoon [Arizona U., Astron. Dept. - Stewa↗
DOE OSTI2023

Fast and accurate simulations of calorimeter showers with normalizing flows

In this study, we introduce caloflow, a fast detector simulation framework based on normalizing flows. For the first time, we demonstrate that normalizing flows can reproduce many-channel calorimeter showers with extremely high fidelity, providing a fresh alternative to computationally expensive geant4 simulations, as well as other state-of-the-art fast simulation frameworks based on generative adversarial networks (GANs) or variational autoencoders (VAEs). In addition to the usual histograms of physical features and images of calorimeter showers, we introduce a new metric for judging the quality of generative modeling: the performance of a classifier trained to differentiate real from generated images. We show that GAN-generated images can be identified by the classifier with nearly 100% accuracy, while images generated from caloflow are better able to fool the classifier. More broadly, normalizing flows offer several advantages compared to other state-of-the-art approaches (GANs and VAEs), including tractable likelihoods, stable and convergent training, and principled model selection. Normalizing flows also provide a bijective mapping between data and the latent space, which could have other applications beyond simulation, for example, to detector unfolding.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

SAFE-OCC: A novelty detection framework for Convolutional Neural Network sensors and its application in process control

Herein we present a novelty detection framework for Convolutional Neural Network (CNN) sensors that we call Sensor-Activated Feature Extraction One-Class Classification (SAFE-OCC). We show that this framework enables the safe use of computer vision sensors in process control architectures. Emergent control applications use CNN models to map visual data to a state signal that can be interpreted by the controller. Incorporating such sensors introduces a significant system operation vulnerability because CNN sensors can exhibit high prediction errors when exposed to novel (abnormal) visual data. Unfortunately, identifying such novelties in real-time is nontrivial. To address this issue, the SAFE-OCC framework leverages the convolutional blocks of the CNN to create an effective feature space to conduct novelty detection using a desired one-class classification technique. This approach engenders a feature space that directly corresponds to that used by the CNN sensor and avoids the need to derive an independent latent space. We demonstrate the effectiveness of SAFE-OCC via simulated control environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Cartesian equivariant representations for learning and understanding molecular orbitals

Qualitative and quantitative orbital properties such as bonding/antibonding character, localization, and orbital energies are critical to how chemists understand reactivity, catalysis, and excited-state behavior. Despite this, representations of orbitals in deep learning models have been very underdeveloped relative to representations of molecular geometries and Hamiltonians. Here, we apply state-of-the-art equivariant deep learning architectures to the task of assigning global labels to orbitals, namely energies characterizations, given the molecular coefficients from Hartree–Fock or density functional theory. The architecture we have developed, the Cartesian Equivariant Orbital Network (CEONET), shows how molecular orbital coefficients are readily featurized as equivariant node features common to all graph-based machine-learned potentials. We find that CEONET performs well at predicting difficult quantitative labels such as the orbital energy and orbital entropy. Furthermore, we find that the CEONET representation provides an intuitive latent space for differentiating orbital character for the qualitative assignment of e.g. bonding or antibonding character. In addition to providing a useful representation for further integrating deep learning with electronic structure theory, we expect CEONET to be useful for automatizing and interpreting the results of advanced electronic structure methods such as complete active space self-consistent field theory. In particular, the ability of CEONET to infer multireference character via the orbital entropy paves the way toward the machine-learned selection of active spaces.

chemical reactions↗
DOE OSTI2024

Synthesizing realistic sand assemblies with denoising diffusion in latent space

Abstract The shapes and morphological features of grains in sand assemblies have far‐reaching implications in many engineering applications, such as geotechnical engineering, computer animations, petroleum engineering, and concentrated solar power. Yet, our understanding of the influence of grain geometries on macroscopic response is often only qualitative, due to the limited availability of high‐quality 3D grain geometry data. In this paper, we introduce a denoising diffusion algorithm that uses a set of point clouds collected from the surface of individual sand grains to generate grains in the latent space. By employing a point cloud autoencoder, the three‐dimensional point cloud structures of sand grains are first encoded into a lower‐dimensional latent space. A generative denoising diffusion probabilistic model is trained to produce synthetic sand that maximizes the log‐likelihood of the generated samples belonging to the original data distribution measured by a Kullback‐Leibler divergence. Numerical experiments suggest that the proposed method is capable of generating realistic grains with morphology, shapes and sizes consistent with the training data inferred from an F50 sand database. We then use a rigid contact dynamic simulator to pour the synthetic sand in a confined volume to form granular assemblies in a static equilibrium state with targeted distribution properties. To ensure third‐party validation, 50,000 synthetic sand grains and the 1542 real synchrotron microcomputed tomography (SMT) scans of the F50 sand, as well as the granular assemblies composed of synthetic sand grains are made available in an open‐source repository.

Vlassis, Nikolaos N.↗
DOE OSTI2026

Higher Efficiency, Demand Flexible Refrigerator with On-Demand Micro-Vibrational De-icing Technology

Refrigerator technology has advanced significantly over the last couple of decades. Today’s refrigerators use only about 25% of the energy that was required to power models built in 1975. Even as they continually improve efficiency to meet standards, refrigerators have increased in size by almost 20%, added energy-consuming features such as through-the-door ice, and provide more benefits than ever before. However, a few challenges and technology gaps are preventing further improvement of the demand responsiveness and efficiency of the refrigerators. One of the major technology gaps in existing refrigerators is their outdated de-icing process. When the evaporator generates frost, an old-fashioned resistive heating element melts the ice. Most refrigerators have a timed defrost cycle, rather than an active system that could monitor the state of the frost. In these systems, not only is the precious electricity used at its least efficient form of conversion (direct conversion of electricity to heat), but also all the latent heat associated with the ice is wasted during the melting process. On top of that, the refrigerator needs to work harder to pull the temperature down after defrosting, and, last but not least, the food quality is severely impacted by the temperature swings during the defrost cycle. According to a study, the EU alone wastes 89 million tons of food in the supply chain every year. Any temperature swing during defrosting (about 6F according to Emerson for low-temperature cases) can negatively impact the shelf life of meat and other products for multiple days. All these issues can happen during the peak demand time of the electric grid. Unlike the conventional systems, the proposed novel advanced micro-vibrational deicing process uses no heat for defrosting. Instead, it uses the micro vibrations generated by a piezoelectric or vibration-generating module to mechanically break ice from the heat exchanger almost instantaneously. The project titled “Higher Efficiency, Demand Flexible Refrigerator with On-Demand Micro-Vibrational De-icing Technology, performed by Ultrasonic Technology Solutions, LLC (UTS) of Knoxville, TN, in collaboration with Emerson (now Copeland), represents the final phase of a multi-year effort funded under the U.S. Department of Energy’s Building Technologies Office (BTO) BENEFIT FOA 2020. Initiated on October 1, 2021, and completed after a nine-month no-cost extension ending September 30, 2025, this project aimed to develop and validate a novel micro-vibrational mechanical defrosting system, achieving more than 25% improvement in defrosting energy efficiency over conventional baseline defrosting technologies. Over sixteen quarters, the project advanced from fundamental ice-mechanical characterization and prototype development to full-scale system integration and validation. Initial efforts established project management infrastructure and characterized ice adhesion properties, followed by the design and fabrication of early aluminum-based prototypes for resonance frequency testing. Subsequent quarters saw rapid technical progression, including the identification of optimal piezoelectric and motor-based vibration mechanisms, the demonstration of effective de-icing over 6x6-inch aluminum surfaces. The team achieved its Go/No-Go milestone by exceeding the 25% energy-efficiency improvement target—reaching up to 3,340% under optimized conditions—and later confirmed that motor-driven systems offered superior performance and energy efficiency compared to piezoelectric alternatives. Continued refinement led to the development of amplifier systems on printed circuit boards, improved control and instrumentation hardware, and integration into full-scale heat exchanger (HX) prototypes at both UTS and Copeland facilities. Multiple vibration-mounting studies and frost-growth experiments guided mechanical optimization and noise-mitigation strategies, achieving a 17.5 dB reduction in sound pressure level and verifying robust mechanical performance. Advanced analyses, including modal and harmonic simulations, established a quantitative understanding of vibrational behavior and de-icing efficiency across >1000 cm² systems. The final project phase successfully demonstrated scalable integration within reach-in and chest freezer prototypes, confirmed >25% efficiency improvements in large-area systems, and completed a comprehensive business model and scale-up strategy identifying electric defrost systems as the primary beachhead market. The culmination of this DOE-supported effort establishes micro-vibrational defrosting as a viable, high-efficiency, low-noise, and demand-flexible de-icing technology, paving the way for commercial deployment and broader application in next-generation refrigeration systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

Short-term traffic state prediction from latent structures: Accuracy vs. efficiency

Recently, deep learning models have shown promising performances in many research areas, including traffic states prediction, due to their ability to model complex nonlinear relationships. However, deep learning models also have drawbacks that make them less preferable for certain short-term traffic prediction applications. For example, they require a large amount of data for model training, which is also computationally expensive. Moreover, deep learning models lack interpretability of the results. This paper develops a short-term traffic states forecasting algorithm based on partial least square (PLS) to help enhance real-time decision-making and build better insights into traffic data. The proposed model is capable of predicting short-term traffic states accurately and efficiently by capturing dominant spatiotemporal features and day-to-day variations from collinear and correlated traffic data. Three case studies are developed to demonstrate the proposed model in short-term traffic prediction applications.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Convectively Forced Diurnal Gravity Waves in the Maritime Continent

Long-lived, zonally propagating diurnal rainfall disturbances are a highly pronounced and common feature in the Maritime Continent (MC). A recent study argues that these disturbances can be explained as diurnally phase-locked gravity waves. Here we explore the origins of these waves through regional cloud-permitting numerical model experiments. The gravity waves are reproduced and isolated in the model framework through the combined use of realistic geography and diurnally cyclic lateral boundary conditions representative of both characteristic easterly and westerly background zonal flow regimes. These flow regimes are characteristic of the Madden–Julian oscillation (MJO) suppressed and active phase in the MC, respectively. Tests are conducted wherein Borneo, Sumatra, or both islands and/or their orography are removed. These tests imply that the diurnal gravity waves are excited and maintained directly by latent heating from the vigorous mesoscale convective systems (MCSs) that form nocturnally in both Borneo and Sumatra. Removing orography has only a secondary impact on both the MCSs and the gravity waves, implying that it is not critical to these waves. We therefore hypothesize that diurnal gravity waves are fundamentally driven by mesoscale organized deep convection, and are only sensitive to orography to the measure that the convection is affected by the orography and its mesoscale flows. Factor separation further reveals that the nonlinear interaction of synchronized diurnal cycles in Sumatra and Borneo slightly amplifies this gravity wave mode compared to if either island existed in isolation. This nonlinear feedback appears most prominently at longitudes directly between the two islands.

Ruppert, Jr., James H.↗
DOE OSTI2025

From disorganized data to emergent dynamic models: Questionnaires to partial differential equations

Starting with sets of disorganized observations of spatially varying and temporally evolving systems, obtained at different (also disorganized) sets of parameters, we demonstrate the data-driven derivation of parameter dependent, evolutionary partial differential equation (PDE) models capable of generating the data. This tensor type of data is reminiscent of shuffled (multidimensional) puzzle tiles. The independent variables for the evolution equations (their “space” and “time”) as well as their effective parameters are all emergent , i.e. determined in a data-driven way from our disorganized observations of behavior in them. We use a diffusion map based questionnaire approach to build a smooth parametrization of our emergent space/time/parameter space for the data. This approach iteratively processes the data by successively observing them on the “space,” the “time” and the “parameter” axes of a tensor. Once the data become organized, we use machine learning (here, neural networks) to approximate the operators governing the evolution equations in this emergent space. Our illustrative examples are based (i) on a simple advection–diffusion model; (ii) on a previously developed vertex-plus-signaling model of Drosophila embryonic development; and (iii) on two complex dynamic network models (one neuronal and one coupled oscillator model) for which no obvious smooth embedding geometry is known a priori. This allows us to discuss features of the process like symmetry breaking, translational invariance, and autonomousness of the emergent PDE model, as well as its interpretability.

generative models↗
DOE OSTI2024

Development of a Full-Scale Connected U-Net for Reflectivity Inpainting in Spaceborne Radar Blind Zones

CloudSat’s Cloud Profiling Radar is a valuable tool for remotely monitoring high-latitude snowfall, but its ability to observe hydrometeor activity near the Earth’s surface is limited by a radar blind zone caused by ground clutter contamination. This study presents the development of a deeply supervised U-Net-style convolutional neural network to predict cold season reflectivity profiles within the blind zone at two Arctic locations. The network learns to predict the presence and intensity of near-surface hydrometeors by coupling latent features encoded in blind zone-aloft clouds with additional context from collocated atmospheric state variables (i.e., temperature, specific humidity, and wind speed). Results show that the U-Net predictions outperform traditional linear extrapolation methods, with low mean absolute error, a 38% higher Sørensen–Dice coefficient, and vertical reflectivity distributions 60% closer to observed values. The U-Net is also able to detect the presence of near-surface cloud with a critical success index (CSI) of 72% and cases of shallow cumuliform snowfall and virga with 18% higher CSI values compared to linear methods. An explainability analysis shows that reflectivity information throughout the scene, especially at cloud edges and at the 1.2-km blind zone threshold, along with atmospheric state variables near the tropopause, are the most significant contributors to model skill. This surface-trained generative inpainting technique has the potential to enhance current and future remote sensing precipitation missions by providing a better understanding of the nonlinear relationship between blind zone reflectivity values and the surrounding atmospheric state.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Boundary layer moisture variability at the Atmospheric Radiation Measurement (ARM) Eastern North Atlantic observatory during marine conditions

Abstract. Boundary layer moisture variability at the Eastern North Atlantic (ENA) site during marine conditions is examined at monthly and daily timescales using 5 years of ground-based observations and output from the European Center for Medium range Weather Forecast (ECMWF) reanalysis model. The annual cycle of the mixed-layer total water budgets is presented to estimate the relative contribution of large-scale advection, local moisture tendency, entrainment, and precipitation to balance the moistening due to surface latent heat flux on monthly timescales. When marine conditions prevail, advection of colder and dry air from the north acts as an important moisture sink (∼ 50 % of the overall budget) during fall and winter driving the seasonality of the budget. Entrainment and precipitation contribute to the drying of the boundary layer (∼ 25 % and ∼ 15 % respectively), and the local change in moisture contributes to a small residual part. On a daily temporal scale, moist and dry mesoscale columns of vapor (∼ 10 km) are analyzed during 10 selected days of precipitating stratocumulus clouds. Adjacent moist and dry columns present distinct mesoscale features that are strongly correlated with clouds and precipitation. Dry columns adjacent to moist columns have more frequent and stronger downdrafts immediately below the cloud base. Moist columns have more frequent updrafts, stronger cloud-top cooling, and higher liquid water path and precipitation compared to the dry columns. This study highlights the complex interaction between large-scale and local processes controlling the boundary layer moisture and the importance of spatial distribution of vapor to support convection and precipitation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

An Overview of Mesoscale Convective Systems: Global Climatology, Satellite Observations, and Modeling Strategies

Deep convection is responsible for redistributing water as well as energy and providing vital water resources for many regions of the world. Cumulonimbus clouds aggregation into a single storm system develop mesoscale convective systems (MCS). MCSs have precipitation covering a horizontal region on the scale of 100?km or more. After more than the last seven decades, MCS has been gradually received wide attention in the scientific community as an important component of the Earth's hydrologic cycle and energy balance. MCSs differ from ordinary deep convection because of the mesoscale circulations consisting of a layer of air overturning on a scale much larger than those created by individual convective updrafts or downdrafts. Moreover, a key feature that separates MCS from ordinary deep convection is the significant portion of stratiform precipitation that results in the production and detrainment of a large number of ice particles from their organized convective cores and continues the mesoscale ascent that supports ice growth and aggregation as the crystals fall. This significant stratiform precipitation gives rise to top-heavy latent heating profiles that have substantial impacts on the upper-level global circulations, especially for those MCS that have a larger portion of stratiform rainfall. Top-heavy latent heating profiles are more frequent over the ocean than over the land. These unique features of MCS suggest that they are important for the hydrologic cycle, general circulation, and radiative balance of the climate system. In this chapter, we focus on the recent advances in the climatological perspective of MCS as well as the research tools used to better understand MCS after the advent of the satellite era. We will discuss both tropical and midlatitude MCS, the influence of modes of tropical climate variability on MCS, and the new insight from satellite observations on MCS interaction with the land surface.

Chakraborty, Sudip↗
DOE OSTI2024

Data for "Design of Diverse, Functional Mitochondrial Targeting Sequences Across Eukaryotic Organisms Using Variational Autoencoder"

Mitochondria play a key role in energy production and metabolism, making them a promising target for metabolic engineering and disease treatment. However, despite the known influence of passenger proteins on localization efficiency, only a few protein-localization tags have been characterized for mitochondrial targeting. To address this limitation, we leverage a Variational Autoencoder to design novel mitochondrial targeting sequences. In silico analysis reveals that a high fraction of the generated peptides (90.14%) are functional and possess features important for mitochondrial targeting. We characterize artificial peptides in four eukaryotic organisms and, as a proof-of-concept, demonstrate their utility in increasing 3-hydroxypropionic acid titers through pathway compartmentalization and improving 5-aminolevulinate synthase delivery by 1.62-fold and 4.76-fold, respectively. Moreover, we employ latent space interpolation to shed light on the evolutionary origins of dual-targeting sequences. Overall, our work demonstrates the potential of generative artificial intelligence for both fundamental research and practical applications in mitochondrial biology.

AI/ML↗
DOE OSTI2022

Optimization of WAAM Process to Produce AUSC Components with Increased Service Life

Additive manufacturing has the potential to revolutionize industrial hardware and unlock efficiency gains through the fabrication of geometries and architectures not possible by conventional processing. Wire Arc Additive manufacturing (WAAM) process is a class of directed energy deposition process enabling higher build rate and allowing custom wire feedstock allowing spatial variation of microstructure. The larger spot size and lower speed creates a larger melt pool, reducing residual stress and often time creating directional/columnar microstructure for Ni-superalloy. The use of flexible platform provides freedom in deposition strategy, which can accommodate complex substrates, including feature addition onto existing structures, non-flat layers, and repair methods. However, the certification of the final component needs to match the strength requirement. Hence, the quality of the component produced is stringently monitored to avoid buildup of residual stress, cracks, porosity and to reduce detrimental segregated phases commonly observed during alloy solidification. Simulation plays a huge role in predicting the melt pool dimension and can be used to optimize the process parameter. Similar development is also required to perform physics-based modeling of microstructural development in WAAM that can predict the microstructural features during solidification and can be used to optimize the process more effectively. To move toward this goal, Raytheon Technologies Research Center together with Siemens worked to create a set of computational tools to control the process parameters, enable on-line measurements and acquisition with feedback to the optimized process parameters, and eventually track material evolution through each step of the additive process. Computational fluid dynamics is used for accurate prediction and calibration of the thermal field during WAAM process. and phase field models for microstructure evolution as a function of processing parameters to establish a connection between additive parameters and the final microstructure. Here we report cellular automata (CA) model development to predict the dendritic microstructure evolution with surface and bulk nuclei for single track and multiple layers. The CA model was developed to account for secondary element addition and predict segregation, local melting, and latent heat release as well as prediction of Euler angles from orientation information and validated against experiments. This framework was utilized to tailor spatially-varying composition in a part by appropriately controlling the microstructure evolution during the additive process. Functionally graded Haynes 282 alloy with high Cr content at the surface was tested for oxidation and mechanical properties. An advanced physics-based reaction-diffusion model predicting the simultaneous creation of chromium oxide and alumina is developed and validated to extend life expectancy of the WAAM manufactured high temperature part. A machine-learning data-driven framework establishing the process-structure relationship from a dataset of real microstructure images and corresponding process history data has been developed and implemented in the NX Siemens design system. The digital twin configuration along with the tool path generation enabled prediction of WAAM component buildup time and the techno-economic analysis provided a favorable option for all 4 cases with 15-40% cost reduction.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Enabling probabilistic learning on manifolds through double diffusion maps

Here, we present a generative learning framework for probabilistic sampling that extends Probabilistic Learning on Manifolds (PLoM), which is designed to generate statistically consistent realizations of a random vector in a finite-dimensional Euclidean space, informed by a (representative) set of observations. In its original form, PLoM constructs a reduced-order probabilistic model by combining three main components: (a) kernel density estimation to approximate the underlying probability measure, (b) Diffusion Maps to characterize the manifold of the data, and (c) a reduced-order Itô Stochastic Differential Equation (ISDE) to sample from the learned distribution. However, its sampling dynamics are posed in the ambient space and the retained number of reduced coordinates is chosen by projection-reconstruction error. In practice, this often (i) requires more coordinates than the data’s intrinsic dimension to achieve stable sampling and (ii) lacks a smooth, basis-independent lifting back to the data domain; moreover, standard Diffusion Maps emphasize harmonic eigenfunctions and can miss non-harmonic latent structure. We address these limitations by decoupling geometry learning from sampling: a first Diffusion Maps pass identifies non-harmonic coordinates on which we formulate a full-order ISDE directly in the latent space, while Double Diffusion Maps captures multiscale geometric features and Geometric Harmonics (GH) learns a smooth lifting map to the ambient variables that is independent of the particular diffusion basis. This hybrid design preserves the system’s dynamical richness with a compact geometric representation and enables principled out-of-sample inference. The effectiveness and robustness of the proposed method are illustrated through two numerical studies: one based on data generated from two-dimensional Hermite polynomial functions and another based on high-fidelity simulations of a detonation wave in a reactive flow.

Double diffusion maps↗
DOE OSTI2025

Kernel Manifolds: Nonlinear‐Augmentation Dimensionality Reduction Using Reproducing Kernel Hilbert Spaces

This paper generalizes recent advances on quadratic manifold (QM) dimensionality reduction by developing kernel methods-based nonlinear-augmentation dimensionality reduction. QMs, and more generally feature map-based nonlinear corrections, augment linear dimensionality reduction with a nonlinear correction term in the reconstruction map to overcome approximation accuracy limitations of purely linear approaches. While feature map-based approaches typically learn a least squares optimal polynomial correction term, we generalize this approach by learning an optimal nonlinear correction from a user-defined reproducing kernel Hilbert space. Our approach allows one to impose arbitrary nonlinear structure on the correction term, including polynomial structure, and includes feature map and radial basis function-based corrections as special cases. Furthermore, our method has relatively low training cost and has monotonically decreasing error as the latent space dimension increases. In conclusion, we compare our approach to proper orthogonal decomposition and several recent QM approaches on data from several example problems.

kernel methods↗
DOE OSTI2021

Outlier classification using autoencoders: application for fluctuation driven flows in fusion plasmas

Understanding the statistics of fluctuation driven flows in the boundary layer of magnetically confined plasmas is desired to accurately model the lifetime of the vacuum vessel components. Mirror Langmuir probes (MLPs) are a novel diagnostic that uniquely allow us to sample the plasma parameters on a time scale shorter than the characteristic time scale of their fluctuations. Sudden large-amplitude fluctuations in the plasma degrade the precision and accuracy of the plasma parameters reported by MLPs for cases in which the probe bias range is of insufficient amplitude. While some data samples can readily be classified as valid and invalid, we find that such a classification may be ambiguous for up to 40% of data sampled for the plasma parameters and bias voltages considered in this study. In this contribution, we employ an autoencoder (AE) to learn a low-dimensional representation of valid data samples. By definition, the coordinates in this space are the features that mostly characterize valid data. Ambiguous data samples are classified in this space using standard classifiers for vectorial data. In this way, we avoid defining complicated threshold rules to identify outliers, which require strong assumptions and introduce biases in the analysis. By removing the outliers that are identified in the latent low-dimensional space of the AE, we find that the average conductive and convective radial heat fluxes are between approximately 5% and 15% lower as when removing outliers identified by threshold values. For contributions to the radial heat flux due to triple correlations, the difference is up to 40%.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗