DOE OSTI · 2573897
Online learning of quadratic manifolds from streaming data for nonlinear dimensionality reduction and nonlinear model reduction
Abstract
Here, this work introduces an online greedy method for constructing quadratic manifolds from streaming data, designed to enable in situ analysis of numerical simulation data on the Petabyte scale. Unlike traditional batch methods, which require all data to be available upfront and take multiple passes over the data, the proposed online greedy method incrementally updates quadratic manifolds in one pass as data points are received, eliminating the need for expensive disk input/output operations as well as storing and loading data points once they have been processed. A range of numerical examples demonstrate that the online greedy method learns accurate quadratic manifold embeddings while being capable of processing data that far exceed common disk input/output capabilities and volumes as well as main-memory sizes.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Schwerdtner, Paul [New York Univ. (NYU), NY (United States)] (ORCID:0000000187619217), Mohan, Prakash [National Renewable Energy Laboratory (NREL), Golden, CO (United States)], Pachalieva, Aleksandra [Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)] (ORCID:0000000312460410), Bessac, Julie [National Renewable Energy Laboratory (NREL), Golden, CO (United States)], O’Malley, Daniel [Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)], Peherstorfer, Benjamin [New York Univ. (NYU), NY (United States)] (ORCID:0000000215586775). 2025-05-28. Online learning of quadratic manifolds from streaming data for nonlinear dimensionality reduction and nonlinear model reduction. https://doi.org/10.1098/rspa.2024.0670
Cite the original work for its findings. Save a collection to share your selection of sources.