Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Manifold model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Iron-sulfur clusters: the road to room temperature

Abstract Iron-sulfur proteins perform a wide variety of reactions central to the metabolisms of all living organisms. Foundational to their reaction chemistry are the rich electronic structures of their constituent Fe-S clusters, which differ in important ways from the active sites of mononuclear Fe enzymes. In this perspective, we summarize the essential electronic structure features that make Fe-S clusters unique, and point to the need for studies aimed at understanding the electronic basis for their reactivity under physiological conditions. Specifically, at ambient temperature, both the ground state and a large number of excited states are thermally populated, and thus a complete understanding of Fe-S cluster reactivity must take into account the properties, energies, and reactivity patterns of these excited states. We highlight prior research toward characterizing the low-energy excited states of Fe-S clusters that has established what is now a consensus model of these excited state manifolds and the bonding interactions that give rise to them. In particular, we discuss the low-energy alternate spin states and valence electron configurations that occur in Fe-S clusters of varying nuclearities, and finally suggest that there may be unrecognized functional roles for these states. Graphical abstract

Skeel, Brighton A. (ORCID:000000018458088X)↗
DOE OSTI2024

Data-driven models of nonautonomous systems

Nonautonomous dynamical systems are characterized by time-dependent inputs, which complicates the discovery of predictive models describing the spatiotemporal evolution of the state variables of quantities of interest from their temporal snapshots. When dynamic mode decomposition (DMD) is used to infer a linear model, this difficulty manifests itself in the need to approximate the time-dependent Koopman operators. Our approach is to approximate the original nonautonomous system with a modified system derived via a local parameterization of the time-dependent inputs. The modified system comprises a sequence of local parametric systems, which are subsequently approximated by a parametric surrogate model using the DRIPS (dimension reduction and interpolation in parameter space) framework. The offline step of DRIPS relies on DMD to build a linear surrogate model, endowed with reduced-order bases for the observables mapped from training data. The online step interpolates on suitable manifolds to construct a sequence of iterative parametric surrogate models; the target/test parameter points on these manifolds are specified by a local parameterization of the test time-dependent inputs. Here, we use numerical experimentation to demonstrate the robustness of our method and compare its performance with that of deep neural networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

An approximate inertial manifold (AIM) based closure for turbulent flows

A closure model for turbulent flows is developed based on a dynamical system theory. An appropriately discretized formulation of the governing equations is considered for this process. The key ingredient is an approximation of the system’s attractor, where all the trajectories in phase space are confined. This approximate inertial manifold based approach provides a path to track trajectories of the system in a lower-dimensional subspace. Unlike conventional coarse-graining approaches, the turbulent field is decomposed into resolved and unresolved dynamics using the properties of the governing equations. The novelty of the approach relies on the reconstruction of the unresolved field constrained by the governing equations. A posteriori tests for homogeneous isotropic turbulence and the Kuramoto–Sivashinsky equation show promising results for considerable dimension reduction with strong convergence properties. The proposed model outperforms the dynamic Smagorinsky model, and the computational overhead is competitive with similar approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Time-series forecasting using manifold learning, radial basis function interpolation, and geometric harmonics

We address a three-tier numerical framework based on nonlinear manifold learning for the forecasting of high-dimensional time series, relaxing the “curse of dimensionality” related to the training phase of surrogate/machine learning models. At the first step, we embed the high-dimensional time series into a reduced low-dimensional space using nonlinear manifold learning (local linear embedding and parsimonious diffusion maps). Then, we construct reduced-order surrogate models on the manifold (here, for our illustrations, we used multivariate autoregressive and Gaussian process regression models) to forecast the embedded dynamics. Finally, we solve the pre-image problem, thus lifting the embedded time series back to the original high-dimensional space using radial basis function interpolation and geometric harmonics. The proposed numerical data-driven scheme can also be applied as a reduced-order model procedure for the numerical solution/propagation of the (transient) dynamics of partial differential equations (PDEs). In conclusion, we assess the performance of the proposed scheme via three different families of problems: (a) the forecasting of synthetic time series generated by three simplistic linear and weakly nonlinear stochastic models resembling electroencephalography signals, (b) the prediction/propagation of the solution profiles of a linear parabolic PDE and the Brusselator model (a set of two nonlinear parabolic PDEs), and (c) the forecasting of a real-world data set containing daily time series of ten key foreign exchange rates spanning the time period 3 September 2001–29 October 2020.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Probabilistic partition of unity networks for high–dimensional regression problems

We explore the probabilistic partition of unity network (PPOU-Net) model in the context of high-dimensional regression problems and propose a general framework focusing on adaptive dimensionality reduction. With the proposed framework, the target function is approximated by a mixture of experts model on a low-dimensional manifold, where each cluster is associated with a fixed-degree polynomial. We present a training strategy that leverages the expectation maximization (EM) algorithm. During the training, we alternate between (i) applying gradient descent to update the DNN coefficients; and (ii) using closed-form formulae derived from the EM algorithm to update the mixture of experts model parameters. Under the probabilistic formulation, step (ii) admits the form of embarrassingly paralleliazable weighted least-squares solves. The PPOU-Nets consistently outperform the baseline fully-connected neural networks of comparable sizes in numerical experiments of various data dimensions. Here, we also explore the proposed model in applications of quantum computing, where the PPOU-Nets act as surrogate models for cost landscapes associated with variational quantum circuits.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Slow manifold reduction for plasma science

The classical Chapman–Enskog procedure admits a substantial geometrical generalization known as slow manifold reduction. This generalization provides a paradigm for deriving and understanding most reduced models in plasma physics that are based on controlled approximations applied to problems with multiple timescales. In this Review we develop the theory of slow manifold reduction with a plasma physics audience in mind. In particular we illustrate (a) how the slow manifold concept may be used to understand breakdown of a reduced model over sufficiently-long time intervals, and (b) how a discrete-time analogue of slow manifold theory provides a useful framework for developing implicit integrators for temporally-stiff plasma models. For readers with more advanced mathematical training we also use slow manifold reduction to explain the phenomenon of inheritance of Hamiltonian structure in dissipation-free reduced plasma models. Various facets of the theory are illustrated in the context of the Abraham–Lorentz model of a single charged particle experiencing its own radiation drag. As a culminating example we derive the slow manifold underlying kinetic quasineutral plasma dynamics up to first-order in perturbation theory. This first-order result incorporates several physical effects associated with small deviations from exact charge neutrality that lead to slow drift away from predictions based on the leading-order approximation n e = Z i n i .

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Manifold Sampling for Optimizing Nonsmooth Nonconvex Compositions

Here we propose a manifold sampling algorithm for minimizing a nonsmooth composition $f= h\circ F$, where we assume $h$ is nonsmooth and may be inexpensively computed in closed form and $F$ is smooth but its Jacobian may not be available. We additionally assume that the composition $h\circ F$ defines a continuous selection. Manifold sampling algorithms can be classified as model-based derivative-free methods, in that models of $F$ are combined with particularly sampled information about $h$ to yield local models for use within a trust-region framework. We demonstrate that cluster points of the sequence of iterates generated by the manifold sampling algorithm are Clarke stationary. We consider the tractability of three particular subproblems generated by the manifold sampling algorithm and the extent to which inexact solutions to these subproblems may be tolerated. Numerical results demonstrate that manifold sampling as a derivative-free algorithm is competitive with state-of-the-art algorithms for nonsmooth optimization that utilize first-order information about $f$.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Nondegenerate Noise-Resilient Superconducting Qubit

We propose a superconducting qubit based on engineering the first and second harmonics of the Josephson energy and phase relation 𝐸 𝐽⁢1 ⁢cos 𝜑 and 𝐸 𝐽⁢2 ⁢cos 2⁢𝜑. By constructing a circuit such that 𝐸 𝐽⁢2 is negative and |𝐸 𝐽⁢1 | ≪ |𝐸 𝐽⁢2 |, we create a periodic potential with two nondegenerate minima. The qubit, which we dub “harmonium,” is formed from the lowest-energy states of each minimum. Bit-flip protection of the qubit arises due to the localization of each qubit state to their respective minima, while phase-flip protection can be understood by considering the circuit within the Born-Oppenheimer approximation. We demonstrate with time-domain simulations that single- and two-qubit gates can be performed in approximately 100 ns. Finally, we compute the qubit coherence times using numerical diagonalization of the complete circuit in conjunction with state-of-the-art noise models. We estimate out-of-manifold heating times on the order of milliseconds, which can be treated as erasure errors using conventional dispersive readout. We estimate pure-dephasing times on the order of many tens of milliseconds, and bit-flip times on the order of seconds.

quantum error correction↗
DOE OSTI2024

MULTI-LEADER: MULTI-source LEarning-Accelerated Design of high-Efficiency multi-stage compRessor (Final Technical Report)

The objective of MULTI-LEADER is to cut design costs by 80% while generating more energy-efficient designs of multi-stage compressors by developing and implementing novel machine learning (ML) techniques, which enable faster and fewer design iterations, improved solver performance, and concurrent multi-disciplinary design. Current industrial practices for the design of multi-stage compressors involve simulation-based design optimization with successive levels of model fidelity, iteratively evaluated between distinct disciplines, one stage at a time to tackle the high dimensional design variations. This project addresses these key design challenges: (1) concurrent optimization of multiple stages under many non-linear constraints; (2) multitude of evaluation of high-fidelity and expensive solvers and their gradients during optimization convergence in high-dimensional design; (3) multi-disciplinary design to maximize aerodynamic performance while guaranteeing structural integrity and additive manufacturability; (4) utilization of multiple fidelity of solvers with disparate parameterization and modeling assumptions. MULTI-LEADER achieved more than 5x speed up in detailed design of more energy-efficient compressors via these machine learning (ML) innovations: (i) rapid design surrogates by multi-source learning from diverse fidelities across multiple disciplines, (ii) physics-constrained data-augmented modeling for improved empiricism, (iii) generative manifold embedding for high dimensional concurrent design without gradient information; (iv) budget-constrained fidelity-adaptive sampling towards fewer design iterations.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Heat Exchanger Intensification Through Powder Processing and Enhanced Design (HIPPED)

High intensity, supercritical CO 2 heat exchangers capable of operating at temperatures between 800 and 1100 ˚C and pressures greater than 80 bar are considered a critical component for high efficiency power generation and a range of next-generation industrial processes. A novel heat exchanger concept was proposed in this project. The proposed concept involved a plate-type architecture with three-dimensional fins, called twisted s-shaped fins, that capitalize on additive manufacturing. Four manufacturing processes were studied to realize the complex envisioned design: press and sinter of metallic powders, directed energy deposition, laser powder bed fusion, and a novel powder bed process involving a photoreactive polymer called SEAM (scalable expeditious additive manufacturing), that later was developed at MSU. The team was able to manufacture subscale heat exchangers using laser powder bed fusion (LPBF) and SEAM. The team settled on using SEAM as a final manufacturing approach due to its very low cost. The SEAM-manufactured heat exchanger, however, when tested under pressure, exhibited leaks and the process still requires further development beyond the timeline of the project. To support the heat exchanger design and testing, the team developed a new high temperature flow loop allowing testing under high temperature and pressure. Computational modeling of the heat exchanger was also performed for the twisted s-shaped fins and the computations were validated with experimental data. The new twisted fins resulted in enhanced heat transfer and reduced pressure drop. To further minimize pressure drop in the plate heat exchanger, the team also developed a simplified model for flow maldistribution in the manifolds, providing a new tool for designers that eliminates the need for complex CFD calculations. A technoeconomic analysis was also developed to contrast SEAM with LPBF, this tool indicated that SEAM is several times less costly and offer significant promises as a rapid low cost additive manufacturing process for metallic systems.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2021

Designing for Supply and Return Air System Interaction in Residential Buildings

Standard practice for HVAC return design has evolved from running a dedicated return to each room with a supply, to systems with returns in more centrally located areas of the home with jump ducts, transfer grilles, or simply door undercuts used as return air pathways from isolated rooms . In these latter systems, hallways and stairwells act as large open ducts for conveying air back to a single (or sometimes multiple) central return. When partition doors to an isolated room are closed, the return airflow resistance goes up, significantly impacting airflow balance if an adequate relief pathway is not installed. Airflow imbalances can lead to comfort and building durability issues and increased envelope leakage. To combat this, some jurisdictions have requirements for return air pathways. The supply system topology – or layout - impacts the airflow balance stability in response to adjustments of return pathway resistances. Branching supply topologies typically have reduced static pressure after each split. The static pressure at the final split will be lower than the primary supply plenum. Because of this, if there is a restriction in a room’s return path, supply airflow will tend to redistribute to adjacent ducts at the end of the branch. A properly designed trunk and branch supply system can effectively equalize static pressure by reducing the cross sectional area after each takeoff . Maintaining static pressure within the trunk will reduce the system’s sensitivity to changes in return paths. However, in practice, it is difficult to design and time consuming to install a complex supply plenum. Velocity effects and poor takeoff placement also impact airflow balance. This fact sheet considers return systems in three main categories: distributed, with a return duct to each room; multiple central, with one return grille on each floor of a home; and single central, with a single return grille located near the air handling unit. Three supply categories are also considered: radial splitter box, trunk and branch, and home-run with all ducts connecting directly to a central manifold. A complete description of the modeling work and results can be found in the companion technical report.

buildings↗
DOE OSTI2020

A long short-term memory embedding for hybrid uplifted reduced order models

In this paper, we introduce an uplifted reduced order modeling (UROM) approach through the integration of standard projection based methods with long short-term memory (LSTM) embedding. Our approach has three modeling layers or components. In the first layer, we utilize an intrusive projection approach to model dynamics represented by the largest modes. The second layer consists of an LSTM model to account for residuals beyond this truncation. This closure layer refers to the process of including the residual effect of the discarded modes into the dynamics of the largest scales. However, the feasibility of generating a low rank approximation tails off for higher Kolmogorov n -width systems due to the underlying nonlinear processes. The third uplifting layer, called super-resolution, addresses this limited representation issue by expanding the span into a larger number of modes utilizing the versatility of LSTM. Therefore, our model integrates a physics-based projection model with a memory embedded LSTM closure and an LSTM based super-resolution model. In several applications, we exploit the use of Grassmann manifold to construct UROM for unseen conditions. We performed numerical experiments by using the Burgers and Navier-Stokes equations with quadratic nonlinearity. Finally, our results show robustness of the proposed approach in building reduced order models for parameterized systems and confirm the improved trade-off between accuracy and efficiency.

42 ENGINEERING↗
DOE OSTI2021

Manifold learning for coarse-graining atomistic simulations: Application to amorphous solids

In this work, we introduce a generalized machine learning framework to probabilistically parameterize upper-scale models in the form of nonlinear PDEs consistent with a continuum theory, based on coarse-grained atomistic simulation data of mechanical deformation and flow processes. The proposed framework utilizes a hypothesized coarse-graining methodology with manifold learning and surrogate-based optimization techniques. Coarse-grained high-dimensional data describing quantities of interest of the multiscale models are projected onto a nonlinear manifold whose geometric and topological structure is exploited for measuring behavioral discrepancies in the form of manifold distances. A surrogate model is constructed using Gaussian process regression to identify a mapping between stochastic parameters and distances. Derivative-free optimization is employed to adaptively identify a unique set of parameters of the upper-scale model capable of rapidly reproducing the system's behavior while maintaining consistency with coarse-grained atomic-level simulations. The proposed method is applied to learn the parameters of the shear transformation zone (STZ) theory of plasticity that describes plastic deformation in amorphous solids as well as coarse-graining parameters needed to translate between atomistic and continuum representations. We show that the methodology is able to successfully link coarse-grained microscale simulations to macroscale observables and achieve a high-level of parity between the models across scales.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Physics-inspired spatiotemporal-graph AI ensemble for the detection of higher order wave mode signals of spinning binary black hole mergers

We present a new class of AI models for the detection of quasi-circular, spinning, non-precessing binary black hole mergers whose waveforms include the higher order gravitational wave modes ($\ell$, |m|) = {(2,2), (2,1), (3,3), (3,2), (4,4)}, and mode mixing effects in the $\ell$ = 3, |m| = 2 harmonics. These AI models combine hybrid dilated convolution neural networks to accurately model both short- and long-range temporal sequential information of gravitational waves; and graph neural networks to capture spatial correlations among gravitational wave observatories to consistently describe and identify the presence of a signal in a three detector network encompassing the Advanced LIGO and Virgo detectors. We first trained these spatiotemporal-graph AI models using synthetic noise, using 1.2 million modeled waveforms to densely sample this signal manifold, within 1.7 h using 256 NVIDIA A100 GPUs in the Polaris supercomputer at the Argonne Leadership Computing Facility. This distributed training approach exhibited optimal classification performance, and strong scaling up to 512 NVIDIA A100 GPUs. With these AI ensembles we processed data from a three detector network, and found that an ensemble of 4 AI models achieves state-of-the-art performance for signal detection, and reports two misclassifications for every decade of searched data. We distributed AI inference over 128 GPUs in the Polaris supercomputer and 128 nodes in the Theta supercomputer, and completed the processing of a decade of gravitational wave data from a three detector network within 3.5 h. Finally, we fine-tuned these AI ensembles to process the entire month of February 2020, which is part of the O3b LIGO/Virgo observation run, and found 6 gravitational waves, concurrently identified in Advanced LIGO and Advanced Virgo data, and zero false positives. This analysis was completed in one hour using one NVIDIA A100 GPU.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

On the influence of over-parameterization in manifold based surrogates and deep neural operators

Constructing accurate and generalizable approximators (surrogate models) for complex physico-chemical processes exhibiting highly non-smooth dynamics is challenging. The main question is what type of surrogate models we should construct and should these models be under-parameterized or over-parameterized. In this work, we propose new developments and perform comparisons for two promising approaches: manifold-based polynomial chaos expansion (m-PCE) and the deep neural operator (DeepONet), and we examine the effect of over-parameterization on generalization. While m-PCE enables the construction of a mapping by first identifying low-dimensional embeddings of the input functions, parameters, and quantities of interest (QoIs), a neural operator learns the nonlinear mapping via the use of deep neural networks. Here, we demonstrate the performance of these methods in terms of generalization accuracy by solving the 2D time-dependent Brusselator reaction-diffusion system with uncertainty sources, modeling an autocatalytic chemical reaction between two species. We first propose an extension of the m-PCE by constructing a mapping between latent spaces formed by two separate embeddings of the input functions and the output QoIs. To further enhance the accuracy of the DeepONet, we introduce weight self-adaptivity in the loss function. We demonstrate that the performance of m-PCE and DeepONet is comparable for cases of relatively smooth input-output mappings. However, when highly non-smooth dynamics is considered, DeepONet shows higher approximation accuracy. We also find that for m-PCE, modest over-parameterization leads to better generalization, both within and outside of distribution, whereas aggressive over-parameterization leads to over-fitting. In contrast, an even highly over-parameterized DeepONet leads to better generalization for both smooth and non-smooth dynamics. Furthermore, we compare the performance of the above models with another recently proposed operator learning model, the Fourier Neural Operator, and show that its over-parameterization also leads to better generalization. Taken together, our studies show that m-PCE can provide very good accuracy at very low training cost, whereas a highly over-parameterized DeepONet can provide better accuracy and robustness to noise but at higher training cost. In both methods, the inference cost is negligible.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

cymyc: $\underline{C}$alabi-$\underline{Y}$au $\underline{M}$etrics, $\underline{Y}$ukawas, and $\underline{C}$urvature

We introduce cymyc, a high-performance Python library for numerical investigation of the geometry of a large class of string compactification manifolds and their associated moduli spaces. We develop a well-defined geometric ansatz to numerically model tensor fields of arbitrary degree on a large class of Calabi-Yau manifolds. cymyc includes a machine learning component which incorporates this ansatz to model tensor fields of interest on these spaces by finding an approximate solution to the system of partial differential equations they should satisfy.

differential and algebraic geometry↗
DOE OSTI2022

Diabatic Valence-Hole States in the C 2 Molecule: “Putting Humpty Dumpty Together Again”

Despite the long history of spectroscopic studies of the C$_2$ molecule, fundamental questions about its chemical bonding are still being hotly debated. The complex electronic structure of C$_2$ is a consequence of its dense manifold of near-degenerate, low-lying electronic states. A global multi-state diabatic model is proposed here to disentangle the numerous configuration interactions within four symmetry manifolds of C$_2$ ($^{1}\Pi_g$, $^{3}\Pi_g$, $^{1}\Sigma_u^+$, and $^{3}\Sigma_u^+$). The key concept of our model is the existence of two "valence-hole" configurations, $2\sigma_g^22\sigma_u^11\pi_{u}^33\sigma_g^2$ for $^{1,3}\Pi_g$ states and $2\sigma_g^22\sigma_u^11\pi_{u}^43\sigma_g^1$ for $^{1,3}\Sigma_u^+$ states that derive from $3\sigma_g\leftarrow2\sigma_u$ electron promotion. The lowest-energy state from each of the four C$_2$ symmetry species is dominated by this type of valence-hole configuration at its equilibrium internuclear separation. Finally, as a result of their large binding energy (nominal bond order of 3) and correlation with the 2s$^2$2p$^2$+2s2p$^3$ separated-atom configurations, the presence of these valence-hole configurations has a profound impact on the $global$ electronic structure and unimolecular dynamics of C$_2$.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗