Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Parameter Dimensionality Reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

ANALYSIS OF VARIANCE-BASED MIXED MULTISCALE FINITE ELEMENT METHOD AND APPLICATIONS IN STOCHASTIC TWO-PHASE FLOWS

The stochastic partial differential systems have been widely used to model physical processes, where the inputs involve large uncertainties. Flows in random and heterogeneous porous media is one of the cases where the random inputs (e.g., permeability) are often modeled as a stochastic field with high-dimensional random parameters. To treat the high dimensionality and heterogeneity efficiently, model reduction is employed in both stochastic space and physical space. An analysis of variance (ANOVA)-based mixed multiscale finite element method MsFEM) is developed to decompose the high-dimensional stochastic problem into a set of lower-dimensional stochastic subproblems, which require much less computational complexity and significantly reduce the computational cost in stochastic space, and the mixed MsFEM can capture the heterogeneities on a coarse grid to greatly reduce the computational cost in the spatial domain. In addition, to enhance the efficiency of the traditional ANOVA method, an adaptive ANOVA method based on a new adaptive criterion is developed, where the most active dimensions can be selected to greatly reduce the computational cost before conducting ANOVA decomposition. This novel adaptive criterion is based on variance-decomposition method coupled with sparse-grid probabilistic collocation method or multilevel Monte Carlo method. The advantage of this adaptive criterion lies in its much lower computational overhead for identifying the active dimensions and interactions. A number of numerical examples in two-phase stochastic flows are presented and demonstrate the accuracy and performance of the adaptive ANOVA-based mixed Ms-FEM.

Wei, Jia↗

Carbonate Management to Enable Energy- and Carbon-Efficient CO 2 Electrolysis (Final Technical Report)

The rapid growth and plummeting cost of solar energy have spurred growing interest in using CO 2 electrolysis to produce chemicals and fuels as an alternative to conventional petrochemical processes. High-temperature (>800 °C) solid oxide electrolyzers that convert CO 2 into CO and O 2 have recently become commercially available. Low-temperature electrolysis cells offer the prospect of more convenient and flexible operation, which is critical for utilizing intermittent solar energy, and provide access to more valuable C 2+ products such as ethylene, ethanol, and propanol. Over the past 10 years, research in this area has yielded substantial progress in both fundamental understanding of the requisite electrocatalytic reactions and design of prototype devices. Leveraging insights from fuel cells and membrane water electrolyzers, researchers have developed electrolysis cells with gas diffusion electrodes (GDE) that have demonstrated high CO 2 electrolysis current densities (>100 mA cm –2 ) as well as promising selectivity and stability. Despite these advances, the energy efficiency (electrical energy-to-product) and carbon efficiency (CO 2 -to-product) of low-temperature CO 2 electrolysis remain far too low for large-scale deployment. A preponderance of evidence indicates that the principal source of efficiency losses is the rapid and thermodynamically favorable reaction of CO 2 with hydroxide (OH – ) to form carbonate (CO 3 2– ). Carbonate formation imposes steady-state electrolysis conditions that result in large voltage and CO 2 losses for all known (photo)electrochemical CO 2 cells. While much current research remains focused on CO 2 reduction catalyst design, this largely overlooked CO 3 2– problem presents a fundamental scientific barrier to creating a viable electrochemical option for converting solar energy into chemicals and fuels. The project pursues an integrated, multi-PI research effort that establishes a fundamental science of CO 3 2– management. PI Kanan and Co-PI Mani’s contribution to the project is to evaluate strategies to mitigate the CO 3 2– problem by changing the properties of the electrolyte and the environment in which CO 2 reduction catalysis takes place. Experimental studies showed that electrolytes composed of a high concentration of both CO 3 2– and HCO 3 – , which serve as moderately alkaline buffers, improved the cell voltage by compared to all-HCO 3 – electrolytes, but these buffered systems still show substantial CO 2 uptake that reduces pH over time. Computational studies developed a homogenized model of a CO 2 reduction catalyst layer that permits a low-cost exploration of the high-dimensional parameter space associated with catalyst layers on gas diffusion electrodes. The model was validated by accurately reproducing experimental data for the related but simpler reaction of CO reduction and then used to probe the effects of catalyst layer architecture on CO 2 reduction. Minimizing the size of catalyst and hydrophobic domains in the catalyst layer is predicted to mitigate CO 3 2– formation and thereby enable prolonged operation at elevated pH. In support of the CO 2 electrolysis studies, a new method for rapidly prototyping electrochemical cells was developed and validated. The method uses a combination of 3D printing and electroless plating to generate conductive cell components for evaluating new cell designs. The carbonate problem encompasses mass transport processes and acid-base reactions that are relevant to many other electrochemical systems. Investigation of strategies to address the carbonate problem led to an additional line of inquiry into the physicochemical phenomena that determine the efficiency of electrochemical acid-base production, which has numerous applications in the broader field of carbon management. New strategies for using the supporting electrolyte to inhibit H + /OH – recombination in electrochemical acid-base production were evaluated, leading to the development of a novel acid-base producing system that eliminates the need for ion exchange membranes and exhibits promising efficiency and current densities for scalable applications.

25 ENERGY STORAGE↗

Dimensional Reduction for Sampled Priors and Application to Photometric Redshift Distributions

A typical Bayesian inference on the values of some parameters of interest q from some data D involves running a Markov Chain (MC) to sample from the posterior $p$($q$,$n$|$D$) $\propto$ $\mathcal{L}$($D$|$q$,$n$)$p$(q)$p$($n$), where n are some nuisance parameters with a separable prior. In some cases, the nuisance parameters are high-dimensional, and their prior p(n) is itself defined only by a set of samples that have been drawn from some other MC. The MC for the posterior will typically require evaluation of p(n) at arbitrary values of n, i.e., one needs to provide a density estimator over the full n space from the provided samples. But the high dimensionality of n hinders both the density estimation and the efficiency of the MC for the posterior. We describe a solution to this problem: a linear compression of the n space into a much lower-dimensional space u, which projects away directions in n space that cannot appreciably alter $\mathcal{L}$. The algorithm for doing so is a slight modification to principal components analysis, and is less restrictive on p(n) than other proposed solutions to this issue. We demonstrate this “mode projection” technique using the analysis of 2-point correlation functions of weak lensing fields and galaxy density in the Dark Energy Survey, where n is a binned representation of the redshift distribution n(z) of the galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

MOOSE ProbML: Parallelized probabilistic machine learning and uncertainty quantification for computational energy applications

Here, this paper presents the development and demonstration of massively parallel probabilistic machine learning (ML) and uncertainty quantification (UQ) capabilities within the Multiphysics Object-Oriented Simulation Environment (MOOSE), an open-source computational platform for parallel finite element and finite volume analyses. In addressing the computational expense and uncertainties inherent in complex multiphysics simulations, this paper integrates Gaussian process (GP) variants, active learning, Bayesian inverse UQ, adaptive forward UQ, Bayesian optimization, evolutionary optimization, and Markov chain Monte Carlo (MCMC) within MOOSE. It also elaborates on the interaction among key MOOSE systems — Sampler, MultiApp, Reporter, and Surrogate — in enabling these capabilities. The modularity offered by these systems enables development of a multitude of probabilistic ML and UQ algorithms in MOOSE. Example code demonstrations include parallel active learning and parallel Bayesian inference via active learning. The impact of these developments is illustrated through five applications relevant to computational energy applications: UQ of nuclear fuel fission product release, using parallel active learning Bayesian inference; very rare events analysis in nuclear microreactors using active learning; advanced manufacturing process modeling using multi-output GPs (MOGPs) and dimensionality reduction; fluid flow using deep GPs (DGPs); and tritium transport model parameter optimization for fusion energy, using batch Bayesian optimization. These capabilities are part of the MOOSE framework.

97 - MATHEMATICS AND COMPUTING↗

Analysis of internal ablation for the thermal control of aerospace vehicles

A new method of thermal protection for transatmospheric vehicles is introduced. The method involves the combination of radiation, ablation and transpiration cooling. By placing an ablating material behind a fixed-shape, porous outer shield, the effectiveness of transpiration cooling is made possible while retaining the simplicity of a passive mechanism. A simplified one-dimensional approach is used to derive the governing equations. Reduction of these equations to non-dimensional form yields two parameters which characterize the thermal protection effectiveness of the shield and ablator combination for a given trajectory. The non-dimensional equations are solved numerically for a sample trajectory corresponding to glide re-entry. Four typical ablators are tested and compared with results obtained by using the thermal properties of water. For the present level of analysis, the numerical computations adequately support the analytical model.

Camberos, Jose A.↗

Aerodynamic Sensitivities over Separable Shape Tensors

Here, we present a comprehensive aerodynamic sensitivity analysis of airfoil parameterization informed by separable shape tensors. This parameterization approach uniquely benefits the design process by isolating various well-studied shape characteristics, such as airfoil thickness, and providing a well-regulated low-dimensional parameter domain for aerodynamic designs. Exploring the aerodynamic sensitivities of this novel parameterization can provide valuable insights for more robust designs and future manufacturing efforts. We construct a data-driven parameter space of airfoils using principal geodesic analysis of separable shape tensors informed by a curated database containing almost 20,000 suitable engineering airfoils. Analyzing the shape reconstruction error and the maximum mean discrepancy between joint distributions of aerodynamic quantities, we study the dimensionality of the learned parameter space. This simple numerical experiment demonstrates a dramatic dimension reduction that retains design effectiveness and promotes regularity of the shape representations. Finally, we generate new airfoils and use the HAM2D Reynolds-averaged Navier–Stokes solver to predict lift, drag, and moment coefficients. We compute multiple sensitivity metrics to quantify and assert the consistency of parameter influence on the aerodynamic quantities. We also explore low-dimensional polynomial ridge approximations to motivate physical intuitions and offer explanations of the approximated sensitivities.

17 WIND ENERGY↗

Analytical and experimental study of mean flow and turbulence characteristics inside the passages of an axial flow inducer

The inviscid and viscid effects existing within the passages of a three bladed axial flow inducer operating at a flow coefficient of 0.065 are investigated. The blade static pressure and blade limiting streamline angle distributions were determined and the three components of mean velocity, turbulence intensities, and turbulence stresses were measured at locations inside the inducer blade passage utilizing a rotating three sensor hotwire probe. Applicable equations were derived for the hotwire data reduction analysis and solved numerically to obtain the appropriate flow parameters. The three dimensional inviscid flow in the inducer was predicted by numerically solving the exact equations of motion, and the three dimensional viscid flow was predicted by incorporating the dominant viscous terms into the exact equations. The analytical results are compared with the experimental measurements and design values where appropriate. Radial velocities are found to be of the same order as axial velocities within the inducer passage, confirming the highly three dimensional characteristic of inducer flow. Total relative velocity distribution indicate a substantial velocity deficiency near the tip at mid-passage which expands significantly as the flow proceeds toward the inducer trailing edge. High turbulence intensities and turbulence stresses are concentrated within this core region. Considerable wake diffusion occurs immediately downstream of the inducer trailing edge to decay this loss core. Evidence of boundary layer interactions, blade blockage effects, radially inward flows, annulus wall effects, and backflows are all found to exist within the long, narrow passages of the inducer.

Gorton, C. A.↗

Process-Structure Linkages Using a Data Science Approach: Application to Simulated Additive Manufacturing Data

A novel data science workflow is developed and demonstrated to extract process-structure linkages (i.e., reduced-order model) for microstructure evolution problems when the final microstructure depends on (simulation or experimental) processing parameters. Our workflow consists of four main steps: data pre-processing, microstructure quantification, dimensionality reduction, and extraction/validation of process-structure linkages. These methods that can be employed within each step vary based on the type and amount of available data. In this paper, this data-driven workflow is applied to a set of synthetic additive manufacturing microstructures obtained using the Potts-kinetic Monte Carlo (kMC) approach. Additive manufacturing techniques inherently produce complex microstructures that can vary significantly with processing conditions. Using the developed workflow, a low-dimensional data-driven model was established to correlate process parameters with the predicted final microstructure. In addition, the modular workflows developed and presented in this work facilitate easy dissemination and curation by the broader community.

36 MATERIALS SCIENCE↗

Trajectory prediction dimensionality reduction for low-cost connected automated vehicle systems

Here, to facilitate low-cost connected automated vehicle (CAV) system development, this study proposes two interpretable dimensionality reduction techniques in vehicle trajectory prediction, i.e., the piecewise Taylor series approximation (PTA) and the piecewise Fourier series approximation (PFA), to lower computation complexity, reduce device investment, and decrease computation energy consumption. Two benchmarks are developed, the long short-term memory (LSTM)-based model without dimensionality reduction and the LSTM-based model with encoder-decoder (a widely used dimensionality reduction technique). Results show that the four predictions have similar accuracy, and the training time (proportional to computation energy consumption) of models with dimensionality reduction techniques is greatly reduced. The reduction is even more significant when PTA/PFA is used. Sensitivity analysis advises PFA/PTA parameter selections to reduce computation complexity without significant loss of prediction accuracy. Further, the robustness of the LSTM PTA/PFA is proven by the investigation of data noises.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Remote Epitaxy of III-V Solar Cells via Hydride Vapor Phase Epitaxy

The promise of remote epitaxy, in which epitaxial registry of a film can still be maintained through two-dimensional layers, has emerged from an advanced understanding of the interactions between two dimensional materials and bulk semiconductors. A promising application of this technology is to facilitate substrate reuse in epitaxial III-V systems, which could significantly reduce material cost and improve commercial viability of this high-efficiency photovoltaic technology. In this process the weak van der Waal bonds between the 2D layer and the III-V substrate make separation of epitaxially-grown layers simple and leaves a smooth substrate that can be reused for cost reduction. Here we present a study of growth parameters of GaAs on AlGaAs through a low dimensional carbon interlayer via hydride vapor phase epitaxy (HVPE). We Investigate the effect of various GaAs nucleation conditions such as V/III ratio, temperature and growth rate on film roughness, crystallinity, and degree of epitaxial alignment. We demonstrate growth of single crystal GaAs layer on top of the low dimensional carbon that follow the crystal orientation of the substrate. Surface roughness measured via AFM found that lower V/III ratios result in smoother III-V films grown on the low dimensional carbon, with a lowest RMS of ~60 nm obtained at a V/III ratio of 5. Growth temperatures are optimized at 650 C, as temperatures below 550 C show non-crystalline growth and higher temperature samples display very rough surfaces. Additionally, we investigate HVPE growth on various forms of low-dimensional carbon including transferred graphene, CVD-grown graphene, and MOCVD-growth amorphous carbon and find the latter to be most well suited for III-V growth as this method results in cleaner interface and potential for direct, large-area coverage. We also identify techniques to mitigate surface degradation in carbon layers as a function of both exposure time and growth environment by analyzing surface changes via x-ray reflectivity. We show growth of heteroepitaxial III-V solar cells on carbon interlayers and preliminary cell results, which are currently limited to 4% efficiency under one sun.

AlGaAs↗

A strategy for improved computational efficiency of the method of anchored distributions

This paper proposes a strategy for improving the computational efficiency of model inversion using the method of anchored distributions by “bundling” similar model parametrizations in the likelihood function. Inferring the likelihood function typically requires a large number of forward model simulations for each possible model parametrization; as a result, the process is quite expensive. To ease this prohibitive cost, we present an approximation for the likelihood function – called “bundling” – that relaxes the requirement for high quantities of forward model simulations. This approximation redefines the conditional statement of the likelihood function as the probability of sets of similar model parametrizations – “bundles” – replicating field measurements. To evaluate the effectiveness of these modifications, we compare the quality of predictions and computational cost of bundling relative to a baseline method of anchored distributions inversion of three-dimensional flow and transport model parameters. For our synthetic experiment, bundling achieved a 35% reduction in overall computational cost and had a limited negative on predicted probability distributions of the model parameters. Strategies for minimizing error in the bundling approximation, for enforcing similarity amongst the sets of model parametrizations, and for identifying convergence of the likelihood function are also presented.

Bayesian Inversion, SVD, computational efficiency↗

MACHINE LEARNING-ENABLED PREDICTION OF TRANSIENT INJECTION MAP IN AUTOMOTIVE INJECTORS WITH UNCERTAINTY QUANTIFICATION

Accurate prediction of injection profiles is a critical aspect of linking injector operation with engine performance and emissions. However, highly resolved injector simulations can take one to two weeks of wall-clock time, which is incompatible with engine design cycles with desired turnaround times of less than a day. Hence, it is important to reduce the time-to-solution of the internal flow simulations by several orders of magnitude to make it compatible with engine simulations. This work demonstrates a data-driven approach for tackling the computational overhead of injector simulations, whereby the transient injection profiles are emulated for a side-oriented, single-hole diesel injector using a Bayesian machine-learning framework. First, an interpretable Bayesian learning strategy was employed to understand the effect of design parameters on the total void fraction field. Then, autoencoders are utilized for efficient dimensionality reduction of the flowfields. Gaussian process models are finally used to predict the spatiotemporal void fraction field at the injector exit for unknown operating conditions. The Gaussian process models produce principled uncertainty estimates associated with the emulated flowfields, which provide the engine designer with valuable information of where the data-driven predictions can be trusted in the design space. The Bayesian flowfield predictions are compared with the corresponding predictions from a deep neural network, which has been transfer-learned from static needle simulations from a previous work by the authors. The emulation framework can predict the void fraction field at the exit of the orifice within a few seconds, thus achieving a speed-up factor of up to 38 x 10(6) over the traditional simulation-based approach of generating transient injection maps.

machine learning↗

Role of physics in physics-informed machine learning

Physical systems are characterized by inherent symmetries, one of which is encapsulated in the units of their parameters and system states. These symmetries enable a lossless order-reduction, e.g., via dimensional analysis based on the Buckingham theorem. Despite the latter's benefits, machine learning (ML) strategies for the discovery of constitutive laws seldom subject experimental and/or numerical data to dimensional analysis. We demonstrate the potential of dimensional analysis to significantly enhance the interpretability and generalizability of ML-discovered secondary laws. Our numerical experiments with creeping fluid flow past solid ellipsoids show how dimensional analysis enable both deep neural networks and sparse regression reproduce old results, e.g., Stokes law for a sphere, and generate new ones, e.g., an expression for an ellipsoid misaligned with the flow direction. Furthermore, our results suggest the need to incorporate other physics-based symmetries and invariances into ML-based techniques for equation discovery.

97 MATHEMATICS AND COMPUTING↗

Greedy Sampling and Incremental Surrogate Model-Based Tailoring of Aeroservoelastic Model Database for Flexible Aircraft

This paper presents a data analysis and modeling framework to tailor and develop linear parameter-varying (LPV) aeroservoelastic (ASE) model database for flexible aircrafts in broad 2D flight parameter space. The Kriging surrogate model is constructed using ASE models at a fraction of grid points within the original model database, and then the ASE model at any flight condition can be obtained simply through surrogate model interpolation. The greedy sampling algorithm is developed to select the next sample point that carries the worst relative error between the surrogate model prediction and the benchmark model in the frequency domain among all input-output channels. The process is iterated to incrementally improve surrogate model accuracy till a pre-determined tolerance or iteration budget is met. The methodology is applied to the ASE model database of a flexible aircraft currently being tested at NASA/AFRC for flutter suppression and gust load alleviation. Our studies indicate that the proposed method can reduce the number of models in the original database by 67%. Even so the ASE models obtained through Kriging interpolation match the model in the original database constructed directly from the physics-based tool with the worst relative error far below 1%. The interpolated ASE model exhibits continuously-varying gains along a set of prescribed flight conditions. More importantly, the selected grid points are distributed non-uniformly in the parameter space, a) capturing the distinctly different dynamic behavior and its dependence on flight parameters, and b) reiterating the need and utility for adaptive space sampling techniques for ASE model database compaction. The present framework is directly extendible to high-dimensional flight parameter space, and can be used to guide the ASE model development, model order reduction, robust control synthesis and novel vehicle design of flexible aircraft.

numerical analysi↗

Improved multifidelity Monte Carlo estimators based on normalizing flows and dimensionality reduction techniques

Here, we study the problem of multifidelity uncertainty propagation for computationally expensive models. In particular, we consider the general setting where the high-fidelity and low-fidelity models have a dissimilar parameterization both in terms of number of random inputs and their probability distributions, which can be either known in closed form or provided through samples. We derive novel multifidelity Monte Carlo estimators which rely on a shared subspace between the high-fidelity and low-fidelity models where the parameters follow the same probability distribution, i.e., a standard Gaussian. We build the shared space employing normalizing flows to map different probability distributions into a common one, together with linear and nonlinear dimensionality reduction techniques, active subspaces and autoencoders, respectively, which capture the subspaces where the models vary the most. We then compose the existing low-fidelity model with these transformations and construct modified models with an increased correlation with the high-fidelity model, which therefore yield multifidelity estimators with reduced variance. A series of numerical experiments illustrate the properties and advantages of our approaches.

97 MATHEMATICS AND COMPUTING↗

Gaussian processes with built-in dimensionality reduction: Applications to high-dimensional uncertainty propagation

Uncertainty quantification (UQ) tasks, such as model calibration, uncertainty propagation, and optimization under uncertainty, typically require several thousand evaluations of the underlying computer codes. To cope with the cost of simulations, one replaces the real response surface with a cheap surrogate based, e.g., on polynomial chaos expansions, neural networks, support vector machines, or Gaussian processes (GP). However, the number of simulations required to learn a generic multivariate response grows exponentially as the input dimension increases. This curse of dimensionality can only be addressed, if the response exhibits some special structure that can be discovered and exploited. A wide range of physical responses exhibit a special structure known as an active subspace (AS). An AS is a linear manifold of the stochastic space characterized by maximal response variation. The idea is that one should first identify this low dimensional manifold, project the high-dimensional input onto it, and then link the projection to the output. If the dimensionality of the AS is low enough, then learning the link function is a much easier problem than the original problem of learning a high-dimensional function. The classic approach to discovering the AS requires gradient information, a fact that severely limits its applicability. Furthermore, and partly because of its reliance to gradients, it is not able to handle noisy observations. The latter is an essential trait if one wants to be able to propagate uncertainty through stochastic simulators, e.g., through molecular dynamics codes. In this work, we develop a probabilistic version of AS which is gradient-free and robust to observational noise. Our approach relies on a novel Gaussian process regression with built-in dimensionality reduction. In particular, the AS is represented as an orthogonal projection matrix that serves as yet another covariance function hyper-parameter to be estimated from the data. To train the model, we design a two-step maximum likelihood optimization procedure that ensures the orthogonality of the projection matrix by exploiting recent results on the Stiefel manifold, i.e., the manifold of matrices with orthogonal columns. The additional benefit of our probabilistic formulation, is that it allows us to select the dimensionality of the AS via the Bayesian information criterion. We validate our approach by showing that it can discover the right AS in synthetic examples without gradient information using both noiseless and noisy observations. We demonstrate that our method is able to discover the same AS as the classical approach in a challenging one-hundred-dimensional problem involving an elliptic stochastic partial differential equation with random conductivity. Finally, we use our approach to study the effect of geometric and material uncertainties in the propagation of solitary waves in a one dimensional granular system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Minimising the effect of nanoparticle deformation in intermittent contact amplitude modulation atomic force microscopy measurements

The results of systematic height measurements of polystyrene (PS) nanoparticles using intermittent contact amplitude modulation atomic force microscopy (IC-AM-AFM) are presented. The experimental findings demonstrate that PS nanoparticles deform during AFM imaging, as indicated by a reduction in the measured particle height. This deformation depends on the IC-AM-AFM imaging parameters, material composition, and dimensional properties of the nanoparticles. A model for nanoparticle deformation occurring during IC-AM-AFM imaging is developed as a function of the peak force which can be calculated for a particular set of experimental conditions. The undeformed nanoparticle height can be estimated from the model by extrapolation to zero peak force. A procedure is proposed to quantify and minimise nanoparticle deformation during IC-AM-AFM imaging, based on appropriate adjustments of the experimental control parameters.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗