Engineering Papers⌕ Search

Engineering topics

He, Xiaolong

Publications and source records attributed to He, Xiaolong.

Weak-Form Latent Space Dynamics Identification

This software showcases the enhanced capabilities of the Latent Space Dynamics Identification (LaSDI) algorithm through the application of the weak form, resulting in WLaSDI. WLaSDI first compresses the data, then projects it onto test functions, and subsequently learns the local latent space models. Notably, WLaSDI demonstrates significantly improved robustness to noise. Using weak-form equation learning techniques, WLaSDI achieves local latent space modeling. Compared to the standard sparse identification of nonlinear dynamics (SINDy) used in LaSDI, the variance reduction of the weak form ensures robust and precise latent space recovery, enabling fast, robust, and accurate simulations. We demonstrate the efficacy of WLaSDI against LaSDI using several common benchmark examples, including viscid and inviscid Burgers', radial advection, and heat conduction. For instance, in 1D inviscid Burgers' simulations with up to 100% Gaussian white noise, WLaSDI maintains relative errors consistently below 6%, whereas LaSDI errors can exceed 10,000%. Similarly, in radial advection simulations, WLaSDI keeps relative errors below 16%, compared to potential errors of up to 10,000% with LaSDI. Additionally, WLaSDI achieves significant speedups, such as a 140X speedup in 1D Burgers' simulations compared to the corresponding full order model.

Choi, Youngsoo↗

Weak-form latent space dynamics identification

Recent work in data-driven modeling has demonstrated that a weak formulation of model equations enhances the noise robustness of a wide range of computational methods. In this paper, we demonstrate the power of the weak form to enhance the LaSDI (Latent Space Dynamics Identification) algorithm, a recently developed data-driven reduced order modeling technique. We introduce a weak form-based version WLaSDI (Weak-form Latent Space Dynamics Identification). WLaSDI first compresses data, then projects onto the test functions and learns the local latent space models. Notably, WLaSDI demonstrates significantly enhanced robustness to noise. With WLaSDI, the local latent space is obtained using weak-form equation learning techniques. Compared to the standard sparse identification of nonlinear dynamics (SINDy) used in LaSDI, the variance reduction of the weak form guarantees a robust and precise latent space recovery, hence allowing for a fast, robust, and accurate simulation. We demonstrate the efficacy of WLaSDI vs. LaSDI on several common benchmark examples including viscid and inviscid Burgers', radial advection, and heat conduction. For instance, in the case of 1D inviscid Burgers' simulations with the addition of up to 100% Gaussian white noise, the relative error remains consistently below 6% for WLaSDI, while it can exceed 10,000% for LaSDI. Similarly, for radial advection simulations, the relative errors stay below 15% for WLaSDI, in stark contrast to the potential errors of up to 10,000% with LaSDI. Moreover, speedups of several orders of magnitude can be obtained with WLaSDI. For example applying WLaSDI to 1D Burgers' yields a 140X speedup compared to the corresponding full order model.

97 MATHEMATICS AND COMPUTING↗

A Comprehensive Review of Latent Space Dynamics Identification Algorithms for Intrusive and Non-Intrusive Reduced-Order-Modeling

Numerical solvers of partial differential equations (PDEs) have been widely employed for simulating physical systems. However, the computational cost remains a major bottleneck in various scientific and engineering applications, which has motivated the development of reduced-order models (ROMs). Recently, machine-learning-based ROMs have gained significant popularity and are promising for addressing some limitations of traditional ROM methods, especially for advection dominated systems. In this chapter, we focus on a particular framework known as Latent Space Dynamics Identification (LaSDI), which transforms the high-fidelity data, governed by a PDE, to simpler and low-dimensional latent-space data, governed by ordinary differential equations (ODEs). These ODEs can be learned and subsequently interpolated to make ROM predictions. Each building block of LaSDI can be easily modulated depending on the application, which makes the LaSDI framework highly flexible. In particular, we present strategies to enforce the laws of thermodynamics into LaSDI models (tLaSDI), enhance robustness in the presence of noise through the weak form (WLaSDI), select high-fidelity training data efficiently through active learning (gLaSDI, GPLaSDI), and quantify the ROM prediction uncertainty through Gaussian processes (GPLaSDI). We demonstrate the performance of different LaSDI approaches on Burgers equation, a non-linear heat conduction problem, and a plasma physics problem, showing that LaSDI algorithms can achieve relative errors of less than a few percent and up to thousands of times speed-ups.

Computational Engineering, Finance, and Science (c↗

gLaSDI: Parametric physics-informed greedy latent space dynamics identification

A parametric adaptive physics-informed greedy Latent Space Dynamics Identification (gLaSDI) method is proposed for accurate, efficient, and robust data-driven reduced-order modeling of high-dimensional nonlinear dynamical systems. In the proposed gLaSDI framework, an autoencoder discovers intrinsic nonlinear latent representations of high-dimensional data, while dynamics identification (DI) models capture local latent-space dynamics. Here, an interactive training algorithm is adopted for the autoencoder and local DI models, which enables identification of simple latent-space dynamics and enhances accuracy and efficiency of data-driven reduced-order modeling. To maximize and accelerate the exploration of the parameter space for the optimal model performance, an adaptive greedy sampling algorithm integrated with a physics-informed residual-based error indicator and random-subset evaluation is introduced to search for the optimal training samples on the fly. Further, to exploit local latent-space dynamics captured by the local DI models for an improved modeling accuracy with a minimum number of local DI models in the parameter space, a -nearest neighbor convex interpolation scheme is employed. The effectiveness of the proposed framework is demonstrated by modeling various nonlinear dynamical problems, including Burgers equations, nonlinear heat conduction, and radial advection. The proposed adaptive greedy sampling outperforms the conventional predefined uniform sampling in terms of accuracy. Compared with the high-fidelity models, gLaSDI achieves 17 to 2,658× speed-up with 1 to 5% relative errors.

97 MATHEMATICS AND COMPUTING↗

Internal calibration of transient kinetic data via machine learning

The temporal analysis of products (TAP) reactor provides a vast amount of transient kinetic information that may be used to describe a variety of chemical features including residence time distributions, kinetic coefficients, number of active sites, reaction mechanism, etc. However, as with any measurement device, the TAP reactor signal is convoluted with noise and drift is common. In order to reduce the uncertainty of the kinetic measurement and any derived parameters or mechanisms, proper preprocessing must be performed prior to any advanced type of analysis. This preprocessing includes baseline correction, i.e., a shift in the voltage response, and calibration, i.e., a scaling of the flux response based on prior experiments. The traditional methodology of preprocessing requires significant user discretion and reliance on separate calibration experiments that may drift over time. Herein we use machine learning techniques combined with physical constraints to understand the noise and drift that is being generated within and between experiments for enhancement of the chemical kinetic signal. As such, the proposed methodology demonstrates clear benefits over the traditional preprocessing approach by eliminating the need for separate calibration experiments or heuristic input from the user.

36 MATERIALS SCIENCE↗

Greedy Latent Space Dynamics Identification

This is a variant of LaSDI where it minimizes both reconstruction loss terms of auto encoder and dynamics regression loss terms simultaneously. Plus, an active learning framework is adopted so that a physics-informed greedy sampling point can be added to enhance the performance of gLaSDI. It is written in python and several examples are included in this software.

He, Xiaolong↗

LaSDI: Parametric Latent Space Dynamics Identification

Enabling fast and accurate physical simulations with data has become an important area of computational physics to aid in inverse problems, design-optimization, uncertainty quantification, and other various decision-making applications. This paper presents a data-driven framework for parametric latent space dynamics identification procedure that enables fast and accurate simulations. The parametric model is achieved by building a set of local latent space model and designing an interaction among them. An individual local latent space dynamics model achieves accurate solution in a trust region. By letting the set of trust region to cover the whole parameter space, our model shows an increase in accuracy with an increase in training data. Herein we introduce two different types of interaction mechanisms, i.e., point-wise and region-based approach. Both linear and nonlinear data compression techniques are used. We illustrate the framework of Latent Space Dynamics Identification (LaSDI) enable a fast and accurate solution process on various partial differential equations, i.e., Burgers’ equations, radial advection problem, and nonlinear heat conduction problem, achieving 0 (100)x speed-up and 0 (1)% relative error with respect to the corresponding full order models.

97 MATHEMATICS AND COMPUTING↗

Recent progress toward catalyst properties, performance, and prediction with data-driven methods

Herein, data-driven approaches are currently renovating the field of heterogenous catalysis and open a door to advance catalyst design. Their success depends heavily on the synergy among machine learning (ML), experimental data, and quantum mechanical (QM) calculations. In this brief survey of recent progress, we examine catalysis informatics in the context of (1) ML-aided catalyst characterizations, (2) knowledge extractions from experimental data, (3) predictions of catalytic properties and constructions of reaction networks, and (4) ML-enabled large-scale QM simulations. An outlook on the current challenges of this rapidly evolving field is also provided.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Initial Simulations of Empty Room Collapse and Reconsolidation at the Waste Isolation Pilot Plant

The Waste Isolation Pilot Plant (WIPP) is a geologic repository for defense-related nuclear waste. If left undisturbed, the virtually impermeable rock salt surrounding the repository will isolate the nuclear waste from the biosphere. If humans accidentally intrude into the repository in the future, then the likelihood of a radionuclide release to the biosphere will depend significantly on the porosity and permeability of the repository itself. Room ceilings and walls at the WIPP tend to collapse over time, causing rubble piles to form on floors of empty rooms. The surrounding rock formation will gradually compact these rubble piles until they eventually become solid salt, but the length of time for a rubble pile to reach a certain porosity and permeability is unknown. This report details the first efforts to build models to predict the porosity and permeability evolution of an empty room as it closes. Conventional geomechanical numerical methods would struggle to model empty room collapse and rubble pile consolidation, so three different meshless methods, the Immersed Isogeometric Analysis Meshfree, Reproducing Kernel Particle Method (RKPM), and the Conformal Reproducing Kernel method, were assessed. First, the meshless methods and the finite element method each simulated gradual room closure, without ceiling or wall collapse. All three methods produced equivalent room closure predictions with comparable computational speed. Second, the Immersed Isogeometric Analysis Meshfree method and RKPM simulated two-dimensional empty room collapse and rubble pile consolidation. Both methods successfully simulated large viscoplastic deformations, fracture, and rubble pile rearrangement to produce qualitatively realistic results. In addition to geomechanical simulations, the flow channels in damaged salt and crushed salt were measured using micro-computed tomography, and input into a computational fluid dynamics simulation to predict the salt's permeability. Although room for improvement exists, the current simulation approaches appear promising.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The up-regulation of long non-coding RNA CCAT2 indicates a poor prognosis for prostate cancer and promotes metastasis by affecting epithelial-mesenchymal transition

Recently, long noncoding RNAs (lncRNAs) have been shown to have critical regulatory roles in human cancer biology. LncRNA CCAT2 is a novel identified lncRNA that was previously reported to be up-regulated in different cancers, however, its role in prostate cancer remains unclear. The aim of this study was to investigate the expression and role of lncRNA CCAT2 in prostate cancer. The expression levels of lncRNA CCAT2 in PCa tissues and cell lines (DU145 and 22RV1) were evaluated by quantitative real-time PCR (qRT-PCR), and its association with prognosis of patients was analyzed by statistical analysis. Furthermore, the effect of CCAT2 on proliferation, migration, and invasion was studied in PCa cells. We found that the expression level of CCAT2 was higher in PCa tissues and cells compared to adjacent non-tumor tissues and normal prostate stromal immortalized cells WPMY-1. Kaplan-Meier survival analysis revealed that patients with high CCAT2 expression level had poorer overall survival and progression-free survival than those with low CCAT2 expression. Furthermore, multivariate analysis showed that the status of CCAT2 expression was an independent prognostic indicator for this disease. We also found that knockdown of CCAT2 could inhibit cell growth, migration, and invasion in vitro. In addition, knockdown of CCAT2 stimulated epithelial-mesenchymal transition (EMT) through abrogating N-cadherin, vimentin expression and intensifing the expression levels of E-cadherin. In conclusion, our data suggested that lncRNA CCAT2 was a novel molecule involved in PCa progression, which provided a potential prognostic biomarker and therapeutic target for new therapies in patients with prostate cancer. - Highlights: • LncRNA CCAT2 is identified with overexpression in prostate cancer tissues and cell lines. • High expression of lncRNA CCAT2 can be an independent prognostic factor for overall survival and progression-free survival. • Knockdown of lncRNA CCAT2 can inhibit cell growth, migration, and invasion in vitro study. • Knockdown of lncRNA CCAT2 stimulates metastasis of prostate cancer cell through regulating EMT-associated gene expression including N-cadherin, Vimentin and E-cadherin.

60 APPLIED LIFE SCIENCES↗

Effects of various Mg/Si ratios on microstructure and performance property of Al-Mg-Si alloy cables

High quality AA6101 aluminum cables are critical to electrical industry to meet the energy consumption requests. In the present work, the influence of Mg/Si ratios on the electrical conductivity and mechanical properties of AA6101 aluminum alloy was investigated. Wheatstone Bridge method and tensile test were employed to characterize the mechanical properties. X-ray Diffraction (XRD), Scanning Electron Microscope (SEM) and Transmission Electron Microscope (TEM) were used to understand the morphology of the precipitation and the mechanism of age hardening. It is found that excessive Si benefits high strength and high conductivity while excessive Mg plays a negative role in the strength and the conductivity of AA6101 cables. Excessive Si elements promote both the precipitating rate and quantity of β″ phase therefore increase the tensile strength. Excessive Si elements also help with decreasing the lattice distortion, which contributes to the enhancement of the conductivity. Excessive Mg elements lead to more dissolved Mg after aging treatment, therefore increase lattice distortion of the matrix and promote the deposit of coarse Mg-enriched secondary phase. - Highlights: •A new available method to improve the mechanical and electrical properties of Al-Mg-Si alloy •Investigation on the role of various Mg/Si ratios in the changes of comprehensive performances •Discussions on the morphology of the precipitation phases and the mechanism of hardening.

36 MATERIALS SCIENCE↗