Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Reduced-dimension Bayesian optimization for model calibration of transient vapor compression cycles

Development and calibration of first-principles dynamic models of vapor compression cycles (VCCs) is of critical importance for applications that include control design and fault detection and diagnostics. Nevertheless, the inherent complexity of models that are represented by large systems of differential–algebraic equations leads to significant challenges for model calibration processes that utilize classical gradient-based methods. Bayesian optimization (BO) is a sample-efficient and gradient-free approach using a probabilistic surrogate model and optimal search over a feasible parameter space. Despite the benefits of BO in reducing computational costs, challenges remain in dealing with a high-dimensional calibration task resulting from a large set of parameters that have significant impacts on system behavior and need to be calibrated simultaneously. This paper presents a reduced-dimension BO framework for calibrating transient VCCs models where the calibration space is projected to a low-dimensional subspace for accelerating convergence of the solution algorithm and consequently reducing the number of transient simulations. The proposed approach was demonstrated via two case studies associated with different VCC applications where 10 parameters were calibrated in each case using laboratory measurements. The reduced-dimension BO framework only required 1 / 8 th of the iterations associated with a standard BO method that deals with high-dimensional calibration parameters for converged solutions and yielded comparable accuracy. Furthermore, both calibrated models revealed significant accuracy improvements compared to uncalibrated models.

Ma, Jiacheng↗

The Role of Circulating Tumor Cells in Breast Cancer and Implications for Radiation Treatment Decisions

Tumor biomarkers are used routinely in oncology to assign risk categorization, screen and assist in diagnosis of malignancy, allow for prognostication and prediction of outcomes and treatment response, and allow for monitoring of patients after treatment completion. Although tissue-based biomarkers have a long history of use, the emergence of liquid-based biomarkers, including circulating tumor cells (CTCs), may soon revolutionize the management of patients with cancer. Here, we review the discovery of CTCs and their role as prognostic and predictive biomarkers, with an emphasis on breast cancer. We discuss the platforms for CTC enumeration and focus on studies using the only US Food and Drug Administration–approved platform for CTC enumeration (CellSearch). In addition, we examine the role of CTCs in women with metastatic, inflammatory, and nonmetastatic breast cancer, as well as the clinical evidence for their use as a surrogate for radiation treatment response as well as surveillance after treatment. Finally, we conclude by investigating ongoing clinical studies assessing CTCs as radiation response predictors and discuss unanswered questions.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Exercise Therapy and Radiation Therapy for Cancer: A Systematic Review

Exercise therapy (ET) is shown to improve toxicity and surrogates of survival for patients receiving chemotherapy. Current National Comprehensive Cancer Network (NCCN) guidelines lack recommendations for concurrent radiation therapy (RT) and ET. The main objective was to determine the impact of concurrent ET + RT with respect to (1) acceptability, feasibility, safety; and (2) to demonstrate how incorporating ET in cancer treatment can enhance patient-reported outcomes (PROs) and physical function—defined as strength or exercise capacity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Evaluation of Motion Compensation Methods for Noninvasive Cardiac Radioablation of Ventricular Tachycardia

Noninvasive cardiac radioablation is increasingly used for treatment of refractory ventricular tachycardia. Attempts to limit normal tissue exposure are important, including managing motion of the target. An interplay between cardiac and respiratory motion exists for cardiac radioablation, which has not been studied in depth. The objectives of this study were to estimate target motion during abdominal compression free breathing (ACFB) and respiratory gated (RG) deliveries and to investigate the quality of either implanted cardioverter defibrillator lead tip or the diaphragm as a gating surrogate.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Screening and evaluation of biomass upgrading strategies for sustainable transportation fuel production with biomass-derived volatile fatty acids

Biomass conversion to fuels and chemicals is crucial to decarbonization, but choosing an advantageous upgrading pathway out of many options is challenging. Rigorously evaluating all candidate pathways (process simulation, product property testing) requires a prohibitive amount of research effort; even simple upgrading schemes have hundreds of possible permutations. We present a method enabling high-throughput screening by approximating upgrading unit operations and drop-in compatibility of products (e.g., fuel properties) and apply it to volatile fatty acid (VFA) conversion to liquid transportation fuels via a MATLAB script, VFA Upgrading to Liquid Transportation fUels Refinery Estimation (VULTURE). VULTURE selects upgrading configurations that maximize fuel blend bio-derived content. We validate VULTURE's approximations through surrogate fuel property testing and process simulation. Techno-economic and life cycle analyses suggest that VFA upgrading processes down-selected by VULTURE are profitable and have low carbon intensities, demonstrating the potential for the strategy to accelerate process development timelines at decreased costs.

09 BIOMASS FUELS↗

Optimal high-throughput virtual screening pipeline for efficient selection of redox-active organic materials

As global interest in renewable energy continues to increase, there has been a pressing need for developing novel energy storage devices based on organic electrode materials that can overcome the shortcomings of the current lithium-ion batteries. One critical challenge for this quest is to find materials whose redox potential (RP) meets specific design targets. In this study, we propose a computational framework for addressing this challenge through the effective design and optimal operation of a high-throughput virtual screening (HTVS) pipeline that enables rapid screening of organic materials that satisfy the desired criteria. Starting from a high-fidelity model for estimating the RP of a given material, we show how a set of surrogate models with different accuracy and complexity may be designed to construct a highly accurate and efficient HTVS pipeline. We demonstrate that the proposed HTVS pipeline construction and operation strategies substantially enhance the overall screening throughput.

36 MATERIALS SCIENCE↗

Uncertainty quantification of a deep learning fuel property prediction model

Deep learning models are being widely used in the field of combustion. Given the black-box nature of typical neural network based models, uncertainty quantification (UQ) is critical to ensure the reliability of predictions as well as the training datasets, and for a principled quantification of noise and its various sources. Deep learning surrogate models for predicting properties of chemical compounds and mixtures have been recently shown to be promising for enabling data-driven fuel design and optimization, with the ultimate goal of improving efficiency and lowering emissions from combustion engines. In this study, UQ is performed for a multi-task deep learning model that simultaneously predicts the research octane number (RON), Motor Octane Number (MON), and Yield Sooting Index (YSI) of pure components and multicomponent blends. The deep learning model is comprised of three smaller networks: Extractor 1, Extractor 2, and Predictor, and a mixing operator. The molecular fingerprints of individual components are encoded via Extractor 1 and Extractor 2, the mixing operator generates fingerprints for mixtures/blends based on linear mixing operation, and the predictor maps the fingerprint to the target properties. Two different classes of UQ methods, Monte Carlo ensemble methods and Bayesian neural networks (BNNs), are employed for quantifying the epistemic uncertainty. Combinations of Bernoulli and Gaussian distributions with DropConnect and DropOut techniques are explored as ensemble methods. All the DropConnect, DropOut and Bayesian layers are applied to the predictor network. Aleatoric uncertainty is modeled by assuming that each data point has an independent uncertainty associated with it. The results of the UQ study are further analyzed to compare the performance of BNN and ensemble methods. Although this study is confined to UQ of fuel property prediction, the methodologies are applicable to other deep learning frameworks that are being widely used in the combustion community.

33 ADVANCED PROPULSION SYSTEMS↗

Airborne hyperspectral imaging of nitrogen deficiency on crop traits and yield of maize by machine learning and radiative transfer modeling

Nitrogen is an essential nutrient that directly affects plant photosynthesis, crop yield, and biomass production for bioenergy crops, but excessive application of nitrogen fertilizers can cause environmental degradation. To achieve sustainable nitrogen fertilizer management for precision agriculture, there is an urgent need for nondestructive and high spatial resolution monitoring of crop nitrogen and its allocation to photosynthetic proteins as that changes over time. Here, we used visible to shortwave infrared (400–2400 nm) airborne hyperspectral imaging with high spatial (0.5 m) and spectral (3–5 nm) resolutions to accurately estimate critical crop traits, i.e., nitrogen, chlorophyll, and photosynthetic capacity (CO 2 -saturated photosynthesis rate, V max,27 ), at leaf and canopy scales, and to assess nitrogen deficiency on crop yield. We conducted three airborne campaigns over a maize (Zea mays L.) field during the growing season of 2019. Physically based soil-canopy Radiative Transfer Modeling (RTM) and data-driven approaches i.e. Partial-Least Squares Regression (PLSR) were used to retrieve crop traits from hyperspectral reflectance, with ground truth of leaf nitrogen, chlorophyll, V max,27 , Leaf Area Index (LAI), and harvested grain yield. To improve computational efficiency of RTMs, Random Forest (RF) was used to mimic RTM simulations to generate machine learning surrogate models RTM-RF. The results show that prior knowledge of soil background and leaf angle distribution can significantly reduce the ill-posed RTM retrieval. RTM-RF achieved a high accuracy to predict leaf chlorophyll content (R 2 = 0.73) and LAI (R 2 = 0.75). Meanwhile, PLSR exhibited better accuracy to predict leaf chlorophyll content (R 2 = 0.79), nitrogen concentration (R 2 = 0.83), nitrogen content (R 2 = 0.77), and V max,27 (R 2 = 0.69) but required measured traits for model training. We also found that canopy structure signals can enhance the use of spectral data to predict nitrogen related photosynthetic traits, as combining RTM-RF LAI and PLSR leaf traits well predicted canopy-level traits (leaf traits × LAI) including canopy chlorophyll (R 2 = 0.80), nitrogen (R 2 = 0.85) and V max,27 (R 2 = 0.82). Compared to leaf traits, we further found that canopy-level photosynthetic traits, particularly canopy V max,27 , have higher correlation with maize grain yield. This study highlights the potential for synergistic use of process-based and data-driven approaches of hyperspectral imaging to quantify crop traits that facilitate precision agricultural management to secure food and bioenergy production.

54 ENVIRONMENTAL SCIENCES↗

Excipient screening by lyophilization provides insights into spray drying formulations for nanoparticle vaccines

Nanoparticles have shown great promise as delivery platforms in the development of tunable and safe vaccines. Nanolipoprotein particles (NLPs), also known as nanodiscs, are discoidal nanoparticles composed of a lipid bilayer stabilized at their periphery by apolipoproteins. Under the right conditions, the NLP self-assembly process is highly customizable in terms of lipids and apolipoprotein constituents, allowing for tunable physical and chemical characteristics. This flexibility allows a wide range of vaccine antigens and adjuvants to be incorporated onto the NLP platform for tailored vaccine design. The stability of NLPs during long term storage is a very important factor in developing a vaccine delivery platform suitable for widespread global use. When stored in a solution for extended periods of time, NLPs dissociate into their corresponding lipids and protein constituents, leading to particle degradation. Proper stabilization of NLPs can often be achieved by lyophilization (i.e. freeze-drying), a method widely used for various applications including pharmaceuticals. This process, however, can be damaging to particles without the presence of lyoprotectants or excipients that help maintain particle stability during lyophilization. Another method used to stabilize vaccines and pharmaceuticals is spray drying, a process that converts liquid formulations into dry powders through controlled heating and airflow. While spray drying is rapid, scalable, and cost-effective, lyophilization is typically a gentler process that better retains biomolecule structure and function. Both processes use excipients for particle stabilization, so lyophilization can be used as a surrogate to test stability of NLPs, to down-select formulations that may withstand the harsher conditions of spray drying. To screen different formulations, NLPs were synthesized and purified to homogeneity by size exclusion chromatography (SEC) and samples were prepared with a wide range of lyoprotectants and/or excipients. To assess the protective effects of excipients on NLPs upon spray drying, both pre- and post-lyophilized samples were analyzed by SEC. To assess the protective effects upon heating (encountered during the spray drying process), NLP samples were incubated at elevated temperatures prior to SEC analysis. The lyoprotectants and excipients evaluated in this study had different efficiencies in protecting NLPs during lyophilization and heating tests. Trehalose, for example, exhibits stabilization on NLPs both upon lyophilization and heating whereas leucine accelerated NLP dissociation. Although some lyoprotectants are effective by themselves, different combinations can decrease the stabilization of NLPs. Shelf-stable vaccines that do not require cold-chain storage are essential for global accessibility and our findings provide fundamental insight into how to advance NLP-based vaccines for these applications.

Serrano, Litzay J [Lawrence Livermore National Lab↗

Application of machine learning interatomic potentials in heterogeneous catalysis

Heterogeneous catalysts are crucial in modern societies as they promote sustainability by enabling lower-energy pathways for various chemical reactions. While Density Functional Theory (DFT) computations can provide critical insights into how heterogeneous catalysts operate at the atomic level, they are limited by computational costs and unfavorable scaling with system size. Recently, machine learning interatomic potentials (MLIPs) have emerged as a promising alternative to DFT, offering near-DFT accuracy at significantly reduced cost. Here, in this perspective, we discuss the application of MLIPs in heterogeneous catalyst modeling as a surrogate for DFT. We detail how MLIPs have been applied in thermal catalysis to probe active sites, enable studying complex metallic and nanoporous catalysts, and investigate the reconstruction of catalytic surfaces. We review the use of MLIPs in electrocatalysis and photocatalysis, emphasizing their capabilities in studying transition metal oxide surfaces and solid–liquid interfaces. We also discuss the current limitations of MLIPs, particularly their challenges with transferability and description of non-local interactions. Finally, we conclude by identifying promising and underexplored domains in which MLIPs can further advance our understanding of heterogeneous catalysts.

Catalytic surfaces↗

Optimum concentration of fly ash nanoparticles to stabilize CO 2 foams for aquifer and soil remediation

Contamination caused by non-aqueous phase liquids (NAPLs) in aquifers and soil is an important challenge that requires effective remediation techniques. One potential approach is through the use of CO 2 foams to displace NAPLs from permeable media. CO 2 foams generated only by surfactants are not stable enough for the efficient removal of NAPLs contamination. This shortcoming may be alleviated via the use of nanoparticles (NPs)-surfactant mixtures as a stabilizing agent. This work focuses on the evaluation of the optimum concentration of fly ash nanoparticles for stabilizing CO 2 foam with the combined action of the surfactant. The performance of this foam is evaluated in remediating a contaminated 41 mm × 36 mm surrogate permeable medium in a microfluidic device. Mixtures of fly ash, a by-product of coal-burning power plants, and alpha-olefin sulfonate (AOS) and lauramidopropyl betaine (LAPB) surfactants are used to generate stable foams. The results show that a 1000 mg/L AOS-LAPB surfactant solution along with 1000 mg/L of fly ash NPs produces the best performance. Formation of deposits in the matrix is observed. These deposits, which are more prominent at higher NP concentrations, appear to adversely affect displacement, displacement efficiency and remediation of the medium. This study demonstrates that using fly ash nanoparticles and optimizing their concentration can effectively stabilize CO 2 foams and improve the displacement efficiency for aquifer and soil remediation.

54 ENVIRONMENTAL SCIENCES↗

A weighted Shifted Boundary Method for free surface flow problems

The Shifted Boundary Method (SBM) belongs to the class of unfitted (or immersed, or embedded) finite element methods and was recently introduced for the Poisson, linear advection/diffusion, Stokes, Navier-Stokes, acoustics, and shallow-water equations. By reformulating the original boundary value problem over a surrogate (approximate) computational domain, the SBM avoids integration over cut cells and the associated problematic issues regarding numerical stability and matrix conditioning. Accuracy is maintained by modifying the original boundary conditions using Taylor expansions. Hence the name of the method, that shifts the location and values of the boundary conditions. In this article, we extend the SBM to the simulation of incompressible Navier-Stokes flows with moving free-surfaces, by appropriately weighting its variational form with the elemental volume fraction of active fluid. This approach prevents spurious pressure oscillations in time, which would otherwise be produced if the total active fluid volume were to change abruptly over a time step. In fact, the proposed weighted SBM method induces small mass (i.e., volume) conservation errors, which converge quadratically in the case of piecewise-linear finite element interpolations, as the grid is refined. Finally, we present an extensive set of two- and three-dimensional tests to demonstrate the robustness and accuracy of the method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Feasibility of DEIM for retrieving the initial field via dimensionality reduction

When parameter estimation is solved in a high-dimensional space, the dimensionality reduction strategy becomes the primary consideration for alleviating the tremendous computational cost. Here, the discrete empirical interpolation method (DEIM) is explored to retrieve the initial condition (IC) by combining the polynomial chaos (PC) based ensemble Kalman filter (i.e. PC-EnKF), where a non-intrusive PC expansion is considered as a surrogate model in place of the forward model in the prediction step of the ensemble Kalman filter, resulting in fewer forward model integrations but with a comparable accuracy as Monte Carlo-based approaches. The DEIM acts as a hyper-reduction tool to provide the low-dimensional input for the high-dimensional initial field, which can be reconstructed using the information on the sparse interpolation grid points that is adaptively obtained through PC-EnKF data assimilation method. Thus an innovative framework to reconstruct the IC is developed. The detailed procedure at each assimilation iteration includes: the determination of the spatial interpolation points, the estimation of the initial values on the interpolation locations using the optimal observations, and the reconstruction of IC in the full space. The current study uses the reconstruction field of initial conditions of the Navier-Stokes equations as an example to illustrate the efficacy of our method. The experimental results demonstrate the proposed algorithm achieves a satisfactory reconstruction for the initial field. The proposed method helps to extend the applicable area of DEIM in solving inverse problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Neural-network learning of SPOD latent dynamics

Here, we aim to reconstruct the latent space dynamics of high dimensional, quasi-stationary systems using model order reduction via the spectral proper orthogonal decomposition (SPOD). The proposed method is based on three fundamental steps: in the first, once that the mean flow field has been subtracted from the realizations (also referred to as snapshots), we compress the data from a high-dimensional representation to a lower dimensional one by constructing the SPOD latent space; in the second, we build the time-dependent coefficients by projecting the snapshots containing the fluctuations onto the SPOD basis and we learn their evolution in time with the aid of recurrent neural networks; in the third, we reconstruct the high-dimensional data from the learnt lower -dimensional representation. The proposed method is demonstrated on two different test cases, namely, a compressible jet flow, and a geophysical problem known as the Madden-Julian Oscillation. An extensive comparison between SPOD and the equivalent POD-based counterpart is provided and differences between the two approaches are highlighted. The numerical results suggest that the proposed model is able to provide low rank predictions of complex statistically stationary data and to provide insights into the evolution of phenomena characterized by specific range of frequencies. The comparison between POD and SPOD surrogate strategies highlights the need for further work on the characterization of the interplay of error between data reduction techniques and neural network forecasts.

97 MATHEMATICS AND COMPUTING↗

Goal-oriented a-posteriori estimation of model error as an aid to parameter estimation

In this work, a Bayesian model calibration framework is presented that utilizes goal-oriented a-posterior error estimates in quantities of interest (QoIs) for classes of high-fidelity models characterized by PDEs. It is shown that for a large class of computational models, it is possible to develop a computationally inexpensive procedure for calibrating parameters of high-fidelity models of physical events when the parameters of low-fidelity (surrogate) models are known with acceptable accuracy. The main ingredients in the proposed model calibration scheme are goal-oriented a-posteriori estimates of error in QoIs computed using a so-called lower fidelity model compared to those of an uncalibrated higher fidelity model. The estimates of error in QoIs are used to define likelihood functions in Bayesian inversion analysis. A standard Bayesian approach is employed to compute the posterior distribution of model parameters of high-fidelity models. As applications, parameters in a quasi-linear second-order elliptic boundary-value problem (BVP) are calibrated using a second-order linear elliptic BVP. In a second application, parameters of a tumor growth model involving nonlinear time-dependent PDEs are calibrated using a lower fidelity linear tumor growth model with known parameter values.

A-posterior estimates↗

CAMERA: A method for cost-aware, adaptive, multifidelity, efficient reliability analysis

Estimating probability of failure in aerospace systems is a critical requirement for flight certification and qualification. Failure probability estimation involves resolving tails of probability distributions, and Monte Carlo sampling methods are intractable when expensive high-fidelity simulations have to be queried. Here, we propose a method to use models of multiple fidelities that trade accuracy for computational efficiency. Specifically, we propose the use of multifidelity Gaussian process models to efficiently fuse models at multiple fidelity, thereby offering a cheap surrogate model that emulates the original model at all fidelities. Furthermore, we propose a novel sequential acquisition function based experiment design framework that can automatically select samples from appropriate fidelity models to make predictions about quantities of interest at the highest fidelity. We use our proposed approach in an importance sampling setting and demonstrate our method on the failure level set and probability estimation on synthetic test functions and two real-world applications, namely, the reliability analysis of a gas turbine engine blade using a finite element method and a transonic aerodynamic wing test case using Reynolds-averaged Navier-Stokes equations. We show that our method predicts the failure boundary and probability more accurately and at a fraction of the computational cost compared with using just a single expensive high-fidelity model. Finally, we show that our sequential approach is guaranteed to asymptotically converge to the true failure boundary with high probability.

97 MATHEMATICS AND COMPUTING↗

Robust second-order approximation of the compressible Euler equations with an arbitrary equation of state

Here, this paper is concerned with the approximation of the compressible Euler equations supplemented with an arbitrary or tabulated equation of state. The proposed approximation technique is robust, formally second-order accurate in space, invariant-domain preserving, and works for every equation of state, tabulated or analytic, provided the pressure is nonnegative. An entropy surrogate functional that grows across shocks is proposed. The numerical method is verified with novel analytical solutions and then validated with several computational benchmarks seen in the literature including problems with composite waves.

97 MATHEMATICS AND COMPUTING↗

DRIPS: A framework for dimension reduction and interpolation in parameter space

Reduced-order models are often used to describe the behavior of complex systems, whose simulation with a full model is too expensive, or to extract salient features from the full model’s output. We introduce a new model-reduction framework DRIPS (dimension reduction and interpolation in parameter space) that combines the offline local model reduction with the online parameter interpolation of reduced-order bases (ROBs). The offline step of this framework relies on dynamic mode decomposition (DMD) to build a low-rank linear surrogate model, equipped with a local ROB, for quantities of interest derived from the training data generated by repeatedly solving the (nonlinear) high-fidelity model for multiple parameter points. The online step consists of the construction of a parametric reduced-order model for each target/test point in the parameter space, with the interpolation of ROBs done on a Grassman manifold and the interpolation of reduced-order operators done on a matrix manifold. The DMD component enables DRIPS to model (typically low-dimensional) quantities of interest directly, without having to access the (typically high-dimensional and possibly nonlinear) operators in a high-fidelity model that governs the dynamics of the underlying high-dimensional state variables, as required in projection-based reduced-order modeling. A series of numerical experiments suggests that DRIPS yields a model reduction, which is computationally more efficient than the commonly used projection-based proper orthogonal decomposition; it does so without requiring a prior knowledge of the governing equation for quantities of interest. Furthermore, for the nonlinear systems considered, DRIPS is more accurate than Gaussian-process interpolation (Kriging).

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗