Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “gaussian process regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Rate constants for fine-structure excitations in O-H collisions with error bars obtained by machine learning

We present an approach using a combination of coupled channel scattering calculations with a machine-learning technique based on Gaussian Process regression to determine the sensitivity of the rate constants for non-adiabatic transitions in inelastic atomic collisions to variations of the underlying adiabatic interaction potentials. Using this approach, we improve the previous computations of the rate constants for the fine-structure transitions in collisions of O({sup 3}P{sub j}) with atomic H. We compute the error bars of the rate constants corresponding to 20% variations of the ab initio potentials and show that this method can be used to determine which of the individual adiabatic potentials are more or less important for the outcome of different fine-structure changing collisions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

What's inside the cone? Numerically reconstructing the metric from observations

We investigate the possibility of using Gaussian process regression to smooth data on the current past null-cone for use as the input to a relativistic integration scheme. The algorithm we present is designed to reconstruct the metric of spacetime within the class of spherically symmetric dust universes, with or without a cosmological constant. Assuming that gravity is well described by General Relativity, we demonstrate how the algorithm can be employed to test the Copernican principle based on currently available observations. It is shown that currently available data is not sufficient for a conclusive result. The intrinsic noise present in realistic data presents a challenge for our smoothing algorithm and we discuss some of its limitations as well as possible extensions to it. We conclude by demonstrating how a direct determination of the cosmological constant is possible using redshift drift data.

79 ASTRONOMY AND ASTROPHYSICS↗

Conditional Karhunen–Loève regression model with Basis Adaptation for high-dimensional problems: Uncertainty quantification and inverse modeling

Here, we propose a methodology for improving the accuracy of surrogate models of the observable response of physical systems as a function of the systems’ spatially heterogeneous parameter fields, with applications to uncertainty quantification and parameter estimation in high-dimensional problems. Practitioners often formulate finite-dimensional representations of spatially heterogeneous parameter fields using truncated unconditional Karhunen–Loève expansions (KLEs) for a certain choice of unconditional covariance kernel and construct surrogate models of the observable response with respect to the KLE coefficients. When direct measurements of the parameter fields are available, we propose improving the accuracy of these surrogate models by representing the parameter fields via conditional Karhunen-Loève expansions (CKLEs). CKLEs are constructed by conditioning the covariance kernel of the unconditional expansion on the direct measurements of the parameter field via Gaussian process regression, and then truncating the corresponding KLE. We apply the proposed methodology to constructing surrogate models via the Basis Adaptation (BA) method of the stationary hydraulic head response, measured at spatially discrete observation locations, of a groundwater flow model of the Hanford Site, as a function of the 1000-dimensional representation of the model’s log-transmissivity field. We find that BA surrogate models of the hydraulic head based on CKLEs are more accurate than BA surrogate models based on unconditional expansions for forward uncertainty quantification tasks. Furthermore, we find that inverse estimates of the hydraulic transmissivity field computed using CKLE-based BA surrogate models are more accurate than those computed using unconditional BA surrogate models.

97 MATHEMATICS AND COMPUTING↗

Uncertainty quantification in multivariable regression for material property prediction with Bayesian neural networks

With the increased use of data-driven approaches and machine learning-based methods in material science, the importance of reliable uncertainty quantification (UQ) of the predicted variables for informed decision-making cannot be overstated. UQ in material property prediction poses unique challenges, including multi-scale and multi-physics nature of materials, intricate interactions between numerous factors, limited availability of large curated datasets, etc. In this work, we introduce a physics-informed Bayesian Neural Networks (BNNs) approach for UQ, which integrates knowledge from governing laws in materials to guide the models toward physically consistent predictions. To evaluate the approach, we present case studies for predicting the creep rupture life of steel alloys. Experimental validation with three datasets of creep tests demonstrates that this method produces point predictions and uncertainty estimations that are competitive or exceed the performance of conventional UQ methods such as Gaussian Process Regression. Additionally, we evaluate the suitability of employing UQ in an active learning scenario and report competitive performance. The most promising framework for creep life prediction is BNNs based on Markov Chain Monte Carlo approximation of the posterior distribution of network parameters, as it provided more reliable results in comparison to BNNs based on variational inference approximation or related NNs with probabilistic outputs.

36 MATERIALS SCIENCE↗

Thinking Bayesian for plasma physicists

Bayesian statistics offers a powerful technique for plasma physicists to infer knowledge from the heterogeneous data types encountered. To explain this power, a simple example, Gaussian Process Regression, and the application of Bayesian statistics to inverse problems are explained. The likelihood is the key distribution because it contains the data model, or theoretic predictions, of the desired quantities. By using prior knowledge, the distribution of the inferred quantities of interest based on the data given can be inferred. Because it is a distribution of inferred quantities given the data and not a single prediction, uncertainty quantification is a natural consequence of Bayesian statistics. The benefits of machine learning in developing surrogate models for solving inverse problems are discussed, as well as progress in quantitatively understanding the errors that such a model introduces.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Time-series forecasting using manifold learning, radial basis function interpolation, and geometric harmonics

We address a three-tier numerical framework based on nonlinear manifold learning for the forecasting of high-dimensional time series, relaxing the “curse of dimensionality” related to the training phase of surrogate/machine learning models. At the first step, we embed the high-dimensional time series into a reduced low-dimensional space using nonlinear manifold learning (local linear embedding and parsimonious diffusion maps). Then, we construct reduced-order surrogate models on the manifold (here, for our illustrations, we used multivariate autoregressive and Gaussian process regression models) to forecast the embedded dynamics. Finally, we solve the pre-image problem, thus lifting the embedded time series back to the original high-dimensional space using radial basis function interpolation and geometric harmonics. The proposed numerical data-driven scheme can also be applied as a reduced-order model procedure for the numerical solution/propagation of the (transient) dynamics of partial differential equations (PDEs). In conclusion, we assess the performance of the proposed scheme via three different families of problems: (a) the forecasting of synthetic time series generated by three simplistic linear and weakly nonlinear stochastic models resembling electroencephalography signals, (b) the prediction/propagation of the solution profiles of a linear parabolic PDE and the Brusselator model (a set of two nonlinear parabolic PDEs), and (c) the forecasting of a real-world data set containing daily time series of ten key foreign exchange rates spanning the time period 3 September 2001–29 October 2020.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Gaussian processes with built-in dimensionality reduction: Applications to high-dimensional uncertainty propagation

Uncertainty quantification (UQ) tasks, such as model calibration, uncertainty propagation, and optimization under uncertainty, typically require several thousand evaluations of the underlying computer codes. To cope with the cost of simulations, one replaces the real response surface with a cheap surrogate based, e.g., on polynomial chaos expansions, neural networks, support vector machines, or Gaussian processes (GP). However, the number of simulations required to learn a generic multivariate response grows exponentially as the input dimension increases. This curse of dimensionality can only be addressed, if the response exhibits some special structure that can be discovered and exploited. A wide range of physical responses exhibit a special structure known as an active subspace (AS). An AS is a linear manifold of the stochastic space characterized by maximal response variation. The idea is that one should first identify this low dimensional manifold, project the high-dimensional input onto it, and then link the projection to the output. If the dimensionality of the AS is low enough, then learning the link function is a much easier problem than the original problem of learning a high-dimensional function. The classic approach to discovering the AS requires gradient information, a fact that severely limits its applicability. Furthermore, and partly because of its reliance to gradients, it is not able to handle noisy observations. The latter is an essential trait if one wants to be able to propagate uncertainty through stochastic simulators, e.g., through molecular dynamics codes. In this work, we develop a probabilistic version of AS which is gradient-free and robust to observational noise. Our approach relies on a novel Gaussian process regression with built-in dimensionality reduction. In particular, the AS is represented as an orthogonal projection matrix that serves as yet another covariance function hyper-parameter to be estimated from the data. To train the model, we design a two-step maximum likelihood optimization procedure that ensures the orthogonality of the projection matrix by exploiting recent results on the Stiefel manifold, i.e., the manifold of matrices with orthogonal columns. The additional benefit of our probabilistic formulation, is that it allows us to select the dimensionality of the AS via the Bayesian information criterion. We validate our approach by showing that it can discover the right AS in synthetic examples without gradient information using both noiseless and noisy observations. We demonstrate that our method is able to discover the same AS as the classical approach in a challenging one-hundred-dimensional problem involving an elliptic stochastic partial differential equation with random conductivity. Finally, we use our approach to study the effect of geometric and material uncertainties in the propagation of solitary waves in a one dimensional granular system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Taming nuclear mass models with Gaussian processes

We propose a new set of nuclear mass predictions based on multiple theoretical mass models. By employing Gaussian process regression with the Matérn kernel, we achieved root-mean-square (rms) deviations below 100 keV for the training dataset. The best-performing mass models achieved rms deviations below 150 keV for the new precise mass data from AME2020, whereas the ensemble average showed robust performance across the nuclear chart. Our approach uniquely combines: (1) systematic refinement of eight mass models through their residuals, (2) physics-informed features, including magic numbers, nucleon parity numbers, neutron excess, and nuclear collectivity, and (3) theory-to-theory validation demonstrating robust extrapolation capability. We find that the Matérn kernel provides superior uncertainty quantification compared to the RBF kernel, with a length-scale analysis revealing enhanced inter-nuclei correlations. We provide complete mass predictions for all unknown nuclides in AME2020, offering valuable constraints for nuclear structure studies and astrophysical modeling when used with proper uncertainty propagation.

Gaussian processes↗

Wavelength Dependence of Activity-induced Photometric Variations for Young Cool Stars in Hyades

We investigate photometric variations due to stellar activity that induce systematic radial-velocity errors (so-called “jitter”) for the four targets in the Hyades open cluster observed by the K2 mission (EPIC 210721261, EPIC 210923016, EPIC 247122957, and EPIC 247783757). Applying Gaussian process regressions to the K2 light curves and the near-infrared (NIR) light curves observed with the IRSF 1.4 m telescope, we derive the wavelength dependences of the photometric signals due to stellar activity. To estimate the temporal variations in the photometric variability amplitudes between the two observation periods of K2 and IRSF, separated by more than 2 yr, we analyze a number of K2 targets in Hyades that have also been observed in Campaigns 4 and 13 and find a representative variation rate over 2 yr of 38% ± 71%. Taking this temporal variation into account, we constrain projected sizes and temperature contrast properties of the starspots in the stellar photosphere to be approximately 10% and 0.95%, respectively. These starspot properties can induce relatively large differences in the variability amplitude over different observational passbands, and we find that radial-velocity jitter may be more suppressed in the NIR than previously expected. Our result supports profits of ongoing exoplanet search projects that are attempting to detect or confirm young planets in open clusters via radial-velocity measurements in the NIR.

47 OTHER INSTRUMENTATION↗

Optical Transmission Spectroscopy of the Terrestrial Exoplanet LHS 3844b from 13 Ground-based Transit Observations

Atmospheric studies of spectroscopically accessible terrestrial exoplanets lay the groundwork for comparative planetology between these worlds and the solar system terrestrial planets. LHS 3844b is a highly irradiated terrestrial exoplanet (R = 1.303 ± 0.022R {sub ⊕}) orbiting a mid-M dwarf 15 parsecs away. Work based on near-infrared Spitzer phase curves ruled out atmospheres with surface pressures ≥10 bars on this planet. We present 13 transit observations of LHS 3844b taken with the Magellan Clay telescope and the LDSS3C multi-object spectrograph covering 620–1020 nm. We analyze each of the 13 data sets individually using a Gaussian process regression, and present both white and spectroscopic light curves. In the combined white light curve we achieve an rms precision of 65 ppm when binning to 10 minutes. The mean white light-curve value of (R {sub p}/R {sub s}){sup 2} is 0.4170 ± 0.0046%. To construct the transmission spectrum, we split the white light curves into 20 spectrophotometric bands, each spanning 20 nm, and compute the mean values of (R {sub p}/R {sub s}){sup 2} in each band. We compare the transmission spectrum to two sets of atmospheric models. We disfavor a clear, solar composition atmosphere (μ = 2.34) with surface pressures ≥0.1 bar to 5.2σ confidence. We disfavor a clear, H{sub 2}O steam atmosphere (μ = 18) with surface pressures ≥0.1 bar to low confidence (2.9σ). Our observed transmission spectrum favors a flat line. For solar composition atmospheres with surface pressures ≥1 bar we rule out clouds with cloud-top pressures of 0.1 bar (5.3σ), but we cannot address high-altitude clouds at lower pressures. Our results add further evidence that LHS 3844b is devoid of an atmosphere.

79 ASTRONOMY AND ASTROPHYSICS↗

Predicting molecular dipole moments by combining atomic partial charges and atomic dipoles

The molecular dipole moment ( μ ) is a central quantity in chemistry. It is essential in predicting infrared and sum-frequency generation spectra as well as induction and long-range electrostatic interactions. Furthermore, it can be extracted directly—via the ground state electron density—from high-level quantum mechanical calculations, making it an ideal target for machine learning (ML). Here, we choose to represent this quantity with a physically inspired ML model that captures two distinct physical effects: local atomic polarization is captured within the symmetry-adapted Gaussian process regression framework which assigns a (vector) dipole moment to each atom, while the movement of charge across the entire molecule is captured by assigning a partial (scalar) charge to each atom. The resulting “MuML” models are fitted together to reproduce molecular μ computed using high-level coupled-cluster theory and density functional theory (DFT) on the QM7b dataset, achieving more accurate results due to the physics-based combination of these complementary terms. The combined model shows excellent transferability when applied to a showcase dataset of larger and more complex molecules, approaching the accuracy of DFT at a small fraction of the computational cost. We also demonstrate that the uncertainty in the predictions can be estimated reliably using a calibrated committee model. The ultimate performance of the models—and the optimal weighting of their combination—depends, however, on the details of the system at hand, with the scalar model being clearly superior when describing large molecules whose dipole is almost entirely generated by charge separation. These observations point to the importance of simultaneously accounting for the local and non-local effects that contribute to μ ; furthermore, they define a challenging task to benchmark future models, particularly those aimed at the description of condensed phases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NEAR-INFRARED EMISSION SPECTRUM OF WASP-103B USING HUBBLE SPACE TELESCOPE/WIDE FIELD CAMERA 3

We present here our observations and analysis of the dayside emission spectrum of the hot Jupiter WASP-103b. We observed WASP-103b during secondary eclipse using two visits of the Hubble Space Telescope with the G141 grism on Wide Field Camera 3 in spatial scan mode. We generated secondary eclipse light curves of the planet in both blended white-light and spectrally binned wavechannels from 1.1 to 1.7 μm and corrected the light curves for flux contamination from a nearby companion star. We modeled the detector systematics and secondary eclipse spectrum using Gaussian process regression and found that the near-IR emission spectrum of WASP-103b is featureless across the observed near-IR region to down to a sensitivity of 175 ppm, and shows a shallow slope toward the red. The atmosphere has a single brightness temperature of T{sub B}=2890 K across this wavelength range. This region of the spectrum is indistinguishable from isothermal, but may not manifest from a physically isothermal system, i.e., pseudo-isothermal. A solar-metallicity profile with a thermal inversion layer at 10{sup −2} bar fits the spectrum of WASP-103b with high confidence, as do an isothermal profile with solar metallicity and a monotonically decreasing atmosphere with C/O > 1. The data rule out a monotonically decreasing atmospheric profile with solar composition, and we rule out a low-metallicity decreasing profile as unphysical for this system. The pseudo-isothermal profile could be explained by a thermal inversion layer just above the layer probed by our observations, or by clouds or haze in the upper atmosphere. Transmission spectra at optical wavelengths would allow us to better distinguish between potential atmospheric models.

79 ASTRONOMY AND ASTROPHYSICS↗

An overview of uncertainty quantification techniques with application to oceanic and oil‐spill simulations

Abstract We give an overview of four different ensemble‐based techniques for uncertainty quantification and illustrate their application in the context of oil plume simulations. These techniques share the common paradigm of constructing a model proxy that efficiently captures the functional dependence of the model output on uncertain model inputs. This proxy is then used to explore the space of uncertain inputs using a large number of samples, so that reliable estimates of the model's output statistics can be calculated. Three of these techniques use polynomial chaos (PC) expansions to construct the model proxy, but they differ in their approach to determining the expansions' coefficients; the fourth technique uses Gaussian Process Regression (GPR). An integral plume model for simulating the Deepwater Horizon oil‐gas blowout provides examples for illustrating the different techniques. A Monte Carlo ensemble of 50,000 model simulations is used for gauging the performance of the different proxies. The examples illustrate how regression‐based techniques can outperform projection‐based techniques when the model output is noisy. They also demonstrate that robust uncertainty analysis can be performed at a fraction of the cost of the Monte Carlo calculation.

Iskandarani, Mohamed↗

Hybrid Data‐Driven Discovery of High‐Performance Silver Selenide‐Based Thermoelectric Composites

Optimizing material compositions often enhances thermoelectric performances. However, the large selection of possible base elements and dopants results in a vast composition design space that is too large to systematically search using solely domain knowledge. To address this challenge, a hybrid data-driven strategy that integrates Bayesian optimization (BO) and Gaussian process regression (GPR) is proposed to optimize the composition of five elements (Ag, Se, S, Cu, and Te) in AgSe-based thermoelectric materials. Data is collected from the literature to provide prior knowledge for the initial GPR model, which is updated by actively collected experimental data during the iteration between BO and experiments. Within seven iterations, the optimized AgSe-based materials prepared using a simple high-throughput ink mixing and blade coating method deliver a high power factor of 2100 µW m −1 K −2 , which is a 75% improvement from the baseline composite (nominal composition of Ag 2 Se 1 ). In conclusion, the success of this study provides opportunities to generalize the demonstrated active machine learning technique to accelerate the development and optimization of a wide range of material systems with reduced experimental trials.

36 MATERIALS SCIENCE↗

A Comprehensive Comparative Study of Active Learning Schemes for Nanophotonics Design

We present a benchmarking study of active learning (AL) schemes for designing planar multilayer nanophotonic metamaterials, where the design tasks are formulated as binary optimization problems. Different surrogate models, including factorization machine (FM), Gaussian process regression (GPR), and convolutional neural network (CNN), combined with different optimization methods, including exhaustive enumeration, discrete particle swarm optimization (DPSO), quantum annealing (QA), hybrid QA, and simulated annealing are studied. The benchmark cases investigated range from small problems with short binary lengths (N = 25) to large problems with N up to 100, focusing on the design of two classes of photonic structures, including antireflective coatings for the long-wavelength infrared region and transparent radiative coolers. For small problems, CNN coupled with DPSO in AL achieves the best performance. As N increases, FM with QA outperforms GPR and CNN. For FM-based AL, hybrid QA yields the best optimization results, particularly in high-dimensional cases (N = 100). These results demonstrate that the optimization method can significantly affect in AL performance as N increases, and that QA-based optimization can provide practical routes for mitigating the optimization bottleneck in high-dimensional problems.

Jung, Serang [Kyung Hee University, Korea]↗

Data‐Driven Engineering of Thermostable Collagen‐Mimetic Peptoid Triple Helices

Collagen-mimetic peptides (CMPs) are engineered molecules designed to replicate the triple-helical structure of natural collagen. A repeating x–y-Gly sequence is the defining motif of CMPs and is critical to their triple-helical structure and stability. Substitutions to the residues occupying the x and y positions present a means to modulate the CMP structure and properties. Peptoid residues—N-substituted glycine derivatives—present an attractive potential substitution due to their thermal stability, proteolytic resistance, biocompatibility, and diverse palette of non-natural side chains, but also tend to introduce a high degree of backbone flexibility that can diminish the stability of the triple helix. In this work, we report a computational active learning cycle comprising molecular dynamics simulation, Gaussian process regression, and Bayesian optimization to computationally identify a number of promising peptoid substitutions predicted to stabilize the desired quaternary structure through side chain interactions and produce stable peptoid-based collagen-like triple helices. To experimentally test the computational predictions, a top candidate identified by the screen was synthesized and imaged using scanning electron microscopy to resolve fibril-like bundles consistent with collagen-like triple helices. This work predicts a number of CMP peptoid substitutions capable of forming stable triple-helical structures, presents a generalizable design strategy for engineering desired peptoid structures, and opens new avenues for the design of peptoid-based biomimetic materials.

active learning↗

Autonomous Synthesis of Thin Film Materials with Pulsed Laser Deposition Enabled by In Situ Spectroscopy and Automation

Autonomous systems that combine synthesis, characterization, and artificial intelligence can greatly accelerate the discovery and optimization of materials, however platforms for growth of macroscale thin films by physical vapor deposition techniques have lagged far behind others. Here this study demonstrates autonomous synthesis by pulsed laser deposition (PLD), a highly versatile synthesis technique, in the growth of ultrathin WSe 2 films. Further, by combing the automation of PLD synthesis and in situ diagnostic feedback with a high-throughput methodology, this study demonstrates a workflow and platform which uses Gaussian process regression and Bayesian optimization to autonomously identify growth regimes for WSe 2 films based on Raman spectral criteria by efficiently sampling 0.25% of the chosen 4D parameter space. With throughputs at least 10x faster than traditional PLD workflows, this platform and workflow enables the accelerated discovery and autonomous optimization of the vast number of materials that can be synthesized by PLD.

36 MATERIALS SCIENCE↗

Search for the associated production of charm quarks and a Higgs boson decaying into a photon pair with the ATLAS detector

A search for the production of a Higgs boson and one or more charm quarks, in which the Higgs boson decays into a photon pair, is presented. This search uses proton-proton collision data with a centre-of-mass energy of $\sqrt{s}$ = 13 TeV and an integrated luminosity of 140 fb −1 recorded by the ATLAS detector at the Large Hadron Collider. The analysis relies on the identification of charm-quark-containing jets, and adopts an approach based on Gaussian process regression to model the non-resonant di-photon background. The observed (expected, assuming the Standard Model signal) upper limit at the 95% confidence level on the cross-section for producing a Higgs boson and at least one charm-quark-containing jet that passes a fiducial selection is found to be 10.6 pb (8.8 pb). The observed (expected) measured cross-section for this process is 5.3 ± 3.2 pb (2.9 ± 3.1 pb).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗