Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Gaussian Process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Bayesian batch optimization for molybdenum versus tungsten inertial confinement fusion double shell target design

Access to reliable, clean energy sources is a major concern for national security. Much research is focused on the “grand challenge” of producing energy via controlled fusion reactions in a laboratory setting. For fusion experiments, specifically inertial confinement fusion (ICF), to produce sufficient energy, the fusion reactions in the ICF fuel need to become self-sustaining and burn deuterium-tritium (DT) fuel efficiently. The recent record-breaking NIF ignition shot was able to achieve this goal as well as produce more energy than used to drive the experiment. This achievement brings self-sustaining fusion-based power systems closer than ever before, capable of providing humans with access to secure, renewable energy. In order to further progress toward the actualization of such power systems, more ICF experiments need to be conducted at large laser facilities such as the United States's National Ignition Facility (NIF) or France's Laser Mega-Joule. The high cost per shot and limited number of shots that are possible per year make it prohibitive to perform large numbers of experiments. As such, experimental design relies heavily on complex predictive physics simulations for high-fidelity “preshot” analysis. These multidimensional, multi-physics, high-fidelity simulations have to account for a variety of input parameters as well as modeling the extreme conditions (pressures and densities) present at ignition. Such simulations (especially in 3D) can become computationally prohibitive to turn around for each ICF experiment. In this work, we explore using Bayesian optimization with Gaussian processes (GPs) to find optimal designs for ICF double shell targets, while keeping computational costs to manageable levels. These double shell targets have an inner shell that grades from beryllium on the outer surface to the higher Z material molybdenum, as opposed to the nominally used tungsten, on the inside in order to trade off between the high performance associated with high density inner shells and capsule stability. We describe our results for “capsule-only” xRAGE simulations to study the physics between different capsule designs, inner shell materials, and potential for future experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Exoplanet population inference and the abundance of Earth analogs from noisy, incomplete catalogs

No true extrasolar Earth analog is known. Hundreds of planets have been found around Sun-like stars that are either Earth-sized but on shorter periods, or else on year-long orbits but somewhat larger. Under strong assumptions, exoplanet catalogs have been used to make an extrapolated estimate of the rate at which Sun-like stars host Earth analogs. These studies are complicated by the fact that every catalog is censored by non-trivial selection effects and detection efficiencies, and every property (period, radius, etc.) is measured noisily. Here we present a general hierarchical probabilistic framework for making justified inferences about the population of exoplanets, taking into account survey completeness and, for the first time, observational uncertainties. We are able to make fewer assumptions about the distribution than previous studies; we only require that the occurrence rate density be a smooth function of period and radius (employing a Gaussian process). By applying our method to synthetic catalogs, we demonstrate that it produces more accurate estimates of the whole population than standard procedures based on weighting by inverse detection efficiency. We apply the method to an existing catalog of small planet candidates around G dwarf stars. We confirm a previous result that the radius distribution changes slope near Earth's radius. We find that the rate density of Earth analogs is about 0.02 (per star per natural logarithmic bin in period and radius) with large uncertainty. This number is much smaller than previous estimates made with the same data but stronger assumptions.

79 ASTRONOMY AND ASTROPHYSICS↗

COMPARISON OF DIVERSITY OF TYPE IIB SUPERNOVAE WITH ASYMMETRY IN CASSIOPEIA A USING LIGHT ECHOES

We compare the diversity of spectral line velocities in a large sample of type IIb supernovae (SNe IIb) with the expected asphericity in the explosion, as measured from the light echoes (LEs) of Cassiopeia A (Cas A), which was a historical galactic SN IIb. We revisit the results of Rest et al., who used LEs to observe Cas A from multiple lines of sight and hence determine its asphericity, as seen in the velocity of three spectral lines (He i λ 5876, H α , and the Ca ii near-infrared (NIR) triplet). We confirm and improve on this measurement by reproducing the effect of the LEs in the spectra of several extragalactic SNe IIb found in the literature as well as mean SN IIb spectra recently created by Liu et al. and comparing these to the observed light echo spectra of Cas A, including their associated uncertainties. In order to quantify the accuracy of this comparison, we smooth the light echo spectra of Cas A using Gaussian processes and use a Monte Carlo method to measure the absorption velocities of these three features in the spectra. We then test the hypothesis that the diversity of ejecta velocities seen in SNe IIb can be explained by asphericity. We do this by comparing the range of velocities seen in the different LEs, and hence different lines of sight, of Cas A to that seen in the population of SNe IIb. We conclude that these two ranges are of the same order and thus asphericity could be enough to explain the diversity in the expansion velocity alone.

79 ASTRONOMY AND ASTROPHYSICS↗

A non-parametric consistency test of the ΛCDM model with Planck CMB data

Non-parametric reconstruction methods, such as Gaussian process (GP) regression, provide a model-independent way of estimating an underlying function and its uncertainty from noisy data. We demonstrate how GP-reconstruction can be used as a consistency test between a given data set and a specific model by looking for structures in the residuals of the data with respect to the model's best-fit. Applying this formalism to the Planck temperature and polarisation power spectrum measurements, we test their global consistency with the predictions of the base ΛCDM model. Our results do not show any serious inconsistencies, lending further support to the interpretation of the base ΛCDM model as cosmology's gold standard.

79 ASTRONOMY AND ASTROPHYSICS↗

Dodging the cosmic curvature to probe the constancy of the speed of light

We develop a new model-independent method to probe the constancy of the speed of light c . In our method, the degeneracy between the cosmic curvature and the speed of light can be eliminated, which makes the test more natural and general. Combining the independent observations of Hubble parameter H ( z ) and luminosity distance d {sub L} ( z ), we use the model-independent smoothing technique, Gaussian processes, to reconstruct them and then detect variation of the speed of light. We find no signal of deviation from the present value of the speed of light c {sub 0}. Moreover, to demonstrate the improvement in probing the constancy of the speed of light from future experiments, we produce a series of simulated data. The Dark Energy Survey will be able to detect Δ c / c {sub 0} ∼ 1% at ∼ 1.5σ confidence level and Δ c / c {sub 0} ∼ 2% at ∼ 3σ confidence level. If the errors are reduced to one-tenth of the expected DES ones, it can detect a Δ c / c {sub 0} ∼ 0.1% variation at ∼ 2σ confidence level.

79 ASTRONOMY AND ASTROPHYSICS↗

Applying Constrained Bayesian Optimization to the Design of Critical Experiments

Often when planning a criticality experiment, many design configurations are iteratively investigated with a Monte Carlo transport code. The goal is that the experiment will be optimal with respect to some variable, like the fraction of fissions occurring at a certain energy range, while simultaneously being critical. Unfortunately, the Monte Carlo transport simulations are expensive, which can ultimately limit the number of configurations that can be explored. In this work, we present how Gaussian processes (GPs) can be used as a reduced-order model in a constrained Bayesian optimization (CBO) algorithm to design a criticality experiment. The GPs replace the Monte Carlo transport simulations that explore the design space. The CBO algorithm efficiently identifies new points in the design space to run the Monte Carlo transport code while respecting the criticality constraint. It does so in a manner that both improves the accuracy of the GP and finds the approximate global optimum. We demonstrate the performance of CBO with the design of a Thermal Epithermal eXperiment (TEX) for the criticality safety validation of nuclear waste models of the Hanford Tank Farm.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Modeling gas–shell mixing in ICF with separated reactants

Mixing between fuel and shell materials in ICF implosions can affect implosion dynamics and even prevent ignition. We use data from a series of separated reactant experiments on the National Ignition Facility to calibrate and test the predictive power of gas–shell mix models. Two models are used to estimate fuel–shell mix: a Reynolds-averaged turbulence model and molecular diffusion. Minor uncertainties in capsule manufacture, experimental conditions, and values for mix model parameters produce significant variation in simulation results. Using input/output pairs from 1D simulations, we train Gaussian process surrogate models to predict experimental quantities of interest. The surrogates are used to construct posteriors for mix model parameters by marginalizing over uncertainties in capsule manufacture and experimental conditions. Mix models are calibrated with a subset of experimental data (neutron yields, ion temperature, and bang time) and tested using the remaining data. In general, both the diffusion and turbulence model correctly predict experimental DT and TT neutron yields. Despite having more free parameters, the turbulence model underpredicts ion temperature at high convergence ratio. Furthermore, the simpler diffusion model correctly predicts these temperatures, suggesting nonhydrodynamic gas–shell mix. The computational model consistently overpredicts DD neutron yield, indicating possible shortcomings outside of the mix model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Infinite neural network quantum states: entanglement and training dynamics

We study infinite limits of neural network quantum states (∞-NNQS), which exhibit representation power through ensemble statistics, and also tractable gradient descent dynamics. Ensemble averages of entanglement entropies are expressed in terms of neural network correlators, and architectures that exhibit volume-law entanglement are presented. The analytic calculations of entanglement entropy bound are tractable because the ensemble statistics are simplified in the Gaussian process limit. A general framework is developed for studying the gradient descent dynamics of neural network quantum states (NNQS), using a quantum state neural tangent kernel (QS-NTK). For ∞-NNQS the training dynamics is simplified, since the QS-NTK becomes deterministic and constant. An analytic solution is derived for quantum state supervised learning, which allows an ∞-NNQS to recover any target wavefunction. Numerical experiments on finite and infinite NNQS in the transverse field Ising model and Fermi Hubbard model demonstrate excellent agreement with theory. ∞-NNQS opens up new opportunities for studying entanglement and training dynamics in other physics applications, such as in finding ground states.

quantum state supervised learning↗

Measuring the speed of light with ultra-compact radio quasars

In this paper, based on a 2.29 GHz VLBI all-sky survey of 613 milliarcsecond ultra-compact radio sources with 0.0035< z <3.787, we describe a method of identifying the sub-sample which can serve as individual standard rulers in cosmology. If the linear size of the compact structure is assumed to depend on source luminosity and redshift as l {sub m} = l L {sup β} (1+ z ) {sup n} , only intermediate-luminosity quasars (10{sup 27} W/Hz< L < 10{sup 28} W/Hz) show negligible dependence (| n |≅ 10{sup −3}, |β|≅ 10{sup −4}), and thus represent a population of such rulers with fixed characteristic length l =11.42 pc. With a sample of 120 such sources covering the redshift range 00.46< z <2.8, we confirm the existence of dark energy in the Universe with high significance under the assumption of a flat universe, and obtain stringent constraints on both the matter density Ω {sub m} =0.323{sup +0.245}{sub −0.145} and the Hubble constant H {sub 0}=66.30{sup +7.00}{sub −8.50} km sec{sup −1} Mpc{sup −1}. Finally, with the angular diameter distances D {sub A} measured for quasars extending to high redshifts (0 z ∼ 3.), we reconstruct the D {sub A} ( z ) function using the technique of Gaussian processes. This allows us to identify the redshift corresponding to the maximum of the D {sub A} ( z ) function: 0 z {sub m} =1.7 and the corresponding angular diameter distance D {sub A} ( z {sub m} )=1719.01±43.46 Mpc. Similar reconstruction of the expansion rate function H ( z ) based on the data from cosmic chronometers and BAO gives us H ( z {sub m} )=176.77±6.11 km sec{sup −1} Mpc{sup −1}. These measurements are used to estimate the speed of light: c =3.039(±0.180)× 10{sup 5} km/s. This is the first measurement of the speed of light in a cosmological setting referring to the distant past.

79 ASTRONOMY AND ASTROPHYSICS↗

Rate constants for fine-structure excitations in O-H collisions with error bars obtained by machine learning

We present an approach using a combination of coupled channel scattering calculations with a machine-learning technique based on Gaussian Process regression to determine the sensitivity of the rate constants for non-adiabatic transitions in inelastic atomic collisions to variations of the underlying adiabatic interaction potentials. Using this approach, we improve the previous computations of the rate constants for the fine-structure transitions in collisions of O({sup 3}P{sub j}) with atomic H. We compute the error bars of the rate constants corresponding to 20% variations of the ab initio potentials and show that this method can be used to determine which of the individual adiabatic potentials are more or less important for the outcome of different fine-structure changing collisions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bayesian Cross-matching of High Proper-motion Stars in Gaia DR2 and Photometric Metallicities for ∼1.7 million K and M Dwarfs

We present a Bayesian method to cross-match 5,827,988 high proper-motion Gaia sources (μ > 40 mas yr{sup −1}) to various photometric surveys: Two Micron All Sky Survey, AllWISE data release from the Wide-field Infrared Explorer (WISE) mission, Galaxy Evolution Explorer, Radial Velocity Experiment, Sloan Digital Sky Survey, and Panoramic Survey Telescope and Rapid Response System (Pan-STARRS). To efficiently associate these objects across catalogs, we develop a technique that compares the multidimensional distribution of all sources in the vicinity of each Gaia star to a reference distribution of random field stars obtained by extracting all sources in a region on the sky displaced 2′. This offset preserves the local field stellar density and magnitude distribution, allowing us to characterize the frequency of chance alignments. The resulting catalog with Bayesian probabilities >95% has a marginally higher match rate than current internal Gaia data release 2 (DR2) matches for most catalogs. However, a significant improvement is found with Pan-STARRS, where ∼99.8% of the sample within the Pan-STARRS footprint is recovered, as compared to a low ∼20.8% in Gaia DR2. Using these results, we train a Gaussian process regressor to calibrate two photometric metallicity relationships. For dwarfs of 3500 < T{sub eff} < 5280 K, we use metallicity values of 4378 stars from the Apache Point Observatory Galactic Evolution Experiment and Hejazi et al. to calibrate the relationship, producing results with a 1σ precision of 0.12 dex and few systematic errors. We then indirectly infer the metallicity of 4018 stars with 2850 < T{sub eff} < 3500 K, which are wide companions of primaries whose metallicities are estimated with our first regressor, to produce a relationship with a 1σ precision of 0.21 dex and significant systematic errors. Additional work is needed to better remove unresolved binaries from this second sample to reduce these systematic errors.

47 OTHER INSTRUMENTATION↗

COSMIC EMULATION: FAST PREDICTIONS FOR THE GALAXY POWER SPECTRUM

The halo occupation distribution (HOD) approach has proven to be an effective method for modeling galaxy clustering and bias. In this approach, galaxies of a given type are probabilistically assigned to individual halos in N-body simulations. In this paper, we present a fast emulator for predicting the fully nonlinear galaxy–galaxy auto and galaxy–dark matter cross power spectrum and correlation function over a range of freely specifiable HOD modeling parameters. The emulator is constructed using results from 100 HOD models run on a large ΛCDM N-body simulation, with Gaussian Process interpolation applied to a PCA-based representation of the galaxy power spectrum. The total error is currently ∼1% in the auto correlations and ∼2% in the cross correlations from z = 1 to z = 0, over the considered parameter range. We use the emulator to investigate the accuracy of various analytic prescriptions for the galaxy power spectrum, parametric dependencies in the HOD model, and the behavior of galaxy bias as a function of HOD parameters. Additionally, we obtain fully nonlinear predictions for tangential shear correlations induced by galaxy–galaxy lensing from our galaxy–dark matter cross power spectrum emulator. All emulation products are publicly available at http://www.hep.anl.gov/cosmology/CosmicEmu/emu.html.

79 ASTRONOMY AND ASTROPHYSICS↗

Scaled Vecchia Approximation for Fast Computer-Model Emulation

Many scientific phenomena are studied using computer experiments consisting of multiple runs of a computer model while varying the input settings. Gaussian processes (GPs) are a popular tool for the analysis of computer experiments, enabling interpolation between input settings, but direct GP inference is computationally infeasible for large datasets. We adapt and extend a powerful class of GP methods from spatial statistics to enable the scalable analysis and emulation of large computer experiments. Specifically, we apply Vecchia’s ordered conditional approximation in a transformed input space, with each input scaled according to how strongly it relates to the computer-model response. The scaling is learned from the data by estimating parameters in the GP covariance function using Fisher scoring. Our methods are highly scalable, enabling estimation, joint prediction, and simulation in near-linear time in the number of model runs. In several numerical examples, our approach substantially outperformed existing methods.

97 MATHEMATICS AND COMPUTING↗

Multi-objective Bayesian optimization of ferroelectric materials with interfacial control for memory and energy storage applications

Optimization of materials’ performance for specific applications often requires balancing multiple aspects of materials’ functionality. Even for the cases where a generative physical model of material behavior is known and reliable, this often requires search over multidimensional function space to identify low-dimensional manifold corresponding to the required Pareto front. In this work, we introduce the multi-objective Bayesian optimization (MOBO) workflow for the ferroelectric/antiferroelectric performance optimization for memory and energy storage applications based on the numerical solution of the Ginzburg–Landau equation with electrochemical or semiconducting boundary conditions. MOBO is a low computational cost optimization tool for expensive multi-objective functions, where we update posterior surrogate Gaussian process models from prior evaluations and then select future evaluations from maximizing an acquisition function. Using the parameters for a prototype bulk antiferroelectric (PbZrO 3 ), we first develop a physics-driven decision tree of target functions from the loop structures. We further develop a physics-driven MOBO architecture to explore multidimensional parameter space and build Pareto-frontiers by maximizing two target functions jointly—energy storage and loss. This approach allows for rapid initial materials and device parameter selection for a given application and can be further expanded toward the active experiment setting. The associated notebooks provide both the tutorial on MOBO and allow us to reproduce the reported analyses and apply them to other systems (https://github.com/arpanbiswas52/MOBO_AFI_Supplements).

36 MATERIALS SCIENCE↗

K2-291b: A Rocky Super-Earth in a 2.2 day Orbit

K2-291 is a solar-type star with a radius of R {sub *} = 0.899 ± 0.034 R {sub ⊙} and mass of M{sub *} = 0.934 ± 0.038 M {sub ⊙}. From the K2 C13 data, we found one super-Earth planet (R {sub p} = 1.589{sub −0.072}{sup +0.095} R {sub ⊕}) transiting this star on a short period orbit (P = 2.225177{sub −6.8e--5}{sup +6.6e--5} days). We followed this system up with adaptive-optic imaging and spectroscopy to derive stellar parameters, search for stellar companions, and determine a planet mass. From our 75 radial velocity measurements using High Resolution Echelle Spectrometer on Keck I and High Accuracy Radial velocity Planet Searcher in the northern hemisphere on Telescopio Nazionale Galileo, we constrained the mass of K2-291 b to M {sub p} = 6.49 ± 1.16 M {sub ⊕}. We found it necessary to model correlated stellar activity radial velocity signals with a Gaussian process (GP) in order to more accurately model the effect of stellar noise on our data; the addition of the GP also improved the precision of this mass measurement. With a bulk density of ρ = 8.84{sub −2.03}{sup +2.50} g cm{sup −3}, the planet is consistent with an Earth-like rock/iron composition and no substantial gaseous envelope. Such an envelope, if it existed in the past, was likely eroded away by photoevaporation during the first billion years of the star’s lifetime.

79 ASTRONOMY AND ASTROPHYSICS↗

Efficient sampling for spatial uncertainty qualification in multibody system dynamics applications.

We present two methods for efficiently sampling the response (trajectory space) of multibody systems operating under spatial uncertainty, when the latter is assumed to be representable with Gaussian processes. In this case, the dynamics (time evolution) of the multibody systems depends on spatially indexed uncertain parameters that span infinite-dimensional spaces. This places a heavy computational burden on existing methodologies, an issue addressed herein with two new conditional sampling approaches. When a single instance of the uncertainty is needed in the entire domain, we use a fast Fourier transform technique. When the initial conditions are fixed and the path distribution of the dynamical system is relatively narrow, we use an incremental sampling approach that is fast and has a small memory footprint. Both methods produce the same distributions as the widely used Cholesky-based approaches. We illustrate this convergence at a smaller computational effort and memory cost for a simple non-linear vehicle model.

97 MATHEMATICS AND COMPUTING↗

Predicting concrete compressive strength using hybrid ensembling of surrogate machine learning models

This study aims to implement a hybrid ensemble surrogate machine learning technique in predicting the compressive strength (CS) of concrete, an important parameter used for durability design and service life prediction of concrete structures in civil engineering projects. For this purpose, an experimental database consisting of 1030 records has been compiled from the machine learning repository of the University of California, Irvine. The database was used to train and validate four conventional machine learning (CML) models, namely Artificial Neural Network (ANN), Linear and Non-Linear Multivariate Adaptive Regression Splines (MARS-L and MARS-C), Gaussian Process Regression (GPR), and Minimax Probability Machine Regression (MPMR). Subsequently, the predicted outputs of CML models were combined and trained using ANN to construct the Hybrid Ensemble Model (HENSM). It is observed that the proposed HENSM produces higher predictive accuracy compared to the CML models used in the present study. The predictive performance of all models for CS prediction was compared using the testing dataset and it is found that the HENSM model attained the highest predictive accuracy in both phases. Based on the experimental results, the newly constructed HENSM model is very potential to be a new alternative in handling the overfitting issues of CML models and hence, can be used to predict the concrete CS, including the design of less polluting and more sustainable concrete constructions.

36 MATERIALS SCIENCE↗

MOOSE ProbML: Parallelized probabilistic machine learning and uncertainty quantification for computational energy applications

Here, this paper presents the development and demonstration of massively parallel probabilistic machine learning (ML) and uncertainty quantification (UQ) capabilities within the Multiphysics Object-Oriented Simulation Environment (MOOSE), an open-source computational platform for parallel finite element and finite volume analyses. In addressing the computational expense and uncertainties inherent in complex multiphysics simulations, this paper integrates Gaussian process (GP) variants, active learning, Bayesian inverse UQ, adaptive forward UQ, Bayesian optimization, evolutionary optimization, and Markov chain Monte Carlo (MCMC) within MOOSE. It also elaborates on the interaction among key MOOSE systems — Sampler, MultiApp, Reporter, and Surrogate — in enabling these capabilities. The modularity offered by these systems enables development of a multitude of probabilistic ML and UQ algorithms in MOOSE. Example code demonstrations include parallel active learning and parallel Bayesian inference via active learning. The impact of these developments is illustrated through five applications relevant to computational energy applications: UQ of nuclear fuel fission product release, using parallel active learning Bayesian inference; very rare events analysis in nuclear microreactors using active learning; advanced manufacturing process modeling using multi-output GPs (MOGPs) and dimensionality reduction; fluid flow using deep GPs (DGPs); and tritium transport model parameter optimization for fusion energy, using batch Bayesian optimization. These capabilities are part of the MOOSE framework.

97 - MATHEMATICS AND COMPUTING↗