Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian Optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Robust phenotyping strategies for evaluation of stem non-structural carbohydrates (NSC) in rice

Rice plants ( Oryza sativa ) accumulate excess photoassimilates in the form of non-structural carbohydrates (NSCs) in their stems prior to heading that can later be mobilized to supplement photosynthate production during grain-filling. Despite longstanding interest in stem NSC for rice improvement, the dynamics of NSC accumulation, remobilization, and re-accumulation that have genetic potential for optimization have not been systematically investigated. Here we conducted three pilot experiments to lay the groundwork for large-scale diversity studies on rice stem NSC. We assessed the relationship of stem NSC components with 21 agronomic traits in large-scale, tropical yield trials using 33 breeder-nominated lines, established an appropriate experimental design for future genetic studies using a Bayesian framework to sample sub-datasets from highly replicated greenhouse data using 36 genetically diverse genotypes, and used 434 phenotypically divergent rice stem samples to develop two partial least-squares (PLS) models using near-infrared (NIR) spectra for accurate, rapid prediction of rice stem starch, sucrose, and total non-structural carbohydrates. Lastly, we find evidence that stem reserves are most critical for short-duration varieties and suggest that pre-heading stem NSC is worthy of further experimentation for breeding early maturing rice.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Deducing subnanometer cluster size and shape distributions of heterogeneous supported catalysts

Abstract Infrared (IR) spectra of adsorbate vibrational modes are sensitive to adsorbate/metal interactions, accurate, and easily obtainable in-situ or operando. While they are the gold standards for characterizing single-crystals and large nanoparticles, analogous spectra for highly dispersed heterogeneous catalysts consisting of single-atoms and ultra-small clusters are lacking. Here, we combine data-based approaches with physics-driven surrogate models to generate synthetic IR spectra from first-principles. We bypass the vast combinatorial space of clusters by determining viable, low-energy structures using machine-learned Hamiltonians, genetic algorithm optimization, and grand canonical Monte Carlo calculations. We obtain first-principles vibrations on this tractable ensemble and generate single-cluster primary spectra analogous to pure component gas-phase IR spectra. With such spectra as standards, we predict cluster size distributions from computational and experimental data, demonstrated in the case of CO adsorption on Pd/CeO 2 (111) catalysts, and quantify uncertainty using Bayesian Inference. We discuss extensions for characterizing complex materials towards closing the materials gap.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

New results from the CUORE experiment

We report that the Cryogenic Underground Observatory for Rare Events (CUORE) is the first bolometric experiment searching for neutrino-less double-beta (0vββ) decay that has been able to reach the one-ton scale. The detector, located at the Laboratori Nazionali del Gran Sasso in Italy, consists of an array of 988 TeO 2 crystals arranged in a compact cylindrical structure of 19 towers. Following the completion of the detector construction in August 2016, CUORE began its first physics data run in 2017 at a base temperature of about 10 mK. Following multiple optimization campaigns in 2018, CUORE is currently in stable operating mode. In 2019, CUORE released its second result of the search for 0vββ corresponding to a TeO 2 exposure of 372.5 kg∙yr and a median exclusion sensitivity to a 130 Te 0vββ decay half-life of 1.7 ∙ 10 25 yr. We find no evidence for 0vββ decay and set a 90% C.I. Bayesian lower limit of 3.2 ∙ 10 25 yr on the 130 Te 0vββ decay half-life. We present the current status of CUORE’s search for 0vββ. We give an update of the CUORE background model and the measurement of the 130 Te two neutrino double-beta (2vββ) decay half-life. Eventually, we show the preliminary results on half-life limits from the analysis of 130 Te 0vββ and 2vββ decay to the first 0 + excited state of 130 Xe.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Proactive Frequency Stability Scheme via Bayesian Filters and Synchrophasors

Underfrequency (UF) load shedding schemes are traditionally implemented in two ways: One approach is based on manual load shedding, with system operators requesting loads to be shed ahead of anticipated stressful operating conditions. Manual load shedding is usually done through phone calls. The second method is automatic load shedding via underfrequency relays. Using static static settings, these schemes can be designed to operate in stages and drop previously identified loads. The main limitation of traditional load shedding schemes is that they are reactive and leave little room for optimized corrective actions. This work presents a proactive and automatic underfrequency load shedding solution for power systems. Measurements are captured via phasor measurement units (PMUs) at relatively low sampling rates of 30 Hz. These measurements are then processed by particle filters who predict the future state of the system's frequency. Based on these predictions excess load is determined and shed. Comparative case studies are performed in simulated environments. Easy-to-implement models, without hard-to-derive parameters, highlight potential aspects for real-life implementation.

Paramo, Gian↗
DOE OSTI2023

PYOED: AN ETENSIBLE SUITE FOR DATA ASSIMILATION AND MODEL-CONSTRAINED OPTIMAL DESIGN OF EXPERIMENTS

SF-23-005 PyOED is a highly extensible scientific package that enables developing and testing model-constrained optimal experimental design (OED) for inverse problems. Specifically, PyOED aims to be a comprehensive Python toolkit for model-constrained OED. The package targets scientists and researchers interested in understanding the details of OED formulations and approaches. It is also meant to enable researchers to experiment with standard and innovative OED technologies with a wide range of test problems (e.g., simulation models). OED, inverse problems (e.g., Bayesian inversion), and data assimilation (DA) are closely related research fields, and their formulations overlap significantly. Thus, PyOED is continuously being expanded with a plethora of Bayesian inversion, DA, and OED methods as well as new scientific simulation models, observation error models, and observation operators. These pieces are added such that they can be permuted to enable testing OED methods in various settings of varying complexities. The PyOED core is completely written in Python and utilizes the inherent object-oriented capabilities; however, PyOED is meant to be extensible rather than scalable. Specifically, PyOED is developed to ``enable rapid development and benchmarking of OED methods with minimal coding effort and to maximize code reutilization.'' PyOED will be continuously expanded with a plethora of Bayesian inversion, DA, and OED methods as well as new scientific simulation models, observation error models, and observation operators.

ATTIA, AHMEDMOHAMED↗
DOE OSTI2020

Optimizing long-term monitoring of radiation air-dose rates after the Fukushima Daiichi Nuclear Power Plant

Radiation air dose rates near the Fukushima Daiichi Nuclear Power Plant (FDNPP) have been steadily decreasing over the past eight years since the release of radioactive elements in March 2011. Currently, the radiation monitoring program is expected to transition to long-term monitoring after most of the remediation activities are completed. The main long-term monitoring objectives are to (1) confirm the continuing reduction of contaminant and hazard levels, (2) provide assurance for the public, (3) accumulate the basic datasets for scientific knowledge and future preparation, and (4) detect changes or anomalies in contaminant mobility (if they occur), or any unexpected processes or events. In this work, we have developed a methodology for optimizing the monitoring locations of radiation air dose-rate monitoring. Our approach consists of three steps in order to determine monitoring locations in a systematic manner: (1) prioritizing the critical locations, such as schools or regulatory requirement locations, (2) diversifying locations that cover the key environmental controls that are known to influence contaminant mobility and distributions, and (3) capturing the heterogeneity of radiation air-dose rates across the domain. Therefore, for the second step, we use a Gaussian mixture model to identify the representative locations among multiple environmental variables, such as elevation and land-cover types. For the third step, we use a Gaussian process model to capture and estimate the heterogeneity of air-dose rates across the domain. Employing an integrated dose-rate map derived from Bayesian geostatistical methods as a reference map, we distribute the monitoring locations in such a way as to capture the heterogeneity of the reference map. Our results have shown that this approach allows us to select monitoring locations in a systematic manner such that the heterogeneity of air dose rates is captured by the minimal number of monitoring locations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Posterior Regularized Bayesian Neural Network

Traditional NNs often lack the ability for uncertainty quantification. Bayesian NNs(BNNs) could help measure the confidence level by using distributions in NNs modeling. Besides, knowledge is commonly available and could improve the performance of BNNs if it can be properly incorporated. In this work, we propose a novel Posterior-Regularized BNN(PR-BNN) model by incorporating soft and hard constraints as a posterior regularization term. We also propose an augmented Lagrangian method and stochastic optimization algorithm for efficient updating via Monte Carlo sampling. The simulations and case studies for solar PV plants have shown the performance improvement of the proposed model over traditional BNNs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Posterior Regularized Bayesian Neural Network

Traditional NNs often lack the ability for uncertainty quantification. Bayesian NNs(BNNs) could help measure the confidence level by using distributions in NNs modeling. Besides, knowledge is commonly available and could improve the performance of BNNs if it can be properly incorporated. In this work, we propose a novel Posterior-Regularized BNN(PR-BNN) model by incorporating soft and hard constraints as a posterior regularization term. We also propose an augmented Lagrangian method and stochastic optimization algorithm for efficient updating via Monte Carlo sampling. The simulations and case studies in solar energy prediction have shown the performance improvement of the proposed model over traditional BNNs.

14 SOLAR ENERGY↗
DOE OSTI2020

A Physical Model for Understanding the Activation of MoS 2 Basal-plane Sulfur Atoms for the Hydrogen Evolution Reaction

All the DFT calculations are done with the Vienna Ab Initio Simulation Package (VASP) using the projector augmented wave method. The Bayesian error estimation exchange-correlation functionals (BEEF) with van der Waals interactions are employed. A plane-wave cutoff energy of 400 eV is used together with PAW-PBE potentials where semi core p states are treated as valence. All the calculations allow for spin-polarization. The structures are relaxed until the force is converged to < 0.01 eV/Å. The lattice parameter of MoS 2 unit cell, optimized with this functional, is 3.19 Å. A (4×4) supercell is used to model all the transition metal doped MoS 2 systems studied here, including those with S vacancies. For calculations in the initial dopant structure exploration, the Brillouin zone is sampled with a 3x3x1 Monkhorst-Pack k-point mesh. A 6×6×1 Monkhorst-Pack k-point mesh is used for the H binding energy and density of states calculations. In all calculations, the vacuum layer is set as 15 Å to eliminate periodic interaction perpendicular to the basal plane.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2023

BEYONDPLANCK VI. Noise characterization and modeling

We present a Bayesian method for estimating instrumental noise parameters and propagating noise uncertainties within the global BeyondPlanck Gibbs sampling framework, and apply this to Planck Low Frequency Instrument (LFI) time-ordered data. Following previous literature, we initially adopt a 1/ f model for the noise power spectral density (PSD), but find the need for an additional lognormal component in the noise model for the 30 and 44 GHz bands. We implement an optimal Wiener-filter (or constrained realization) gap-filling procedure to account for masked data. We then use this procedure to both estimate the gapless correlated noise in the time-domain, n corr , and to sample the noise PSD parameters, ξ n = {σ 0 , f knee , α, A p }. In contrast to previous Planck analyses, we assume piecewise stationary noise only within each pointing period (PID), not throughout the full mission, but we adopt the LFI Data Processing Center (DPC) results as priors on α and f knee . On average, we find best-fit correlated noise parameters that are mostly consistent with previous results, with a few notable exceptions. However, a detailed inspection of the time-dependent results reveals many important findings. First and foremost, we find strong evidence for statistically significant temporal variations in all noise PSD parameters, many of which are directly correlated with satellite housekeeping data. Second, while the simple 1/ f model appears to be an excellent fit for the LFI 70 GHz channel, there is evidence for additional correlated noise not described by a 1/ f model in the 30 and 44 GHz channels, including within the primary science frequency range of 0.1–1 Hz. In general, most 30 and 44 GHz channels exhibit deviations from 1/ f at the 2–3σ level in each one hour pointing period, motivating the addition of the lognormal noise component for these bands. For some periods of time, we also find evidence of strong common mode noise fluctuations across the entire focal plane. Overall, we conclude that a simple 1/ f profile is not adequate to fully characterize the Planck LFI noise, even when fitted hour-by-hour, and a more general model is required. These findings have important implications for large-scale CMB polarization reconstruction with the Planck LFI data, and the current work is a first attempt at understanding and mitigating these issues.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Decision-Making Under Uncertainty for a Digital Thread-Enabled Design Process

Abstract Digital thread is a data-driven architecture that links together information from all stages of the product lifecycle. Despite increasing application in manufacturing, maintenance/operations, and design related tasks, a principled formulation of analyzing the decision-making problem under uncertainty for the digital thread remains absent. The contribution of this article is to present a formulation using Bayesian statistics and decision theory. First, we address how uncertainty propagates in the product lifecycle and how the digital thread evolves based on the decisions we make and the data we collect. By using these mechanics, we explore designing over multiple product generations or iterations and provide an algorithm to solve the underlying multistage decision problem. We illustrate our method on an example structural design problem where our method can quantify and optimize different types and sequences of decisions, ranging from experimentation, manufacturing, and sensor placement/selection, to minimize total accrued costs.

Engineering↗
DOE OSTI2017

Multi-scale modeling of carbon capture systems

The development and scale up of cost effective carbon capture processes is of paramount importance to enable the widespread deployment of these technologies to significantly reduce greenhouse gas emissions. The U.S. Department of Energy initiated the Carbon Capture Simulation Initiative (CCSI) in 2011 with the goal of developing a computational toolset that would enable industry to more effectively identify, design, scale up, operate, and optimize promising concepts. The first half of the presentation will introduce the CCSI Toolset consisting of basic data submodels, steady-state and dynamic process models, process optimization and uncertainty quantification tools, an advanced dynamic process control framework, and high-resolution filtered computationalfluid- dynamics (CFD) submodels. The second half of the presentation will describe a high-fidelity model of a mesoporous silica supported, polyethylenimine (PEI)-impregnated solid sorbent for CO 2 capture. The sorbent model includes a detailed treatment of transport and amine-CO 2 - H 2 O interactions based on quantum chemistry calculations. Using a Bayesian approach for uncertainty quantification, we calibrate the sorbent model to Thermogravimetric (TGA) data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Fully Arbitrary Control of Frequency-Bin Qubits

Accurate control of two-level systems is a longstanding problem in quantum mechanics. One such quantum system is the frequency-bin qubit: a single photon existing in superposition of two discrete frequency modes. In this Letter, we demonstrate fully arbitrary control of frequency-bin qubits in a quantum frequency processor for the first time. Furthermore, we numerically establish optimal settings for multiple configurations of electro-optic phase modulators and pulse shapers, experimentally confirming near-unity mode-transformation fidelity for all fundamental rotations. Performance at the single-photon level is validated through the rotation of a single frequency-bin qubit to 41 points spread over the entire Bloch sphere, as well as tracking of the state path followed by the output of a tunable frequency beam splitter, with Bayesian tomography confirming state fidelities Fρ>0.98 for all cases. Overall, such high-fidelity transformations expand the practical potential of frequency encoding in quantum communications, offering exceptional precision and low noise in general qubit manipulation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Parameter estimation from spontaneous imbibition into volcanic tuff

Two-phase fluid flow properties underlie quantitative prediction of water and gas movement, but constraining these properties typically requires multiple time-consuming laboratory methods. The estimation of two-phase flow properties (van Genuchten parameters, porosity, and intrinsic permeability) is illustrated in cores of vitric nonwelded volcanic tuff using Bayesian parameter estimation that fits numerical models to observations from spontaneous imbibition experiments. The uniqueness and correlation of the estimated parameters is explored using different modeling assumptions and subsets of the observed data. The resulting estimation process is sensitive to both moisture retention and relative permeability functions, thereby offering a comprehensive method for constraining both functions. The data collected during this relatively simple laboratory experiment, used in conjunction with a numerical model and a global optimizer, result in a viable approach for augmenting more traditional capillary pressure data obtained from hanging water column, membrane plate extractor, or mercury intrusion methods. This method may be useful when imbibition rather than drainage parameters are sought, when larger samples (e.g., including heterogeneity or fractures) need to be tested that cannot be accommodated in more traditional methods, or when in educational laboratory settings.

58 GEOSCIENCES↗
DOE OSTI2019

Approximate Bayesian Model Inversion for PDEs with Heterogeneous and State-Dependent Coefficients

We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and cost-effective alternatives to Markov Chain Monte Carlo simulation. We assume a parameterized Gaussian prior on the unknown functions, and approximate the posterior density by a parameterized multivariate Gaussian density. The parameters of the prior and posterior are estimated from sparse observations of the PDE model's states and the unknown functions themselves by maximizing the evidence lower bound (ELBO), a lower bound on the log marginal likelihood of the observations. The first method, Laplace-EM, employs the expectation maximization algorithm to maximize the ELBO, with a Laplace approximation of the posterior on the E-step, and minimization of a Kullback-Leibler divergence on the M-step. The second method, DSVI-EB, employs the doubly stochastic variational inference (DSVI) algorithm, in which the ELBO is maximized via gradient-based stochastic optimization, with nosiy gradients computed via simple Monte Carlo sampling and Gaussian backpropagation. We apply these methods to identifying diffusion coefficients in linear and nonlinear diffusion equations, and we find that both methods provide accurate estimates of posterior densities and the hyperparameters of Gaussian priors. While the Laplace-EM method is more accurate, it requires computing Hessians of the physics model. The DSVI-EB method is found to be less accurate but only requires gradients of the physics model.

approximate Bayesian inference, model inversion, v↗
DOE OSTI2022

Physics-informed Bayesian machine learning case study: Integral blade rotors

This paper provides a physics-informed Bayesian machine learning (PIBML) description and case study. The PIBML approach applies three physics-based models to establish the initial beliefs before testing to determine the probability of milling stability (or prior). These include: receptance coupling substructure analysis (RCSA) prediction for the tool tip frequency response functions; finite element software prediction of the mechanistic force model coefficients; and a spindle speed-dependent power law model for process damping. Testing was then performed to identify optimal stable machining conditions using an expected improvement in material removal rate criterion. The prior probability of stability was updated using the test results to determine the posterior probability of stability. The test results were compared to the parameter recommendations provided by the endmill manufacturer. A demonstration integral blade rotor was machined at the optimal stable machining conditions for 304 stainless steel and 6061-T6 aluminum. Finally, the disagreement between manufacturer recommendations and milling performance in both materials tested emphasizes the need for broad implementation of PIBML approaches to increase machining productivity and efficiency.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Robust scalable initialization for Bayesian variational inference with multi-modal Laplace approximations

Predictive modeling typically relies on Bayesian model calibration to provide uncertainty quantification. Variational inference utilizing fully independent (“mean-field”) Gaussian distributions are often used as approximate probability density functions. This simplification is attractive since the number of variational parameters grows only linearly with the number of unknown model parameters. However, the resulting diagonal covariance structure and unimodal behavior can be too restrictive to provide useful approximations of intractable Bayesian posteriors that exhibit highly non-Gaussian behavior, including multimodality. High-fidelity surrogate posteriors for these problems can be obtained by considering the family of Gaussian mixtures. Gaussian mixtures are capable of capturing multiple modes and approximating any distribution to an arbitrary degree of accuracy, while maintaining some analytical tractability. Unfortunately, variational inference using Gaussian mixtures with full-covariance structures suffers from a quadratic growth in variational parameters with the number of model parameters. The existence of multiple local minima due to strong nonconvex trends in the loss functions often associated with variational inference present additional complications, These challenges motivate the need for robust initialization procedures to improve the performance and computational scalability of variational inference with mixture models. In this work, we propose a method for constructing an initial Gaussian mixture model approximation that can be used to warm-start the iterative solvers for variational inference. The procedure begins with a global optimization stage in model parameter space. In this step, local gradient-based optimization, globalized through multistart, is used to determine a set of local maxima, which we take to approximate the mixture component centers. Around each mode, a local Gaussian approximation is constructed via the Laplace approximation. Finally, the mixture weights are determined through constrained least squares regression. The robustness and scalability of the proposed methodology is demonstrated through application to an ensemble of synthetic tests using high-dimensional, multimodal probability density functions. Here, the practical aspects of the approach are demonstrated with inversion problems in structural dynamics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

New results from the CUORE experiment

The Cryogenic Underground Observatory for Rare Events (CUORE) is the first cryogenic experiment searching for neutrinoless double-beta ($0\nu\beta\beta$) decay that has been able to reach the one-ton scale. The detector, located at the Laboratori Nazionali del Gran Sasso in Italy, consists of an array of 988 TeO$_2$ crystals arranged in a compact cylindrical structure of 19 towers. Following the completion of the detector construction in August 2016, CUORE began its first physics data run in 2017 at a base temperature of about 10 mK. Following multiple optimization campaigns in 2018, CUORE is currently in stable operating mode. In 2019, CUORE released its 2\textsuperscript{nd} result of the search for $0\nu\beta\beta$ with a TeO$_2$ exposure of 372.5 kg$\cdot$yr and a median exclusion sensitivity to a $^{130}$Te $0\nu\beta\beta$ decay half-life of $1.7\cdot 10^{25}$ yr. We find no evidence for $0\nu\beta\beta$ decay and set a 90\% C.I. (credibility interval) Bayesian lower limit of $3.2\cdot 10^{25}$ yr on the $^{130}$Te $0\nu\beta\beta$ decay half-life. In this work, we present the current status of CUORE's search for $0\nu\beta\beta$, as well as review the detector performance. Finally, we give an update of the CUORE background model and the measurement of the $^{130}$Te two neutrino double-beta ($2\nu\beta\beta$) decay half-life.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗