Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian Optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

A Grobner Basis Solution for Lightning Ground Flash Fraction Retrieval

A Bayesian inversion method was previously introduced for retrieving the fraction of ground flashes in a set of flashes observed from a (low earth orbiting or geostationary) satellite lightning imager. The method employed a constrained mixed exponential distribution model to describe the lightning optical measurements. To obtain the optimum model parameters, a scalar function was minimized by a numerical method. In order to improve this optimization, we introduce a Grobner basis solution to obtain analytic representations of the model parameters that serve as a refined initialization scheme to the numerical optimization. Using the Grobner basis, we show that there are exactly 2 solutions involving the first 3 moments of the (exponentially distributed) data. When the mean of the ground flash optical characteristic (e.g., such as the Maximum Group Area, MGA) is larger than that for cloud flashes, then a unique solution can be obtained.

Solakiewicz, Richard↗
NASA NTRS2016

Constraining the Sulfur Dioxide Degassing Flux from Turrialba Volcano, Costa Rica Using Unmanned Aerial System Measurements

Observed sulfur dioxide (SO2)mixing ratios onboard unmanned aerial systems (UAS) duringMarch 11-13, 2013 are used to constrain the three-day averaged SO2 degassing flux fromTurrialba volcanowithin a Bayesian inverse modeling framework. A mesoscale model coupled with Lagrangian stochastic particle backward trajectories is used to quantify the source-receptor relationships at very high spatial resolutions (i.e., b1 km). The model shows better performance in reproducing the near-surface meteorological properties and observed SO2 variations when using a first-order closure non-local planetary boundary layer (PBL) scheme. The optimized SO2 degassing fluxes vary from 0.59 +/- 0.37 to 0.83 +/- 0.33 kt d−1 depending on the PBL scheme used. These fluxes are in good agreement with ground-based gas flux measurements, and correspond to corrective scale factors of 8-12 to the posteruptive SO2 degassing rate in the AeroCom emission inventory. The maximum a posteriori solution for the SO2 flux is highly sensitive to the specification of prior and observational errors, and relatively insensitive to the SO2 loss term and temporal averaging of observations. Our results indicate relatively low degassing activity but sustained sulfur emissions from Turrialba volcano to the troposphere during March 2013. This study demonstrates the utility of low-cost small UAS platforms for volcanic gas composition and flux analysis.

Xi, Xin↗
DOE OSTI2023

Proactive Frequency Stability Scheme via Bayesian Filters and Synchrophasors

Underfrequency (UF) load shedding schemes are traditionally implemented in two ways: One approach is based on manual load shedding, with system operators requesting loads to be shed ahead of anticipated stressful operating conditions. Manual load shedding is usually done through phone calls. The second method is automatic load shedding via underfrequency relays. Using static static settings, these schemes can be designed to operate in stages and drop previously identified loads. The main limitation of traditional load shedding schemes is that they are reactive and leave little room for optimized corrective actions. This work presents a proactive and automatic underfrequency load shedding solution for power systems. Measurements are captured via phasor measurement units (PMUs) at relatively low sampling rates of 30 Hz. These measurements are then processed by particle filters who predict the future state of the system's frequency. Based on these predictions excess load is determined and shed. Comparative case studies are performed in simulated environments. Easy-to-implement models, without hard-to-derive parameters, highlight potential aspects for real-life implementation.

Paramo, Gian↗
DOE OSTI2023

PYOED: AN ETENSIBLE SUITE FOR DATA ASSIMILATION AND MODEL-CONSTRAINED OPTIMAL DESIGN OF EXPERIMENTS

SF-23-005 PyOED is a highly extensible scientific package that enables developing and testing model-constrained optimal experimental design (OED) for inverse problems. Specifically, PyOED aims to be a comprehensive Python toolkit for model-constrained OED. The package targets scientists and researchers interested in understanding the details of OED formulations and approaches. It is also meant to enable researchers to experiment with standard and innovative OED technologies with a wide range of test problems (e.g., simulation models). OED, inverse problems (e.g., Bayesian inversion), and data assimilation (DA) are closely related research fields, and their formulations overlap significantly. Thus, PyOED is continuously being expanded with a plethora of Bayesian inversion, DA, and OED methods as well as new scientific simulation models, observation error models, and observation operators. These pieces are added such that they can be permuted to enable testing OED methods in various settings of varying complexities. The PyOED core is completely written in Python and utilizes the inherent object-oriented capabilities; however, PyOED is meant to be extensible rather than scalable. Specifically, PyOED is developed to ``enable rapid development and benchmarking of OED methods with minimal coding effort and to maximize code reutilization.'' PyOED will be continuously expanded with a plethora of Bayesian inversion, DA, and OED methods as well as new scientific simulation models, observation error models, and observation operators.

ATTIA, AHMEDMOHAMED↗
NASA NTRS2011

Tests of the Grobner Basis Solution for Lightning Ground Flash Fraction Retrieval

Satellite lightning imagers such as the NASA Tropical Rainfall Measuring Mission Lightning Imaging Sensor (TRMM/LIS) and the future GOES-R Geostationary Lightning Mapper (GLM) are designed to detect total lightning (ground flashes + cloud flashes). However, there is a desire to discriminate ground flashes from cloud flashes from the vantage point of space since this would enhance the overall information content of the satellite lightning data and likely improve its operational and scientific applications (e.g., in severe weather warning, lightning nitrogen oxides studies, and global electric circuit analyses). A Bayesian inversion method was previously introduced for retrieving the fraction of ground flashes in a set of flashes observed from a satellite lightning imager. The method employed a constrained mixed exponential distribution model to describe the lightning optical measurements. To obtain the optimum model parameters (one of which is the ground flash fraction), a scalar function was minimized by a numerical method. In order to improve this optimization, a Grobner basis solution was introduced to obtain analytic representations of the model parameters that serve as a refined initialization scheme to the numerical optimization. In this study, we test the efficacy of the Grobner basis initialization using actual lightning imager measurements and ground flash truth derived from the national lightning network.

Koshak, William↗
DOE OSTI2020

Optimizing long-term monitoring of radiation air-dose rates after the Fukushima Daiichi Nuclear Power Plant

Radiation air dose rates near the Fukushima Daiichi Nuclear Power Plant (FDNPP) have been steadily decreasing over the past eight years since the release of radioactive elements in March 2011. Currently, the radiation monitoring program is expected to transition to long-term monitoring after most of the remediation activities are completed. The main long-term monitoring objectives are to (1) confirm the continuing reduction of contaminant and hazard levels, (2) provide assurance for the public, (3) accumulate the basic datasets for scientific knowledge and future preparation, and (4) detect changes or anomalies in contaminant mobility (if they occur), or any unexpected processes or events. In this work, we have developed a methodology for optimizing the monitoring locations of radiation air dose-rate monitoring. Our approach consists of three steps in order to determine monitoring locations in a systematic manner: (1) prioritizing the critical locations, such as schools or regulatory requirement locations, (2) diversifying locations that cover the key environmental controls that are known to influence contaminant mobility and distributions, and (3) capturing the heterogeneity of radiation air-dose rates across the domain. Therefore, for the second step, we use a Gaussian mixture model to identify the representative locations among multiple environmental variables, such as elevation and land-cover types. For the third step, we use a Gaussian process model to capture and estimate the heterogeneity of air-dose rates across the domain. Employing an integrated dose-rate map derived from Bayesian geostatistical methods as a reference map, we distribute the monitoring locations in such a way as to capture the heterogeneity of the reference map. Our results have shown that this approach allows us to select monitoring locations in a systematic manner such that the heterogeneity of air dose rates is captured by the minimal number of monitoring locations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Posterior Regularized Bayesian Neural Network

Traditional NNs often lack the ability for uncertainty quantification. Bayesian NNs(BNNs) could help measure the confidence level by using distributions in NNs modeling. Besides, knowledge is commonly available and could improve the performance of BNNs if it can be properly incorporated. In this work, we propose a novel Posterior-Regularized BNN(PR-BNN) model by incorporating soft and hard constraints as a posterior regularization term. We also propose an augmented Lagrangian method and stochastic optimization algorithm for efficient updating via Monte Carlo sampling. The simulations and case studies for solar PV plants have shown the performance improvement of the proposed model over traditional BNNs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Posterior Regularized Bayesian Neural Network

Traditional NNs often lack the ability for uncertainty quantification. Bayesian NNs(BNNs) could help measure the confidence level by using distributions in NNs modeling. Besides, knowledge is commonly available and could improve the performance of BNNs if it can be properly incorporated. In this work, we propose a novel Posterior-Regularized BNN(PR-BNN) model by incorporating soft and hard constraints as a posterior regularization term. We also propose an augmented Lagrangian method and stochastic optimization algorithm for efficient updating via Monte Carlo sampling. The simulations and case studies in solar energy prediction have shown the performance improvement of the proposed model over traditional BNNs.

14 SOLAR ENERGY↗
DOE OSTI2020

A Physical Model for Understanding the Activation of MoS 2 Basal-plane Sulfur Atoms for the Hydrogen Evolution Reaction

All the DFT calculations are done with the Vienna Ab Initio Simulation Package (VASP) using the projector augmented wave method. The Bayesian error estimation exchange-correlation functionals (BEEF) with van der Waals interactions are employed. A plane-wave cutoff energy of 400 eV is used together with PAW-PBE potentials where semi core p states are treated as valence. All the calculations allow for spin-polarization. The structures are relaxed until the force is converged to < 0.01 eV/Å. The lattice parameter of MoS 2 unit cell, optimized with this functional, is 3.19 Å. A (4×4) supercell is used to model all the transition metal doped MoS 2 systems studied here, including those with S vacancies. For calculations in the initial dopant structure exploration, the Brillouin zone is sampled with a 3x3x1 Monkhorst-Pack k-point mesh. A 6×6×1 Monkhorst-Pack k-point mesh is used for the H binding energy and density of states calculations. In all calculations, the vacuum layer is set as 15 Å to eliminate periodic interaction perpendicular to the basal plane.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2023

BEYONDPLANCK VI. Noise characterization and modeling

We present a Bayesian method for estimating instrumental noise parameters and propagating noise uncertainties within the global BeyondPlanck Gibbs sampling framework, and apply this to Planck Low Frequency Instrument (LFI) time-ordered data. Following previous literature, we initially adopt a 1/ f model for the noise power spectral density (PSD), but find the need for an additional lognormal component in the noise model for the 30 and 44 GHz bands. We implement an optimal Wiener-filter (or constrained realization) gap-filling procedure to account for masked data. We then use this procedure to both estimate the gapless correlated noise in the time-domain, n corr , and to sample the noise PSD parameters, ξ n = {σ 0 , f knee , α, A p }. In contrast to previous Planck analyses, we assume piecewise stationary noise only within each pointing period (PID), not throughout the full mission, but we adopt the LFI Data Processing Center (DPC) results as priors on α and f knee . On average, we find best-fit correlated noise parameters that are mostly consistent with previous results, with a few notable exceptions. However, a detailed inspection of the time-dependent results reveals many important findings. First and foremost, we find strong evidence for statistically significant temporal variations in all noise PSD parameters, many of which are directly correlated with satellite housekeeping data. Second, while the simple 1/ f model appears to be an excellent fit for the LFI 70 GHz channel, there is evidence for additional correlated noise not described by a 1/ f model in the 30 and 44 GHz channels, including within the primary science frequency range of 0.1–1 Hz. In general, most 30 and 44 GHz channels exhibit deviations from 1/ f at the 2–3σ level in each one hour pointing period, motivating the addition of the lognormal noise component for these bands. For some periods of time, we also find evidence of strong common mode noise fluctuations across the entire focal plane. Overall, we conclude that a simple 1/ f profile is not adequate to fully characterize the Planck LFI noise, even when fitted hour-by-hour, and a more general model is required. These findings have important implications for large-scale CMB polarization reconstruction with the Planck LFI data, and the current work is a first attempt at understanding and mitigating these issues.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Decision-Making Under Uncertainty for a Digital Thread-Enabled Design Process

Abstract Digital thread is a data-driven architecture that links together information from all stages of the product lifecycle. Despite increasing application in manufacturing, maintenance/operations, and design related tasks, a principled formulation of analyzing the decision-making problem under uncertainty for the digital thread remains absent. The contribution of this article is to present a formulation using Bayesian statistics and decision theory. First, we address how uncertainty propagates in the product lifecycle and how the digital thread evolves based on the decisions we make and the data we collect. By using these mechanics, we explore designing over multiple product generations or iterations and provide an algorithm to solve the underlying multistage decision problem. We illustrate our method on an example structural design problem where our method can quantify and optimize different types and sequences of decisions, ranging from experimentation, manufacturing, and sensor placement/selection, to minimize total accrued costs.

Engineering↗
DOE OSTI2020

Fully Arbitrary Control of Frequency-Bin Qubits

Accurate control of two-level systems is a longstanding problem in quantum mechanics. One such quantum system is the frequency-bin qubit: a single photon existing in superposition of two discrete frequency modes. In this Letter, we demonstrate fully arbitrary control of frequency-bin qubits in a quantum frequency processor for the first time. Furthermore, we numerically establish optimal settings for multiple configurations of electro-optic phase modulators and pulse shapers, experimentally confirming near-unity mode-transformation fidelity for all fundamental rotations. Performance at the single-photon level is validated through the rotation of a single frequency-bin qubit to 41 points spread over the entire Bloch sphere, as well as tracking of the state path followed by the output of a tunable frequency beam splitter, with Bayesian tomography confirming state fidelities Fρ>0.98 for all cases. Overall, such high-fidelity transformations expand the practical potential of frequency encoding in quantum communications, offering exceptional precision and low noise in general qubit manipulation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Parameter estimation from spontaneous imbibition into volcanic tuff

Two-phase fluid flow properties underlie quantitative prediction of water and gas movement, but constraining these properties typically requires multiple time-consuming laboratory methods. The estimation of two-phase flow properties (van Genuchten parameters, porosity, and intrinsic permeability) is illustrated in cores of vitric nonwelded volcanic tuff using Bayesian parameter estimation that fits numerical models to observations from spontaneous imbibition experiments. The uniqueness and correlation of the estimated parameters is explored using different modeling assumptions and subsets of the observed data. The resulting estimation process is sensitive to both moisture retention and relative permeability functions, thereby offering a comprehensive method for constraining both functions. The data collected during this relatively simple laboratory experiment, used in conjunction with a numerical model and a global optimizer, result in a viable approach for augmenting more traditional capillary pressure data obtained from hanging water column, membrane plate extractor, or mercury intrusion methods. This method may be useful when imbibition rather than drainage parameters are sought, when larger samples (e.g., including heterogeneity or fractures) need to be tested that cannot be accommodated in more traditional methods, or when in educational laboratory settings.

58 GEOSCIENCES↗
DOE OSTI2022

Physics-informed Bayesian machine learning case study: Integral blade rotors

This paper provides a physics-informed Bayesian machine learning (PIBML) description and case study. The PIBML approach applies three physics-based models to establish the initial beliefs before testing to determine the probability of milling stability (or prior). These include: receptance coupling substructure analysis (RCSA) prediction for the tool tip frequency response functions; finite element software prediction of the mechanistic force model coefficients; and a spindle speed-dependent power law model for process damping. Testing was then performed to identify optimal stable machining conditions using an expected improvement in material removal rate criterion. The prior probability of stability was updated using the test results to determine the posterior probability of stability. The test results were compared to the parameter recommendations provided by the endmill manufacturer. A demonstration integral blade rotor was machined at the optimal stable machining conditions for 304 stainless steel and 6061-T6 aluminum. Finally, the disagreement between manufacturer recommendations and milling performance in both materials tested emphasizes the need for broad implementation of PIBML approaches to increase machining productivity and efficiency.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Robust scalable initialization for Bayesian variational inference with multi-modal Laplace approximations

Predictive modeling typically relies on Bayesian model calibration to provide uncertainty quantification. Variational inference utilizing fully independent (“mean-field”) Gaussian distributions are often used as approximate probability density functions. This simplification is attractive since the number of variational parameters grows only linearly with the number of unknown model parameters. However, the resulting diagonal covariance structure and unimodal behavior can be too restrictive to provide useful approximations of intractable Bayesian posteriors that exhibit highly non-Gaussian behavior, including multimodality. High-fidelity surrogate posteriors for these problems can be obtained by considering the family of Gaussian mixtures. Gaussian mixtures are capable of capturing multiple modes and approximating any distribution to an arbitrary degree of accuracy, while maintaining some analytical tractability. Unfortunately, variational inference using Gaussian mixtures with full-covariance structures suffers from a quadratic growth in variational parameters with the number of model parameters. The existence of multiple local minima due to strong nonconvex trends in the loss functions often associated with variational inference present additional complications, These challenges motivate the need for robust initialization procedures to improve the performance and computational scalability of variational inference with mixture models. In this work, we propose a method for constructing an initial Gaussian mixture model approximation that can be used to warm-start the iterative solvers for variational inference. The procedure begins with a global optimization stage in model parameter space. In this step, local gradient-based optimization, globalized through multistart, is used to determine a set of local maxima, which we take to approximate the mixture component centers. Around each mode, a local Gaussian approximation is constructed via the Laplace approximation. Finally, the mixture weights are determined through constrained least squares regression. The robustness and scalability of the proposed methodology is demonstrated through application to an ensemble of synthetic tests using high-dimensional, multimodal probability density functions. Here, the practical aspects of the approach are demonstrated with inversion problems in structural dynamics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

New results from the CUORE experiment

The Cryogenic Underground Observatory for Rare Events (CUORE) is the first cryogenic experiment searching for neutrinoless double-beta ($0\nu\beta\beta$) decay that has been able to reach the one-ton scale. The detector, located at the Laboratori Nazionali del Gran Sasso in Italy, consists of an array of 988 TeO$_2$ crystals arranged in a compact cylindrical structure of 19 towers. Following the completion of the detector construction in August 2016, CUORE began its first physics data run in 2017 at a base temperature of about 10 mK. Following multiple optimization campaigns in 2018, CUORE is currently in stable operating mode. In 2019, CUORE released its 2\textsuperscript{nd} result of the search for $0\nu\beta\beta$ with a TeO$_2$ exposure of 372.5 kg$\cdot$yr and a median exclusion sensitivity to a $^{130}$Te $0\nu\beta\beta$ decay half-life of $1.7\cdot 10^{25}$ yr. We find no evidence for $0\nu\beta\beta$ decay and set a 90\% C.I. (credibility interval) Bayesian lower limit of $3.2\cdot 10^{25}$ yr on the $^{130}$Te $0\nu\beta\beta$ decay half-life. In this work, we present the current status of CUORE's search for $0\nu\beta\beta$, as well as review the detector performance. Finally, we give an update of the CUORE background model and the measurement of the $^{130}$Te two neutrino double-beta ($2\nu\beta\beta$) decay half-life.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2004

Putting Priors in Mixture Density Mercer Kernels

This paper presents a new methodology for automatic knowledge driven data mining based on the theory of Mercer Kernels, which are highly nonlinear symmetric positive definite mappings from the original image space to a very high, possibly infinite dimensional feature space. We describe a new method called Mixture Density Mercer Kernels to learn kernel function directly from data, rather than using predefined kernels. These data adaptive kernels can en- code prior knowledge in the kernel using a Bayesian formulation, thus allowing for physical information to be encoded in the model. We compare the results with existing algorithms on data from the Sloan Digital Sky Survey (SDSS). The code for these experiments has been generated with the AUTOBAYES tool, which automatically generates efficient and documented C/C++ code from abstract statistical model specifications. The core of the system is a schema library which contains template for learning and knowledge discovery algorithms like different versions of EM, or numeric optimization methods like conjugate gradient methods. The template instantiation is supported by symbolic- algebraic computations, which allows AUTOBAYES to find closed-form solutions and, where possible, to integrate them into the code. The results show that the Mixture Density Mercer-Kernel described here outperforms tree-based classification in distinguishing high-redshift galaxies from low- redshift galaxies by approximately 16% on test data, bagged trees by approximately 7%, and bagged trees built on a much larger sample of data by approximately 2%.

Srivastava, Ashok N.↗
DOE OSTI2022

Optimizing aircraft flows at airports using data driven predicted capabilities

A method for safe and efficient use of airport runway capacity includes receiving, at an air traffic control system at an airport, airport data related to movement areas of the airport, time data related to a time period, aircraft data related to a plurality of aircraft expected to operate into and out of the airport during the time period, and environmental data related to environmental conditions predicted for the airport during the time period. The method further includes computing a probability distribution for inter-aircraft spacing by applying the airport data, the time data, the aircraft data, and the environmental data to a trained Bayesian network, producing the probability distribution for the inter-aircraft spacing as an output observation of the trained Bayesian network, and, using the probability distribution and a confidence value, identifying an inter-aircraft spacing value for the plurality of aircraft expected to operate into and out of the airport during the time period.

Sweet, Douglas↗