SEARCH · Engineering Papers

Results for “Bayesian Optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

All sources NASA NTRS DOE OSTI

DOE OSTI2015

Quantifying properties of hot and dense QCD matter through systematic model-to-data comparison

We systematically compare an event-by-event heavy-ion collision model to data from the CERN Large Hadron Collider. Using a general Bayesian method, we probe multiple model parameters including fundamental quark-gluon plasma properties such as the specific shear viscosity η/s, calibrate the model to optimally reproduce experimental data, and extract quantitative constraints for all parameters simultaneously. Furthermore, the method is universal and easily extensible to other data and collision models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2017

Radiation Source Mapping with Bayesian Inverse Methods

In this work, we present a method to map the spectral and spatial distributions of radioactive sources using a limited number of detectors. Locating and identifying radioactive materials is important for border monitoring, in accounting for special nuclear material in processing facilities, and in cleanup operations following a radioactive material spill. Most methods to analyze these types of problems make restrictive assumptions about the distribution of the source. In contrast, the source mapping method presented here allows an arbitrary three-dimensional distribution in space and a gamma peak distribution in energy. To apply the method, the problem is cast as an inverse problem where the system’s geometry and material composition are known and fixed, while the radiation source distribution is sought. A probabilistic Bayesian approach is used to solve the resulting inverse problem since the system of equations is ill-posed. The posterior is maximized with a Newton optimization method. The probabilistic approach also provides estimates of the confidence in the final source map prediction. A set of adjoint, discrete ordinates flux solutions, obtained in this work by the Denovo code, is required to efficiently compute detector responses from a candidate source distribution. These adjoint fluxes form the linear mapping from the state space to the response space. The test of the method’s success is simultaneously locating a set of 137 Cs and 60 Co gamma sources in a room. This test problem is solved using experimental measurements that we collected for this purpose. Because of the weak sources available for use in the experiment, some of the expected photopeaks were not distinguishable from the Compton continuum. However, by supplanting 14 flawed measurements (out of a total of 69) with synthetic responses computed by MCNP, the proof-of-principle source mapping was successful. The locations of the sources were predicted within 25 cm for two of the sources and 90 cm for the third, in a room with an ~4-x 4-m floor plan. Finally, the predicted source intensities were within a factor of ten of their true value.

07 ISOTOPE AND RADIATION SOURCES↗

DOE OSTI2022

Multi-variance replica exchange SGMCMC for inverse and forward problems via Bayesian PINN

Physics-informed neural network (PINN) has been successfully applied in solving a variety of nonlinear non-convex forward and inverse problems. However, the training is challenging because of the non-convex loss functions and the multiple optima in the Bayesian inverse problem. In this work, we propose a multi-variance replica exchange stochastic gradient Langevin dynamics method to tackle the challenge of the multiple local optima in the optimization and the challenge of the multiple modal posterior distribution in the inverse problem. Replica exchange methods are capable of escaping from the local traps and accelerating the convergence; two chains with different temperatures are designed where the low temperature chain aims for the local convergence, and the target of the high temperature chain is to travel globally and explore the whole loss function entropy landscape. However, it may not be efficient to solve mathematical inversion problems by using the vanilla replica method directly since the method doubles the computational cost in evaluating the forward solvers (likelihood functions) in the two chains. To address this issue, we propose to make different assumptions on the energy function estimation and this facilities one to use solvers of different fidelities in the likelihood function evaluation. More precisely, one can use a solver with low fidelity in the high temperature chain while using a solver with high fidelity in the low temperature chain. Our proposed method significantly lowers the computational cost in the high temperature chain, meanwhile preserving the accuracy and converging very fast. Here we give an unbiased estimate of the swapping rate and give an estimation of the discretization error of the scheme. To verify our idea, we design and solve four inverse problems which have multiple modes. The proposed method is also employed to train the Bayesian PINN to solve the forward and inverse problems; faster and more accurate convergence has been observed when compared to the stochastic gradient Langevin dynamics (SGLD) method and vanilla replica exchange methods.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

An anomaly detection framework for dynamic systems using a Bayesian hierarchical framework

Complex systems are susceptible to many types of anomalies, faults, and abnormal behavior caused by a variety of off-nominal conditions that may ultimately result in major failures or catastrophic events. Early and accurate detection of these anomalies using system inputs and outputs collected from sensors and smart devices has become a challenging problem and an active area of research in many application domains. In this article, we present a new Bayesian hierarchical framework that is able to model the relationship between system inputs (sensor measurements) and outputs (response variables) without imposing strong distributional/parametric assumptions while using only a subset of training samples and sensor attributes. Then, an optimal cost-sensitive anomaly detection framework is proposed to determine whether a sample is an anomalous one taking into consideration the trade-off between misclassification errors and detection rates. The model can be used for both supervised and unsupervised settings depending on the availability of data regarding the behavior of the system under anomaly conditions. The unsupervised model is particularly useful when it is prohibitive to identify in advance the anomalies that a system may present and where no data are available regarding the behavior of the system under anomaly conditions. A Bayesian hierarchical setting is used to structure the proposed framework and help with accommodating uncertainty, imposing interpretability, and controlling the sparsity and complexity of the proposed anomaly detection framework. A Markov chain Monte Carlo algorithm is also developed for model training using past data. Furthermore, the numerical experiments conducted using a simulated data set and a wind turbine data set demonstrate the successful application of the proposed work for system response modeling and anomaly detection.

17 WIND ENERGY↗

DOE OSTI2018

D-Guaranteed Discrimination of Statistical Hypotheses: a Review of Results and Unsolved Problems

We compare two sequential d-guaranteed tests and an optimal d-guaranteed test based on a fixed number of observations with respect to the average number of observations within the most accepted practical applications of Bayesian probabilistic models. We consider the sequential “first skipping” test, the sequential locally efficient test based on the score statistic, and the test based on a fixed number of observations that minimizes the necessary sample size. We study various characteristics of these tests connected with the number of observations within three probabilistic models, namely, the normal (ϑ, σ{sup 2}) distribution of the observed random variable and the normal a priori distribution of ϑ with fixed σ{sup 2}; the exponential distribution with the intensity parameter ϑ and the a priori gamma distribution of ϑ; and the Bernoulli sampling with the success probability ϑ and the a priori beta distribution of ϑ. We discuss the connection of the d-posterior approach with the compound decision problem as applied to the analysis of data provided by microchips (when the false discovery rate, or FDR, for short, is treated as the d-risk of the first kind). We present the vast data on characteristics of the mentioned tests obtained by the method of mathematical modeling in several tables. We discuss unsolved problems of the d-guaranteed discrimination of hypotheses with the minimal number of observations and approaches to their solution.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Optimization of Hydrogen Production from Pyrolysis of Biomass Waste [Poster]

We developed an CFD aided ML-based tool for rapid assessment and optimization of different compositions of biomass in a fluidized bed reactor. First, we use CFD to simulate fluidized bed reactors with known inlet biomass mixtures and obtain corresponding syngas yields. A lumped kinetic mechanisms represents the conversion of cellulose, hemicellulose, and lignin, as well as subsequent cracking of tars into non-condensable gases (H 2 , CO, CO 2 , CH 4 ). We use Bayesian analysis/optimization to obtain the ideal operational and mass flow conditions for hydrogen production.

08 HYDROGEN↗

DOE OSTI2021

Bayesian automated weighting of aggregated DFT, MD, and experimental data for candidate thermodynamic models of aluminum with uncertainty quantification

Atomic-scale modeling methods such as density functional theory (DFT) and molecular dynamics (MD) can predict the thermodynamic properties of materials at a lower cost than experimental measurements. However, their regular usage in thermodynamic model construction is hampered by the lack of quantitative agreement with experimental measurements and the lack of uncertainty estimates on the data. To make regular usage of this atomistic simulation data, it is important to assess whether the atomistic simulation datasets, by themselves or in combination with experimental measurements, result in the same physics-informed models best supported by experimental measurements alone. Here, models of aluminum thermodynamic properties are discussed using three data sources: atomistic calculations (DFT and MD), experiments, and a combination of atomistic calculations and experiments. The study shows that, after ensuring self-consistency in predicting key invariant points, both experimental measurements and atomistic calculations can significantly contribute to an optimal model.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Bayesian tomography of high-dimensional on-chip biphoton frequency combs with randomized measurements

Abstract Owing in large part to the advent of integrated biphoton frequency combs, recent years have witnessed increased attention to quantum information processing in the frequency domain for its inherent high dimensionality and entanglement compatible with fiber-optic networks. Quantum state tomography of such states, however, has required complex and precise engineering of active frequency mixing operations, which are difficult to scale. To address these limitations, we propose a solution that employs a pulse shaper and electro-optic phase modulator to perform random operations instead of mixing in a prescribed manner. We successfully verify the entanglement and reconstruct the full density matrix of biphoton frequency combs generated from an on-chip Si 3 N 4 microring resonator in up to an 8 × 8-dimensional two-qudit Hilbert space, the highest dimension to date for frequency bins. More generally, our employed Bayesian statistical model can be tailored to a variety of quantum systems with restricted measurement capabilities, forming an opportunistic tomographic framework that utilizes all available data in an optimal way.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

Risk-informed Predictive Analytics To Achieve Cost-effective Condition-based Monitoring And Maintenance Strategy

The research involves developing risk-informed predictive analytic capabilities to achieve condition-based monitoring and maintenance strategies to reduce overall maintenance costs. The research utilizes data (real-time data, periodic data, and institutional knowledge) related to a particular plant asset from a specific nuclear plant site to develop risk-informed predictive analytic algorithms. The developed algorithms and codes are used to optimize the maintenance strategy and estimate/forecast generation costs based on the state of health of the plant asset. Developed codes specifically include 1. Parameter estimation code based on Bayesian inference 2. Statistical data analysis code 3. Feature engineering code 4. Health classifier code 5. Diagnosis code 6. Prognosis code 7. Hazard code 8. Generation risk code 9. Economic code

Agarwal, Vivek↗

DOE OSTI2017

Determination of Quark-Gluon-Plasma Parameters from a Global Bayesian Analysis

The quality of data taken at RHIC and LHC as well as the success and sophistication of computational models for the description of ultra-relativistic heavy-ion collisions have advanced to a level that allows for the quantitative extraction of the transport properties of the Quark-Gluon-Plasma. However, the complexity of this task as well as the computational effort associated with it can only be overcome by developing novel methodologies: in this paper we outline such an analysis based on Bayesian Statistics and systematically compare an event-by-event heavy-ion collision model to data from the Large Hadron Collider. We simultaneously probe multiple model parameters including fundamental quark-gluon plasma properties such as the temperature-dependence of the specific shear viscosity η/s, calibrate the model to optimally reproduce experimental data, and extract quantitative constraints for all parameters simultaneously. As a result, the method is universal and easily extensible to other data and collision models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2025

Simple model to investigate jet quenching and correlated errors for centrality-dependent nuclear modification factors in relativistic heavy-ion collisions

Here, we apply Bayesian techniques to compare a simple, empirical model for jet quenching in heavy-ion collisions to centrality-dependent jet R AA measured by ATLAS for Pb + Pb collisions at $\sqrt{s_{NN}}$ = 5.02 TeV. We find that the R AA values for central collisions are adequately described with a model for the mean p T -dependent jet energy loss using only two parameters. This model is extended by incorporating two-dimensional initial geometry information from TRENTo and compared to centrality-dependent R AA values. We find that the results are sensitive to the value of the jet-quenching formation time, τ ƒ , and that the optimal value of τ ƒ varies with the assumed path-length dependence of the energy loss. We construct a covariance error matrix for the data from the p T -dependent contributions to the ATLAS systematic errors and perform Bayesian calibrations for several different assumptions for the systematic error correlations. We show that the most-probable functions and $χ^2_d$ values are sensitive to assumptions made when fitting to correlated errors. This work demonstrates the utility of a simple model that can quickly demonstrate the constraining power of jet-quenching observables with corresponding uncertainties and guide future studies using more sophisticated models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2025

Electronic structure prediction of medium and high entropy alloys across composition space

We propose machine learning (ML) models to predict the electron density — the fundamental unknown of a material’s ground state — across the composition space of concentrated alloys. From this, other physical properties can be inferred, enabling accelerated exploration. A significant challenge is that the number of descriptors and sampled compositions required for accurate prediction grows rapidly with species. To address this, we employ Bayesian Active Learning (AL), which minimizes training data requirements by leveraging uncertainty quantification capabilities of Bayesian Neural Networks. Compared to the strategic tessellation of the composition space, Bayesian-AL reduces the number of training data points by a factor of 2.5 for ternary (SiGeSn) and 1.7 for quaternary (CrFeCoNi) systems. We also introduce easy-to-optimize, body-attached-frame descriptors, which respect physical symmetries while keeping descriptor-vector size nearly constant as alloy complexity increases. Our ML models demonstrate high accuracy and generalizability in predicting both electron density and energy across composition space.

materials science↗

DOE OSTI2015

Classifier-Guided Sampling for Complex Energy System Optimization

This report documents the results of a Laboratory Directed Research and Development (LDRD) effort entitled “Classifier-Guided Sampling for Complex Energy System Optimization” that was conducted during FY 2014 and FY 2015. The goal of this project was to develop, implement, and test major improvements to the classifier-guided sampling (CGS) algorithm. CGS is type of evolutionary algorithm for performing search and optimization over a set of discrete design variables in the face of one or more objective functions. Existing evolutionary algorithms, such as genetic algorithms, may require a large number of objective function evaluations to identify optimal or near-optimal solutions. Reducing the number of evaluations can result in significant time savings, especially if the objective function is computationally expensive. CGS reduces the evaluation count by using a Bayesian network classifier to filter out non-promising candidate designs, prior to evaluation, based on their posterior probabilities. In this project, both the single-objective and multi-objective versions of the CGS are developed and tested on a set of benchmark problems. As a domain-specific case study, CGS is used to design a microgrid for use in islanded mode during an extended bulk power grid outage.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2015

Π4U: A high performance computing framework for Bayesian uncertainty quantification of complex models

We present Π4U,{sup 1} an extensible framework, for non-intrusive Bayesian Uncertainty Quantification and Propagation (UQ+P) of complex and computationally demanding physical models, that can exploit massively parallel computer architectures. The framework incorporates Laplace asymptotic approximations as well as stochastic algorithms, along with distributed numerical differentiation and task-based parallelism for heterogeneous clusters. Sampling is based on the Transitional Markov Chain Monte Carlo (TMCMC) algorithm and its variants. The optimization tasks associated with the asymptotic approximations are treated via the Covariance Matrix Adaptation Evolution Strategy (CMA-ES). A modified subset simulation method is used for posterior reliability measurements of rare events. The framework accommodates scheduling of multiple physical model evaluations based on an adaptive load balancing library and shows excellent scalability. In addition to the software framework, we also provide guidelines as to the applicability and efficiency of Bayesian tools when applied to computationally demanding physical models. Theoretical and computational developments are demonstrated with applications drawn from molecular dynamics, structural dynamics and granular flow.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2026

Improvement of Drop‐Hammer Impact Testing for Safety Assessment of High Explosives Using 10‐mg Samples

Here, in this study, we established an improved method for drop-hammer impact testing of small quantities of high explosives (10 mg). We performed about seven hundred impact tests under various experimental conditions (e.g., sandpaper vs bare anvil, different sample masses, drop-weights, and striker diameters) to determine an optimal set of conditions and reaction detection methods (e.g., gas analysis, video, and sound recordings) that give the most statistically reliable results with 10 mg samples. We used both Frequentist and Bayesian statistical approaches to compare estimates of the drop height (DH50) that initiates a reaction 50% of the time, and to quantify the associated uncertainty. Gas analysis proved to be the most reliable reaction detection method, showing unambiguous rises in HE decomposition products (e.g., CO 2 ) even when the other indicators (e.g., sound, video) were inconclusive. The impact tests performed with a bare anvil showed much better reproducibility than those conducted with sandpaper, reducing the largest uncertainty observed in the data sets by a factor of 1.7. The DH 50 values obtained from three different sample masses (10, 20, and 35 mg) fell within the uncertainties of the measurements. We demonstrated the improved procedure (i.e., 10-mg samples, gas analysis, bare anvil, and Bayesian approach) on a variety of PETN samples having different surface areas and thermal histories.

PETN↗

DOE OSTI2024

Source localization for neutron imaging systems using convolutional neural networks

The nuclear imaging system at the National Ignition Facility (NIF) is a crucial diagnostic for determining the geometry of inertial confinement fusion implosions. The geometry is reconstructed from a neutron aperture image via a set of reconstruction algorithms using an iterative Bayesian inference approach. An important step in these reconstruction algorithms is finding the fusion source location within the camera field-of-view. Currently, source localization is achieved via an iterative optimization algorithm. In this paper, we introduce a machine learning approach for source localization. Specifically, we train a convolutional neural network to predict source locations given a neutron aperture image. We show that this approach decreases computation time by several orders of magnitude compared to the current optimization-based source localization while achieving similar accuracy on both synthetic data and a collection of recent NIF deuterium–tritium shots.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Source localization for neutron imaging systems using convolutional neural networks

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Uncertainty quantification for equations of state: copper as an example

Equations of state are essential for providing a fundamental description of materials properties in thermodynamic equilibrium and are used to provide closure relations for hydrodynamics simulations. Generally, equations of state rely on simple physics-based parameterized materials models to inform on the free energy of a material through out a given thermodynamic state space. Historically the parameters of these models have been tuned by hand to fit various experimental data. However, modern optimization and uncertainty quantification techniques allow us to quickly test thousands of parameter combinations and obtain meaningful uncertainty estimates on the parameters, opening opportunities for assessing systematic uncertainties in experiments, assessing model adequacy, and more. In this report, we use Bayesian inference to fit the solid (fcc) equation of state of copper. We focus on fitting five different experimental datasets, including the isobaric density, isobaric heat capacity, room temperature isotherm, principal isentrope, and principal Hugoniot. We fit all five data types simultaneously, and then explore the extent to which combinations of 2 subsets of the 5 datasets can constrain the EOS parameters, as compared to the fit to all 5. This information is useful for investigating the extent to which different datasets can con strain EOS models and thereby help guide experimental investigations in order to best constrain the EOS. We also discuss ways that the methodologies can be used to investigate systematic discrepancies between experiments, as well as how the methods can be used to assess model uncertainty. The framework we develop is general, in that it can be used with a variety of optimization or uncertainty quantification techniques and with a variety of data sources, including both experimental and ab-inito data.

97 MATHEMATICS AND COMPUTING↗