Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “bayesian optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Development of Thomson scattering system on VEST

A Thomson scattering (TS) system has been developed on Versatile Experiment Spherical Torus (VEST) to measure the electron temperature and the density. In VEST, it is quite challenging to measure TS signals because the energy of the utilized pulsed laser and the target electron density are low, 0.85 J and ~5×1018 m-3, respectively. Furthermore, the difficulties caused by filter specifications have to be resolved because of the use of commercial interference filters with broad bandwidth and poor blocking at the laser wavelength. Therefore, we especially optimize the placement order of the filter sets based on the evaluation of the relative errors to overcome the poor spectral resolution. In addition, the amount of the stray light that penetrating filters is reduced by vacuum components such as baffles, louvres, and a viewing dump. With the careful installation and the optimization of the system, we can develop an efficient Thomson scattering system. Recently, TS signals have been successfully measured from the ohmic plasmas, and the electron temperature and the density are determined by analyzing the signals with the Bayesian method.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Low-rank separated representation surrogates of high-dimensional stochastic functions: Application in Bayesian inference

This study introduces a non-intrusive approach in the context of low-rank separated representation to construct a surrogate of high-dimensional stochastic functions, e.g., PDEs/ODEs, in order to decrease the computational cost of Markov Chain Monte Carlo simulations in Bayesian inference. The surrogate model is constructed via a regularized alternative least-square regression with Tikhonov regularization using a roughening matrix computing the gradient of the solution, in conjunction with a perturbation-based error indicator to detect optimal model complexities. The model approximates a vector of a continuous solution at discrete values of a physical variable. The required number of random realizations to achieve a successful approximation linearly depends on the function dimensionality. The computational cost of the model construction is quadratic in the number of random inputs, which potentially tackles the curse of dimensionality in high-dimensional stochastic functions. Furthermore, this vector-valued separated representation-based model, in comparison to the available scalar-valued case, leads to a significant reduction in the cost of approximation by an order of magnitude equal to the vector size. The performance of the method is studied through its application to three numerical examples including a 41-dimensional elliptic PDE and a 21-dimensional cavity flow.

97 MATHEMATICS AND COMPUTING↗

Uncovering multiscale structure-property correlations via active learning in scanning tunneling microscopy

Atomic arrangements and local sub-structures fundamentally influence emergent material functionalities. These structures are conventionally probed using spatially resolved studies and the property correlations are deciphered by a researcher based on sequential explorations, thereby limiting the efficiency and scope. Here we demonstrate a multi-scale Bayesian deep-learning based framework that automatically correlates material structure with its electronic properties using scanning tunneling microscopy (STM) measurements in real-time. Its predictions are used to autonomously direct exploration toward regions of the sample that optimize a given material property. This method is deployed on a low-temperature ultra-high vacuum STM to understand the structure-property relationship in a europium-based semimetal, EuZn 2 As 2 , a promising candidate relevant to magnetism-driven topological phenomena. The framework employs a sparse-sampling approach to efficiently construct the scalar-property space using minimal measurements, about 1–10% of the data required in standard hyperspectral methods. Moreover, we formulate the problem hierarchically across length scales, implementing autonomous workflow to locate mesoscopic and atomic structures that correspond to a target material property. This framework offers the choice to design scalar-property from the spectroscopic data to steer sample exploration. Our findings reveal correlations of the electronic properties unique to surface terminations, local defect density, and point defects.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Stochastic reconstructions of spectral functions: Application to lattice QCD

Here, we present a detailed study of the applications of two stochastic approaches, stochastic optimization method (SOM) and stochastic analytical inference (SAI), to extract spectral functions from Euclidean correlation functions. SOM has the advantage that it does not require prior information. On the other hand, SAI is a more generalized method based on Bayesian inference. Under mean field approximation SAI reduces to the often-used maximum entropy method (MEM), and for a specific choice of the prior SAI becomes equivalent to SOM. To test the applicability of these two stochastic methods to lattice QCD, Firstly, we apply these methods to various reasonably chosen model correlation functions, and present detailed comparisons of the reconstructed spectral functions obtained from SOM, SAI and MEM. Next, we present similar studies for charmonia correlation functions obtained from lattice QCD computations using clover-improved Wilson fermions on large, fine, isotropic lattices at 0:75 and 1:5 T c , T c being the deconfinement transition temperature of a pure gluon plasma. We find that SAI and SOM give consistent results to MEM at these two temperatures.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Statistical Characterization of Temperature and Pressure Vertical Profiles for the Analysis of Laser Heterodyne Radiometry Data

The statistical analysis of historic pressure and temperature profiles from radiosonde launches for use in the fitting of molecular oxygen line shapes is presented. As the O 2 mixing ratio is nearly constant throughout the lower atmosphere, only variations in pressure and temperature profiles will affect the fit of observed O 2 features in Laser Heterodyne Radiometry (LHR) spectra. Radiosonde temperature and pressure data are extracted from the Integrated Global Radiosonde Archive (IGRA) for a given station, date, and launch time. Data may be extracted for a single launch, for the same date over several years, and/or within a window centered on a target date. The temperature and pressure profiles are further characterized by the statistical variation in coefficients of polynomial fits in altitude. The properties of the probability distributions for each coefficient are used to constrain fits of O 2 line shapes through Nelder–Mead optimization. The refined temperature and pressure profiles are then used in the retrieval of vertically resolved mixing ratios for greenhouse gases (GHGs) measured in the same instrument. In continuous collections, each vertical profile determination may be treated as a Bayesian prior to inform subsequent measurements and provide an estimate of uncertainties.

47 OTHER INSTRUMENTATION↗

Designing optimal experiments: an application to proton Compton scattering

Interpreting measurements requires a physical theory, but the theory’s accuracy may vary across the experimental domain. To optimize experimental design, and so to ensure that the substantial resources necessary for modern experiments are focused on acquiring the most valuable data, both the theory uncertainty and the expected pattern of experimental errors must be considered. We develop a Bayesian approach to this problem, and apply it to the example of proton Compton scattering. Chiral Effective Field Theory (χEFT) predicts the functional form of the scattering amplitude for this reaction, so that the electromagnetic polarizabilities of the nucleon can be inferred from data. With increasing photon energy, both experimental rates and sensitivities to polarizabilities increase, but the accuracy of χEFT decreases. Our physics-based model of χEFT truncation errors is combined with present knowledge of the polarizabilities and reasonable assumptions about experimental capabilities at HI γ S and MAMI to assess the information gain from measuring specific observables at specific kinematics, i.e. to determine the relative amount by which new data are apt to shrink uncertainties. The strongest gains would likely come from new data on the spin observables Σ 2x and Σ 2x' at ω≃140 to 200 MeV and 40° to 120°. These would tightly constrain γ E1E1 –γ E1M2 . New data on the differential cross section between 100 and 200 MeV and over a wide angle range will substantially improve constraints on α E1 –β M1 , γ π and γ M1M1 –γ M1E2 . Good signals also exist around 160 MeV for Σ 3 and Σ 2z' . As a result, such data will be pivotal in the continuing quest to pin down the scalar polarizabilities and refine understanding of the spin polarizabilities.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Crop physiology calibration in the CLM

Farming is using more of the land surface, as population increases and agriculture is increasingly applied for non-nutritional purposes such as biofuel production. This agricultural expansion exerts an increasing impact on the terrestrial carbon cycle. In order to understand the impact of such processes, the Community Land Model (CLM) has been augmented with a CLM-Crop extension that simulates the development of three crop types: maize, soybean, and spring wheat. The CLM-Crop model is a complex system that relies on a suite of parametric inputs that govern plant growth under a given atmospheric forcing and available resources. CLM-Crop development used measurements of gross primary productivity (GPP) and net ecosystem exchange (NEE) from AmeriFlux sites to choose parameter values that optimize crop productivity in the model. In this paper, we calibrate these parameters for one crop type, soybean, in order to provide a faithful projection in terms of both plant development and net carbon exchange. Calibration is performed in a Bayesian framework by developing a scalable and adaptive scheme based on sequential Monte Carlo (SMC). The model showed significant improvement of crop productivity with the new calibrated parameters. We demonstrate that the calibrated parameters are applicable across alternative years and different sites.

54 ENVIRONMENTAL SCIENCES↗

Galaxy Morphology Classification Using Bayesian Neural Networks for LSST

Within the decade, many new ground and space-based observatories will become operational, generating massive amounts of data on short timescales. New surveys like Rubin Observatory's Legacy Survey of Space and Time (LSST) will be capable of observing objects with greater resolution than ever before, but processing and analyzing these datasets optimally will pose a significant challenge. In an effort to prepare for this, we explore how incorporating Deep Neural Networks can better support future data-intensive Astrophysics tasks such as galaxy morphology classification.

79 ASTRONOMY AND ASTROPHYSICS↗

A neural-network-enhanced parameter-varying framework for multi-objective model predictive control applied to buildings

Management of the electrical grid is becoming more complex due to the increased penetration of alternative energy generation technologies and a broadening diversity of electric loads. This complexity creates challenges in balancing demand and generation that can increase the potential for grid instabilities. One effective way to address this issue is to leverage previously unexploited demand flexibility through advanced control strategies. In this work, we propose an advanced control method, called adaptive neural parameter-varying model predictive control (ANPV-MPC), to control the temperature and energy consumption of a building via its Heating, Ventilation, and Air Conditioning system. ANPV-MPC combines key ideas in parameter-varying control, adaptive control, and online learning strategies to bridge the gap between computationally efficient linear model predictive control and more accurate nonlinear model predictive control. The novelty in ANPV-MPC is the use of a physics-inspired Bayesian neural network to estimate the coefficients of the parameter-varying linear control model. The Bayesian neural network additionally provides uncertainty estimates, triggering online training to capture evolving building system conditions. We show that ANPV-MPC can approximate the building system dynamics with a 28.39% higher accuracy than traditional linear model predictive control, resulting in 36.23% better control performance without increasing complexity of the optimal control problem. ANPV-MPC also adapts in real time to previously unseen conditions using online learning, further improving its performance.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Automating Bayesian inference and design to quantify acoustic particle levitation

Self-propulsion of micro- and nanoparticles powered by ultrasound provides an attractive strategy for the remote manipulation of colloidal matter using biocompatible energy inputs. Quantitative understanding of particle motion and its dependence on size, shape, and composition requires accurate characterization of the acoustic field, which depends sensitively on the experimental setup. Here, we show how automated experiments based on Bayesian inference and design can accurately and efficiently characterize the acoustic field within resonant chambers used to propel acoustic nanomotors. Repeated cycles of observation, inference, and design (OID) are guided by a physical model that describes the rate at which levitating particles approach the nodal plane. Using video microscopy, we observe the relaxation of tracer particles to this plane following the application of the acoustic field. We use sequential Monte Carlo methods to infer model parameters such as the amplitude and frequency of the resonant chamber while accounting for particle-level measurement noise and population-level heterogeneity in the field. Guided by simulated outcomes, we select the optimal design for the next experiment as to maximize the information gain in the relevant parameters. We show how this iterative process serves to discriminate between competing hypotheses and efficiently converges to accurate parameter estimates using only few automated experiments. We discuss the need for model criticism to ensure the validity of the guiding model throughout automated cycles of observation, inference, and design. Furthermore, this work demonstrates how Bayesian methods can learn the parameters of nonlinear, hierarchical models used to describe video microscopy data of active colloids.

42 ENGINEERING↗

Proactive Frequency Stability Scheme: A Distributed Framework Based on Particle Filters and Synchrophasors

The reactive nature of traditional under-frequency load shedding schemes can lead to delayed response and unnecessary loss of load. This work presents a proactive framework for power system frequency stability. Bayesian filters and synchrophasors are leveraged to produce predictions after disturbances are detected. By being able to estimate the future state of frequency corrective actions can be taken before the system reaches a critical condition. This proactive approach makes it possible to optimize the response to a disturbance, which results in a decrease in the amount of compensation utilized. The framework is tested via Matlab simulations based on Kundur’s Two-Area System, and the IEEE 14-Bus System. Performance metrics are provided and evaluated against other contemporary solutions found in literature. During testing this framework outperformed other solutions by drastically reducing the amount of load dropped during compensation.

42 ENGINEERING↗

SU-E-T-144: Bayesian Inference of Local Relapse Data Using a Poisson-Based Tumour Control Probability Model

Purpose: The purpose of this project is to develop a robust method of parameter estimation for a Poisson-based TCP model using Bayesian inference. Methods: Bayesian inference was performed using the PyMC3 probabilistic programming framework written in Python. A Poisson-based TCP regression model that accounts for clonogen proliferation was fit to observed rates of local relapse as a function of equivalent dose in 2 Gy fractions for a population of 623 stage-I non-small-cell lung cancer patients. The Slice Markov Chain Monte Carlo sampling algorithm was used to sample the posterior distributions, and was initiated using the maximum of the posterior distributions found by optimization. The calculation of TCP with each sample step required integration over the free parameter α, which was performed using an adaptive 24-point Gauss-Legendre quadrature. Convergence was verified via inspection of the trace plot and posterior distribution for each of the fit parameters, as well as with comparisons of the most probable parameter values with their respective maximum likelihood estimates. Results: Posterior distributions for α, the standard deviation of α (σ), the average tumour cell-doubling time (Td), and the repopulation delay time (Tk), were generated assuming α/β = 10 Gy, and a fixed clonogen density of 10{sup 7} cm−{sup 3}. Posterior predictive plots generated from samples from these posterior distributions are in excellent agreement with the observed rates of local relapse used in the Bayesian inference. The most probable values of the model parameters also agree well with maximum likelihood estimates. Conclusion: A robust method of performing Bayesian inference of TCP data using a complex TCP model has been established.

60 APPLIED LIFE SCIENCES↗

Leveraging differentiable programming in the inverse problem of neutron stars

Neutron stars (NSs) probe the high-density regime of the nuclear equation of state (EOS). However, inferring the EOS from observations of NSs is a computationally challenging task. Here, in this work, we efficiently solve this inverse problem by leveraging differential programming in two ways. First, we enable full Bayesian inference in under one hour of wall time on a GPU by using gradient-based samplers, without requiring pretrained machine learning emulators. Moreover, we demonstrate efficient scaling to high-dimensional parameter spaces. Second, we introduce a novel gradient-based optimization scheme that recovers the EOS of a given NS mass-radius curve. We demonstrate how our framework can reveal consistencies or tensions between nuclear physics and astrophysics. First, we show how the breakdown density of a metamodel description of the EOS can be determined from NS observations. Second, we demonstrate how degeneracies in EOS modeling using nuclear empirical parameters can influence the inverse problem during gradient-based optimization. Looking ahead, our approach opens up new theoretical studies of the relation between NS properties and the EOS, while effectively tackling the data analysis challenges brought by future detectors.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Correct Flat Field Model For DARHT

The forward modeling approach has been utilized to obtain the density distribution during dynamic radiographic experiments using the Bayesian Inference Engine (BIE) at the Dual Axis Radiographic Hydrodynamic Test Facility (DARHT) for over two decades. The forward modeling approach attempts to incorporate all of the known physics to obtain the transmission, from an unknown density field. The density field is then optimized in an attempt to match the flat-fielded radiographic image using a Chi-squared comparison. A depiction of the forward modeling approach implemented in the BIE is given.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Sensor Networks for Detecting Toxic Releases in Buildings

Sudden releases of a toxic agent indoors can cause immediate and long-term harm to occupants. In order to protect building occupants from such threats, it is necessary to have a robust air monitoring system that can detect, locate, and characterize accidental or deliberate toxic gas releases. However, developing such a system is complicated by several requirements, in particular the need to operate in real-time. This task is further complicated when monitoring sensors are prone to false positive and false negative readings. We report on work towards developing an indoor monitoring system that is robust even in the presence of poor quality sensor data. The algorithm, named BASSET, combines deterministic modeling and Bayesian statistics to join prior knowledge of the contaminant transport in the building with real-time sensor information. We evaluate BASSET across several data sets, which vary in sensor characteristics such as accuracy, response time, and trigger level. Our results suggest that optimal designs are not always intuitive. For example, a network comprised of slower but more accurate sensors may locate the contaminant source more quickly than a network with faster but less accurate sensors.

54 ENVIRONMENTAL SCIENCES↗

Emulator-Based Bayesian Calibration of the CISNET Colorectal Cancer Models

Purpose To calibrate Cancer Intervention and Surveillance Modeling Network (CISNET)'s SimCRC, MISCAN-Colon, and CRC-SPIN simulation models of the natural history colorectal cancer (CRC) with an emulator-based Bayesian algorithm and internally validate the model-predicted outcomes to calibration targets.Methods We used Latin hypercube sampling to sample up to 50,000 parameter sets for each CISNET-CRC model and generated the corresponding outputs. We trained multilayer perceptron artificial neural networks (ANNs) as emulators using the input and output samples for each CISNET-CRC model. We selected ANN structures with corresponding hyperparameters (i.e., number of hidden layers, nodes, activation functions, epochs, and optimizer) that minimize the predicted mean square error on the validation sample. We implemented the ANN emulators in a probabilistic programming language and calibrated the input parameters with Hamiltonian Monte Carlo-based algorithms to obtain the joint posterior distributions of the CISNET-CRC models' parameters. We internally validated each calibrated emulator by comparing the model-predicted posterior outputs against the calibration targets.Results The optimal ANN for SimCRC had 4 hidden layers and 360 hidden nodes, MISCAN-Colon had 4 hidden layers and 114 hidden nodes, and CRC-SPIN had 1 hidden layer and 140 hidden nodes. The total time for training and calibrating the emulators was 7.3, 4.0, and 0.66 h for SimCRC, MISCAN-Colon, and CRC-SPIN, respectively. The mean of the model-predicted outputs fell within the 95% confidence intervals of the calibration targets in 98 of 110 for SimCRC, 65 of 93 for MISCAN, and 31 of 41 targets for CRC-SPIN.Conclusions Using ANN emulators is a practical solution to reduce the computational burden and complexity for Bayesian calibration of individual-level simulation models used for policy analysis, such as the CISNET CRC models. In this work, we present a step-by-step guide to constructing emulators for calibrating 3 realistic CRC individual-level models using a Bayesian approach.

artificial neural networks↗

Probabilistic assessment of cloud fraction using Bayesian blending of independent datasets: Feasibility study of a new method

We describe and evaluate a novel method to blend two observed cloud fraction (CF) datasets through Bayesian posterior estimation. The research reported here is a feasibility study designed to explore the method. In this proof‐of‐concept study, we illustrate the approach using specific observational datasets from the U. S. Department of Energy Atmospheric Radiation Measurement Program's Southern Great Plains site in the central United States, but the method is quite general and is readily applicable to other datasets. The total sky image (TSI) camera observations are used to determine the prior distribution. A regression model and the active remote sensing of clouds (ARSCL) radar/lidar observations are used to determine the likelihood function. The posterior estimate is a probability density function (pdf) of the CF whose mean is taken to be the optimal blend of the two observations. The data at hourly, daily, 5‐day, monthly, and annual time scales are considered. Some physical and probabilistic properties of the CFs are explored from radar/lidar, camera, and satellite observations and from simulations using the Community Atmosphere Model (CAM5). Our results imply that (a) the Beta distribution is a reasonable model for CF for both short‐ and long‐time means, the 5‐day data are skewed right, and the annual data are almost normally distributed, and (b) the Bayesian method developed successfully yields a pdf of CF, rather than a deterministic CF value, and it is feasible to blend the TSI and ARSCL data with a capability for bias correction.

58 GEOSCIENCES↗

A multitower measurement network estimate of California's methane emissions

In this paper, we present an analysis of methane (CH 4 ) emissions using atmospheric observations from five sites in California's Central Valley across different seasons (September 2010 to June 2011). CH 4 emissions for spatial regions and source sectors are estimated by comparing measured CH 4 mixing ratios with transport model (Weather Research and Forecasting and Stochastic Time-Inverted Lagrangian Transport) predictions based on two 0.1° CH 4 (seasonally varying “California-specific” (California Greenhouse Gas Emission Measurements, CALGEM) and a static global (Emission Database for Global Atmospheric Research, release version 42, EDGAR42)) prior emission models. Region-specific Bayesian analyses indicate that for California's Central Valley, the CALGEM- and EDGAR42-based inversions provide consistent annual total CH 4 emissions (32.87 ± 2.09 versus 31.60 ± 2.17 Tg CO 2 eq yr -1 ; 68% confidence interval (CI), assuming uncorrelated errors between regions). Summing across all regions of California, optimized CH 4 emissions are only marginally consistent between CALGEM- and EDGAR42-based inversions (48.35 ± 6.47 versus 64.97 ± 11.85 Tg CO 2 eq), because emissions from coastal urban regions (where landfill and natural gas emissions are much higher in EDGAR than CALGEM) are not strongly constrained by the measurements. Combining our results with those from a recent study of the South Coast Air Basin narrows the range of estimates to 43–57 Tg CO2eq yr -1 (1.3–1.8 times higher than the current state inventory). Finally, these results suggest that the combination of rural and urban measurements will be necessary to verify future changes in California's total CH 4 emissions.

54 ENVIRONMENTAL SCIENCES↗