SEARCH · Engineering Papers

Results for “Bayesian updating”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Parsimonious Inference Information-Theoretic Foundations for a Complete Theory of Machine Learning (CIS-LDRD Project 218313 Final Technical Report)

This work examines how we may cast machine learning within a complete Bayesian framework to quantify and suppress explanatory complexity from first principles. Our investigation into both the philosophy and mathematics of rational belief leads us to emphasize the critical role of Bayesian inference in learning well-justified predictions within a rigorous and complete extended logic. The Bayesian framework allows us to coherently account for evidence in the learned plausibility of potential explanations. As an extended logic, the Bayesian paradigm regards probability as a notion of degrees of truth. In order to satisfy critical properties of probability as a coherent measure, as well as maintain consistency with binary propositional logic, we arrive at Bayes' Theorem as the only justifiable mechanism to update our beliefs to account for empiracle evidence. Yet, in the machine learning paradigm, where explanations are unconstrained algorithmic abstractions, we arrive at a critical challenge: Bayesian inference requires prior belief. Conventional approaches fail to yield a consistent framework in which we could compare prior plausibility among the infinities of potential choices in learning architectures. The difficulty of articulating well-justified prior belief over abstract models is the provinence of memorization in traditional machine learning training practices. This becomes exceptionally problematic in the context of limited datasets, when we wish to learn justifiable predictions from only a small amount of data.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

What makes a discovery?

In this contribution to the proceedings of the 182nd Nobel Symposium, I reflect on the concept of “discovery” as it is used by physicists and astronomers. In particular, I comment on how the scientific community distinguishes discoveries from propositions that are supported only by lesser forms of evidence, emphasizing the social nature of this process and remarking on the subjective factors that go into making such judgments. I advocate for an approach that is intentionally Bayesian in nature, in which individuals are encouraged to evaluate and publicly state their priors and to update them systematically. I close by applying these practices to the case example of the Galactic Center Gamma-Ray Excess.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2022

A review of computing-based automated fault detection and diagnosis of heating, ventilation and air conditioning systems

We report faults in Heating, Ventilation, and Air Conditioning (HVAC) systems of buildings result in significant energy waste in building operation. With fast-growing sensing data availability and advancement in computing, computational modeling has demonstrated strong capability to detect and diagnose HVAC system faults, hence, ensuring efficient building operation. This paper comprehensively reviews the state-of-the-art computing-based fault detection and diagnosis (FDD) for HVAC systems. Overall, the reviewed computing-based FDD methods are classified as two major approaches: knowledge-based and data-driven approaches. We then identify multiple important topics, including data availability, training data size, data quality, approach generality, capability, interpretability, and required modeling efforts, along with corresponding metrics to summarize the most updated FDD development. Generally, the knowledge-based approaches are further divided as physics-based modeling, Diagnostic Bayesian Network, and performance indicator-based methods while data-driven approaches include supervised learning, unsupervised learning, and regression and statistics-based methods. State-of-the-art FDD development, remaining challenges, and future research directions are further discussed to push forward FDD in practice. Availability of fault data, capability of existing methods to deal with complex fault situations (such as simultaneous faults), modeling interpretability for data-driven methods, and required engineering efforts for physics-based methods are identified as remaining challenges in FDD development. Improving modeling fidelity and reducing modeling efforts are essential for applying physics-based methods in real buildings. Meanwhile, addressing fault data availability, increasing algorithm adaptability, and handling multiple faults are essential to further enhance the applicability of data-driven FDD approaches.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Updated universal relations for tidal deformabilities of neutron stars from phenomenological equations of state

Equation of state (EOS) insensitive relations, so-called universal relations, between the neutron star (NS) compactness, its multipolar tidal deformability coefficients, and between the tidal parameters for binary systems are essential to break degeneracies in gravitational wave data analysis. Here, we validate and recalibrate these universal relations using a large set of almost 2 million phenomenological EOSs that are consistent with current observations. In doing so, we extend universal relations to a larger region of the EOS parameter space, most notably to softer EOSs and larger compactnesses. We show that waveform models that neglect higher-than-leading-order tidal deformations of the NSs accumulate as much as 3.5 radians of dephasing from 20Hz to merger. Further, we also perform a full Bayesian parameter estimation of the GW170817 data, and we compare the NS radius constraints produced using universal relations from the literature and the updated fits we propose here. We find that the new fits yield a NS radius that is smaller by about 500 meters. This difference is less than the statistical uncertainty on the radius at the signal-to-noise-ratio of GW170817, but it is significantly larger than the precision anticipated for next-generation detectors.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

A Multi-Objective Bayesian Optimization Approach Using the Weighted Tchebycheff Method

Abstract Bayesian optimization (BO) is a low-cost global optimization tool for expensive black-box objective functions, where we learn from prior evaluated designs, update a posterior surrogate Gaussian process model, and select new designs for future evaluation using an acquisition function. This research focuses upon developing a BO model with multiple black-box objective functions. In the standard multi-objective (MO) optimization problem, the weighted Tchebycheff method is efficiently used to find both convex and non-convex Pareto frontiers. This approach requires knowledge of utopia values before we start optimization. However, in the BO framework, since the functions are expensive to evaluate, it is very expensive to obtain the utopia values as a prior knowledge. Therefore, in this paper, we develop a MO-BO framework where we calibrate with multiple linear regression (MLR) models to estimate the utopia value for each objective as a function of design input variables; the models are updated iteratively with sampled training data from the proposed MO-BO. These iteratively estimated mean utopia values are used to formulate the weighted Tchebycheff MO acquisition function. The proposed approach is implemented in two numerical test examples and one engineering design problem of optimizing thin tube geometries under constant loading of temperature and pressure, with minimizing the risk of creep-fatigue failure and design cost, along with risk-based and manufacturing constraints. Finally, the model accuracy with frequentist, Bayesian and without MLR-based calibration are compared to true Pareto solutions.

Engineering↗

DOE OSTI2022

Dynamic logistic regression and variable selection: Forecasting and contextualizing civil unrest

Civil unrest can range from peaceful protest to violent furor, and researchers are working to monitor, forecast, and assess such events to allocate resources better. Twitter has become a real-time data source for forecasting civil unrest because millions of people use the platform as a social outlet. Additionally, daily word counts are used as model features, and predictive terms contextualize the reasons for the protest. To forecast civil unrest and infer the reasons for the protest, we consider the problem of Bayesian variable selection for the dynamic logistic regression model and propose using penalized credible regions to select parameters of the updated state vector. This method avoids the need for shrinkage priors, is scalable to high-dimensional dynamic data, and allows the importance of variables to vary in time as new information becomes available. A substantial improvement in both precision and F1-score using this approach is demonstrated through simulation. Finally, we apply the proposed model fitting and variable selection methodology to the problem of forecasting civil unrest in Latin America. Our dynamic logistic regression approach shows improved accuracy compared to the static approach currently used in event prediction and feature selection.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

An Approach to Bayesian Optimization for Design Feasibility Check on Discontinuous Black-Box Functions

The paper presents a novel approach to applying Bayesian Optimization (BO) in predicting an unknown constraint boundary, also representing the discontinuity of an unknown function, for a feasibility check on the design space, thereby representing a classification tool to discern between a feasible and infeasible region. Bayesian optimization is a low-cost black-box global optimization tool in the Sequential Design Methods where one learns and updates knowledge from prior evaluated designs, and proceeds to the selection of new designs for future evaluation. However, BO is best suited to problems with the assumption of a continuous objective function and does not guarantee true convergence when having a discontinuous design space. This is because of the insufficient knowledge of the BO about the nature of the discontinuity of the unknown true function. In this paper, we have proposed to predict the location of the discontinuity using a BO algorithm on an artificially projected continuous design space from the original discontinuous design space. The proposed approach has been implemented in a thin tube design with the risk of creep-fatigue failure under constant loading of temperature and pressure. The stated risk depends on the location of the designs in terms of safe and unsafe regions, where the discontinuities lie at the transition between those regions; therefore, the discontinuity has also been treated as an unknown creep-fatigue failure constraint. The proposed BO algorithm has been trained to maximize sampling toward the unknown transition region, to act as a high accuracy classifier between safe and unsafe designs with minimal training cost. The converged solution has been validated for different design parameters with classification error rate and function evaluations at an average of <1% and ~150, respectively. Finally, the performance of our proposed approach in terms of training cost and classification accuracy of thin tube design is shown to be better than the existing machine learning (ML) algorithms such as Support Vector Machine (SVM), Random Forest (RF), and Boosting.

Engineering↗

DOE OSTI2026

The Dark Energy Survey supernova program: a reanalysis of cosmology results and evidence for evolving dark energy with an updated Type Ia supernova calibration

We present improved cosmological constraints from a re-analysis of the Dark Energy Survey (DES) 5-year sample of Type Ia supernovae (DES-SN5YR). This re-analysis includes an improved photometric cross-calibration, recent white dwarf observations to cross-calibrate between DES and low-redshift surveys, retraining the salt3 light-curve model and fixing a numerical approximation in the host-galaxy colour law. Our fully recalibrated sample, which we call DES-Dovekie, comprises ~1600 likely Type Ia SNe from DES and ~200 low-redshift SNe from other surveys. With DES-Dovekie, we obtain Ω m = 0.330 ± 0.015 in flat Lambda-cold dark matter (⁠ΛCDM) which changes Ω m by –0.022 compared to DES-SN5YR. Combining DES-Dovekie with cosmic microwave background data from Planck, Atacama Cosmology Telescope, and South Pole Telescope and the DESI DR2 measurements in a flat CDM cosmology, we find ω 0 = –0.803 ± 0.054 and ω a = –0.72 ± 0.21⁠. Our results hold a significance of 3.2σ, reduced from 4.2σ for DES-SN5YR, to reject the null hypothesis that the data are compatible with the cosmological constant. This significance is equivalent to a Bayesian model preference odds of approximately 5:1 in favour of the flat ω 0 ω a CDM model. Using generally accepted thresholds for model preference, our updated data exhibits only a weak preference for evolving dark energy.

dark energy↗

DOE OSTI2025

ELM–Wet: Inclusion of a Wet–Landunit With Sub–Grid Representation of Eco–Hydrological Patches and Hydrological Forcing Improves Methane Emission Estimations in the E3SM Land Model (ELM)

Wetlands are the largest emitters of biogenic methane (CH 4 ) and represent the highest source of uncertainty in global CH 4 budgets. Here, we aim to improve the realism of wetland representation in the U.S. Department of Energy's Exascale Earth System Model land surface model, ELM, thereby reducing uncertainty of CH 4 flux predictions. We develop an updated version, ELM-Wet, where we activate a separate landunit for wetlands that handles multiple wetland-specific eco-hydrological patch functional types. We introduce more realistic hydrological forcing through prescribing site-level constraints on surface water elevation, which allows resolving different sustained inundation depth for different patches, and if data exists, prescribing inundation depth. We modified the calculation of aerenchyma transport diffusivity based on observed conductance per leaf area for different vegetation types. We use Bayesian Optimization to parameterize CO 2 and CH 4 fluxes in the developed wet-landunit. Site-level simulations of a coastal non-tidal freshwater wetland in Louisiana were performed with the updated model. Eddy covariance observations of CO 2 and CH 4 fluxes from 2012 to 2013 were used to train the model and data from 2021 were used for validation. Patch-specific chamber flux observations and observations of CH 4 concentration profiles in the soil porewater from 2021 were used for evaluation of the model performance. Our results show that ELM-Wet reduces the model's CH 4 emission root mean squared error by up to 33% and is able to represent inter-daily CO 2 and CH 4 flux variability across the wetland's eco-hydrological patches, including during periods of extreme dry or wet conditions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

ADAPTIVE GROUP TESTING WITH MISMATCHED MODELS

Accurate detection of infected individuals is one of the critical steps in stopping any pandemic. When the underlying infection rate of the disease is low, testing people in groups, instead of testing each individual in the population, can be more efficient. In this work, we consider noisy adaptive group testing design with specific test sensitivity and specificity that select the optimal group given previous test results based on pre-selected utility function. As in prior studies on group testing, we model this problem as a sequential Bayesian Optimal Experimental Design (BOED) to adaptively design the groups for each test. We analyze the required number of group tests when using the updated posterior on the infection status and the corresponding Mutual Information (MI) as our utility function for selecting new groups. More importantly, we study how the potential bias on the ground-truth noise of group tests may affect the group testing sample complexity.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Rapid retreat of the southwestern Laurentide Ice Sheet during the Bølling-Allerød interval

The timing of Laurentide Ice Sheet deglaciation along its southwestern margin controlled the evolution of large glacial lakes and has implications for human migration into the Americas. Accurate reconstruction of the ice sheet’s retreat also constrains glacial isostatic adjustment models and is important for understanding ice-sheet sensitivity to climate forcing. Despite its significance, retreat of the southwestern Laurentide Ice Sheet (SWLIS) is poorly constrained by minimum-limiting 14 C data. We present 26 new cosmogenic 10 Be exposure ages spanning the western Interior Plains, Canada. Using a Bayesian framework, we combine these data with geomorphic mapping, 10 Be, and high-quality minimum-limiting 14 C ages to provide an updated chronology. This dataset presents an internally consistent retreat record and indicates that the initial detachment of the SWLIS from its convergence with the Cordilleran Ice Sheet began by ca. 15.0 ka, concurrent with or slightly prior to the onset of the Bølling-Allerød interval (14.7–12.9 ka) and retreated >1200 km to its Younger Dryas (YD) position in ~2500 yr. Ice-sheet stabilization at the Cree Lake Moraine facilitated a meltwater drainage route to the Arctic from glacial Lake Agassiz within the YD, but not necessarily at the beginning. Our record of deglaciation and new YD constraints demonstrate deglaciation of the Interior Plains was ~60% faster than suggested by minimum 14 C constraints alone. In conclusion, numerical modeling of this rapid retreat estimates a loss of ~3.7 m of sea-level equivalent from the SWLIS during the Bølling-Allerød interval.

58 GEOSCIENCES↗

DOE OSTI2024

Interpreting strain tensor data to characterize and monitor reservoirs for CO2 storage and other applications

Recent advances in instrumentation have made it feasible to measure the transient strain tensor caused by small changes in fluid volume or pressure in the subsurface and this has opened the door to new opportunities for characterization and monitoring. We have deployed strainmeters and then conducted injection well tests in an underlying reservoir at 530m depth. The resulting data indicated that the horizontal strain at shallow strainmeters (30 to 40m depth) was tensile and the vertical strain was compressive. The radial strain was less than the horizontal strain, and the strain rates decreased from 100 nanostrain/day to roughly 10 n/d over a few days. The signal at two strainmeters at shallow depth were consistent, although the magnitude of the horizontal strains were different reflecting the different radial directions from the well. The signal at a deep strainmeter deployed at reservoir depth was much different, with tensile vertical strains and compressive horizontal strains. These data can be interpreted by inverting poroelastic forward models developed using numerical and analytical methods. The average horizontal strain in the caprock resembles the transient pressure in the underlying reservoir and classic type-curve methods from transient well testing can be used for preliminary interpretations of strain data. We have developed closed-form analytical solutions to a pressurized poroelastic inclusion and inhomogeneity in a half-space. This model is fast and can be inverted to estimate reservoir stiffness and geometry. Numerical models developed using finite element methods allow more details of the subsurface to be included in the inversion, but they require much longer run times and this makes inversion cumbersome using standard methods. We have developed an inversion approach that uses a proxy model created using machine learning to do most of the forward calculations. The proxy model is periodically updated and refined using the finite element model to ensure accuracy. This approach significantly reduces the computational requirements and makes it feasible to use Bayesian inversion with large numerical models. We have shown that the strain tensor in the caprock is sensitive to pressure in the reservoir, boundaries in the reservoir, and pressure in the caprock caused by leaks. These results indicate that coupling strain tensor data with inversion has the potential to help evaluate reservoirs during initial characterization, and to monitor them during the CO2 injection and storage process.

Murdoch, Larry↗

DOE OSTI2021

ACCESS: An Optical Transmission Spectrum of the High-gravity Hot Jupiter HAT-P-23b

We present a new ground-based visible transmission spectrum of the high-gravity, hot Jupiter HAT-P-23b, obtained as part of the ACCESS project. We derive the spectrum from five transits observed between 2016 and 2018, with combined wavelength coverage between 5200 Å and 9269 Å in 200 Å bins, and with a median precision of 247 ppm per bin. HAT-P-23b’s relatively high surface gravity (g ≈ 30 m s{sup −2}), combined with updated stellar and planetary parameters from Gaia DR2, gives a five-scale-height signal of 384 ppm for a hydrogen-dominated atmosphere. Bayesian models favor a clear atmosphere for the planet with the tentative presence of TiO, after simultaneously modeling stellar contamination, using spots parameter constraints from photometry. If confirmed, HAT-P-23b would be the first example of a high-gravity gas giant with a clear atmosphere observed in transmission at optical/near-IR wavelengths; therefore, we recommend expanding observations to the UV and IR to confirm our results and further characterize this planet. This result demonstrates how combining transmission spectroscopy of exoplanet atmospheres with long-term photometric monitoring of the host stars can help disentangle the exoplanet and stellar activity signals.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Stability boundary and optimal operating parameter identification in milling using Bayesian learning

Here, this paper describes a novel Bayesian learning approach for stability boundary and optimal parameter identification in milling without the knowledge of the underlying tool dynamics or material cutting force coefficients. The paper is divided into two parts. First, a Bayesian learning method for stability lobe identification using test results is described. Each axial depth and spindle speed combination is characterized by a probability of stability which is updated using Bayes’ rule when a test result (stable or unstable) is made available. A novel likelihood function is defined which incorporates knowledge of the stability behavior. Numerical results show convergence to the analytical stability lobe diagram. Second, an adaptive experimental strategy to identify optimal operating parameters that maximize material removal rate is described. Numerical evaluation shows convergence to the optimal operating point with error less than 15 % within ten tests on average. The approach is validated using experimental results. Results show that the proposed method is an efficient and robust learning method to identify the stability lobe diagram and optimal operating parameters with a limited number of tests/data points.

Bayesian machine learning↗

DOE OSTI2021

High-Quality Revision of the Israeli Seismic Bulletin

Seismic bulletins, with trustworthy phase picks, origin times, and source locations are key for regional seismic studies, such as travel-time (TT) tomography, attenuation tomography, and anisotropy studies. To lay the groundwork for such studies in Israel, we revised the seismic bulletin of Israel and the surrounding area and obtained a trustworthy TT data set. From the earthquake and explosion bulletins of the Geophysical Institute of Israel, we compiled a starting data set of about 123,000 earthquakes and explosions that occurred during the past 40 yr. After screening out the poorly recorded events, we were left with a data set of ~38,000 well-recorded events. We then revised the remaining data set in two consecutive steps. In the first, we reviewed and updated station metadata, including changes in station metadata parameters over time. In the second step, we jointly relocated a list of selected seismic events, using the Bayesian hierarchical location software package (BayesLoc) of Myers et al. (2007) that performs joint relocation of multiple events. We observed striking dissimilarities between the spatial distributions of the newly relocated catalog and the initial locations. Although the depth distribution of the starting catalog is trimodal with peaks at 0, 5, and 10 km, the distribution in this study is unimodal, with a broad peak between 7.5 and 12.5 km. By differencing the observed arrival times and the origin times obtained through relocation with BayesLoc, we obtained a revised TT database that consists of 261,336 Pg, 132,876 Pn, 114,816 Sg, and 60,394 Sn arrivals, from a set of 30,458 jointly relocated seismic sources. In this work, we compared prerevision and postrevision TTs as a function of epicentral distance and concluded that the revised data set contains far fewer outliers and inconsistencies than the original data set. The revised TT data set may be used for seismic studies, such as TT tomography, attenuation tomography, and anisotropy studies.

58 GEOSCIENCES↗

DOE OSTI2022

Improving convergence of the Matrix Power Control Algorithm for random vibration testing

Herein, this paper describes modifications to the Matrix Power Control Algorithm (MPCA) to improve convergence for Random Vibration Control (RVC) testing. In particular, this paper presents Multiple-Input Multiple-Output (MIMO) implementations of MPCA in simulation and experiment. An Euler–Bernoulli beam model was simulated with applied base excitations and the Box Assembly with Removable Component (BARC) was used in experiment to validate results. The Bayesian optimization package Dragonfly was used to optimize control parameters. Additionally, a moving-average was employed and optimized to improve the measured response feedback for MPCA, reduce the number of averages needed to be taken between control updates, and further improve convergence. The key results of this paper show that the performance of MPCA can be improved by tuning the control parameters and by applying an optimized moving-average. Furthermore, it is demonstrated that convergence can be achieved within 12 drive-frames, which greatly enhances vibration control capability.

42 ENGINEERING↗

DOE OSTI2022

New results from the CUORE experiment

We report that the Cryogenic Underground Observatory for Rare Events (CUORE) is the first bolometric experiment searching for neutrino-less double-beta (0vββ) decay that has been able to reach the one-ton scale. The detector, located at the Laboratori Nazionali del Gran Sasso in Italy, consists of an array of 988 TeO 2 crystals arranged in a compact cylindrical structure of 19 towers. Following the completion of the detector construction in August 2016, CUORE began its first physics data run in 2017 at a base temperature of about 10 mK. Following multiple optimization campaigns in 2018, CUORE is currently in stable operating mode. In 2019, CUORE released its second result of the search for 0vββ corresponding to a TeO 2 exposure of 372.5 kg∙yr and a median exclusion sensitivity to a 130 Te 0vββ decay half-life of 1.7 ∙ 10 25 yr. We find no evidence for 0vββ decay and set a 90% C.I. Bayesian lower limit of 3.2 ∙ 10 25 yr on the 130 Te 0vββ decay half-life. We present the current status of CUORE’s search for 0vββ. We give an update of the CUORE background model and the measurement of the 130 Te two neutrino double-beta (2vββ) decay half-life. Eventually, we show the preliminary results on half-life limits from the analysis of 130 Te 0vββ and 2vββ decay to the first 0 + excited state of 130 Xe.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

Hierarchical ensemble Kalman methods with sparsity-promoting generalized gamma hyperpriors

This paper introduces a computational framework to incorporate flexible regularization techniques in ensemble Kalman methods, generalizing the iterative alternating scheme to nonlinear inverse problems. The proposed methodology approximates the maximum a posteriori (MAP) estimate of a hierarchical Bayesian model characterized by a conditionally Gaussian prior and generalized gamma hyperpriors. Suitable choices of hyperparameters yield sparsity-promoting regularization. We propose an iterative algorithm for MAP estimation, which alternates between updating the unknown with an ensemble Kalman method and updating the hyperparameters in the regularization to promote sparsity. Here, the effectiveness of our methodology is demonstrated in several computed examples, including compressed sensing and subsurface flow inverse problems.

Ensemble Kalman methods↗