Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Impact of the newly revised gravitational redshift of x-ray burster GS 1826-24 on the equation of state of supradense neutron-rich matter

Thanks to the recent advancement in producing rare isotopes and measuring their masses with unprecedented precision, the updated nuclear masses around the waiting-point nucleus 64 Ge in the rapid-proton capture process have led to a significant revision of the surface gravitational redshift of the neutron star (NS) in GS 1826-24 by refitting its x-ray burst light curve using Modules for Experiments in Stellar Astrophysics (MESA). The resulting NS compactness ξ is between 0.183 and 0.259 at 95% confidence level, and its upper boundary is significantly smaller than the maximum ξ previously known. Incorporating these new data within a comprehensive Bayesian statistical framework, we investigate its impact on the Equation of State (EOS) of supradense neutron-rich matter and the required spin frequency for GW190814’s minor m 2 with mass 2.59 ± 0.05⁢M ⊙ to be a rotationally stable pulsar. We found that the EOS of high-density symmetric nuclear matter (SNM) has to be softened significantly while the symmetry energy at supersaturation densities stiffened compared to our prior knowledge from earlier analyses using data from both astrophysical observations and terrestrial nuclear experiments. In particular, the skewness J 0 characterizing the stiffness of high-density symmetric nuclear matter (SNM) decreases significantly, while the slope L, curvature K sym , and skewness Jsym of nuclear symmetry energy all increase appreciably compared to their fiducial values. Here, we also found that the most probable spin rate for the m 2 to be a stable pulsar is very close to its mass-shedding limit once the revised redshift data from GS 1826-24 is considered, making the m 2 unlikely the most massive NS observed so far.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Descriptor Aided Bayesian Optimization for Many-Level Qualitative Variables With Materials Design Applications

Abstract Engineering design often involves qualitative and quantitative design variables, which requires systematic methods for the exploration of these mixed-variable design spaces. Expensive simulation techniques, such as those required to evaluate optimization objectives in materials design applications, constitute the main portion of the cost of the design process and underline the need for efficient search strategies—Bayesian optimization (BO) being one of the most widely adopted. Although recent developments in mixed-variable Bayesian optimization have shown promise, the effects of dimensionality of qualitative variables have not been well studied. High-dimensional qualitative variables, i.e., with many levels, impose a large design cost as they typically require a larger dataset to quantify the effect of each level on the optimization objective. We address this challenge by leveraging domain knowledge about underlying physical descriptors, which embody the physics of the underlying physical phenomena, to infer the effect of unobserved levels that have not been sampled yet. We show that physical descriptors can be intuitively embedded into the latent variable Gaussian process approach—a mixed-variable GP modeling technique—and used to selectively explore levels of qualitative variables in the Bayesian optimization framework. This physics-informed approach is particularly useful when one or more qualitative variables are high dimensional (many-level) and the modeling dataset is small, containing observations for only a subset of levels. Through a combination of mathematical test functions and materials design applications, our method is shown to be robust to certain types of incomplete domain knowledge and significantly reduces the design cost for problems with high-dimensional qualitative variables.

Engineering↗
DOE OSTI2024

Projective Integral Updates for High-Dimensional Variational Inference

Variational inference is an approximation framework for Bayesian inference that seeks to improve quantified uncertainty in predictions by optimizing a simplified distribution over parameters to stand in for the full posterior. Capturing model variations that remain consistent with training data enables more robust predictions by reducing parameter sensitivity. This work introduces a fixed-point optimization for variational inference that is applicable when every feasible log density can be expressed as a linear combination of functions from a given basis. In such cases, the optimizer becomes a fixed-point of projective integral updates. When the basis spans univariate quadratics in each parameter, the feasible distributions are Gaussian mean-fields and the projective integral updates yield quasi-Newton variational Bayes (QNVB). Other bases and updates are also possible. Since these updates require high-dimensional integration, this work begins by proposing an efficient quasirandom sequence of quadratures for mean-field distributions. Each iterate of the sequence contains two evaluation points that combine to correctly integrate all univariate quadratic functions and, if the mean-field factors are symmetric, all univariate cubics. More importantly, averaging results over short subsequences achieves periodic exactness on a much larger space of multivariate polynomials of quadratic total degree. The corresponding variational updates require four loss evaluations with standard (not second-order) backpropagation to eliminate error terms from over half of all multivariate quadratic basis functions. Furthermore, this integration technique is motivated by first proposing stochastic blocked mean-field quadratures, which may be useful in other contexts. A PyTorch implementation of QNVB allows for better control over model uncertainty during training than competing methods. Experiments demonstrate superior generalizability for multiple learning problems and architectures.

Gaussian mean-field↗
DOE OSTI2024

Bayesian inference of structured latent spaces from neural population activity with the orthogonal stochastic linear mixing model

The brain produces diverse functions, from perceiving sounds to producing arm reaches, through the collective activity of populations of many neurons. Determining if and how the features of these exogenous variables (e.g., sound frequency, reach angle) are reflected in population neural activity is important for understanding how the brain operates. Often, high-dimensional neural population activity is confined to low-dimensional latent spaces. However, many current methods fail to extract latent spaces that are clearly structured by exogenous variables. This has contributed to a debate about whether or not brains should be thought of as dynamical systems or representational systems. Here, we developed a new latent process Bayesian regression framework, the orthogonal stochastic linear mixing model (OSLMM) which introduces an orthogonality constraint amongst time-varying mixture coefficients, and provide Markov chain Monte Carlo inference procedures. We demonstrate superior performance of OSLMM on latent trajectory recovery in synthetic experiments and show superior computational efficiency and prediction performance on several real-world benchmark data sets. We primarily focus on demonstrating the utility of OSLMM in two neural data sets: μ ECoG recordings from rat auditory cortex during presentation of pure tones and multi-single unit recordings form monkey motor cortex during complex arm reaching. We show that OSLMM achieves superior or comparable predictive accuracy of neural data and decoding of external variables (e.g., reach velocity). Most importantly, in both experimental contexts, we demonstrate that OSLMM latent trajectories directly reflect features of the sounds and reaches, demonstrating that neural dynamics are structured by neural representations. Together, these results demonstrate that OSLMM will be useful for the analysis of diverse, large-scale biological time-series datasets.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Bayesian Monte-Carlo Evaluation Framework for Imperfect Data [Slides]

BMC evaluation is a tool to address imperfect data & models, non-linear models, and non-normal PDFs. New posterior PDFs may need new storage formats to allow storage of non-normal PDFs. Storing posterior sets allows for: variance, covariance, skewness, etc.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Bayesian Monte-Carlo Evaluation Framework for Imperfect Nuclear Data [Slides]

BMC evaluation is a tool used to address imperfect data and models, non-linear models, and non-normal PDFs. ENDF-6 format does not allow non-normal parameter PDFs. Storing posterior sets allows for variance, covariance, skewness, etc. To better predict criticality, we should document non-normal parameter PDFs (i.e. asymmetric uncertainty) and consider non-linear sensitivity of $k_{\text{eff}}$ to resonance parameters.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Bayesian Exploration and Surrogate Emulation of Nonlinear Beam-Response Geometry in the LBNF Beamline

Next-generation long-baseline neutrino experiments aim to achieve multi-MW proton beam power while reducing accelerator-induced systematic uncertainties. At Fermilab, the LBNF beamline is designed for 1.2 MW operation with PIP-II and is upgradeable to 2.4 MW. DUNE will probe the three-flavor neutrino paradigm and search for CP violation, requiring precise neutrino-flux normalization and improved control of accelerator-related uncertainties. Within the LBNF beamline, the System for On-Axis Neutrino Detection (SAND) will constrain flux uncertainties using precision near-detector measurements, while the Muon Monitor System (MuMS) will provide beamline diagnostics sensitive to the proton beam, target, and horn configuration. However, the pion phase space relevant for DUNE depends simultaneously on many correlated parameters, including beam centroid, beam width, horn current and alignment, target position, optics shifts, and radiation-induced changes. Consequently, MuMS observables exhibit nonlinear and coupled responses that are difficult to characterize using traditional one-parameter scans. To address this challenge, we are developing a Bayesian Exploration framework coupled to physics-informed surrogate emulators trained on Geant4 beamline simulations. Gaussian-process emulators provide both fast predictions and uncertainty estimates, enabling adaptive selection of new simulation points in beam-parameter space. As an initial demonstration, we construct surrogate emulators for MuMS response observables using a verified simulation campaign spanning proton-beam steering conditions. The emulators reproduce the simulated dependence of MuMS centroid and gradient observables while providing predictive uncertainties, and serve as the foundation for future multidimensional exploration including beam width, horn current, and additional beamline parameters. This work establishes a framework for uncertainty-aware beam monitoring, adaptive simulation campaigns, and rapid beam-response inference for future DUNE operations.

Ganguly, Sudeshna [Fermilab] (ORCID:00000003163482↗
DOE OSTI2020

Transfer Learning for HVAC System Fault Detection

Faults in HVAC systems degrade thermal comfort and energy efficiency in buildings and have received significant attention from the research community, with data driven methods gaining in popularity. Yet the lack of labeled data, such as normal versus faulty operational status, has slowed the application of machine learning to HVAC systems. In addition, for any particular building, there may be an insufficient number of observed faults over a reasonable amount of time for training. To overcome these challenges, we present a transfer methodology for a novel Bayesian classifier designed to distinguish between normal operations and faulty operations. The key is to train this classifier on a building with a large amount of sensor and fault data (for example, via simulation or standard test data) then transfer the classifier to a new building using a small amount of normal operations data from the new building. We demonstrate a proof-of-concept for transferring a classifier between architecturally similar buildings in different climates and show few samples are required to maintain classification precision and recall.

transfer learning, Building HVAC, Bayesian framewo↗
DOE OSTI2023

A Preferential Growth Channel for Supermassive Black Holes in Elliptical Galaxies at z ≲ 2

The assembly of stellar and supermassive black hole (SMBH) mass in elliptical galaxies since z ~ 1 can help to diagnose the origins of locally observed correlations between SMBH mass and stellar mass. We therefore construct three samples of elliptical galaxies, one at z ~ 0 and two at 0.7 ≲ z ≲ 2.5, and quantify their relative positions in the M BH -M * plane. Using a Bayesian analysis framework, we find evidence for translational offsets in both stellar mass and SMBH mass between the local sample and both higher-redshift samples. The offsets in stellar mass are small, and consistent with measurement bias, but the offsets in SMBH mass are much larger, reaching a factor of 7 between z ~ 1 and z ~ 0. The magnitude of the SMBH offset may also depend on redshift, reaching a factor of ~20 at z ~ 2. The result is robust against variation in the high- and low-redshift samples and changes in the analysis approach. The magnitude and redshift evolution of the offset are challenging to explain in terms of selection and measurement biases. We conclude that either there is a physical mechanism that preferentially grows SMBHs in elliptical galaxies at z ≲ 2, or that selection and measurement biases are both underestimated, and depend on redshift.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

BeyondPlanck I. Global Bayesian analysis of the Planck Low Frequency Instrument data

We describe the BeyondPlanck project in terms of motivation, methodology and main products, and provide a guide to a set of companion papers that describe each result in fuller detail. Building directly on experience from ESA's Planck mission, we implement a complete end-to-end Bayesian analysis framework for the Planck Low Frequency Instrument (LFI) observations. The primary product is a joint posterior distribution P(omega|d), where omega represents the set of all free instrumental (gain, correlated noise, bandpass etc.), astrophysical (synchrotron, free-free, thermal dust emission etc.), and cosmological (CMB map, power spectrum etc.) parameters. Some notable advantages of this approach are seamless end-to-end propagation of uncertainties; accurate modeling of both astrophysical and instrumental effects in the most natural basis for each uncertain quantity; optimized computational costs with little or no need for intermediate human interaction between various analysis steps; and a complete overview of the entire analysis process within one single framework. As a practical demonstration of this framework, we focus in particular on low-l CMB polarization reconstruction, paying special attention to the LFI 44 GHz channel. We find evidence of significant residual systematic effects that are still not accounted for in the current processing, but must be addressed in future work. These include a break-down of the 1/f correlated noise model at 30 and 44 GHz, and scan-aligned stripes in the Southern Galactic hemisphere at 44 GHz. On the Northern hemisphere, however, we find that all results are consistent with the LCDM model, and we constrain the reionization optical depth to tau = 0.067 +/- 0.016, with a low-resolution chi-squared probability-to-exceed of 16%. The marginal CMB dipole amplitude is 3359.5 +/- 1.9 uK. (Abridged.)

Andersen, KJ↗
DOE OSTI2025

Uncertainty quantification in MELCOR Safety analysis of ARIES reactor designs

MELCOR-TMAP is a combined thermal-hydraulics and tritium tracking code developed to simulate severe accident scenarios in fission and fusion power plants. Here, we demonstrate the results of MELCOR-TMAP analyses on historical ARIES program reference designs. By coupling MELCOR-TMAP with the open source RAVEN probabilistic risk analysis framework’s Bayesian UQ capabilities, we also demonstrate key uncertainties in material properties with the highest impact on tritium inventory and plant risk.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Optimal sizing of battery energy storage systems for peak shaving and demand response using a degradation-aware Bayesian Optimization-Mixed-Integer Linear Programming framework

The increasing integration of renewable energy and rising electricity demand highlight the importance of battery energy storage systems for peak shaving and demand response. Unlike prior approaches that overlook operational impacts on degradation, this study proposes a Bayesian Optimization–Mixed Integer Linear Programming framework for optimal battery energy storage system sizing. In this framework, Mixed Integer Linear Programming determines short-term scheduling while a calibrated electrochemical model iteratively evaluates degradation. The central hypothesis is that the framework can efficiently identify optimal sizes that yield realistic and economically robust outcomes. The method is tested across three scenarios: peak shaving, peak shaving with energy-reduction demand response, and peak shaving with power-reduction demand response. Results show that the framework converge to the optimum within 20 iterations out of 150 possible sizes. Under baseline conditions, the framework consistently selects the smallest feasible system, minimizing unnecessary degradation costs from oversized storage. Sensitivity analyses reveal that larger systems are favored as demand rates or incentives increase. Comparisons of demand response programs indicate that power-reduction demand response offers greater economic benefits than energy-reduction demand response, although demand savings from peak shaving remain the dominant contributor to overall performance. This study demonstrates that the proposed framework balances computational tractability with degradation fidelity, identifies critical economic thresholds for investment, and offers a practical, flexible tool to guide industrial stakeholders in cost-effective battery energy storage system deployment.

Batteries↗
DOE OSTI2024

Extracting the Pion Distribution Amplitude from Lattice QCD through Pseudo-Distributions

The Light-Cone Distribution Amplitude (LCDA) encodes the non-perturbative information of the leading Fock component of the hadron wave function, therefore required for processes including exclusive hadron production. As the Pseudo-Nambu-Goldstone boson of QCD, the nonperturbative structure of the pion is of particular interest. Progress on the Lattice QCD calculation of the pion LCDA on O(a) -improved Wilson fermion ensembles at several lattice spacings is presented. Excited-state systematics are taken into account within a Bayesian Model Averaging framework. A Renormalization-Group-Invariant (RGI) ratio of matrix elements is formed for further extraction of the pion LCDA.

Kovner, Daniel↗
DOE OSTI2024

Probing quarkyonic matter in neutron stars with the Bayesian nuclear-physics multimessenger astrophysics framework

The interiors of neutron stars contain matter at the highest densities realized in our Universe. Interestingly, theoretical studies of dense matter, in combination with the existence of two-solar-mass neutron stars, indicate that the speed of sound $c_s$ has to increase to values well above the conformal limit ($c_s^2$ = 1/3) before decreasing again at higher densities. Further, the decrease could be explained by either a strong first-order phase transition or a crossover transition from hadronic to quark matter. The latter scenario leads to a pronounced peak in the speed of sound, reaching values above the conformal limit, naturally explaining the inferred behavior. In this work, we use the nuclear-physics multimessenger astrophysics (NMMA) framework to compare predictions of the quarkyonic matter model with astrophysical observations of neutron stars, with the goal of constraining model parameters. Assuming quarkyonic matter to be realized within neutron stars, we find that there can be a significant amount of quarks inside the cores of neutron stars with masses in the two-solar-mass range, amounting to up to ≈0.13$M$ ⊙ , contributing ≈ 5.9% of the total mass. Furthermore, for the quarkyonic matter model investigated here, the radius of a 1.4$M$ ⊙ neutron star would be $13.44_{–1.54}^{+1.69}(13. 54_{–1.04}^{+1.02})$ km, at 95% credibility, without (with) the inclusion of AT2017gfo.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Dynamic, risk informed decision support systems and methods

The present disclosure is directed to a decision support system or tool based on a Bayesian Network (BN) framework. The diagnostic support tool is created by using advanced Probabilistic Risk Assessment (PRA) method(s) to construct Bayesian Networks (BNs) that form a Bayesian Decision Support Process (BDSP) to provide science-based decision support for understanding and managing events in complex systems. In an embodiment, the PRA method(s) may include Discrete Dynamic Event Trees (DDETs) and simulations.

Groth, Katrina↗
DOE OSTI2021

A Bayesian and HRA-Aided Method for the Novel Reliability Analysis of Software

Technological advancements and nuclear power plant modernization has inspired considerable research in the areas of safety and reliability, yet there remains a lack of consensus for the reliability assessment of digital instrumentation and control (I&C) systems. Motivated by the lack of consensus for reliability analysis methods, this work employs a novel framework that incorporates Bayesian, human reliability, and common-cause failure (CCF) modeling techniques. The novel framework allows the use of state-of-the-art or classical modeling techniques when accounting for human and CCF effects on system reliability. The Bayesian and HRA-Aided Method for the Reliability Analysis of Software (BAHAMAS) is demonstrated by a case study for the quantification of software hazards found in a previous analysis of a digital reactor trip system. The results demonstrate the ability of BAHAMAS to account for human activities during the software development life cycle and their influence on software reliability. BAHAMAS is a flexible tool for extending the coverage of conventional probabilistic risk assessments to include modernized digital I&C systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Local Bayesian Dirichlet mixing of imperfect models

Abstract To improve the predictability of complex computational models in the experimentally-unknown domains, we propose a Bayesian statistical machine learning framework utilizing the Dirichlet distribution that combines results of several imperfect models. This framework can be viewed as an extension of Bayesian stacking. To illustrate the method, we study the ability of Bayesian model averaging and mixing techniques to mine nuclear masses. We show that the global and local mixtures of models reach excellent performance on both prediction accuracy and uncertainty quantification and are preferable to classical Bayesian model averaging. Additionally, our statistical analysis indicates that improving model predictions through mixing rather than mixing of corrected models leads to more robust extrapolations.

97 MATHEMATICS AND COMPUTING↗