Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

765 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

On Finding Black Holes in Photometric Microlensing Surveys

There are expected to be millions of isolated black holes in the galaxy resulting from the deaths of massive stars. Measuring the abundance and properties of this remnant population would shed light on the end stages of stellar evolution and the evolution paths of black hole systems. Detecting isolated black holes is currently only possible via gravitational microlensing, which has so far yielded one definitive detection. The difficulty in finding microlensing black holes lies in having to choose a small subset of events, based on characteristics of their light curves, to allocate expensive and scarce follow-up resources to confirm the identity of the lens. Current methods either rely on simple cuts in parameter space without using the full distribution information or are only effective on small subsets of events. In this paper, we present a new lens classification method. The classifier takes in posterior constraints on light-curve parameters and combines them with a Galactic simulation to estimate the lens class probability. This method is flexible and can be used with any set of microlensing light-curve parameters, making it applicable to large samples of events. We make this classification framework available via the popclass Python package. We apply the classifier to ~10,000 microlensing events from the Optical Gravitational Lensing Experiment survey and find 23 high-probability black hole candidates. Our classifier also suggests that the only known isolated black hole is an observational outlier, according to current Galactic models, and the allocation of astrometric follow-up on this event was a high-risk strategy.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Manifold learning for coarse-graining atomistic simulations: Application to amorphous solids

In this work, we introduce a generalized machine learning framework to probabilistically parameterize upper-scale models in the form of nonlinear PDEs consistent with a continuum theory, based on coarse-grained atomistic simulation data of mechanical deformation and flow processes. The proposed framework utilizes a hypothesized coarse-graining methodology with manifold learning and surrogate-based optimization techniques. Coarse-grained high-dimensional data describing quantities of interest of the multiscale models are projected onto a nonlinear manifold whose geometric and topological structure is exploited for measuring behavioral discrepancies in the form of manifold distances. A surrogate model is constructed using Gaussian process regression to identify a mapping between stochastic parameters and distances. Derivative-free optimization is employed to adaptively identify a unique set of parameters of the upper-scale model capable of rapidly reproducing the system's behavior while maintaining consistency with coarse-grained atomic-level simulations. The proposed method is applied to learn the parameters of the shear transformation zone (STZ) theory of plasticity that describes plastic deformation in amorphous solids as well as coarse-graining parameters needed to translate between atomistic and continuum representations. We show that the methodology is able to successfully link coarse-grained microscale simulations to macroscale observables and achieve a high-level of parity between the models across scales.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Evaluating the Potential and Challenges of an Uncertainty Quantification Method for Long Short–Term Memory Models for Soil Moisture Predictions

Recently, recurrent deep networks have shown promise to harness newly available satellite–sensed data for long–term soil moisture projections. However, to be useful in forecasting, deep networks must also provide uncertainty estimates. Here we evaluated Monte Carlo dropout with an input–dependent data noise term (MCD+N), an efficient uncertainty estimation framework originally developed in computer vision, for hydrologic time series predictions. MCD+N simultaneously estimates a heteroscedastic input–dependent data noise term (a trained error model attributable to observational noise) and a network weight uncertainty term (attributable to insufficiently constrained model parameters). Although MCD+N has appealing features, many heuristic approximations were employed during its derivation, and rigorous evaluations and evidence of its asserted capability to detect dissimilarity were lacking. To address this, we provided an in–depth evaluation of the scheme's potential and limitations. We showed that for reproducing soil moisture dynamics recorded by the Soil Moisture Active Passive (SMAP) mission, MCD+N indeed gave a good estimate of predictive error, provided that we tuned a hyperparameter and used a representative training data set. The input–dependent term responded strongly to observational noise, while the model term clearly acted as a detector for physiographic dissimilarity from the training data, behaving as intended. However, when the training and test data were characteristically different, the input–dependent term could be misled, undermining its reliability. Additionally, due to the data–driven nature of the model, data noise also influences network weight uncertainty, and therefore the two uncertainty terms are correlated. Altogether, this approach has promise, but care is needed to interpret the results.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2022

A Framework for Deep Learning Emulation of Numerical Models With a Case Study in Satellite Remote Sensing

Numerical models based on physics represent the state of the art in Earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and characterizing variability and uncertainty. Thus, surrogate models are often developed to capture the essential attributes of the full-blown numerical models. Recent successes of machine learning methods, especially deep learning (DL), across many disciplines offer the possibility that complex nonlinear connectionist representations may be able to capture the underlying complex structures and nonlinear processes in Earth systems. A difficult test for DL-based emulation, which refers to function approximation of numerical models, is to understand whether they can be comparable to traditional forms of surrogate models in terms of computational efficiency while simultaneously reproducing model results in a credible manner. A DL emulation that passes this test may be expected to perform even better than simple models with respect to capturing complex processes and spatiotemporal dependencies. Here, we examine, with a case study in satellite-based remote sensing, the hypothesis that DL approaches can credibly represent the simulations from a surrogate model with comparable computational efficiency. Our results are encouraging in that the DL emulation reproduces the results with acceptable accuracy and often even faster performance. We discuss the broader implications of our results in light of the pace of improvements in high-performance implementations of DL and the growing desire for higher resolution simulations in the Earth sciences.

Bayesian Deep Learning↗
DOE OSTI2022

AI-assisted optimization of the ECCE tracking system at the Electron Ion Collider

The Electron-Ion Collider (EIC) is a cutting-edge accelerator facility that will study the nature of the “glue” that binds the building blocks of the visible matter in the universe. The proposed experiment will be realized at Brookhaven National Laboratory in approximately 10 years from now, with detector design and R&D currently ongoing. Notably, EIC is one of the first large-scale facilities to leverage Artificial Intelligence (AI) already starting from the design and R&D phases. The EIC Comprehensive Chromodynamics Experiment (ECCE) is a consortium that proposed a detector design based on a 1.5 T solenoid. The EIC detector proposal review concluded that the ECCE design will serve as the reference design for an EIC detector. Herein we describe a comprehensive optimization of the ECCE tracker using AI. The work required a complex parametrization of the simulated detector system. Herein our approach dealt with an optimization problem in a multidimensional design space driven by multiple objectives that encode the detector performance, while satisfying several mechanical constraints. We describe our strategy and show results obtained for the ECCE tracking system. The AI-assisted design is agnostic to the simulation framework and can be extended to other sub-detectors or to a system of sub-detectors to further optimize the performance of the EIC detector.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Multiscale Physics of Atomic Nuclei from First Principles

Atomic nuclei exhibit multiple energy scales ranging from hundreds of MeV in binding energies to fractions of an MeV for low-lying collective excitations. As the limits of nuclear binding are approached near the neutron and proton drip lines, traditional shell structure starts to melt with an onset of deformation and an emergence of coexisting shapes. It is a long-standing challenge to describe this multiscale physics starting from nuclear forces with roots in quantum chromodynamics. Here, we achieve this within a unified and nonperturbative quantum many-body framework that captures both short- and long-range correlations starting from modern nucleon-nucleon and three-nucleon forces from chiral effective field theory. The short-range (dynamic) correlations which account for the bulk of the binding energy are included within a symmetry-breaking framework, while long-range (static) correlations (and fine details about the collective structure) are included by employing symmetry projection techniques. Our calculations accurately reproduce—within theoretical error bars—available experimental data for low-lying collective states and the electromagnetic quadrupole transitions in 20−30 Ne. In addition, we reveal coexisting spherical and deformed shapes in 30 Ne, which indicates the breakdown of the magic neutron number 𝑁 = 20 as the key nucleus 28 O is approached, and we predict that the drip line nuclei 32,34 Ne are strongly deformed and collective. By developing reduced-order models for symmetry-projected states, we perform a global sensitivity analysis and find that the subleading singlet 𝑆-wave contact and a pion-nucleon coupling strongly impact nuclear deformation in chiral effective field theory. The techniques developed in this work clarify how microscopic nuclear forces generate the multiscale physics of nuclei spanning collective phenomena as well as short-range correlations and allow one to capture emergent and dynamical phenomena in finite fermion systems such as atom clusters, molecules, and atomic nuclei.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2020

Integrating field observations and process-based modeling to predict watershed water quality under environmental perturbations

Watersheds play a critical role in supplying water resources needed for human use and ecosystem health. Understanding and predicting how, when, and where changes in the quantity and quality of water resources occur under different environmental stresses including extreme events is crucial for sustainable management of water resources under a changing environment. However, few studies have attempted to quantify or identify the factors and process interactions controlling the impact of extreme events across water-shed systems. Only few large-scale studies include coordinated monitoring and modeling efforts, which limits our ability to assess the large-scale impact of extreme events on water supply and quality. Methods are lacking to propagate uncertainty in process understanding through an integrated hydro-biogeochemical model framework and evaluate its importance, thus failing to take full advantage of the information potentially available through transformative advances in characterization technologies from high-resolution mass spectrometry to airborne and satellite-based remote sensing. There are consequent risks to our nations water security and to human and ecosystem health that may become exacerbated with the increasing frequency of extreme events that is projected for the coming decades. This paper reviews the current status of watershed science for both water quantity and quality and identifies critical gaps in our current knowledge and modeling capability in addressing the emergent needs in predicting watershed hydrologic and biogeochemical responses (i.e., water quantity and quality) under natural and anthropogenic perturbations. We highlight the need to (1) understand how environmental perturbations including extreme events like floods and droughts propagate through watershed systems and assess their short- and long-term impacts on watershed biogeochemistry, water quality and their recovery pathways; (2) develop and improve a watershed water quality model that reflects the state of scientific understanding gained from observations; and (3) construct a data-model fusion system for watershed characterization, process identification, and mechanistic model parameterization. A large base of modeling, monitoring and data capabilities have been built by various federal government agencies given the relevance of water to their critical missions. An emerging need is to build an integrated national capability for watershed water availability and quality that can address water-related missions across multiple federal agencies.

13 HYDRO ENERGY↗
DOE OSTI2025

Evaluating Probabilistic Deep Learning Methods for Uncertainty Quantification of Precipitation Bias Correction

Climate models often exhibit biases in their precipitation predictions, particularly underestimating high-intensity events and overestimating low precipitation. Deep learning approaches offer promising solutions, but their epistemic uncertainty associated with a deep learning–based bias correction method has not previously been quantified for reliable downstream climate impact studies. While methods for capturing the epistemic uncertainty in deep learning frameworks exist, there is currently no consensus on the best method. In this work, we compare three uncertainty quantification (UQ) methods—Deep Ensembles (DEns), Monte Carlo Dropout (MCD), and Flipout—by assessing the reliability of their uncertainty estimates using standard measures such as sharpness and calibration. These UQ methods are applied to an existing deep learning precipitation bias correction model known as UFNet: a coupled U-Net and fully connected neural network. The methods utilized to assess the models’ uncertainties are 1) calibration, which ensures that the expected probabilities of the model align with reality and 2) sharpness, which is a measure of the precision of the model’s probabilistic predictions. Of the three UQ methods evaluated, the DEns and MCD methods demonstrated the best-calibrated performance (expected calibration error of 0.36 and 0.35, respectively), compared to Flipout (0.58). In contrast, Flipout had the sharpest predictions and the highest metric performance in bias correcting precipitation—especially for higher-order moments such as kurtosis with a spatial correlation of 72% compared to 32% and 55% spatial correlation for DEns and MCD, respectively. Of the three UQ methods, MCD was found to be the most suitable method for UQ purposes based on its calibration, sharpness, and computational requirements.

Bayesian methods↗
DOE OSTI2025

Enhancing DESI DR1 full-shape analyses using HOD-informed priors

We present an analysis of DESI Data Release 1 (DR1) that incorporates Halo Occupation Distribution (HOD)-informed priors into Full-Shape (FS) modeling of the power spectrum based on cosmological perturbation theory (PT). By leveraging physical insights from the galaxy-halo connection, these HOD-informed priors on nuisance parameters substantially mitigate projection effects in extended cosmological models that allow for dynamical dark energy. The resulting credible intervals now encompass the posterior maximum from the baseline analysis using gaussian priors, eliminating a significant posterior shift observed in baseline studies. In the ΛCDM framework, a combined DESI DR1 FS information and constraints from the DESI DR1 baryon acoustic oscillations (BAO) — including Big Bang Nucleosynthesis (BBN) constraints and a weak prior on the scalar spectral index — yields Ω m = 0.2994 ± 0.0090 and σ 8 = 0.836$^{+0.024}_{-0.027}$, representing improvements of approximately 4% and 23% over the baseline analysis, respectively. For the w 0 w a CDM model, our results from various data combinations are highly consistent, with all configurations converging to a region with w 0 > -1 and w a < 0. This convergence not only suggests intriguing hints of dynamical dark energy but also underscores the robustness of our HOD-informed prior approach in delivering reliable cosmological constraints.

59 BASIC BIOLOGICAL SCIENCES↗