Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “bayesian nets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Atmospheric inversion of surface carbon flux with consideration of the spatial distribution of US crop production and consumption

In order to improve quantification of the spatial distribution of carbon sinks and sources in the conterminous US, we conduct a nested global atmospheric inversion with detailed spatial information on crop production and consumption. County-level cropland net primary productivity, harvested biomass, soil carbon change, and human and livestock consumption data over the conterminous US are used for this purpose. Time-dependent Bayesian synthesis inversions are conducted based on CO₂ observations at 210 stations to infer CO₂ fluxes globally at monthly time steps with a nested focus on 30 regions in North America. Prior land surface carbon fluxes are first generated using a biospheric model, and the inversions are constrained using prior fluxes with and without adjustments for crop production and consumption over the 2002–2007 period. After these adjustments, the inverted regional carbon sink in the US Midwest increases from 0.25 ± 0.03 to 0.42 ± 0.13 Pg C yr⁻¹, whereas the large sink in the US southeast forest region is weakened from 0.41 ± 0.12 to 0.29 ± 0.12 Pg C yr⁻¹. These adjustments also reduce the inverted sink in the west region from 0.066 ± 0.04 to 0.040 ± 0.02 Pg C yr⁻¹ because of high crop consumption and respiration by humans and livestock. The general pattern of sink increases in crop production areas and sink decreases (or source increases) in crop consumption areas highlights the importance of considering the lateral carbon transfer in crop products in atmospheric inverse modeling, which provides a reliable atmospheric perspective of the overall carbon balance at the continental scale but is unreliable for separating fluxes from different ecosystems.

54 ENVIRONMENTAL SCIENCES↗

Demonstration of machine-learning-enhanced Bayesian quantum state estimation

Machine learning (ML) has found broad applicability in quantum information science in topics as diverse as experimental design, state classification, and even studies on quantum foundations. Here, we experimentally realize an approach for defining custom prior distributions that are automatically tuned using ML for Bayesian quantum state estimation methods that generally better conform to the physical properties of the underlying system than standard fixed prior distributions. Previously, researchers have looked to Bayesian quantum state tomography for advantages like uncertainty quantification, the return of reliable estimates under any measurement condition, and minimal mean-squared error. However, practical challenges related to long computation times and conceptual issues concerning how to incorporate prior knowledge most suitably can overshadow these benefits. Using both simulated and experimental measurement results, we demonstrate that ML-defined prior distributions reduce net convergence times and provide a natural way to incorporate both implicit and explicit information directly into the prior distribution. These results constitute a promising path toward practical implementations of Bayesian quantum state tomography.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Method for the Selection of Exploration Areas for Unconformity Uranium Deposits

The method we propose employs two analyses: (1) exploration simulation and risk valuation and (2) portfolio optimization. The first analysis, implemented by the investment worth system (IWS), uses Monte Carlo simulation to integrate a wide spectrum of uncertain and varied components to a relative frequency histogram for net present value of the exploration investment, which is converted to a risk-adjusted value (RAV). Iterative rerunning of the IWS enables the mapping of the relationship of RAV to magnitude of exploration expenditure, X. The second major analysis uses RAV vs. X maps to identify that subset (portfolio) of areas that maximizes the RAV of the firm's multiyear exploration budget. The IWS, which is demonstrated numerically, consists of six components based on the geologic description of a hypothetical basin and project area (PA) and a mix of hypothetical and actual conditions of an unidentified area. The geology is quantified and processed by Bayesian belief networks to produce the geology-based inputs required by the IWS. An exploration investment of $60 M produced a highly skewed distribution of net present value (NPV), having mean and median values of $4,160 M and $139 M, respectively. For hypothetical mining firm Minex, the RAV of the exploration investment of $60 M is only $110.7 M. An RAV that is less than 3% of mean NPV reflects the aversion by Minex to risk as well as the magnitude of risk implicit to the highly skewed NPV distribution and the probability of 0.45 for capital loss. Potential benefits of initiating exploration of a portfolio of areas, as contrasted with one area, include increased marginal productivity of exploration as well as reduced probability for nondiscovery. For an exogenously determined multiyear exploration budget, a conceptual framework for portfolio optimization is developed based on marginal RAV exploration products for candidate PAs. PORTFOLIO, a software developed to implement optimization, allocates exploration to PAs so that the RAV of the exploration budget is maximized. Moreover, PORTFOLIO provides a means to examine the impact of magnitude of budget on the composition of the exploration portfolio and the optimum allocation of exploration to PAs that comprise the portfolio. Using fictitious data for five PAs, a numerical demonstration is provided of the use of PORTFOLIO to identify those PAs that comprise the optimum exploration portfolio and to optimally allocate the multiyear budget across portfolio PAs.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Integrating System Dynamics and Bayesian Networks with Application to Counter-IED Scenarios

The practice of choosing a single modeling paradigm for predictive analysis can limit the scope and relevance of predictions and their utility to decision-making processes. Considering multiple modeling methods simultaneously may improve this situation, but a better solution provides a framework for directly integrating different, potentially complementary modeling paradigms to enable more comprehensive modeling and predictions, and thus better-informed decisions. The primary challenges of this kind of model integration are to bridge language and conceptual gaps between modeling paradigms, and to determine whether natural and useful linkages can be made in a formal mathematical manner. To address these challenges in the context of two specific modeling paradigms, we explore mathematical and computational options for linking System Dynamics (SD) and Bayesian network (BN) models and incorporating data into the integrated models. We demonstrate that integrated SD/BN models can naturally be described as either state space equations or Dynamic Bayes Nets, which enables the use of many existing computational methods for simulation and data integration. To demonstrate, we apply our model integration approach to techno-social models of insurgent-led attacks and security force counter-measures centered on improvised explosive devices.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

An Ensemble Approach for Forecasting Net Interchange Schedule

The net interchange schedule (NIS) is the sum of the transactions (MW) between an ISO/RTO and its neighbors. Effective forecasting of the submitted NIS can improve grid operation efficiency. This paper applies a Bayesian model averaging (BMA) technique to forecast submitted NIS. As an ensemble approach, the BMA method aggregates different forecasting models in order to improve forecasting accuracy and consistency. In this study, the BMA method is compared to two alternative approaches: a stepwise regression method and an artificial neural network (ANN) trained for NIS forecasting. In our comparative analysis, we use field measurement data from the Pennsylvania, New Jersey, and Maryland (PJM) Regional Transmission Organization (RTO) to train and test each method. Our preliminary results indicate that ensemble-based methods can provide more accurate and consistent NIS forecasts in comparison to non-ensemble alternate methods.

Vlachopoulou, Maria↗

PINN surrogate of Li-ion battery models for parameter inference, Part I: Implementation and multi-fidelity hierarchies for the single-particle model

To plan and optimize energy storage demands that account for Li-ion battery aging dynamics, techniques need to be developed to diagnose battery internal states accurately and rapidly. Here, this study seeks to reduce the computational resources needed to determine a battery's internal states by replacing physics-based Li-ion battery models - such as the single-particle model (SPM) and the pseudo-2D (P2D) model - with a physics-informed neural network (PINN) surrogate. The surrogate model makes high-throughput techniques, such as Bayesian calibration, tractable to determine battery internal parameters from voltage responses. This manuscript is the first of a two-part series that introduces PINN surrogates of Li-ion battery models for parameter inference (i.e., state-of-health diagnostics). In this first part, a method is presented for constructing a PINN surrogate of the SPM. A multi-fidelity hierarchical training, where several neural nets are trained with multiple physics-loss fidelities is shown to significantly improve the surrogate accuracy when only training on the governing equation residuals. The implementation is made available in a companion repository (https://github.com/NREL/PINNSTRIPES). The techniques used to develop a PINN surrogate of the SPM are extended in Part II for the PINN surrogate for the P2D battery model, and explore the Bayesian calibration capabilities of both surrogates.

25 ENERGY STORAGE↗

Bayesian calibration of terrestrial ecosystem models: a study of advanced Markov chain Monte Carlo methods

Calibration of terrestrial ecosystem models is important but challenging. Bayesian inference implemented by Markov chain Monte Carlo (MCMC) sampling provides a comprehensive framework to estimate model parameters and associated uncertainties using their posterior distributions. The effectiveness and efficiency of the method strongly depend on the MCMC algorithm used. In this work, a differential evolution adaptive Metropolis (DREAM) algorithm is used to estimate posterior distributions of 21 parameters for the data assimilation linked ecosystem carbon (DALEC) model using 14 years of daily net ecosystem exchange data collected at the Harvard Forest Environmental Measurement Site eddy-flux tower. The calibration of DREAM results in a better model fit and predictive performance compared to the popular adaptive Metropolis (AM) scheme. Moreover, DREAM indicates that two parameters controlling autumn phenology have multiple modes in their posterior distributions while AM only identifies one mode. The application suggests that DREAM is very suitable to calibrate complex terrestrial ecosystem models, where the uncertain parameter size is usually large and existence of local optima is always a concern. In addition, this effort justifies the assumptions of the error model used in Bayesian calibration according to the residual analysis. Here, the result indicates that a heteroscedastic, correlated, Gaussian error model is appropriate for the problem, and the consequent constructed likelihood function can alleviate the underestimation of parameter uncertainty that is usually caused by using uncorrelated error models.

54 ENVIRONMENTAL SCIENCES↗

Assimilation of repeated woody biomass observations constrains decadal ecosystem carbon cycle uncertainty in aggrading forests

Forest carbon sink strengths are governed by plant growth, mineralization of dead organic matter, and disturbance. Across landscapes, remote sensing can provide information about aboveground states of forests and this information can be linked to models to estimate carbon cycling in forests close to steady state. For aggrading forests this approach is more challenging and has not been demonstrated. Here in this paper we apply a Bayesian approach, linking a simple model to a range of data, to evaluate their information content, for two aggrading forests. We compare high information content analyses using local observations with retrievals using progressively sparser remotely sensed information (repeated, single, and no woody biomass observations). The net biome productivity of both forests is constrained to be a net sink with <2 Mg C ha -1 yr -1 variation across the range of inputs. However, the sequestration of particular carbon pool(s) varies with assimilated biomass information. Assimilation of repeated biomass observations reduces uncertainty and/or bias in all ecosystem C pools not just wood, compared to analyses using single or no stock information. As verification, our repeated biomass analysis explains 78–86% of variation in litter dynamics at one forest, while at the second forest total dead organic matter estimates are within observational uncertainty. The uncertainty of retrieved ecosystem traits in the repeated biomass analysis is reduced by up to 50% compared to analyses with less biomass information. This study quantifies the importance of repeated woody observations in constraining the dynamics of both wood and dead organic matter, highlighting the benefit of proposed remote sensing missions.

59 BASIC BIOLOGICAL SCIENCES↗

An Approach for Assessing the Signature Quality of Various Chemical Assays when Predicting the Culture Media Used to Grow Microorganisms

We demonstrate an approach for assessing the quality of a signature system designed to predict the culture medium used to grow a microorganism. The system was comprised of four chemical assays designed to identify various ingredients that could be used to produce the culture medium. The analytical measurements resulting from any combination of these four assays can be used in a Bayesian network to predict the probabilities that the microorganism was grown using one of eleven culture media. We evaluated combinations of the signature system by removing one or more of the assays from the Bayes network. We measured and compared the quality of the various Bayes nets in terms of fidelity, cost, risk, and utility, a method we refer to as Signature Quality Metrics

Holmes, Aimee E.↗

Active learning for SNAP interatomic potentials via Bayesian predictive uncertainty

Bayesian inference with a simple Gaussian error model is used to efficiently compute prediction variances for energies, forces, and stresses in the linear SNAP interatomic potential. Here, the prediction variance is shown to have a strong correlation with the absolute error over approximately 24 orders of magnitude. Using this prediction variance, an active learning algorithm is constructed to iteratively train a potential by selecting the structures with the most uncertain properties from a pool of candidate structures. The relative importance of the energy, force, and stress errors in the objective function is shown to have a strong impact upon the trajectory of their respective net error metrics when running the active learning algorithm. Batched training of different batch sizes is also tested against singular structure updates, and it is found that batches can be used to significantly reduce the number of retraining steps required with only minor impact on the active learning trajectory.

97 MATHEMATICS AND COMPUTING↗

BeyondPlanck X. Bandpass and beam leakage corrections

We discuss the treatment of bandpass and beam leakage corrections in the Bayesian BeyondPlanck CMB analysis pipeline as applied to the Planck LFI measurements. As a preparatory step, we first apply three corrections to the nominal LFI bandpass profiles including removal of a known systematic effect in the ground measuring equipment at 61 GHz; smoothing of standing wave ripples; and edge regularization. The main net impact of these modifications is an overall shift in the 70 GHz bandpass of +0.6 GHz; we argue that any analysis of LFI data products, either from Planck or BeyondPlanck, should use these new bandpasses. In addition, we fit a single free bandpass parameter for each radiometer of the form Δ i = Δ 0 + $δ$ i , where Δ 0 represents an absolute frequency shift per frequency band and $δ$i is a relative shift per detector. The absolute correction is only fitted at 30 GHz with a full $\chi$ 2 -based likelihood, resulting in a correction of Δ 30 = 0.24 ± 0.03 GHz. The relative corrections are fitted using a spurious map approach, fundamentally similar to the method pioneered by the WMAP team, but without introducing many additional degrees of freedom. All bandpass parameters are sampled using a standard Metropolis sampler within the main BeyondPlanck Gibbs chain, and bandpass uncertainties are thus propagated to all other data products in the analysis. In total, we find that our bandpass model significantly reduces leakage effects. For beam leakage corrections, we adopt the official Planck LFI beam estimates without additional degrees of freedom, and only marginalize over the underlying sky model. We note that this is the first-time leakage from beam mismatch has been included for Planck LFI maps.

79 ASTRONOMY AND ASTROPHYSICS↗

MODEL-FREE MULTI-PROBE LENSING RECONSTRUCTION OF CLUSTER MASS PROFILES

Lens magnification by galaxy clusters induces characteristic spatial variations in the number counts of background sources, amplifying their observed fluxes and expanding the area of sky, the net effect of which, known as magnification bias, depends on the intrinsic faint-end slope of the source luminosity function. The bias is strongly negative for red galaxies, dominated by the geometric area distortion, whereas it is mildly positive for blue galaxies, enhancing the blue counts toward the cluster center. We generalize the Bayesian approach of Umetsu et al. for reconstructing projected cluster mass profiles, by incorporating multiple populations of background sources for magnification-bias measurements and combining them with complementary lens-distortion measurements, effectively breaking the mass-sheet degeneracy and improving the statistical precision of cluster mass measurements. The approach can be further extended to include strong-lensing projected mass estimates, thus allowing for non-parametric absolute mass determinations in both the weak and strong regimes. We apply this method to our recent CLASH lensing measurements of MACS J1206.2-0847, and demonstrate how combining multi-probe lensing constraints can improve the reconstruction of cluster mass profiles. This method will also be useful for a stacked lensing analysis, combining all lensing-related effects in the cluster regime, for a definitive determination of the averaged mass profile.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian calibration of terrestrial ecosystem models: A study of advanced Markov chain Monte Carlo methods

Calibration of terrestrial ecosystem models is important but challenging. Bayesian inference implemented by Markov chain Monte Carlo (MCMC) sampling provides a comprehensive framework to estimate model parameters and associated uncertainties using their posterior distributions. The effectiveness and efficiency of the method strongly depend on the MCMC algorithm used. In this study, a Differential Evolution Adaptive Metropolis (DREAM) algorithm was used to estimate posterior distributions of 21 parameters for the data assimilation linked ecosystem carbon (DALEC) model using 14 years of daily net ecosystem exchange data collected at the Harvard Forest Environmental Measurement Site eddy-flux tower. The DREAM is a multi-chain method and uses differential evolution technique for chain movement, allowing it to be efficiently applied to high-dimensional problems, and can reliably estimate heavy-tailed and multimodal distributions that are difficult for single-chain schemes using a Gaussian proposal distribution. The results were evaluated against the popular Adaptive Metropolis (AM) scheme. DREAM indicated that two parameters controlling autumn phenology have multiple modes in their posterior distributions while AM only identified one mode. The calibration of DREAM resulted in a better model fit and predictive performance compared to the AM. DREAM provides means for a good exploration of the posterior distributions of model parameters. Lastly, it reduces the risk of false convergence to a local optimum and potentially improves the predictive performance of the calibrated model.

54 ENVIRONMENTAL SCIENCES↗

Bayesian optimization of the Community Land Model simulated biosphere-atmosphere exchange using CO 2 observations from a dense tower network and aircraft campaigns over Oregon

Here, the vast forests and natural areas of the Pacific Northwest comprise one of the most productive ecosystems in the northern hemisphere. The heterogeneous landscape of Oregon poses a particular challenge to ecosystem models. We present a framework using a scaling factor Bayesian inversion to improve the modeled atmosphere-biosphere exchange of carbon dioxide. Observations from 5 CO/CO 2 towers, eddy covariance towers, and airborne campaigns were used to constrain the Community Land Model CLM4.5 simulated terrestrial CO 2 exchange at a high spatial and temporal resolution (1/24°, 3-hourly). To balance aggregation errors and the degrees of freedom in the inverse modeling system, we applied an unsupervised clustering approach for the spatial structuring of our model domain. Data from flight campaigns were used to quantify the uncertainty introduced by the Lagrangian particle dispersion model that was applied for the inversions. The average annual statewide net ecosystem productivity (NEP) was increased by 32% to 29.7 TgC per year by assimilating the tropospheric mixing ratio data. The associated uncertainty was decreased by 28.4% to 29%, on average over the entire Oregon model domain with the lowest uncertainties of 11% in western Oregon. The largest differences between posterior and prior CO 2 fluxes were found for the Coast Range ecoregion of Oregon that also exhibits the highest availability of atmospheric observations and associated footprints. In this area, covered by highly productive Douglas-fir forest, the differences between the prior and posterior estimate of NEP averaged 3.84 TgC per year during the study period from 2012 through 2014.

54 ENVIRONMENTAL SCIENCES↗

The Global LAnd Surface Satellite (GLASS) evapotranspiration product Version 5.0: Algorithm development and preliminary validation

An accurate estimation of spatially and temporally continuous global terrestrial evapotranspiration (ET) is essential in the assessment of surface energy, water and carbon cycles. The Global LAnd Surface Satellite (GLASS) ET product Version 4.0 (v4.0) based on the Bayesian model averaging (BMA) method was generated to estimate global terrestrial ET. However, certain uncertainty for the GLASS ET product v4.0 limits its application. In this study, we introduced the deep neural networks (DNN) merging framework to improve terrestrial ET estimation for GLASS ET product Version 5.0 (v5.0) generation by integrating five satellite-derived ET products [Moderate Resolution Imaging Spectroradiometer (MODIS) ET product (MOD16), Shuttleworth–Wallace dual-source ET product (SW), Priestley–Taylor-based ET product (PT-JPL), modified satellite-based Priestley–Taylor ET product (MS-PT) and simple hybrid ET product (SIM)]. We compared the performance of DNN method against other merging methods, including GLASS ET algorithm v4.0 (BMA), the gradient boosting regression tree (GBRT) method and the random forest (RF) method, based on 195 global eddy covariance (EC) flux towers covering observations from 2000 through 2015. Validations indicated that the DNN had the highest accuracy among four merging methods across different land cover types, yielding the highest average determination coefficients (R 2 , 0.62), root-mean-squared-error (RMSE, 24.1 W/m 2 ) and Kling–Gupta efficiency (KGE, 0.77) with a of 99% confidence interval. Compared with GLASS ET algorithm v4.0, the DNN improved on the R 2 by approximately 7% (p < 0.01) and the KGE by 10%. Based on the DNN, we then generated 8-day GLASS ET product v5.0 globally with a 1 km spatial resolution from 2001 to 2015 driven by GLASS vegetation and surface net radiation (R n ) datasets and Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA2) datasets. Finally, this global terrestrial ET product provides a valuable dataset for monitoring regional and global water resources and environmental changes.

54 ENVIRONMENTAL SCIENCES↗

Coupling Remote Sensing With a Process Model for the Simulation of Rangeland Carbon Dynamics

Rangelands provide significant environmental benefits through many ecosystem services, which may include soil organic carbon (SOC) sequestration. However, quantifying SOC stocks and monitoring carbon (C) fluxes in rangelands are challenging due to the considerable spatial and temporal variability tied to rangeland C dynamics as well as limited data availability. We developed the Rangeland Carbon Tracking and Management (RCTM) system to track long-term changes in SOC and ecosystem C fluxes by leveraging remote sensing inputs and environmental variable data sets with algorithms representing terrestrial C-cycle processes. Bayesian calibration was conducted using quality-controlled C flux data sets obtained from 61 Ameriflux and NEON flux tower sites from Western and Midwestern US rangelands to parameterize the model according to dominant vegetation classes (perennial and/or annual grass, grass-shrub mixture, and grass-tree mixture). The resulting RCTM system produced higher model accuracy for estimating annual cumulative gross primary productivity (GPP) (R 2 > 0.6, RMSE <390 g C m -2 ) relative to net ecosystem exchange of CO 2 (NEE) (R 2 > 0.4, RMSE <180 g C m -2 ). Model performance in estimating rangeland C fluxes varied by season and vegetation type. The RCTM captured the spatial variability of SOC stocks with R 2 = 0.6 when validated against SOC measurements across 13 NEON sites. Model simulations indicated slightly enhanced SOC stocks for the flux tower sites during the past decade, which is mainly driven by an increase in precipitation. Future efforts to refine the RCTM system will benefit from long-term network-based monitoring of vegetation biomass, C fluxes, and SOC stocks.

54 ENVIRONMENTAL SCIENCES↗

Peak Ground Displacement Saturates Exactly When Expected: Implications for Earthquake Early Warning

The scaling of rupture properties with magnitude is of critical importance to earthquake early warning (EEW) systems that rely on source characterization using limited snapshots of waveform data. ShakeAlert, a prototype EEW system that is being developed for the western United States, provides real-time estimates of earthquake magnitude based on P-wave peak ground displacements calculated at stations triggered by the event. The algorithms used in ShakeAlert assume that the displacement measurements at each station are statistically independent and that there exists a linear and time-independent relation between log peak ground displacement and earthquake magnitude. Here we challenge this basic assumption using the largest dataset assembled for this purpose to date: a comprehensive database of more than 140,000 vertical-component waveforms from M4.5–M9 earthquakes occurring near Japan from 1997 through 2018 and recorded by the K-NET and KiK-net strong-motion networks. By analyzing the time-evolution of P-wave peak ground displacements for these earthquakes, we show that there is a break, or saturation, in the magnitude-displacement scaling that depends on the length of the measurement time window. We demonstrate that the magnitude at which this saturation occurs is well-explained by a simple and non-deterministic model of earthquake rupture growth. We then utilize the predictions of this saturation model to develop a Bayesian framework for estimating posterior uncertainties in real-time magnitude estimates.

58 GEOSCIENCES↗

Gaussian-process generative model for the QCD equation of state

We develop a generative model for the nuclear matter equation of state at zero net baryon density using the Gaussian process regression method. We impose first-principles theoretical constraints from lattice quantum chromodynamics and hadron resonance gas at high- and low-temperature regions, respectively. By allowing the trained Gaussian process regression model to vary freely near the phase transition region, we generate random smooth crossover equations of state with different speeds of sound that do not rely on specific parametrizations. Here, we explore a collection of experimental observable dependencies on the generated equations of state, which paves the groundwork for future Bayesian inference studies to use experimental measurements from relativistic heavy-ion collisions to constrain the nuclear matter equation of state.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗