A novel approach to quantifying the sensitivity of current and future cosmological datasets to the neutrino mass ordering through Bayesian hierarchical modeling
Explore the source record for details and available documents.
Martina Gerbino↗
SEARCH · Engineering Papers
Results for “Bayesian modeling”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Kinetic model development and Bayesian uncertainty quantification for the complete reduction of Fe-based oxygen carriers with CH 4 , CO, and H 2 for chemical looping combustion
In this work, three kinetic models are developed and calibrated for the complete multi-step reduction of an Fe-based oxygen carrier (OC) particle with CH 4 , CO, and H 2 , using data from thermogravimetric analysis. The complete reduction rate profiles exhibit complex dynamics whose trajectory is significantly different depending on the reducing gas. A Bayesian model building and parameter estimation framework is applied for simultaneous parameter and model structure uncertainty quantification. The final models show excellent agreement between model predictions and calibration data, as well as new data not used for calibration (for the reduction of the OC with CH 4 ). Parameter uncertainty is quantified by determining joint posterior distribution, and model structure uncertainty is addressed by incorporating Gaussian process stochastic functions (represented by Bayesian smoothing splines) into the kinetic models. The final kinetic models with discrepancy functions are readily employable in equation-oriented simulation and optimization platforms.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Bayesian Optimization Framework for Imperfect Data or Models
Conventional Bayesian optimization methods implicitly assume that the data and model being optimized are “perfect.” This assumption leads to inaccurate posterior probability distribution functions (PDFs) when applied to “imperfect” data or models. The new Bayesian optimization framework presented in this report provides a way to parameterize the effect of imperfections usually encountered in a prior PDF of generalized data or a model on the posterior PDF. The effects of imperfections are parameterized by a set of constraints imposed on the posterior expectation values of deviations between the data and the model and on their covariance matrix elements. A particular set of values for these constraints conveys an evaluator’s best estimate of the effect of imperfections on the corresponding posterior expectation values. When a prior PDF of generalized data is assumed to be normal, an expression for a posterior PDF satisfying an arbitrary set of constraints is derived analytically for linear models. An analogous iterative algorithm is given for nonlinear models. The corresponding posterior PDF should be used to estimate any posterior expectation values in the presence of imperfections parameterized by that set of constraints. A posterior PDF of a conventional Bayesian optimization method is recovered analytically when all evaluator-specified constraints are set to zero (i.e., in the absence of any imperfections). The analytical expressions derived in this report for normal PDFs and linear models were verified numerically by a Metropolis–Hastings Monte Carlo method. The methods presented herein could be applied to any kind of data or models, including differential cross-section data or integral benchmark experiments.
97 MATHEMATICS AND COMPUTING↗
An analysis of Bayesian estimates for missing higher orders in perturbative calculations
With current high precision collider data, the reliable estimation of theoretical uncertainties due to missing higher orders (MHOs) in perturbation theory has become a pressing issue for collider phenomenology. Traditionally, the size of the MHOs is estimated through scale variation, a simple but ad hoc method without probabilistic interpretation. Bayesian approaches provide a compelling alternative to estimate the size of the MHOs, but it is not clear how to interpret the perturbative scales, like the factorisation and renormalisation scales, in a Bayesian framework. Recently, it was proposed that the scales can be incorporated as hidden parameters into a Bayesian model. In this paper, we thoroughly scrutinise Bayesian approaches to MHO estimation and systematically study the performance of different models on an extensive set of high-order calculations. We extend the framework in two significant ways. First, we define a new model that allows for asymmetric probability distributions. Second, we introduce a prescription to incorporate information on perturbative scales without interpreting them as hidden model parameters. We clarify how the two scale prescriptions bias the result towards specific scale choice, and we discuss and compare different Bayesian MHO estimates among themselves and to the traditional scale variation approach. Finally, we provide a practical prescription of how existing perturbative results at the standard scale variation points can be converted to 68%/95% credibility intervals in the Bayesian approach using the new public code MiHO.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Goal-oriented a-posteriori estimation of model error as an aid to parameter estimation
In this work, a Bayesian model calibration framework is presented that utilizes goal-oriented a-posterior error estimates in quantities of interest (QoIs) for classes of high-fidelity models characterized by PDEs. It is shown that for a large class of computational models, it is possible to develop a computationally inexpensive procedure for calibrating parameters of high-fidelity models of physical events when the parameters of low-fidelity (surrogate) models are known with acceptable accuracy. The main ingredients in the proposed model calibration scheme are goal-oriented a-posteriori estimates of error in QoIs computed using a so-called lower fidelity model compared to those of an uncalibrated higher fidelity model. The estimates of error in QoIs are used to define likelihood functions in Bayesian inversion analysis. A standard Bayesian approach is employed to compute the posterior distribution of model parameters of high-fidelity models. As applications, parameters in a quasi-linear second-order elliptic boundary-value problem (BVP) are calibrated using a second-order linear elliptic BVP. In a second application, parameters of a tumor growth model involving nonlinear time-dependent PDEs are calibrated using a lower fidelity linear tumor growth model with known parameter values.
A-posterior estimates↗
Can we use antipredator behavior theory to predict wildlife responses to high-speed vehicles?
Animals seem to rely on antipredator behavior to avoid vehicle collisions. There is an extensive body of antipredator behavior theory that have been used to predict the distance/time animals should escape from predators. These models have also been used to guide empirical research on escape behavior from vehicles. However, little is known as to whether antipredator behavior models are appropriate to apply to an approaching high-speed vehicle scenario. We addressed this gap by (a) providing an overview of the main hypotheses and predictions of different antipredator behavior models via a literature review, (b) exploring whether these models can generate quantitative predictions on escape distance when parameterized with empirical data from the literature, and (c) evaluating their sensitivity to vehicle approach speed using a simulation approach wherein we assessed model performance based on changes in effect size with variations in the slope of the flight initiation distance (FID) vs. approach speed relationship. The slope of the FID vs. approach speed relationship was then related back to three different behavioral rules animals may rely on to avoid approaching threats: the spatial, temporal, or delayed margin of safety. We used literature on birds for goals (b) and (c). Our review considered the following eight models: the economic escape model, Blumstein’s economic escape model, the optimal escape model, the perceptual limit hypothesis, the visual cue model, the flush early and avoid the rush (FEAR) hypothesis, the looming stimulus hypothesis, and the Bayesian model of escape behavior. We were able to generate quantitative predictions about escape distance with the last five models. However, we were only able to assess sensitivity to vehicle approach speed for the last three models. The FEAR hypothesis is most sensitive to high-speed vehicles when the species follows the spatial (FID remains constant as speed increases) and the temporal margin of safety (FID increases with an increase in speed) rules of escape. The looming stimulus effect hypothesis reached small to intermediate levels of sensitivity to high-speed vehicles when a species follows the delayed margin of safety (FID decreases with an increase in speed). The Bayesian optimal escape model reached intermediate levels of sensitivity to approach speed across all escape rules (spatial, temporal, delayed margins of safety) but only for larger (> 1 kg) species, but was not sensitive to speed for smaller species. Overall, no single antipredator behavior model could characterize all different types of escape responses relative to vehicle approach speed but some models showed some levels of sensitivity for certain rules of escape behavior. We derive some applied applications of our findings by suggesting the estimation of critical vehicle approach speeds for managing populations that are especially susceptible to road mortality. Overall, we recommend that new escape behavior models specifically tailored to high-speeds vehicles should be developed to better predict quantitatively the responses of animals to an increase in the frequency of cars, airplanes, drones, etc. they will face in the next decade.
54 ENVIRONMENTAL SCIENCES↗
Holocene paleoclimate change in the western US: The importance of chronology in discerning patterns and drivers
We report sediment in lakes and meadows forms a powerful archive that can be used to reconstruct environmental change through time. Reconstructions of lake level, of chemical, biological, and hydrological conditions, and of surrounding vegetation provide detailed information about past climate conditions, both locally and regionally. Indeed, most of our current knowledge of centennial- to millennial-scale climate variability in the arid western United States, where information about past hydroclimate is particularly important, comes from such sediment-based reconstructions. The pressing need for robust, precise predictions of future conditions is a significant motivation for paleoclimate science, and current research questions frequently require Holocene reconstructions to be resolved at sub-centennial timescales. Increasingly, regional syntheses seek to identify synoptic-scale patterns similar to those defined from modern observations (seasonal, interannual, multi-decadal, etc.) or to compare with the output of climate model simulations. However, the age control on existing records, especially those more than about 20 years old, is often sufficient only for millennial-scale interpretation. Here we assess the age control for 84 published and unpublished records from lakes and meadows in the Great Basin, California, and desert southwest, and use Bayesian modeling to evaluate the 95% uncertainty ranges for the 42 best-dated records. In the Late Holocene, about half of the 42 records have <400-year mean uncertainty ranges; however, high-precision age control is especially critical for young records, used to develop an accurate understanding of a proxy’s response to known climate variations. In the Middle Holocene, records vary from 400 to >800-year mean uncertainty and records of the Early Holocene have 600- to >1400-year mean uncertainty ranges. We find that the largest control on modeled uncertainties is dating density, with at least 2 dates/kyr being optimal and suggest obtaining “range-finder” dates at the onset of a study to better predict the total number of dates needed for an adequate age model. Such a density avoids a commonly observed phenomenon of significant peaks in uncertainty arising in gaps between age control points. Analysis of the uncertainties associated with proxy shifts reveal that more than half are >400 years. Although such large uncertainties currently prevent sub-centennial interpretations in most cases, increased dating density, strategic use of limited funds (including budgeting for a 2 date/kyr minimum at the proposal stage), construction of age-depth models with Bayesian methods, and critical evaluation of chronological uncertainty will shed light on past climate variability at finer timescales, enhancing our understanding of global and regional drivers of western U.S. climate.
54 ENVIRONMENTAL SCIENCES↗
Calibration and validation of the foundation for a multiphase strength model for tin
In this work, the Common Model of Multi-phase Strength and Equation of State (CMMP) model was applied to tin. Specifically, calibrations of the strength-specific elements of the CMMP foundation were developed with a combination of experiments and theory, and then the model was validated experimentally. The first element of the foundation is a multi-phase analytic treatment of the melt temperature and the shear modulus for the solid phases. These models were parameterized for each phase based on ab initio calculations using the software VASP (Vienna Ab initio Simulations Package) based on density functional theory. The shear modulus model for the ambient phase was validated with ultrasonic sound speed measurements as a function of pressure and temperature. The second element of the foundation is a viscoplastic strength model for the phase, upon which strength for inaccessible higher-pressure phases can be scaled as necessary. The stress–strain response of tin was measured at strain rates of 10 -3 to 3 x 10 3 s -1 and temperatures ranging from 87 to 373 K. The Preston–Tonks–Wallace (PTW) strength model was fit to that data using Bayesian model calibration. For validation, six forward and two reverse Taylor impact experiments were performed at different velocities to measure large plastic deformation of tin at strain rates up to 10 5 s -1 . The PTW model accurately predicted the deformed shapes of the cylinders, with modest discrepancies attributed to the inability of PTW to capture the effects of twinning and dynamic recrystallization. Some material in the simulations of higher velocity Taylor cylinders reached the melting temperature, thus testing the multiphase model because of the presence of a second phase, the liquid. In simulations using a traditional modeling approach, the abrupt reduction of strength upon melt resulted in poor predictions of the deformed shape and non-physical temperatures. With CMMP, the most deformed material points evolved gradually to a mixed solid–liquid but never a fully liquid state, never fully lost strength, stayed at the melt temperature as the latent heat of fusion was absorbed, and predicted the deformed shape well.
36 MATERIALS SCIENCE↗
Calibration and validation of the foundation for a multiphase strength model for tin
In this work, the Common Model of Multi-phase Strength and Equation of State (CMMP) model was applied to tin. Specifically, calibrations of the strength-specific elements of the CMMP foundation were developed with a combination of experiments and theory, and then the model was validated experimentally. The first element of the foundation is a 10 multi-phase analytic treatment of the melt temperature and the shear modulus for the solid phases. These models were parameterized for each phase based on ab initio calculations using the software VASP (Vienna Ab initio Simulations Package) based on density functional theory (DFT). The shear modulus model for the ambient β phase was validated with ultrasonic sound speed measurements as a function of pressure and temperature. The second element of the foundation is a viscoplastic strength model for the β phase, upon which strength for inaccessible higher-pressure phases can be scaled as necessary. The stress-strain response of tin was measured at strain rates of 10 -3 to 3 x 10 3 s -1 and temperatures ranging from 87 to 373 K. The Preston-Tonks-Wallace (PTW) strength model was fit to that data using Bayesian model calibration. For validation, six forward and two reverse Taylor impact experiments were performed at different velocities to measure large plastic deformation of tin at strain rates up to 10 5 s -1 . The PTW model accurately predicted the deformed shapes of the cylinders, with modest discrepancies attributed to the inability 20 of PTW to capture the effects of twinning and dynamic recrystallization. Some material in the simulations of higher velocity Taylor cylinders reached the melting temperature, thus testing the multiphase model because of the presence of a second phase, the liquid. In simulations using a traditional modeling approach, the abrupt reduction of strength upon melt resulted in poor predictions of the deformed shape and non-physical temperatures. With CMMP, the most deformed material points evolved gradually to a mixed solid-liquid but never fully liquid state, never fully lost strength, 25 stayed at the melt temperature as the latent heat of fusion was absorbed, and predicted the deformed shape well.
36 MATERIALS SCIENCE↗
Evaluation of Deep Learning Model Architectures for Point-of-Care Ultrasound Diagnostics
Point-of-care ultrasound imaging is a critical tool for patient triage during trauma for diagnosing injuries and prioritizing limited medical evacuation resources. Specifically, an eFAST exam evaluates if there are free fluids in the chest or abdomen but this is only possible if ultrasound scans can be accurately interpreted, a challenge in the pre-hospital setting. In this effort, we evaluated the use of artificial intelligent eFAST image interpretation models. Widely used deep learning model architectures were evaluated as well as Bayesian models optimized for six different diagnostic models: pneumothorax (i) B- or (ii) M-mode, hemothorax (iii) B- or (iv) M-mode, (v) pelvic or bladder abdominal hemorrhage and (vi) right upper quadrant abdominal hemorrhage. Models were trained using images captured in 27 swine. Using a leave-one-subject-out training approach, the MobileNetV2 and DarkNet53 models surpassed 85% accuracy for each M-mode scan site. The different B-mode models performed worse with accuracies between 68% and 74% except for the pelvic hemorrhage model, which only reached 62% accuracy for all model architectures. These results highlight which eFAST scan sites can be easily automated with image interpretation models, while other scan sites, such as the bladder hemorrhage model, will require more robust model development or data augmentation to improve performance. With these additional improvements, the skill threshold for ultrasound-based triage can be reduced, thus expanding its utility in the pre-hospital setting.
47 OTHER INSTRUMENTATION↗
Learning time series for intelligent monitoring
We address the problem of classifying time series according to their morphological features in the time domain. In a supervised machine-learning framework, we induce a classification procedure from a set of preclassified examples. For each class, we infer a model that captures its morphological features using Bayesian model induction and the minimum message length approach to assign priors. In the performance task, we classify a time series in one of the learned classes when there is enough evidence to support that decision. Time series with sufficiently novel features, belonging to classes not present in the training set, are recognized as such. We report results from experiments in a monitoring domain of interest to NASA.
Manganaris, Stefanos↗
Model orthogonalization and Bayesian forecast mixing via principal component analysis
One can improve predictability in the unknown domain by combining forecasts of imperfect complex computational models using a Bayesian statistical machine learning framework. In many cases, however, the models used in the mixing process are similar. In addition to contaminating the model space, the existence of such similar, or even redundant, models during the multimodeling process can result in misinterpretation of results and deterioration of predictive performance. In this paper we describe a method based on the principal component analysis that eliminates model redundancy. We show that by adding model orthogonalization to the proposed Bayesian model combination framework, one can arrive at better prediction accuracy and reach excellent uncertainty quantification performance.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Precision mass measurement of lightweight self-conjugate nucleus 80 Zr
Protons and neutrons in the atomic nucleus move in shells analogous to the electronic shell structures of atoms. The nuclear shell structure varies due to changes of the nuclear mean field with the number of neutrons N and protons Z, and these variations can be probed by measuring mass differences between nuclei. The N=Z=40 self-conjugate nucleus 80 Zr is of particular interest as its proton and neutron shell structures are expected to be very similar, and its ground state is highly deformed. Here, we provide evidence for the existence of a deformed double shell closure in 80Zr through high precision Penning trap mass measurements of 80-83 Zr. Our mass values show that 80Zr is significantly lighter, and thus more strongly bound than predicted. This can be attributed to the deformed shell closure at N=Z=40 and the large Wigner energy. A statistical Bayesian model mixing analysis employing several global nuclear mass models demonstrates difficulties with reproducing the observed mass anomaly using current theory.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Update on Bayesian Blocks: Segmented Models for Sequential Data
The Bayesian Block algorithm, in wide use in astronomy and other areas, has been improved in several ways. The model for block shape has been generalized to include other than constant signal rate - e.g., linear, exponential, or other parametric models. In addition the computational efficiency has been improved, so that instead of O(N**2) the basic algorithm is O(N) in most cases. Other improvements in the theory and application of segmented representations will be described.
Scargle, Jeff↗
Survival of Juvenile Florida Scrub-Jays is Habitat Specific, Positively Correlated With Month and Negatively Correlated With Male Breeder Death
Juvenile survival in birds is difficult to estimate but this vital rate can be an important consideration for management decisions. We estimated juvenile survival of cooperatively breeding Florida Scrub-Jays (Aphelocoma coerulescens) in a landscape degraded by fire suppression and fragmentation using data from marked (n = 325) and unmarked juveniles (n = 1,306) with an integrated hierarchical Bayesian model. To assess the combined analyses, we also analyzed these datasets separately, with a Cormack-Jolly-Seber (CJS) model (marked) and young model (unmarked). Our data consisted of monthly censuses of territorial family groups from Florida Scrub-Jay populations in East Central Florida collected over a 22-yr period. Juvenile survival was estimated from July when young Florida Scrub-Jays begin developing independence to March when they become first year individuals and grouped according to the habitat quality class of their natal territory that were based on shrub height (with intermediate shrub heights being optimal and short and tall shrub heights being suboptimal) and the presence of sandy openings (the preferred open having many sandy openings; closed not having enough). Parameter estimates in the combined analysis were intermediate to the separate analyses. Notable differences among the separate analyses were that suboptimal habitat survival was lower in the unmarked analysis, the unmarked analysis showed a linear effect of time not seen in the marked analysis, and there was an effect of male breeder death in the marked but not unmarked analysis. The combined data analysis provided more inference than did either data set analyzed separately including juveniles in optimal-closed territories unexpectedly had higher survival than those in optimal-open, survival increased through time, and male breeder death had a negative effect on survival. This study suggests that optimal-closed habitat may play an important role in juvenile Florida Scrub-Jay survival perhaps by providing better cover from predators and warrants further investigation for management implications.
Florida Scrub-Jay↗
The Global LAnd Surface Satellite (GLASS) evapotranspiration product Version 5.0: Algorithm development and preliminary validation
An accurate estimation of spatially and temporally continuous global terrestrial evapotranspiration (ET) is essential in the assessment of surface energy, water and carbon cycles. The Global LAnd Surface Satellite (GLASS) ET product Version 4.0 (v4.0) based on the Bayesian model averaging (BMA) method was generated to estimate global terrestrial ET. However, certain uncertainty for the GLASS ET product v4.0 limits its application. In this study, we introduced the deep neural networks (DNN) merging framework to improve terrestrial ET estimation for GLASS ET product Version 5.0 (v5.0) generation by integrating five satellite-derived ET products [Moderate Resolution Imaging Spectroradiometer (MODIS) ET product (MOD16), Shuttleworth–Wallace dual-source ET product (SW), Priestley–Taylor-based ET product (PT-JPL), modified satellite-based Priestley–Taylor ET product (MS-PT) and simple hybrid ET product (SIM)]. We compared the performance of DNN method against other merging methods, including GLASS ET algorithm v4.0 (BMA), the gradient boosting regression tree (GBRT) method and the random forest (RF) method, based on 195 global eddy covariance (EC) flux towers covering observations from 2000 through 2015. Validations indicated that the DNN had the highest accuracy among four merging methods across different land cover types, yielding the highest average determination coefficients (R 2 , 0.62), root-mean-squared-error (RMSE, 24.1 W/m 2 ) and Kling–Gupta efficiency (KGE, 0.77) with a of 99% confidence interval. Compared with GLASS ET algorithm v4.0, the DNN improved on the R 2 by approximately 7% (p < 0.01) and the KGE by 10%. Based on the DNN, we then generated 8-day GLASS ET product v5.0 globally with a 1 km spatial resolution from 2001 to 2015 driven by GLASS vegetation and surface net radiation (R n ) datasets and Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA2) datasets. Finally, this global terrestrial ET product provides a valuable dataset for monitoring regional and global water resources and environmental changes.
54 ENVIRONMENTAL SCIENCES↗
FlowPM: Distributed TensorFlow implementation of the FastPM cosmological N-body solver
Here, we present FlowPM, a Particle-Mesh (PM) cosmological N-body code implemented in Mesh-TensorFlow for GPU-accelerated, distributed, and differentiable simulations. We implement and validate the accuracy of a novel multi-grid scheme based on multiresolution pyramids to compute large-scale forces efficiently on distributed platforms. We explore the scaling of the simulation on large-scale supercomputers and compare it with corresponding Python based PM code, finding on an average 10x speed-up in terms of wallclock time. We also demonstrate how this novel tool can be used for efficiently solving large scale cosmological inference problems, in particular reconstruction of cosmological fields in a forward model Bayesian framework with hybrid PM and neural network forward model. We provide skeleton code for these examples and the entire code is publicly available at https://github.com/modichirag/flowpm[Formula presented].
79 ASTRONOMY AND ASTROPHYSICS↗
Inductive Approaches to Improving Diagnosis and Design for Diagnosability
The first research area under this grant addresses the problem of classifying time series according to their morphological features in the time domain. A supervised learning system called CALCHAS, which induces a classification procedure for signatures from preclassified examples, was developed. For each of several signature classes, the system infers a model that captures the class's morphological features using Bayesian model induction and the minimum message length approach to assign priors. After induction, a time series (signature) is classified in one of the classes when there is enough evidence to support that decision. Time series with sufficiently novel features, belonging to classes not present in the training set, are recognized as such. A second area of research assumes two sources of information about a system: a model or domain theory that encodes aspects of the system under study and data from actual system operations over time. A model, when it exists, represents strong prior expectations about how a system will perform. Our work with a diagnostic model of the RCS (Reaction Control System) of the Space Shuttle motivated the development of SIG, a system which combines information from a model (or domain theory) and data. As it tracks RCS behavior, the model computes quantitative and qualitative values. Induction is then performed over the data represented by both the 'raw' features and the model-computed high-level features. Finally, work on clustering for operating mode discovery motivated some important extensions to the clustering strategy we had used. One modification appends an iterative optimization technique onto the clustering system; this optimization strategy appears to be novel in the clustering literature. A second modification improves the noise tolerance of the clustering system. In particular, we adapt resampling-based pruning strategies used by supervised learning systems to the task of simplifying hierarchical clusterings, thus making post-clustering analysis easier.
Fisher, Douglas H.↗