Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

SU-E-T-51: Bayesian Network Models for Radiotherapy Error Detection

Purpose: To develop a probabilistic model of radiotherapy plans using Bayesian networks that will detect potential errors in radiation delivery. Methods: Semi-structured interviews with medical physicists and other domain experts were employed to generate a set of layered nodes and arcs forming a Bayesian Network (BN) which encapsulates relevant radiotherapy concepts and their associated interdependencies. Concepts in the final network were limited to those whose parameters are represented in the institutional database at a level significant enough to develop mathematical distributions. The concept-relation knowledge base was constructed using the Web Ontology Language (OWL) and translated into Hugin Expert Bayes Network files via the the RHugin package in the R statistical programming language. A subset of de-identified data derived from a Mosaiq relational database representing 1937 unique prescription cases was processed and pre-screened for errors and then used by the Hugin implementation of the Estimation-Maximization (EM) algorithm for machine learning all parameter distributions. Individual networks were generated for each of several commonly treated anatomic regions identified by ICD-9 neoplasm categories including lung, brain, lymphoma, and female breast. Results: The resulting Bayesian networks represent a large part of the probabilistic knowledge inherent in treatment planning. By populating the networks entirely with data captured from a clinical oncology information management system over the course of several years of normal practice, we were able to create accurate probability tables with no additional time spent by experts or clinicians. These probabilistic descriptions of the treatment planning allow one to check if a treatment plan is within the normal scope of practice, given some initial set of clinical evidence and thereby detect for potential outliers to be flagged for further investigation. Conclusion: The networks developed here support the use of probabilistic models into clinical chart checking for improved detection of potential errors in RT plans.

60 APPLIED LIFE SCIENCES↗

Cosmic ray spectrum of protons plus helium nuclei between 6 and 158 TeV from HAWC data

Here, a measurement with high statistics of the differential energy spectrum of light elements in cosmic rays, in particular, of primary H plus He nuclei, is reported. The spectrum is presented in the energy range from 6 to 158 TeV per nucleus. Data was collected with the High Altitude Water Cherenkov (HAWC) Observatory between June 2015 and June 2019. The analysis was based on a Bayesian unfolding procedure, which was applied on a subsample of vertical HAWC data that was enriched to 82% of events induced by light nuclei. To achieve the mass separation, a cut on the lateral age of air shower data was set guided by predictions of CORSIKA/QGSJET-II-04 simulations. The measured spectrum is consistent with a broken power-law spectrum and shows a kneelike feature at around E = 24.0$^{+3.6}_{-3.1}$ TeV , with a spectral index γ = -2.51 ± 0.02 before the break and with γ = -2.83 ± 0.02 above it. The feature has a statistical significance of 4.1σ. Within systematic uncertainties, the significance of the spectral break is 0.8σ.

79 ASTRONOMY AND ASTROPHYSICS↗

Dwarf spheroidal J-factor likelihoods for generalized NFW profiles

ABSTRACT Indirect detection strategies of particle dark matter (DM) in Dwarf spheroidal satellite galaxies (dSphs) typically entail searching for annihilation signals above the astrophysical background. To robustly compare model predictions with the observed fluxes of product particles, most analyses of astrophysical data – which are generally frequentist – rely on estimating the abundance of DM by calculating the so-called J factor. This quantity is usually inferred from the kinematic properties of the stellar population of a dSph using the Jeans equation, commonly by means of Bayesian techniques that entail the presence (and additional systematic uncertainty) of prior choice. Here, extending earlier work, we develop a scheme to derive the profile likelihood for J factors of dwarf spheroidals for models with five or more free parameters. We validate our method on a publicly available simulation suite, released by the Gaia Challenge, finding satisfactory statistical properties for bias and probability coverage. We present the profile likelihood function and maximum likelihood estimates for the J-factor of 10 dSphs. As an illustration, we apply these profile likelihoods to recently published analyses of γ-ray data with the Fermi Large Area Telescope to derive new, consistent upper limits on the DM annihilation cross-section. We do this for a subset of systems, generally referred to as classical dwarfs. The implications of these findings for DM searches are discussed, together with future improvements and extensions of this technique.

79 ASTRONOMY AND ASTROPHYSICS↗

Deeply uncertain: comparing methods of uncertainty quantification in deep learning algorithms

We present a comparison of methods for uncertainty quantification (UQ) in deep learning algorithms in the context of a simple physical system. Three of the most common uncertainty quantification methods - Bayesian Neural Networks (BNN), Concrete Dropout (CD), and Deep Ensembles (DE) - are compared to the standard analytic error propagation. We discuss this comparison in terms endemic to both machine learning ("epistemic" and "aleatoric") and the physical sciences ("statistical" and "systematic"). The comparisons are presented in terms of simulated experimental measurements of a single pendulum - a prototypical physical system for studying measurement and analysis techniques. Our results highlight some pitfalls that may occur when using these UQ methods. For example, when the variation of noise in the training set is small, all methods predicted the same relative uncertainty independently of the inputs. This issue is particularly hard to avoid in BNN. On the other hand, when the test set contains samples far from the training distribution, we found that no methods sufficiently increased the uncertainties associated to their predictions. This problem was particularly clear for CD. In light of these results, we make some recommendations for usage and interpretation of UQ methods.

59 BASIC BIOLOGICAL SCIENCES↗

HEPfit: a code for the combination of indirect and direct constraints on high energy physics models

HEPfit is a flexible open-source tool which, given the Standard Model or any of its extensions, allows to (i) fit the model parameters to a given set of experimental observables; (ii) obtain predictions for observables. HEPfit can be used either in Monte Carlo mode, to perform a Bayesian Markov Chain Monte Carlo analysis of a given model, or as a library, to obtain predictions of observables for a given point in the parameter space of the model, allowing HEPfit to be used in any statistical framework. In the present version, around a thousand observables have been implemented in the Standard Model and in several new physics scenarios. In this paper, we describe the general structure of the code as well as models and observables implemented in the current release.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A probabilistic inverse prediction method for predicting plutonium processing conditions

In the past decade, nuclear chemists and physicists have been conducting studies to investigate the signatures associated with the production of special nuclear material (SNM). In particular, these studies aim to determine how various processing parameters impact the physical, chemical, and morphological properties of the resulting special nuclear material. By better understanding how these properties relate to the processing parameters, scientists can better contribute to nuclear forensics investigations by quantifying their results and ultimately shortening the forensic timeline. This paper aims to statistically analyze and quantify the relationships that exist between the processing conditions used in these experiments and the various properties of the nuclear end-product by invoking inverse methods. In particular, these methods make use of Bayesian Adaptive Spline Surface models in conjunction with Bayesian model calibration techniques to probabilistically determine processing conditions as an inverse function of morphological characteristics. Not only does the model presented in this paper allow for providing point estimates of a sample of special nuclear material, but it also incorporates uncertainty into these predictions. This model proves sufficient for predicting processing conditions within a standard deviation of the observed processing conditions, on average, provides a solid foundation for future work in predicting processing conditions of particles of special nuclear material using only their observed morphological characteristics, and is generalizable to the field of chemometrics for applicability across different materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Comparing traditional and Bayesian approaches to ecological meta‐analysis

Abstract Despite the wide application of meta‐analysis in ecology, some of the traditional methods used for meta‐analysis may not perform well given the type of data characteristic of ecological meta‐analyses. We reviewed published meta‐analyses on the ecological impacts of global climate change, evaluating the number of replicates used in the primary studies ( n i ) and the number of studies or records ( k ) that were aggregated to calculate a mean effect size. We used the results of the review in a simulation experiment to assess the performance of conventional frequentist and Bayesian meta‐analysis methods for estimating a mean effect size and its uncertainty interval. Our literature review showed that n i and k were highly variable, distributions were right‐skewed and were generally small (median n i = 5, median k = 44). Our simulations show that the choice of method for calculating uncertainty intervals was critical for obtaining appropriate coverage (close to the nominal value of 0.95). When k was low (<40), 95% coverage was achieved by a confidence interval (CI) based on the t distribution that uses an adjusted standard error (the Hartung–Knapp–Sidik–Jonkman, HKSJ), or by a Bayesian credible interval, whereas bootstrap or z distribution CIs had lower coverage. Despite the importance of the method to calculate the uncertainty interval, 39% of the meta‐analyses reviewed did not report the method used, and of the 61% that did, 94% used a potentially problematic method, which may be a consequence of software defaults. In general, for a simple random‐effects meta‐analysis, the performance of the best frequentist and Bayesian methods was similar for the same combinations of factors ( k and mean replication), though the Bayesian approach had higher than nominal (>95%) coverage for the mean effect when k was very low ( k < 15). Our literature review suggests that many meta‐analyses that used z distribution or bootstrapping CIs may have overestimated the statistical significance of their results when the number of studies was low; more appropriate methods need to be adopted in ecological meta‐analyses.

Pappalardo, Paula↗

Inference of Transmission Network Structure from HIV Phylogenetic Trees

Phylogenetic inference is an attractive means to reconstruct transmission histories and epidemics. However, there is not a perfect correspondence between transmission history and virus phylogeny. Both node height and topological differences may occur, depending on the interaction between within-host evolutionary dynamics and between-host transmission patterns. To investigate these interactions, we added a within-host evolutionary model in epidemiological simulations and examined if the resulting phylogeny could recover different types of contact networks. To further improve realism, we also introduced patient-specific differences in infectivity across disease stages, and on the epidemic level we considered incomplete sampling and the age of the epidemic. Second, we implemented an inference method based on approximate Bayesian computation (ABC) to discriminate among three well-studied network models and jointly estimate both network parameters and key epidemiological quantities such as the infection rate. Our ABC framework used both topological and distance-based tree statistics for comparison between simulated and observed trees. Overall, our simulations showed that a virus time-scaled phylogeny (genealogy) may be substantially different from the between-host transmission tree. This has important implications for the interpretation of what a phylogeny reveals about the underlying epidemic contact network. In particular, we found that while the within-host evolutionary process obscures the transmission tree, the diversification process and infectivity dynamics also add discriminatory power to differentiate between different types of contact networks. We also found that the possibility to differentiate contact networks depends on how far an epidemic has progressed, where distance-based tree statistics have more power early in an epidemic. Finally, we applied our ABC inference on two different outbreaks from the Swedish HIV-1 epidemic.

60 APPLIED LIFE SCIENCES↗

Neural network classification - A Bayesian interpretation

The relationship between minimizing a mean squared error and finding the optimal Bayesian classifier is reviewed. This provides a theoretical interpretation for the process by which neural networks are used in classification. A number of confidence measures are proposed to evaluate the performance of the neural network classifier within a statistical framework.

Wan, Eric A.↗

Solar Activity Relations in Energetic Electron Events Measured By the MESSENGER Mission

Aims. We perform a statistical study of the relations between the properties of solar energetic electron (SEE) events measured by the MESSENGER mission from 2010 to 2015 and the parameters of the respective parent solar activity phenomena in order to identify the potential correlations between them. During the time of analysis, the MESSENGER heliocentric distance varied between 0.31 and 0.47 au. Methods. We used a published list of 61 SEE events measured by MESSENGER, which includes information on the near-relativistic electron peak intensities, the peak-intensity energy spectral indices, and the measured X-ray peak intensity of the flares related to the SEE events. Taking advantage of multi-viewpoint remote-sensing observations, we reconstructed, whenever possible, the associated coronal mass ejections (CMEs) and shock waves; and we determined the three-dimensional (3D) properties (location, speed, and width) of the CMEs and the maximum speed of the 3D CME-driven shocks in the corona. We used different methods (Spearman, Pearson, and a Bayesian approach, namely the Kelly method to linear regression) to estimate the correlation coefficients between the flare intensity, maximum speed at the apex of the CME-driven shock, CME speed at the apex, and CME width with the electron peak intensities and with the energy spectral indices. In this statistical study, we considered and addressed the limitations of the particle instrument on board MESSENGER (elevated background intensity level, anti-Sun pointing). Results. There is an asymmetry to the east in the range of connection angles (CAs) for which the SEE events present the highest peak intensities, where the CA is the longitudinal separation between the footpoint of the magnetic field connecting to the spacecraft and the flare location. Based on this asymmetry, we define a subsample of well-connected events as when −65° ≤ CA ≤ +33°. For the well-connected sample, we find moderate to strong correlations between the near-relativistic electron peak intensity and the 3D CME-driven shock maximum speed at the apex (Spearman: cc = 0.53 ± 0.05; Pearson: cc = 0.65 ± 0.04; Kelly: cc = 0.87 ± 0.20), the flare peak intensity (Spearman: cc = 0.63 ± 0.03; Pearson: cc = 0.59 ± 0.03; Kelly: cc = 0.74 ± 0.30), and the 3D CME speed at the apex (Spearman: cc = 0.50 ± 0.04; Pearson: cc = 0.46 ± 0.03; Kelly: cc = 0.60 ± 0.39). When including poorly connected events (full sample), the relations between the peak intensities and the solar-activity phenomena are blurred, showing lower correlation coefficients. Conclusions. Based on the comparison of the correlation coefficients presented in this study using near 0.4 au data, (1) both flare and shock-related processes may contribute to the acceleration of near relativistic electrons in large SEE events, in agreement with previous studies based on near 1 au data; and (2) the maximum speed of the CME-driven shock is a better parameter to investigate particle-acceleration-related mechanisms than the average CME speed, as suggested by the stronger correlation with the SEE peak intensities.

Sun↗

Inverse Modeling of Hydrologic Parameters Using Surface Flux and Runoff Observations in the Community Land Model

This study demonstrates the possibility of inverting hydrologic parameters using surface flux and runoff observations in version 4 of the Community Land Model (CLM4). Previous studies showed that surface flux and runoff calculations are sensitive to major hydrologic parameters in CLM4 over different watersheds, and illustrated the necessity and possibility of parameter calibration. Two inversion strategies, the deterministic least-square fitting and stochastic Markov-Chain Monte-Carlo (MCMC) - Bayesian inversion approaches, are evaluated by applying them to CLM4 at selected sites. The unknowns to be estimated include surface and subsurface runoff generation parameters and vadose zone soil water parameters. We find that using model parameters calibrated by the least-square fitting provides little improvements in the model simulations but the sampling-based stochastic inversion approaches are consistent - as more information comes in, the predictive intervals of the calibrated parameters become narrower and the misfits between the calculated and observed responses decrease. In general, parameters that are identified to be significant through sensitivity analyses and statistical tests are better calibrated than those with weak or nonlinear impacts on flux or runoff observations. Temporal resolution of observations has larger impacts on the results of inverse modeling using heat flux data than runoff data. Soil and vegetation cover have important impacts on parameter sensitivities, leading to the different patterns of posterior distributions of parameters at different sites. Overall, the MCMC-Bayesian inversion approach effectively and reliably improves the simulation of CLM under different climates and environmental conditions. Bayesian model averaging of the posterior estimates with different reference acceptance probabilities can smooth the posterior distribution and provide more reliable parameter estimates, but at the expense of wider uncertainty bounds.

inverse, modeling, hydrologic, parameters, flux, r↗

Decoding {beta}-decay systematics: A global statistical model for {beta}{sup -} half-lives

Statistical modeling of nuclear data provides a novel approach to nuclear systematics complementary to established theoretical and phenomenological approaches based on quantum theory. Continuing previous studies in which global statistical modeling is pursued within the general framework of machine learning theory, we implement advances in training algorithms designed to improve generalization, in application to the problem of reproducing and predicting the half-lives of nuclear ground states that decay 100% by the {beta}{sup -} mode. More specifically, fully connected, multilayer feed-forward artificial neural network models are developed using the Levenberg-Marquardt optimization algorithm together with Bayesian regularization and cross-validation. The predictive performance of models emerging from extensive computer experiments is compared with that of traditional microscopic and phenomenological models as well as with the performance of other learning systems, including earlier neural network models as well as the support vector machines recently applied to the same problem. In discussing the results, emphasis is placed on predictions for nuclei that are far from the stability line, and especially those involved in r-process nucleosynthesis. It is found that the new statistical models can match or even surpass the predictive performance of conventional models for {beta}-decay systematics and accordingly should provide a valuable additional tool for exploring the expanding nuclear landscape.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Emulating Simulations of Cosmic Dawn for 21 cm Power Spectrum Constraints on Cosmology, Reionization, and X-Ray Heating

Current and upcoming radio interferometric experiments are aiming to make a statistical characterization of the high-redshift 21 cm fluctuation signal spanning the hydrogen reionization and X-ray heating epochs of the universe. However, connecting 21 cm statistics to the underlying physical parameters is complicated by the theoretical challenge of modeling the relevant physics at computational speeds quick enough to enable exploration of the high-dimensional and weakly constrained parameter space. In this work, we use machine learning algorithms to build a fast emulator that can accurately mimic an expensive simulation of the 21 cm signal across a wide parameter space. We embed our emulator within a Markov Chain Monte Carlo framework in order to perform Bayesian parameter constraints over a large number of model parameters, including those that govern the Epoch of Reionization, the Epoch of X-ray Heating, and cosmology. As a worked example, we use our emulator to present an updated parameter constraint forecast for the Hydrogen Epoch of Reionization Array experiment, showing that its characterization of a fiducial 21 cm power spectrum will considerably narrow the allowed parameter space of reionization and heating parameters, and could help strengthen Planck's constraints on σ{sub 8}. We provide both our generalized emulator code and its implementation specifically for 21 cm parameter constraints as publicly available software.

79 ASTRONOMY AND ASTROPHYSICS↗

Simultaneous calibration of surface flow and baseflow simulations: a revisit of the SWAT model calibration framework

Accurate analysis of water flow pathways from rainfall to streams is critical for simulating water use, climate change impact, and contaminants transport. In this study, we developed a new scheme to simultaneously calibrate surface flow (SF) and baseflow (BF) simulations of soil and water assessment tool (SWAT) by combing evolutionary multi-objective optimization (EMO) and BF separation techniques. The application of this scheme demonstrated pronounced trade-off of SWAT’s performance on SF and BF simulations. The simulated major water fluxes and storages variables (e.g. soil moisture, evapotranspiration, and groundwater) using the multiple parameters from EMO span wide ranges. Uncertainty analysis was conducted by Bayesian model averaging of the Pareto optimal solutions. The 90% confidence interval (CI) estimated using all streamflows substantially overestimate the uncertainty of low flows on BF days while underestimating the uncertainty of high flows on SF days. Despite using statistical criteria calculated based on streamflow for model selection, it is important to conduct diagnostic analysis of the agreement of SWAT behaviour and actual watershed dynamics. The new calibration technique can serve as a useful tool to explore the tradeoff between SF and BF simulations and provide candidates for further diagnostic assessment and model identification.

54 ENVIRONMENTAL SCIENCES↗

Towards optimal extraction of cosmological information from nonlinear data

One of the main unsolved problems of cosmology is how to maximize the extraction of information from nonlinear data. If the data are nonlinear the usual approach is to employ a sequence of statistics (N-point statistics, counting statistics of clusters, density peaks or voids etc.), along with the corresponding covariance matrices. However, this approach is computationally prohibitive and has not been shown to be exhaustive in terms of information content. Here we instead develop a hierarchical Bayesian approach, expanding the likelihood around the maximum posterior of linear modes, which we solve for using optimization methods. By integrating out the modes using perturbative expansion of the likelihood we construct an initial power spectrum estimator, which for a fixed forward model contains all the cosmological information if the initial modes are gaussian distributed. We develop a method to construct the window and covariance matrix such that the estimator is explicitly unbiased and nearly optimal. We then generalize the method to include the forward model parameters, including cosmological and nuisance parameters, and primordial non-gaussianity. We apply the method in the simplified context of nonlinear structure formation, using either simplified 2-LPT dynamics or N-body simulations as the nonlinear mapping between linear and nonlinear density, and 2-LPT dynamics in the optimization steps used to reconstruct the initial density modes. We demonstrate that the method gives an unbiased estimator of the initial power spectrum, providing among other a near optimal reconstruction of linear baryonic acoustic oscillations.

79 ASTRONOMY AND ASTROPHYSICS↗

Localization of deformable tumors from short-arc projections using Bayesian estimation

Purpose: The authors present a stochastic framework for radiotherapy patient positioning directly utilizing radiographic projections. This framework is developed to be robust against anatomical nonrigid deformations and to cope with challenging imaging scenarios, involving only a few cone beam CT projections from short arcs. Methods: Specifically, a Bayesian estimator (BE) is explicitly derived for the given scanning geometry. This estimator is compared to reference methods such as chamfer matching (CM) and the minimization of the median absolute error adapted as tools of robust image processing and statistics. In order to show the performance of the stochastic short-arc patient positioning method, a CIRS IMRT thorax phantom study is presented with movable markers and the utilization of an Elekta Synergy{sup Registered-Sign} XVI system. Furthermore, a clinical prostate CBCT scan of a Varian{sup Registered-Sign} On-Board Imager{sup Registered-Sign} system is utilized to investigate the robustness of the method for large variations of image quality (anterior-posterior vs lateral views). Results: The results show that the BE shifts reduce the initial setup error of up to 3 cm down to 3 mm at maximum for an imaging arc as short as 10 Degree-Sign while CM achieves residual errors of 7 mm at maximum only for arcs longer than 40 Degree-Sign . Furthermore, the BE can compensate robustly for low image qualities using several low quality projections simultaneously. Conclusions: In conclusion, an estimation method for marker-based patient positioning for short imaging arcs is presented and shown to be robust and accurate for deformable anatomies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

THE DISTANCE TO M51

Great investments of observing time have been dedicated to the study of nearby spiral galaxies with diverse goals ranging from understanding the star formation process to characterizing their dark matter distributions. Accurate distances are fundamental to interpreting observations of these galaxies, yet many of the best studied nearby galaxies have distances based on methods with relatively large uncertainties. We have started a program to derive accurate distances to these galaxies. Here we measure the distance to M51—the Whirlpool galaxy—from newly obtained Hubble Space Telescope optical imaging using the tip of the red giant branch method. We measure the distance modulus to be 8.58 ± 0.10 Mpc (statistical), corresponding to a distance modulus of 29.67 ± 0.02 mag. Our distance is an improvement over previous results as we use a well-calibrated, stable distance indicator, precision photometry in a optimally selected field of view, and a Bayesian Maximum Likelihood technique that reduces measurement uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative data sets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student t process regression. We apply Student t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via colouring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics and classic machine learning clustering algorithms.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗