Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BAYESIAN STATISTICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Stopping criteria for ending autonomous, single detector radiological source searches

While the localization of radiological sources has traditionally been handled with statistical algorithms, such a task can be augmented with advanced machine learning methodologies. The combination of deep and reinforcement learning has provided learning-based navigation to autonomous, single-detector, mobile systems. However, these approaches lacked the capacity to terminate a surveying/search task without outside influence of an operator or perfect knowledge of source location (defeating the purpose of such a system). Two stopping criteria are investigated in this work for a machine learning navigated system: one based upon Bayesian and maximum likelihood estimation (MLE) strategies commonly used in source localization, and a second providing the navigational machine learning network with a “stop search” action. A convolutional neural network was trained via reinforcement learning in a 10 m × 10 m simulated environment to navigate a randomly placed detector-agent to a randomly placed source of varied strength (stopping with perfect knowledge during training). The network agent could move in one of four directions (up, down, left, right) after taking a 1 s count measurement at the current location. During testing, the stopping criteria for this navigational algorithm was based upon a Bayesian likelihood estimation technique of source presence, updating this likelihood after each step, and terminating once the confidence of the source being in a single location exceeded 0.9. A second network was trained and tested with similar architecture as the previous but which contained a fifth action: for self-stopping. The accuracy and speed of localization with set detector and source initializations were compared over 50 trials of MLE-Bayesian approach and 1000 trials of the CNN with self-stopping. The statistical stopping condition yielded a median localization error of ~1.41 m and median localization speed of 12 steps. The machine learning stopping condition yielded a median localization error of 0 m and median localization speed of 17 steps. This work demonstrated two stopping criteria available to a machine learning guided, source localization system.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

CROSS IDENTIFICATION OF STARS WITH UNKNOWN PROPER MOTIONS

The cross identification of sources in separate catalogs is one of the most basic tasks in observational astronomy. It is, however, surprisingly difficult and generally ill defined. Recently, Budavari and Szalay formulated the problem in the realm of probability theory and laid down the statistical foundations of an extensible methodology. In this paper, we apply their Bayesian approach to stars with detectable proper motion and show how to associate their observations. We study models on a sample of stars in the Sloan Digital Sky Survey, which allow for an unknown proper motion per object, and demonstrate the improvements over the analytic static model. Our models and conclusions are directly applicable to upcoming surveys such as PanSTARRS, the Dark Energy Survey, Sky Mapper, and the Large Synoptic Survey Telescope, whose data sets will contain hundreds of millions of stars observed multiple times over several years.

79 ASTRONOMY AND ASTROPHYSICS↗

New constraints on sodium production in globular clusters from the Na 23 ( He 3 , d ) Mg 24 reaction

The star-to-star anticorrelation of sodium and oxygen is a defining feature of globular clusters, but, to date, the astrophysical site responsible for this unique chemical signature remains unknown. Sodium enrichment within these clusters depends sensitively on reaction rate of the sodium destroying reactions 23 Na(p, γ) and 23 Na(p,α). In this paper, we report the results of a 23 Na( 3 He,d) 24 Mg transfer reaction carried out at Triangle Universities Nuclear Laboratory using a 21 MeV 3 He beam. Astrophysically relevant states in 24 Mg between 11 < E x < 12 MeV were studied using high-resolution magnetic spectroscopy, thereby allowing the extraction of excitation energies and spectroscopic factors. Bayesian methods are combined with the distorted wave Born approximation to assign statistically meaningful uncertainties to the extracted spectroscopic factors. For the first time, these uncertainties are propagated through to the estimation of proton partial widths. Our experimental data are used to calculate the reaction rate. The impact of the new rates are investigated using asymptotic giant branch star models. Furthermore, it is found that while the astrophysical conditions still dominate the total uncertainty, intramodel variations on sodium production from the 23 Na(p, γ) and 23 Na(p,α) reaction channels are a lingering source of uncertainty.

20 ≤ A ≤ 38↗

Implementation of a Bayesian Engine for Uncertainty Analysis

In probabilistic risk assessment, it is important to have an environment where analysts have access to a shared and secured high performance computing and a statistical analysis tool package. As part of the advanced small modular reactor probabilistic risk analysis framework implementation, we have identified the need for advanced Bayesian computations. However, in order to make this technology available to non-specialists, there is also a need of a simplified tool that allows users to author models and evaluate them within this framework. As a proof-of-concept, we have implemented an advanced open source Bayesian inference tool, OpenBUGS, within the browser-based cloud risk analysis framework that is under development at the Idaho National Laboratory. This development, the “OpenBUGS Scripter” has been implemented as a client side, visual web-based and integrated development environment for creating OpenBUGS language scripts. It depends on the shared server environment to execute the generated scripts and to transmit results back to the user. The visual models are in the form of linked diagrams, from which we automatically create the applicable OpenBUGS script that matches the diagram. These diagrams can be saved locally or stored on the server environment to be shared with other users.

99 GENERAL AND MISCELLANEOUS↗

A Method for Retrieving Ground Flash Fraction from Satellite Lightning Imager Data

A general theory for retrieving the fraction of ground flashes in N lightning observed by a satellite-based lightning imager is provided. An "exponential model" is applied as a physically reasonable constraint to describe the measured optical parameter distributions, and population statistics (i.e., mean, variance) are invoked to add additional constraints to the retrieval process. The retrieval itself is expressed in terms of a Bayesian inference, and the Maximum A Posteriori (MAP) solution is obtained. The approach is tested by performing simulated retrievals, and retrieval error statistics are provided. The ability to retrieve ground flash fraction has important benefits to the atmospheric chemistry community. For example, using the method to partition the existing satellite global lightning climatology into separate ground and cloud flash climatologies will improve estimates of lightning nitrogen oxides (NOx) production; this in turn will improve both regional air quality and global chemistry/climate model predictions.

Koshak, William J.↗

Statistics and Discoveries at the LHC (1/4)

The lectures will give an introduction to statistics as applied in particle physics and will provide all the necessary basics for data analysis at the LHC. Special emphasis will be placed on the the problems and questions that arise when searching for new phenomena, including p-values, discovery significance, limit setting procedures, treatment of small signals in the presence of large backgrounds. Specific issues that will be addressed include the advantages and drawbacks of different statistical test procedures (cut-based, likelihood-ratio, etc.), the look-elsewhere effect and treatment of systematic uncertainties.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Operations for Learning with Graphical Models

This paper is a multidisciplinary review of empirical, statistical learning from a graphical model perspective. Well-known examples of graphical models include Bayesian net- works, directed graphs representing a Markov chain, and undirected networks representing a Markov field. These graphical models are extended to model data analysis and empirical learning using the notation of plates. Graphical operations for simplifying and manipulating a problem are provided including decomposition, differentiation, and the manipulation of probability models from the exponential family. These operations adapt existing techniques from statistics and automatic differentiation to graphs. Two standard algorithm schemes for learning are reviewed in a graphical framework: Gibbs sampling and the expectation maximization algorithm. Some algorithms are developed in this graphical framework including a generalized version of linear regression, techniques for feed-forward networks, and learning Gaussian and discrete Bayesian networks from data. The paper concludes by sketching some implications for data analysis and summarizing some popular algorithms that fall within the framework presented. The main original contributions here are the decomposition techniques and the demonstration that graphical models provide a framework for understanding and developing complex learning algorithms.

Buntine, Wray L.↗

Joint Bayesian analysis of large angular scale CMB temperature anomalies

Cosmic microwave background measurements show an agreement with the concordance cosmology model except for a few notable anomalies: Power Suppression , the lack of large scale power in the temperature data compared to what is expected in the concordance model, and Cosmic Hemispherical Asymmetry , a dipolar breakdown of statistical isotropy. An expansion of the CMB covariance in Bipolar Spherical Harmonics naturally parametrizes both these large-scale anomalies, allowing us to perform an exhaustive, fully Bayesian joint analysis of the power spectrum and violations of statistical isotropy up to the dipole level. Our analysis sheds light on the scale dependence of the Cosmic Hemispherical Asymmetry. Assuming a scale-dependent dipole modulation model with a two-parameter power law form, we explore the posterior pdf of amplitude A($l$ = 16) and the power law index α and find the maximum a posteriori values A * (l = 16) = 0.064 ± 0.022 and $α_*$ = -0.92 ± 0.22. The maximum a posteriori direction associated with the Cosmic Hemispherical Asymmetry is ($l,b$) = (247.8 o , -19.6 o ) in Galactic coordinates, consistent with previous analyses. We evaluate the Bayes factor BSI-DM to compare the Cosmic Hemispherical Asymmetry model with the isotropic model. The data prefer but do not substantially favor the anisotropic model (BSI-DM=0.4). We consider several priors and find that this evidence ratio is robust to prior choice. The large-scale power suppression does not soften when jointly inferring both the isotropic power spectrum and the parameters of the asymmetric model, indicating no evidence that these anomalies are coupled.

79 ASTRONOMY AND ASTROPHYSICS↗

Uncertainty quantification in breakup reactions

Breakup reactions are one of the favored probes to study loosely bound nuclei, particularly those in the limit of stability forming a halo. In order to interpret such breakup experiments, the continuum discretized coupled channel method is typically used. In this study, the first Bayesian analysis of a breakup reaction model is performed. Herein we use a combination of statistical methods together with a three-body reaction model (the continuum discretized coupled channel method) to quantify the uncertainties on the breakup observables due to the parameters in the effective potential describing the loosely bound projectile of interest. The combination of tools we develop opens the path for a Bayesian analysis of not only breakup processes, but also a wide array of complex processes that require computationally intensive reaction models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Multi-objective Bayesian alloy design using multi-task Gaussian processes

In design applications, correlations among material properties (such as the tendency for stronger materials to be less ductile) are often neglected. This approach is echoed in multi-objective optimization techniques which treat each performance characteristic as an independent objective, aiming to optimize scalar functions and find optimal Pareto fronts. However, this overlooks the statistical relationships between performance characteristics inherent in a material system. To address this, we propose the use of Bayesian optimization, a highly efficient black-box optimization algorithm known for constructing Gaussian processes (GPs) – uncorrelated surrogates - to model objective functions. Rather than evaluating multiple GPs for each objective function separately, we argue for a shift towards jointly modeling these objective functions, considering their statistical correlations. This integrated approach utilizes naturally occurring relationships among material properties, providing additional information to enhance the performance of the design framework. This requires the replacement of multiple independent GPs with a single multi-task GP, employing a correlation matrix to construct a multi-task kernel function, wherein each task corresponds to a single objective function. Here, we anticipate this refined methodology will better leverage material correlations, improving design optimization results.

36 MATERIALS SCIENCE↗

Statistical method for resolving the photon-photoelectron-counting inversion problem

A statistical inversion method is proposed for the photon-photoelectron-counting statistics in quantum key distribution experiment. With the statistical viewpoint, this problem is equivalent to the parameter estimation for an infinite binomial mixture model. The coarse-graining idea and Bayesian methods are applied to deal with this ill-posed problem, which is a good simple example to show the successful application of the statistical methods to the inverse problem. Numerical results show the applicability of the proposed strategy. The coarse-graining idea for the infinite mixture models should be general to be used in the future.

97 MATHEMATICS AND COMPUTING↗

Forest aboveground biomass estimation through integration of sentinel-2 and PALSAR-2 time series: assessing models trained on GEDI and field inventory benchmarks

Accurate and spatially explicit forest Aboveground Biomass (AGB) mapping through remote sensing is critical for quantifying terrestrial carbon stocks and informing effective forest management strategies. However, AGB estimation in dense forests with complex terrain remains challenging due to satellite sensor signal saturation problem (saturation issue occurs in high biomass forests), structural complexity, and limited ground truth for calibration. This study presents a novel framework that integrates multi-temporal Sentinel-2 optical imagery, ALOS PALSAR-2 Synthetic Aperture Radar (SAR) data, and topographic variables with explainable Machine Learning to map AGB across mountainous forests within subtropical and temperate oceanic climate zones of Mexico. We evaluate the effects of temporal granularity and sensor synergy by comparing multiple temporal inputs and sensor configurations (Sentinel-2, PALSAR-2, and their fusion), and assess model performance using two reference datasets: NASA GEDI LiDAR-derived biomass and Mexico’s National Forest and Soil Inventory (INFyS). Our results showed that models trained on INFyS consistently outperformed those trained on GEDI, highlighting limitations in GEDI’s reliability in biomass estimates within this study region. Furthermore, the integration of Sentinel-2 and PALSAR-2 provided improved predictions compared to single-sensor models, particularly when combined with temporally explicit yearly statistics. The best-performing model, which was trained on INFyS data, and considered both Sentinel-2 and PALSAR-2 yearly statistics, as well as topographic variables, achieved an R2 of 0.64, RMSE of 51.10 Mg/ha, and relative RMSE (rRMSE) of 58.69%. Explainable ML analysis identified Sentinel-2 spectral indices and topographic features as key predictors, while PALSAR-2 metrics provided complementary information, partially mitigating saturation effects in high-biomass areas. Specifically, integrating both sensors substantially improved AGB estimation in high biomass forest (≥200 Mg/ha), yielding 98% gains over optical-only model, with resulting estimates exceeding GEDI L4B by 29% and ESA-CCI-BIOMASS by 174%. Terrain-stratified analysis indicated close agreement with GEDI in low-slope areas, with increasing divergence as slope steepness increased, while estimates remained consistently higher than ESA-CCI-BIOMASS across all slope classes. The proposed approach advances multi-sensor fusion and temporal feature engineering for AGB mapping using open-access satellite datasets, providing a scalable and reproducible framework for annual biomass monitoring in topographically complex mountainous forests. The resulting 25 m resolution biomass product has the potential to provide spatially detailed information for forest monitoring and may support applications in carbon accounting and forest management.

54 ENVIRONMENTAL SCIENCES↗

Bayesian Proteoform Modeling Improves Protein Quantification of Global Proteomic Measurements

As the capability of mass spectrometry-based proteomics has matured, tens of thousands of peptides can be measured simultaneously, which has the benefit of offering a systems view of protein expression. However, a major challenge is that with an increase in throughput, protein quantification estimation from the native measured peptides has become a computational task. A limitation to existing computationally-driven protein quantification methods is that most ignore protein variation, such as alternate splicing of the RNA transcript and post-translational modifications or other possible proteoforms, which will affect a significant fraction of the proteome. The consequence of this assumption is that statistical inference at the protein level, and consequently downstream analyses, such as network and pathway modeling, have only limited power for biomarker discovery. Here, we describe a Bayesian model (BP-Quant) that uses statistically derived peptides signatures to identify peptides that are outside the dominant pattern, or the existence of multiple over-expressed patterns to improve relative protein abundance estimates. It is a research-driven approach that utilizes the objectives of the experiment, defined in the context of a standard statistical hypothesis, to identify a set of peptides exhibiting similar statistical behavior relating to a protein. This approach infers that changes in relative protein abundance can be used as a surrogate for changes in function, without necessarily taking into account the effect of differential post-translational modifications, processing, or splicing in altering protein function. We verify the approach using a dilution study from mouse plasma samples and demonstrate that BP-Quant achieves similar accuracy as the current state-of-the-art methods at proteoform identification with significantly better specificity. BP-Quant is available as a MatLab ® and R packages at https://github.com/PNNL-Comp-Mass-Spec/BP-Quant.

Protein Quantitation, proteomics↗

Modeling Radiation Detection Using a Mixed-Effects Statistical Model for Background Variation

In this paper, we consider radiation source localization in an urban environment as an inverse problem and use Bayesian parameter estimation techniques to infer the source location and intensity. Since parameter estimation generally requires a large number of model evaluations, we employ a simplified photon transport model, as in a 2017 paper by Stefanescu, et al., to reduce computational requirements. However, the model in the 2017 paper does not account for the physical reality that background radiation varies with position within an urban locale. We incorporate statistical mixed-effects modeling into the simplified transport equation from the Stefanescu, et al. paper to reflect individual variation among the background radiation measurements at multiple detector locations. With our new model, we use a Bayesian DRAM-within-Gibbs technique, which incorporates the Delayed Rejection Adaptive Metropolis (DRAM) algorithm, to estimate the mixed-effects parameters. We note that without adequate prior information, we were unable to simultaneously estimate the set of parameters corresponding to the source intensity, source location, and individual background radiation counts. By calibrating the background in the absence of a source, we obtained narrow prior distributions, which permitted us to jointly infer the source intensity and location and the background radiation distribution.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

D-Guaranteed Discrimination of Statistical Hypotheses: a Review of Results and Unsolved Problems

We compare two sequential d-guaranteed tests and an optimal d-guaranteed test based on a fixed number of observations with respect to the average number of observations within the most accepted practical applications of Bayesian probabilistic models. We consider the sequential “first skipping” test, the sequential locally efficient test based on the score statistic, and the test based on a fixed number of observations that minimizes the necessary sample size. We study various characteristics of these tests connected with the number of observations within three probabilistic models, namely, the normal (ϑ, σ{sup 2}) distribution of the observed random variable and the normal a priori distribution of ϑ with fixed σ{sup 2}; the exponential distribution with the intensity parameter ϑ and the a priori gamma distribution of ϑ; and the Bernoulli sampling with the success probability ϑ and the a priori beta distribution of ϑ. We discuss the connection of the d-posterior approach with the compound decision problem as applied to the analysis of data provided by microchips (when the false discovery rate, or FDR, for short, is treated as the d-risk of the first kind). We present the vast data on characteristics of the mentioned tests obtained by the method of mathematical modeling in several tables. We discuss unsolved problems of the d-guaranteed discrimination of hypotheses with the minimal number of observations and approaches to their solution.

97 MATHEMATICS AND COMPUTING↗

Astrophysical data analysis with information field theory

Non-parametric imaging and data analysis in astrophysics and cosmology can be addressed by information field theory (IFT), a means of Bayesian, data based inference on spatially distributed signal fields. IFT is a statistical field theory, which permits the construction of optimal signal recovery algorithms. It exploits spatial correlations of the signal fields even for nonlinear and non-Gaussian signal inference problems. The alleviation of a perception threshold for recovering signals of unknown correlation structure by using IFT will be discussed in particular as well as a novel improvement on instrumental self-calibration schemes. IFT can be applied to many areas. Here, applications in in cosmology (cosmic microwave background, large-scale structure) and astrophysics (galactic magnetism, radio interferometry) are presented.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

THE DEGENERACY OF M33 MASS MODELING AND ITS PHYSICAL IMPLICATIONS

The Local Group galaxy M33 exhibits a regular spiral structure and is close enough to permit high resolution analysis of its kinematics, making it an ideal candidate for rotation curve studies of its inner regions. Previous studies have claimed the galaxy has a dark matter halo with an Navarro-Frenk-White profile, based on statistical comparisons with a small number of other profiles. We apply a Bayesian method from our previous paper to place the dark matter density profile in the context of a continuous, and more general, parameter space. For a wide range of initial assumptions we find that models with inner log slope γ{sub in} < 0.9 are strongly excluded by the kinematics of the galaxy unless the mass-to-light ratio of the stellar components in the 3.6 μm band satisfies Y{sub 3.6} ≥ 2. Such a high Y{sub 3.6} is inconsistent with current modeling of the stellar population of M33. This suggests that M33 is a galaxy whose dark matter halo has not been significantly modified by feedback. We discuss possible explanations of this result, including ram pressure stripping during earlier interactions with M31.

79 ASTRONOMY AND ASTROPHYSICS↗

Likelihood non-Gaussianity in large-scale structure analyses

The standard present-day large-scale structure (LSS) analyses make a major assumption in their Bayesian parameter inference – that the likelihood has a Gaussian form. For summary statistics currently used in LSS, this assumption, even if the underlying density field is Gaussian, cannot be correct in detail. We investigate the impact of this assumption on two recent LSS analyses: the Beutler et al. power spectrum multipole ($P_ℓ$) analysis and the Sinha et al. group multiplicity function ($ζ$) analysis. Using non-parametric divergence estimators on mock catalogues originally constructed for covariance matrix estimation, we identify significant non-Gaussianity in both the $P_ℓ$ and $ζ$ likelihoods. We then use Gaussian mixture density estimation and independent component analysis on the same mocks to construct likelihood estimates that approximate the true likelihood better than the Gaussian pseudo-likelihood. Using these likelihood estimates, we accurately estimate the true posterior probability distribution of the Beutler et al. and Sinha et al. parameters. Likelihood non-Gaussianity shifts the fσ8 constraint by -0.44σ, but otherwise does not significantly impact the overall parameter constraints of Beutler et al. For the $ζ$ analysis, using the pseudo-likelihood significantly underestimates the uncertainties and biases the constraints of the Sinha et al. halo occupation parameters. For log $M_1$ and α, the posteriors are shifted by +0.43σ and -0.51σ and broadened by 42 per cent and 66 per cent, respectively. The divergence and likelihood estimation methods we present provide a straightforward framework for quantifying the impact of likelihood non-Gaussianity and deriving more accurate parameter constraints.

79 ASTRONOMY AND ASTROPHYSICS↗