Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BAYESIAN STATISTICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Bayesian event categorization matrix approach for explosion monitoring

Current efforts to correctly categorize natural events from suspected explosion sources with data that is collected by ground- or space-based sensors presents historical challenges that remain unaddressed by the Event Categorization Matrix (ECM) model. Smaller historical events (lower yield explosions) may have data available from fewer measurement techniques than are available today, and therefore, a historical event record can lack a complete set of discriminants. The covariance structures can also differ between such observations of event (source-type) categories. Both obstacles are problematic for the classic ECM model. Our work addresses this gap and presents a Bayesian update to the previous ECM model, termed the Bayesian Event Categorization Matrix model, which can be trained on partial observations and does not rely on a pooled covariance structure. We further augment the ECM model with Bayesian Decision Theory so that false negative or false positive rates of an event categorization can be reduced in an intuitive manner. To demonstrate improved categorization rates for the Bayesian Event Categorization Matrix model, we compare an array of Bayesian and classic models with multiple performance metrics using Monte Carlo experiments. We use both synthetic and real data. Our Bayesian models show consistent gains in overall accuracy and lower false negative rates relative to the classic ECM model. Here, we propose future avenues to improve Bayesian Event Categorization Matrix models’ decision making and predictive capability.

58 GEOSCIENCES↗

Sequential Detection of Fission Processes for Harbor Defense

With the large increase in terrorist activities throughout the world, the timely and accurate detection of special nuclear material (SNM) has become an extremely high priority for many countries concerned with national security. The detection of radionuclide contraband based on their γ-ray emissions has been attacked vigorously with some interesting and feasible results; however, the fission process of SNM has not received as much attention due to its inherent complexity and required predictive nature. In this paper, on-line, sequential Bayesian detection and estimation (parameter) techniques to rapidly and reliably detect unknown fissioning sources with high statistical confidence are developed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Why Do We Find Ourselves Around a Yellow Star Instead of a Red Star?

M-dwarf stars are more abundant than G-dwarf stars, so our position as observers on a planet orbiting a G-dwarf raises questions about the suitability of other stellar types for supporting life. If we consider ourselves as typical, in the anthropic sense that our environment is probably a typical one for conscious observers, then we are led to the conclusion that planets orbiting in the habitable zone of G-dwarf stars should be the best place for conscious life to develop. But such a conclusion neglects the possibility that K-dwarfs or M-dwarfs could provide more numerous sites for life to develop, both now and in the future. In this paper we analyse this problem through Bayesian inference to demonstrate that our occurrence around a G-dwarf might be a slight statistical anomaly, but only the sort of chance event that we expect to occur regularly. Even if M-dwarfs provide more numerous habitable planets today and in the future, we still expect mid G- to early K-dwarfs stars to be the most likely place for observers like ourselves. This suggests that observers with similar cognitive capabilities as us are most likely to be found at the present time and place, rather than in the future or around much smaller stars.

anthropic principle↗

EIGHT-DIMENSIONAL MID-INFRARED/OPTICAL BAYESIAN QUASAR SELECTION

We explore the multidimensional, multiwavelength selection of quasars from mid-infrared (MIR) plus optical data, specifically from Spitzer-Infrared Array Camera (IRAC) and the Sloan Digital Sky Survey (SDSS). Traditionally, quasar selection relies on cuts in two-dimensional color space despite the fact that most modern surveys (optical and IR) are done in more than three bandpasses. In this paper, we apply modern statistical techniques to combined Spitzer MIR and SDSS optical data, allowing up to eight-dimensional (8-D) color selection of quasars. Using a Bayesian selection method, we catalog 5546 quasar candidates to an 8.0 {mu}m depth of 56 {mu}Jy over an area of {approx}24 deg{sup 2}. Roughly 70% of these candidates are not identified by applying the same Bayesian algorithm to 4-color SDSS optical data alone. The 8-D optical+MIR selection on this data set recovers 97.7% of known type 1 quasars in this area and greatly improves the effectiveness of identifying 3.5 < z < 5 quasars which are challenging to identify (without considerable contamination) using MIR data alone. We demonstrate that, even using only the two shortest wavelength IRAC bandpasses (3.6 and 4.5 {mu}m), it is possible to use our Bayesian techniques to select quasars with 97% completeness and as little as 10% contamination (as compared to {approx}60% contamination using color cuts alone). We compute photometric redshifts for our sample; comparison with known objects suggests a photometric redshift accuracy of 93.6% ({delta}z {+-} 0.3), remaining roughly constant when the two reddest MIR bands are excluded. Despite the fact that our methods are designed to find type 1 (unobscured) quasars, as many as 1200 of the objects are type 2 (obscured) quasar candidates. Coupling deep optical imaging data, with deep MIR data, could enable selection of quasars in significant numbers past the peak of the quasar luminosity function (QLF) to at least z {approx} 4. Such a sample would constrain the shape of the QLF both above and below the break luminosity (L* {sub Q}) and enable quasar clustering studies over the largest range of redshift and luminosity to date, yielding significant gains in our understanding of the physics of quasars and their contribution to galaxy evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

A support vector machine classifier reduces interscanner variation in the HRCT classification of regional disease pattern in diffuse lung disease: Comparison to a Bayesian classifier

Purpose: To investigate the effect of using different computed tomography (CT) scanners on the accuracy of high-resolution CT (HRCT) images in classifying regional disease patterns in patients with diffuse lung disease, support vector machine (SVM) and Bayesian classifiers were applied to multicenter data. Methods: Two experienced radiologists marked sets of 600 rectangular 20 Multiplication-Sign 20 pixel regions of interest (ROIs) on HRCT images obtained from two scanners (GE and Siemens), including 100 ROIs for each of local patterns of lungs-normal lung and five of regional pulmonary disease patterns (ground-glass opacity, reticular opacity, honeycombing, emphysema, and consolidation). Each ROI was assessed using 22 quantitative features belonging to one of the following descriptors: histogram, gradient, run-length, gray level co-occurrence matrix, low-attenuation area cluster, and top-hat transform. For automatic classification, a Bayesian classifier and a SVM classifier were compared under three different conditions. First, classification accuracies were estimated using data from each scanner. Next, data from the GE and Siemens scanners were used for training and testing, respectively, and vice versa. Finally, all ROI data were integrated regardless of the scanner type and were then trained and tested together. All experiments were performed based on forward feature selection and fivefold cross-validation with 20 repetitions. Results: For each scanner, better classification accuracies were achieved with the SVM classifier than the Bayesian classifier (92% and 82%, respectively, for the GE scanner; and 92% and 86%, respectively, for the Siemens scanner). The classification accuracies were 82%/72% for training with GE data and testing with Siemens data, and 79%/72% for the reverse. The use of training and test data obtained from the HRCT images of different scanners lowered the classification accuracy compared to the use of HRCT images from the same scanner. For integrated ROI data obtained from both scanners, the classification accuracies with the SVM and Bayesian classifiers were 92% and 77%, respectively. The selected features resulting from the classification process differed by scanner, with more features included for the classification of the integrated HRCT data than for the classification of the HRCT data from each scanner. For the integrated data, consisting of HRCT images of both scanners, the classification accuracy based on the SVM was statistically similar to the accuracy of the data obtained from each scanner. However, the classification accuracy of the integrated data using the Bayesian classifier was significantly lower than the classification accuracy of the ROI data of each scanner. Conclusions: The use of an integrated dataset along with a SVM classifier rather than a Bayesian classifier has benefits in terms of the classification accuracy of HRCT images acquired with more than one scanner. This finding is of relevance in studies involving large number of images, as is the case in a multicenter trial with different scanners.

60 APPLIED LIFE SCIENCES↗

Gravity dual for a model of perception

One of the salient features of human perception is its invariance under dilatation in addition to the Euclidean group, but its non-invariance under special conformal transformation. We investigate a holographic approach to the information processing in image discrimination with this feature. We claim that a strongly coupled analogue of the statistical model proposed by Bialek and Zee can be holographically realized in scale invariant but non-conformal Euclidean geometries. We identify the Bayesian probability distribution of our generalized Bialek-Zee model with the GKPW partition function of the dual gravitational system. We provide a concrete example of the geometric configuration based on a vector condensation model coupled with the Euclidean Einstein-Hilbert action. From the proposed geometry, we study sample correlation functions to compute the Bayesian probability distribution.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The DESI-Lensing Mock Challenge: large-scale cosmological analysis of 3x2-pt statistics

The current generation of large galaxy surveys will test the cosmological model by combining multiple types of observational probes. Realising the statistical promise of these new datasets requires rigorous attention to all aspects of analysis including cosmological measurements, modelling, covariance and parameter likelihood. In this paper we present the results of an end-to-end simulation study designed to test the analysis pipeline for the combination of the Dark Energy Spectroscopic Instrument (DESI) Year 1 galaxy redshift dataset and separate weak gravitational lensing information from the Kilo-Degree Survey, Dark Energy Survey and Hyper-Suprime-Cam Survey. Our analysis employs the 3x2-pt correlation functions including cosmic shear and galaxy-galaxy lensing, together with the projected correlation function of the spectroscopic DESI lenses. We build realistic simulations of these datasets including galaxy halo occupation distributions, photometric redshift errors, weights, multiplicative shear calibration biases and magnification. We calculate the analytical covariance of these correlation functions including the Gaussian, noise and super-sample contributions, and show that our covariance determination agrees with estimates based on the ensemble of simulations. We use a Bayesian inference platform to demonstrate that we can recover the fiducial cosmological parameters of the simulation within the statistical error margin of the experiment, investigating the sensitivity to scale cuts. This study is the first in a sequence of papers in which we present and validate the large-scale 3x2-pt cosmological analysis of DESI-Y1.

79 ASTRONOMY AND ASTROPHYSICS↗

Empirical radius formulas for canonical neutron stars from bidirectionally selecting features of equations of state in extended Bayesian analyses of observational data

Significant advancement in Bayesian inference of nuclear equation of state (EOS) from gravitational wave and x-ray observations of neutron stars (NSs) has been made by the nuclear astrophysics community especially since GW170817. By extending the traditional Bayesian analysis which normally ends at presenting the marginalized posterior probability distribution functions (PDFs) of individual EOS parameters and their correlations (or sometimes only the Pearson correlation coefficients which are only reliably useful when the variables are linearly correlated while they are actually often not), we search for a data-driven and robust empirical formula for the radius 𝑅 1.4 of canonical NSs in terms of the characteristic EOS parameters (features). We also identify the single most important but currently poorly known EOS parameter for determining the 𝑅 1.4 . Using three regression-model-building methodologies: bidirectional stepwise feature selection, least absolute shrinkage selection operator (LASSO) regression, and neural network regression on a large set of posterior EOSs and the corresponding 𝑅 1.4 values inferred from earlier comprehensive Bayesian analyses of NS observational data, we systematically and rigorously develop the most probable 𝑅 1.4 formulas with varying statistical accuracy and technical complexity. Here, the most important EOS parameters for determining 𝑅 1.4 are found consistently in each of the feature selection processes to be (in order of decreasing importance): curvature 𝐾 sym , slope 𝐿, skewness 𝐽 sym of nuclear symmetry energy, skewness 𝐽 0 , incompressibility 𝐾 0 of symmetric nuclear matter, and the magnitude 𝐸 sym ⁡(𝜌 0 ) of symmetry energy at the saturation density 𝜌 0 of nuclear matter.

Bayesian methods↗

Bayesian Treed Calibration: An Application to Carbon Capture With AX Sorbent

In cases where field or experimental measurements are not available, computer models can model real physical or engineering systems to reproduce their outcomes. They are usually calibrated in light of experimental data to create a better representation of the real system. Statistical methods, based on Gaussian processes, for calibration and prediction have been especially important when the computer models are expensive and experimental data limited. In this paper, we develop the Bayesian treed calibration (BTC) as an extension of standard Gaussian process calibration methods to deal with non-stationarity computer models and/or their discrepancy from the field (or experimental) data. Our proposed method partitions both the calibration and observable input space, based on a binary tree partitioning, into sub-regions where existing model calibration methods can be applied to connect a computer model with the real system. The estimation of the parameters in the proposed model is carried out using Markov chain Monte Carlo (MCMC) computational techniques. Different strategies have been applied to improve mixing. We illustrate our method in two artificial examples and a real application that concerns the capture of carbon dioxide with AX amine based sorbents. The source code and the examples analyzed in this paper are available as part of the supplementary materials.

Bayesian tree↗

Tipping point analysis of atmospheric oxygen concentration

We apply tipping point analysis to nine observational oxygen concentration records around the globe, analyse their dynamics and perform projections under possible future scenarios, leading to oxygen deficiency in the atmosphere. The analysis is based on statistical physics framework with stochastic modelling, where we represent the observed data as a composition of deterministic and stochastic components estimated from the observed data using Bayesian and wavelet techniques.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

General Bayesian Inference over the Stiefel Manifold via the Givens Transform

We introduce here an approach based on the Givens representation for posterior inference in statistical models with orthogonal matrix parameters, such as factor models and probabilistic principal component analysis (PPCA). We show how the Givens representation can be used to develop practical methods for transforming densities over the Stiefel manifold into densities over subsets of Euclidean space. We demonstrate how to deal with issues arising from the topology of the Stiefel manifold and how to inexpensively compute the change-of-measure terms. We introduce an auxiliary parameter approach that limits the impact of topological issues. We provide both analysis of our methods and numerical examples demonstrating the effectiveness of the approach. We also discuss how our Givens representation can be used to define general classes of distributions over the space of orthogonal matrices. We then give demonstrations on several examples showing how the Givens approach performs in practice in comparison with other methods.

97 MATHEMATICS AND COMPUTING↗

REVISITING THE SCALING RELATIONS OF BLACK HOLE MASSES AND HOST GALAXY PROPERTIES

New kinematic data and modeling efforts in the past few years have substantially expanded and revised dynamical measurements of black hole masses (M {sub .}) at the centers of nearby galaxies. Here we compile an updated sample of 72 black holes and their host galaxies, and present revised scaling relations between M {sub .} and stellar velocity dispersion ({sigma}), V-band luminosity (L), and bulge stellar mass (M {sub bulge}), for different galaxy subsamples. Our best-fitting power-law relations for the full galaxy sample are log{sub 10}(M {sub .}) = 8.32 + 5.64log{sub 10}({sigma}/200 km s{sup -1}), log{sub 10}(M {sub .}) = 9.23 + 1.11log{sub 10}(L/10{sup 11} L {sub Sun }), and log{sub 10}(M {sub .}) = 8.46 + 1.05log{sub 10}(M {sub bulge}/10{sup 11} M {sub Sun }). A log-quadratic fit to the M {sub .}-{sigma} relation with an additional term of {beta}{sub 2} [log{sub 10}({sigma}/200 km s{sup -1})]{sup 2} gives {beta}{sub 2} = 1.68 {+-} 1.82 and does not decrease the intrinsic scatter in M {sub .}. Including 92 additional upper limits on M {sub .} does not change the slope of the M {sub .}-{sigma} relation. When the early- and late-type galaxies are fit separately, we obtain similar slopes of 5.20 and 5.06 for the M {sub .}-{sigma} relation but significantly different intercepts-M {sub .} in early-type galaxies are about two times higher than in late types at a given sigma. Within early-type galaxies, our fits to M {sub .}({sigma}) give M {sub .} that is about two times higher in galaxies with central core profiles than those with central power-law profiles. Our M {sub .}-L and M {sub .}-M {sub bulge} relations for early-type galaxies are similar to those from earlier compilations, and core and power-law galaxies yield similar L- and M {sub bulge}-based predictions for M {sub .}. When the conventional quadrature method is used to determine the intrinsic scatter in M {sub .}, our data set shows weak evidence for increased scatter at M {sub bulge} < 10{sup 11} M {sub Sun} or L{sub V} < 10{sup 10.3} L {sub Sun }, while the scatter stays constant for 10{sup 11} < M {sub bulge} < 10{sup 12.3} M {sub Sun} and 10{sup 10.3} < L{sub V} < 10{sup 11.5} L {sub Sun }. A Bayesian analysis indicates that a larger sample of M {sub .} measurements would be needed to detect any statistically significant trend in the scatter with galaxy properties.

79 ASTRONOMY AND ASTROPHYSICS↗

Probabilistic models for feedback systems.

In previous work, we developed a Bayesian-based methodology to analyze the reliability of hierarchical systems. The output of the procedure is a statistical distribution of the reliability, thus allowing many questions to be answered. The principal advantage of the approach is that along with an estimate of the reliability, we also can provide statements of confidence in the results. The model is quite general in that it allows general representations of all of the distributions involved, it incorporates prior knowledge into the models, it allows errors in the 'engineered' nodes of a system to be determined by the data, and leads to the ability to determine optimal testing strategies. In this report, we provide the preliminary steps necessary to extend this approach to systems with feedback. Feedback is an essential component of 'complexity' and provides interesting challenges in modeling the time-dependent action of a feedback loop. We provide a mechanism for doing this and analyze a simple case. We then consider some extensions to more interesting examples with local control affecting the entire system. Finally, a discussion of the status of the research is also included.

99 GENERAL AND MISCELLANEOUS↗

Machine Learning Algorithms for Matching Theories, Simulations, and Observations in Cosmology (Final Project)

The search for simple and elegant equations to explain and predict observable natural phenomena has been a driving force in scientific theory for several centuries. The great successes of Newton's laws, Maxwell's equations, the Schrodinger equation, and the theory of General Relativity have encouraged this perspective, and perhaps a beautiful equation comprising a “theory of everything” remains to be discovered. But now scientists are grappling with systems of ever-increasing complexity, fraught with nonlinearity, and with the quantities of interest often only indirectly observed. Nature may resist a simple description, and the most important discoveries of the next century may be complex theories with countless variables and parameters. The era of big data opens up a promising new approach to scientific discovery in this setting. The predictions of modern theories, even if complex or nonlinear, can be examined through detailed and computationally-intensive simulations that take days or weeks to run and fill petabytes of disk space. The upcoming generation of scientific instruments will provide petabytes of observations at unprecedented resolution and depth. The challenge is to compare data to simulations so as to test theories and identify those that best match the observations. The data are numerous and rich but are subject to noise and various systematic biases. The simulations are large and detailed but are so costly that the effective sample size is small. Moreover, the mapping from data to simulation to the parameters of interest is typically complicated and ill-conditioned. Although these challenges, and the solutions we propose, apply across the sciences, we will ground our efforts by focusing on cosmology. Here, we are truly entering the era of big data in several senses. Ever larger experiments survey larger and larger cosmological volumes, resulting in enormous amounts of pixel data to process and extract the information of cosmological interest. These include large imaging surveys, which collect all the light in broad wavelength ranges over significant fractions of the sky, and spectroscopic surveys, which measure the light as a function of wavelength to map out 3D distances. These experiments are designed to shed light on the big unanswered questions in cosmology. Distilling the petabytes of data into observed quantities for comparison with theory is a daunting task. But these large experiments do not only result in large amounts of data to analyze: if we wish to compare to theories of physics, then we need increasingly extensive predictions for the observed quantities as well, which requires ever-larger cosmological simulations that take substantial -- and at times prohibitive -- computational resources to produce. Our goal is to develop statistical and machine learning methods for using observed and simulated data to advance machine learning with applications cosmology. In particular, we focus our research efforts on the following tasks: The challenge for automated science is that it is computationally impossible and statistically dangerous to consider every possible model in order to find the best one. We will develop Bayesian Optimization based active-learning methods that accelerate both the execution of the simulations and the search for best-fitting parameters. The key idea is to make the simulations adaptive -- across resolutions, time, and parameters -- using the data to search as the simulation runs; Most ML methods operate on simple finite dimensional feature vectors. However, many cosmology and other science applications require ML methods that can operate on more complex objects as inputs or outputs such as functions, distributions, or sets and point clouds. Our goal is to develop efficient ML methods for this problem and demonstrate their applicability in Cosmology, Astrophysics, and other science problems.

79 ASTRONOMY AND ASTROPHYSICS↗

DESI Strong Lens Foundry. I. HST Observations and Modeling with GIGA-Lens

We present the Dark Energy Spectroscopic Instrument (DESI) Strong Lens Foundry. We discovered ∼3500 new strong gravitational lens candidates in the DESI Legacy Imaging Surveys using residual neural networks (ResNet). We observed a subset (51) of our candidates using the Hubble Space Telescope (HST). Except for one ambiguous case, we have confirmed 50 of the 51 candidates to be strong lenses. We also briefly describe spectroscopic follow-up observations by DESI and Keck NIRES programs. From this very rich data set, a number of studies will be carried out, including evaluating the quality of the ResNet search candidates and lens modeling. In this paper, we present our initial effort in these directions. In particular, as a demonstration, we present the lens model for DESI-165.4754−06.0423, with imaging data from HST, and lens and source redshifts from DESI and Keck NIRES, respectively. In this effort, we have applied a fully forward-modeling Bayesian approach (GIGA-Lens), using multiple GPUs, to a strong lens with HST data, and achieved statistical convergence.

79 ASTRONOMY AND ASTROPHYSICS↗

A Guide to the Literature on Learning Graphical Models

This literature review discusses different methods under the general rubric of learning Bayesian networks from data, and more generally, learning probabilistic graphical models. Because many problems in artificial intelligence, statistics and neural networks can be represented as a probabilistic graphical model, this area provides a unifying perspective on learning. This paper organizes the research in this area along methodological lines of increasing complexity.

Buntine, Wray L.↗

Structure of the accretion disk in the lensed quasar Q2237+0305 from multi-epoch and multi-wavelength narrowband photometry

We present estimates for the size and the logarithmic slope of the disk temperature profile of the lensed quasar Q2237+0305, independent of the component velocities. These estimates are based on six epochs of multi-wavelength narrowband images from the Nordic Optical Telescope. For each pair of lensed images and each photometric band, we determine the microlensing amplitude and chromaticity using pre-existing mid-IR photometry to define the baseline for no microlensing magnification. A statistical comparison of the combined microlensing data (6 epochs × 5 narrow bands × 6 image pairs) with simulations based on microlensing magnification maps gives Bayesian estimates for the half-light radius of R{sub 1/2}=8.5{sub −4.0}{sup +7.5}√(〈M〉/0.3 M{sub ⊙}) lt-day, and p = 0.95 ± 0.33 for the exponent of the logarithmic temperature profile T∝R{sup −1/p}. This size estimate is in good agreement with most recent studies. Other works based on the study of single microlensing events predict smaller sizes, but could be statistically biased by focusing on high-magnification events.

79 ASTRONOMY AND ASTROPHYSICS↗

Improved Statistical Analysis for the Neutrinoless Double-Beta Decay Matrix Element of 136Xe

Neutrinoless double beta decay nuclear matrix element (M0ν) for 136Xe was recently analyzed using a statistical approach (Phys. Rev. C 107, 045501 (2023)). In the analysis, three initial shell model effective Hamiltonians were randomly altered, and their results for 23 measured observables were used to infer credibility for the M0ν nuclear matrix element (NME) based on a Bayesian Model Averaging approach. In that analysis, a reasonable Gamow-Teller quenching factor of 0.7 was assumed for each starting effective Hamiltonian. Given that the result of the statistical analysis was sensible to this choice, we are here improving that analysis by assuming that the Gamow-Teller quenching factor is also randomly chosen within reasonabe limits for all three starting Hamiltonians. The outcomes are slightly higher expectation values and uncertainties for the M0ν NME.

Astronomy & Astrophysics↗