Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian Robustness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Data-driven upper bounds and event attribution for unprecedented heatwaves

The last decade has seen numerous record-shattering heatwaves in all corners of the globe. In the aftermath of these devastating events, there is interest in identifying worst-case thresholds or upper bounds that quantify just how hot temperatures can become. Generalized Extreme Value theory provides a data-driven estimate of extreme thresholds; however, upper bounds may be exceeded by future events, which undermines attribution and planning for heatwave impacts. Here, we show how the occurrence and relative probability of observed yet unprecedented events that exceed a priori upper bound estimates, so-called “impossible” temperatures, has changed over time. We find that many unprecedented events are actually within data-driven upper bounds, but only when using modern spatial statistical methods. Furthermore, there are clear connections between anthropogenic forcing and the “impossibility” of the most extreme temperatures. Robust understanding of heatwave thresholds provides critical information about future record-breaking events and how their extremity relates to historical measurements.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of a pair-based, joint-likelihood association approach for regional infrasound event identification

SUMMARY A Bayesian framework for the association of infrasonic detections is presented and evaluated for analysis at regional propagation scales. A pair-based, joint-likelihood association approach is developed that identifies events by computing the probability that individual detection pairs are attributable to a hypothetical common source and applying hierarchical clustering to identify events from the pair-based analysis. The framework is based on a Bayesian formulation introduced for infrasonic source localization and utilizes the propagation models developed for that application with modifications to improve the numerical efficiency of the analysis. Clustering analysis is completed using hierarchical analysis via weighted linkage for a non-Euclidean distance matrix defined by the negative log-joint-likelihood values. The method is evaluated using regional synthetic data with propagation distances of hundreds of kilometres in order to study the sensitivity of the method to uncertainties and errors in backazimuth and time of arrival. The method is found to be robust and stable for typical uncertainties, able to effectively distinguish noise detections within the data set from those in events, and can be made numerically efficient due to its ease of parallelization.

58 GEOSCIENCES↗

Bayesian approach to the follow-up of candidate gravitational wave signals

Ground-based gravitational wave laser interferometers (LIGO, GEO-600, Virgo, and Tama-300) have now reached high sensitivity and duty cycle. We present a Bayesian evidence-based approach to the search for gravitational waves, in particular aimed at the follow-up of candidate events generated by the analysis pipeline. We introduce and demonstrate an efficient method to compute the evidence and odds ratio between different models, and illustrate this approach using the specific case of the gravitational wave signal generated during the inspiral phase of binary systems, modeled at the leading quadrupole Newtonian order, in synthetic noise. We show that the method is effective in detecting signals at the detection threshold and it is robust against (some types of) instrumental artifacts. The computational efficiency of this method makes it scalable to the analysis of all the triggers generated by the analysis pipelines to search for coalescing binaries in surveys with ground-based interferometers, and to a whole variety of signal waveforms, characterized by a larger number of parameters.

Robust approaches to quantification of margin and uncertainty for sparse data

Characterizing the tails of probability distributions plays a key role in quantification of margins and uncertainties (QMU), where the goal is characterization of low probability, high consequence events based on continuous measures of performance. When data are collected using physical experimentation, probability distributions are typically fit using statistical methods based on the collected data, and these parametric distributional assumptions are often used to extrapolate about the extreme tail behavior of the underlying probability distribution. In this project, we character- ize the risk associated with such tail extrapolation. Specifically, we conducted a scaling study to demonstrate the large magnitude of the risk; then, we developed new methods for communicat- ing risk associated with tail extrapolation from unvalidated statistical models; lastly, we proposed a Bayesian data-integration framework to mitigate tail extrapolation risk through integrating ad- ditional information. We conclude that decision-making using QMU is a complex process that cannot be achieved using statistical analyses alone.

97 MATHEMATICS AND COMPUTING↗

Hierarchical Gaussian process-based Bayesian optimization for materials discovery in high entropy alloy spaces

Bayesian optimization (BO) is a powerful and data-efficient method for iterative materials discovery and design, particularly valuable when prior knowledge is limited, underlying functional relationships are complex or unknown, and the cost of querying the materials space is significant. Traditional BO methodologies typically utilize conventional Gaussian Processes (cGPs) to model the relationships between material inputs and properties, as well as correlations within the input space. However, cGP-BO approaches often fall short in multi-objective optimization scenarios, where they are unable to fully exploit correlations between distinct material properties. Leveraging these correlations can significantly enhance the discovery process, as information about one property can inform and improve predictions about others. Here, this study addresses this limitation by employing advanced kernel structures to capture and model multi-dimensional property correlations through multi-task (MTGPs) or deep Gaussian Processes (DGPs), thus accelerating the discovery process. We demonstrate the effectiveness of MTGP-BO and DGP-BO in rapidly and robustly solving complex materials design challenges that occur within the context of complex multi-objective optimization over FCC FeCrNiCoCu high entropy alloy (HEA) spaces, where traditional cGP-BO approaches fail. Furthermore, we highlight how the differential costs associated with querying various material properties can be strategically leveraged to make the materials discovery process more cost-efficient.

36 MATERIALS SCIENCE↗

Conditional preparation of states containing a definite number of photons

A technique for conditionally creating single-mode or multimode photon-number states is analyzed using Bayesian theory. We consider the heralded N-photon states created from the photons produced by an unseeded optical parametric amplifier when the heralding detector is the time-multiplexed photon-number-resolving detector recently demonstrated by Fitch et al. [Phys. Rev. A 68, 043814 (2003)] and simultaneously by Achilles et al. [Opt. Lett. 28, 2387 (2003)]. We find that even with significant loss in the heralding detector, fields with sub-Poissonian photon-number distributions can be created. We also show that heralded multimode fields created using this technique are more robust against detector loss than are single-mode fields.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Adaptive changes in sexual behavior in the high–risk population in response to human monkeypox transmission in Canada can help control the outbreak: Insights from a two–group, two–route epidemic model

Monkeypox, a zoonotic disease, is emerging as a potential sexually transmitted infection/disease, with underlying transmission mechanisms still unclear. We devised a risk-structured, compartmental model, incorporating sexual behavior dynamics. We compared different strategies targeting the high-risk population: a scenario of control policies geared toward the use of condoms and/or sexual abstinence (robust control strategy) with risk compensation behavior change, and a scenario of control strategies with behavior change in response to the doubling rate (adaptive control strategy). Monkeypox's basic reproduction number is 1.464, 0.0066, and 1.461 in the high-risk, low-risk, and total populations, respectively, with the high-risk group being the major driver of monkeypox spread. Policies imposing condom use or sexual abstinence need to achieve a 35% minimum compliance rate to stop further transmission, while a combination of both can curb the spread with 10% compliance to abstinence and 25% to condom use. With risk compensation, the only option is to impose sexual abstinence by at least 35%. Adaptive control is more effective than robust control where the daily sexual contact number is reduced proportionally and remains constant thereafter, shortening the time to epidemic peak, lowering its size, facilitating disease attenuation, and playing a key role in controlling the current outbreak.

60 APPLIED LIFE SCIENCES↗

Robust phenotyping strategies for evaluation of stem non-structural carbohydrates (NSC) in rice

Rice plants ( Oryza sativa ) accumulate excess photoassimilates in the form of non-structural carbohydrates (NSCs) in their stems prior to heading that can later be mobilized to supplement photosynthate production during grain-filling. Despite longstanding interest in stem NSC for rice improvement, the dynamics of NSC accumulation, remobilization, and re-accumulation that have genetic potential for optimization have not been systematically investigated. Here we conducted three pilot experiments to lay the groundwork for large-scale diversity studies on rice stem NSC. We assessed the relationship of stem NSC components with 21 agronomic traits in large-scale, tropical yield trials using 33 breeder-nominated lines, established an appropriate experimental design for future genetic studies using a Bayesian framework to sample sub-datasets from highly replicated greenhouse data using 36 genetically diverse genotypes, and used 434 phenotypically divergent rice stem samples to develop two partial least-squares (PLS) models using near-infrared (NIR) spectra for accurate, rapid prediction of rice stem starch, sucrose, and total non-structural carbohydrates. Lastly, we find evidence that stem reserves are most critical for short-duration varieties and suggest that pre-heading stem NSC is worthy of further experimentation for breeding early maturing rice.

59 BASIC BIOLOGICAL SCIENCES↗

Exploring unsupervised top tagging using Bayesian inference

Recognizing hadronically decaying top-quark jets in a sample of jets, or even its total fraction in the sample, is an important step in many LHC searches for Standard Model and Beyond Standard Model physics as well. Although there exists outstanding top-tagger algorithms, their construction and their expected performance rely on Montecarlo simulations, which may induce potential biases. For these reasons we develop two simple unsupervised top-tagger algorithms based on performing Bayesian inference on a mixture model. In one of them we use as the observed variable a new geometrically-based observable \tilde{A}_{3} A ̃ 3 , and in the other we consider the more traditional \tau_{3}/\tau_{2} τ 3 / τ 2 N N -subjettiness ratio, which yields a better performance. As expected, we find that the unsupervised tagger performance is below existing supervised taggers, reaching expected Area Under Curve AUC \sim 0.80-0.81 ∼ 0.80 − 0.81 and accuracies of about 69% - − 75% in a full range of sample purity. However, these performances are more robust to possible biases in the Montecarlo that their supervised counterparts. Our findings are a step towards exploring and considering simpler and unbiased taggers.

Alvarez, Ezequiel↗

Encyclopædia curvatonis

We investigate whether the predictions of single-field models of inflation are robust under the introduction of additional scalar degrees of freedom, and whether these extra fields change the potentials for which the data show the strongest preference. We study the situation where an extra light scalar field contributes both to the total curvature perturbations and to the reheating kinematic properties. Ten reheating scenarios are identified, and all necessary formulas allowing a systematic computation of the predictions for this class of models are derived. They are implemented in the public library ASPIC, which contains more than 75 single-field potentials. This paves the way for a forthcoming full Bayesian analysis of the problem. A few representative examples are displayed and discussed.

79 ASTRONOMY AND ASTROPHYSICS↗

Machine Learning

The absence of a robust and unified theory of cyber dynamics presents challenges and opportunities for using machine learning based data-driven approaches to further the understanding of the behavior of such complex systems. Analysts can also use machine learning approaches to gain operational insights. In order to be operationally beneficial, cybersecurity machine learning based models need to have the ability to: (1) represent a real-world system, (2) infer system properties, and (3) learn and adapt based on expert knowledge and observations. Probabilistic models and Probabilistic graphical models provide these necessary properties and are further explored in this chapter. Bayesian Networks and Hidden Markov Models are introduced as an example of a widely used data driven classification/modeling strategy.

Anomaly detection↗

Bayesian Spectral Moment Estimation and Uncertainty Quantification

We present a Bayesian spectral fitting method developed for spectroscopic data analysis, particularly (but not solely) in the context of fusion energy research. The presented techniques are particularly valuable to estimating moments and corresponding uncertainties whenever the spectra result from line-integrated measurements in nonuniform plasmas, for which the approximation of atomic line shapes being ideal Gaussians gives poor estimates. We decompose multiple, potentially overlapping spectral lines into a sum of Gauss-Hermite polynomials, whose properties allow efficient truncation and uncertainty quantification, often with only three free parameters per atomic emission line. Tests with both synthetic and experimental data demonstrate the effectiveness and robustness where more standard nonlinear fitting routines may experience difficulties. A parallelized version of our implementation is publicly released under an open source license.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Gaussian processes with built-in dimensionality reduction: Applications to high-dimensional uncertainty propagation

Uncertainty quantification (UQ) tasks, such as model calibration, uncertainty propagation, and optimization under uncertainty, typically require several thousand evaluations of the underlying computer codes. To cope with the cost of simulations, one replaces the real response surface with a cheap surrogate based, e.g., on polynomial chaos expansions, neural networks, support vector machines, or Gaussian processes (GP). However, the number of simulations required to learn a generic multivariate response grows exponentially as the input dimension increases. This curse of dimensionality can only be addressed, if the response exhibits some special structure that can be discovered and exploited. A wide range of physical responses exhibit a special structure known as an active subspace (AS). An AS is a linear manifold of the stochastic space characterized by maximal response variation. The idea is that one should first identify this low dimensional manifold, project the high-dimensional input onto it, and then link the projection to the output. If the dimensionality of the AS is low enough, then learning the link function is a much easier problem than the original problem of learning a high-dimensional function. The classic approach to discovering the AS requires gradient information, a fact that severely limits its applicability. Furthermore, and partly because of its reliance to gradients, it is not able to handle noisy observations. The latter is an essential trait if one wants to be able to propagate uncertainty through stochastic simulators, e.g., through molecular dynamics codes. In this work, we develop a probabilistic version of AS which is gradient-free and robust to observational noise. Our approach relies on a novel Gaussian process regression with built-in dimensionality reduction. In particular, the AS is represented as an orthogonal projection matrix that serves as yet another covariance function hyper-parameter to be estimated from the data. To train the model, we design a two-step maximum likelihood optimization procedure that ensures the orthogonality of the projection matrix by exploiting recent results on the Stiefel manifold, i.e., the manifold of matrices with orthogonal columns. The additional benefit of our probabilistic formulation, is that it allows us to select the dimensionality of the AS via the Bayesian information criterion. We validate our approach by showing that it can discover the right AS in synthetic examples without gradient information using both noiseless and noisy observations. We demonstrate that our method is able to discover the same AS as the classical approach in a challenging one-hundred-dimensional problem involving an elliptic stochastic partial differential equation with random conductivity. Finally, we use our approach to study the effect of geometric and material uncertainties in the propagation of solitary waves in a one dimensional granular system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Selecting a model of supersymmetry breaking mediation

We study the problem of selecting between different mechanisms of supersymmetry breaking in the minimal supersymmetric standard model using current data. We evaluate the Bayesian evidence of four supersymmetry breaking scenarios: mSUGRA, mGMSB, mAMSB, and moduli mediation. The results show a strong dependence on the dark matter assumption. Using the inferred cosmological relic density as an upper bound, minimal anomaly mediation is at least moderately favored over the CMSSM. Our fits also indicate that evidence for a positive sign of the {mu} parameter is moderate at best. We present constraints on the anomaly and gauge mediated parameter spaces and some previously unexplored aspects of the dark matter phenomenology of the moduli mediation scenario. We use sparticle searches, indirect observables and dark matter observables in the global fit and quantify robustness with respect to prior choice. We quantify how much information is contained within each constraint.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

EGS Stimulation Design with Uncertainty Quantification at the EGS Collab Site

Engineering a robust hydraulic connection between wells is one of the most difficult aspects of enhanced geothermal systems (EGS). Designing and constructing such hydraulic connections requires and understanding of the in situ state of stress and the heterogeneities and discontinuities that naturally exist and may control the stimulation. Even with comprehensive stress and formation characterization programs substantial uncertainty remains in these key parameters. This is especially the case in high-temperature EGS environments where drilling conditions are often difficult and a far fewer logging and testing options are available. This paper presents a new approach for explicitly quantifying the uncertainties in the state of stress using a Bayesian Markov Chain Monte Carlo method. This approach produces a probability distribution for the stress tensor, including a general 3D orientation, that reflects the uncertainties in all the observations or indicators used to constrain the stress state. This method is demonstrated on the characterization data for the EGS Collab Experiment 2 site. The output of the analysis is used to guide the design of the planned stimulations. In the case of research projects like EGS Collab, explicitly quantifying the uncertainties in the stress state allow for more rigorous hypothesis testing by allowing conclusions drawn from the experiments to be interpreted in the context of the uncertain knowledge about conditions in the test bed.

Burghardt, Jeffrey A.↗

A Statistical Framework for Operational lnfrasound Monitoring [Slides]

Historically, much infrasound research has been event-based, with known events providing the ground-truth required to inform the search for associated signals. For monitoring nuclear explosions in the atmosphere or underground, reliable techniques are required for operational infrasound data processing that effectively minimize both false alarms and missed detections. A difficulty in working with infrasound data is to adequately account for dynamic variations in the atmosphere, which occur over a variety of temporal and spatial scales. However, contrary to one's intuition, it is not necessary to have a high fidelity atmospheric model in order to perform robust detection, association and location. We present detection, association and location algorithms that assume no a priori knowledge of the atmosphere; however, where knowledge is available we show how it can be used to reduce the associated uncertainties. Rather than exporting seismic techniques to the problem of infrasound monitoring, our techniques were developed from the ground-up to properly account for the unique considerations of atmospheric acoustics. In contrast with other routinely used infrasound detectors, we utilize a contextual detection hypothesis that adaptively accounts for temporally variable correlated ambient noise. Our location scheme allows for the location of infrasound events without any meteorological data through a Bayesian framework. We demonstrate the application of the techniques presented here for a series of ground-truth events, and for routine data processing of large amounts of regional infrasound data.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Simulation based inference with domain adaptation for strong gravitational lensing

Simulation based inference leverages machine learning to carry out Bayesian inference in systems with intractable likelihoods. However, transitioning a network trained on simulated data to real data runs the risk of encountering domain shift, leading to performance losses. We attempt to implement domain adaptation into the sbi neural posterior estimation framework using the Maximum Mean Discrepancy as an additional network loss, using masked autoregressive fow (MAF) as our density estimator. We test the network on a set of 400,000 simulated strong gravitational lensing images generated using deeplenstronomy. The source domain is defined as low noise whereas the target domain has a noise profile sampled from experimentally derived DES survey conditions. We find that SBI appears robust against small changes in the data with similar performance on source and target. Moreover, while DA does lead to performance improvements, they are marginal at 6% less inference error.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Evidence for dark matter modulation in CoGeNT?

We investigate the question of whether the recent modulation signal claimed by CoGeNT is best explained by the dark matter (DM) hypothesis from a Bayesian model comparison perspective. We consider five phenomenological explanations for the data: no modulation signal, modulation due to DM, modulation due to DM compatible with the total CoGeNT rate, and a signal coming from other physics with a free phase but annual period, or with a free phase and a free period. In each scenario, we assign to the free parameters physically motivated priors. We find that while the DM models are weakly preferred to the no modulation model, but when compared to models where the modulation is due to other physics, the DM hypothesis is favoured with odds ranging from 185:1 to 560:1. This result is robust even when astrophysical uncertainties are taken into account and the impact of priors assessed. Interestingly, the odds for the DM model in which the modulation signal is compatible with the total rate against a DM model in which this prior is not implemented is only 5:8, in spite of the former's prediction of a modulation amplitude in the energy range 0.9 → 3.0 keVee that is significantly smaller than the value observed by CoGeNT. Classical hypothesis testing also rules out the null hypothesis of no modulation at the 1.6σ to 2.3σ level, depending on the details of the alternative. Lastly, we investigate whether anisotropic velocity distributions can help to mitigate the tension between the CoGeNT total and modulated rates, and find encouraging results.

79 ASTRONOMY AND ASTROPHYSICS↗