Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Probabilistic Prognosis of Non-Planar Fatigue Crack Growth

Quantifying the uncertainty in model parameters for the purpose of damage prognosis can be accomplished utilizing Bayesian inference and damage diagnosis data from sources such as non-destructive evaluation or structural health monitoring. The number of samples required to solve the Bayesian inverse problem through common sampling techniques (e.g., Markov chain Monte Carlo) renders high-fidelity finite element-based damage growth models unusable due to prohibitive computation times. However, these types of models are often the only option when attempting to model complex damage growth in real-world structures. Here, a recently developed high-fidelity crack growth model is used which, when compared to finite element-based modeling, has demonstrated reductions in computation times of three orders of magnitude through the use of surrogate models and machine learning. The model is flexible in that only the expensive computation of the crack driving forces is replaced by the surrogate models, leaving the remaining parameters accessible for uncertainty quantification. A probabilistic prognosis framework incorporating this model is developed and demonstrated for non-planar crack growth in a modified, edge-notched, aluminum tensile specimen. Predictions of remaining useful life are made over time for five updates of the damage diagnosis data, and prognostic metrics are utilized to evaluate the performance of the prognostic framework. Challenges specific to the probabilistic prognosis of non-planar fatigue crack growth are highlighted and discussed in the context of the experimental results.

Leser, Patrick E.↗

Detection and recognition of simple spatial forms

A model of human visual sensitivity to spatial patterns is constructed. The model predicts the visibility and discriminability of arbitrary two-dimensional monochrome images. The image is analyzed by a large array of linear feature sensors, which differ in spatial frequency, phase, orientation, and position in the visual field. All sensors have one octave frequency bandwidths, and increase in size linearly with eccentricity. Sensor responses are processed by an ideal Bayesian classifier, subject to uncertainty. The performance of the model is compared to that of the human observer in detecting and discriminating some simple images.

Watson, A. B.↗

Photometry of Outer Solar System Objects from the Dark Energy Survey. II. A Joint Analysis of Trans-Neptunian Absolute Magnitudes, Colors, Light Curves and Dynamics

For the 696 trans-Neptunian objects (TNOs) with absolute magnitudes 5.5 < H r < 8.2 detected in the Dark Energy Survey, we characterize the relationships between their dynamical state and physical properties—namely H r , indicating size; colors, indicating surface composition; and flux variation semiamplitude A, indicating asphericity and surface inhomogeneity. We seek “birth” physical distributions that can recreate these parameters in every dynamical class. We show that the observed colors of these TNOs are consistent with two Gaussian distributions in griz space, “near-infrared bright” (NIRB) and “near-infrared faint” (NIRF), presumably an inner and outer birth population, respectively. We find a model in which both the NIRB and NIRF H r and A distributions are independent of current dynamical states, supporting their assignment as birth populations. All objects are consistent with a common rolling p(H r ), but NIRF objects are significantly more variable. Cold classicals (CCs) are purely NIRF, while hot classical (HC), scattered, and detached TNOs are consistent with ≈ 70% NIRB and the resonance NIRB fractions show significant variation. The NIRB components of the HCs and of some resonances have broader inclination distributions than the NIRFs, i.e. their current dynamics retains information about birth location. We find evidence for radial stratification within the birth NIRB population, in that HC NIRBs are on average redder than detached or scattered NIRBs; a similar effect distinguishes CCs from other NIRFs. We estimate total object counts and masses of each class within our H r range. These results will strongly constrain models of the outer solar system.

79 ASTRONOMY AND ASTROPHYSICS↗

Liana optical traits increase tropical forest albedo and reduce ecosystem productivity

Lianas are a key growth form in tropical forests. Their lack of self-supporting tissues and their vertical position on top of the canopy make them strong competitors of resources. A few pioneer studies have shown that liana optical traits differ on average from those of colocated trees. Those trait discrepancies were hypothesized to be responsible for the competitive advantage of lianas over trees. Yet, in the absence of reliable modelling tools, it is impossible to unravel their impact on the forest energy balance, light competition, and on the liana success in Neotropical forests. To bridge this gap, we performed a meta-analysis of the literature to gather all published liana leaf optical spectra, as well as all canopy spectra measured over different levels of liana infestation. We then used a Bayesian data assimilation framework applied to two radiative transfer models (RTMs) covering the leaf and canopy scales to derive tropical tree and liana trait distributions, which finally informed a full dynamic vegetation model. According to the RTMs inversion, lianas grew thinner, more horizontal leaves with lower pigment concentrations. Those traits made the lianas very efficient at light interception and significantly modified the forest energy balance and its carbon cycle. While forest albedo increased by 14% in the shortwave, light availability was reduced in the understorey (−30% of the PAR radiation) and soil temperature decreased by 0.5°C. Those liana-specific traits were also responsible for a significant reduction of tree (−19%) and ecosystem (−7%) gross primary productivity (GPP) while lianas benefited from them (their GPP increased by +27%). This study provides a novel mechanistic explanation to the increase in liana abundance, new evidence of the impact of lianas on forest functioning, and paves the way for the evaluation of the large-scale impacts of lianas on forest biogeochemical cycles.

Félicien Meunier↗

popclass

popclass is a lightweight python package that allows fast, probabilistic classification of the lens of a microlensing event given the event's posterior distribution and a model of the Galaxy. popclass provides the bridge between Galactic simulation and lens classification, an interface to common Bayesian inference libraries, and the ability for users to flexibly specify their own Galactic model and classification parameters.

Mcgill, Peter↗

Variation-Resilient FeFET-Based In-Memory Computing Leveraging Probabilistic Deep Learning

Reliability issues stemming from device level nonidealities of nonvolatile emerging technologies like ferroelectric field-effect transistors (FeFETs), especially at scaled dimensions, cause substantial degradation in the accuracy of in-memory crossbar-based AI systems. Here, in this work, we present a variation-aware design technique to characterize the device level variations and to mitigate their impact on hardware accuracy employing a Bayesian neural network (BNN) approach. An effective conductance variation model is derived from the experimental measurements of cycle-to-cycle (C2C) and device-to-device (D2D) variations performed on FeFET devices fabricated using 28 nm high-k metal gate technology. The variations were found to be a function of different conductance states within the given programming range, which sharply contrasts earlier efforts where a fixed variation dispersion was considered for all conductance values. Such variation characteristics formulated for three different device sizes at different read voltages were provided as prior variation information to the BNN to yield a more exact and reliable inference. Near-ideal accuracy for shallow networks (MLP5 and LeNet models) on the MNIST dataset and limited accuracy decline by ~3.8%–16.1% for deeper AlexNet models on CIFAR10 dataset under a wide range of variations corresponding to different device sizes and read voltages, demonstrates the efficacy of our proposed device-algorithm co-design technique.

97 MATHEMATICS AND COMPUTING↗

Probabilistic Groundwater Modeling of the RDX Plume at Los Alamos National Laboratory to Support Risk Assessment - 20359

A plume of the contaminant hexahydro-1,3,5-trinitro-1,3,5-triazine (RDX) with concentrations greater than the New Mexico tap water drinking standard (9.66 ppb) is present in the regional aquifer near the southwestern boundary of Los Alamos National Laboratory (LANL). A risk assessment is performed for exposure to regional aquifer groundwater, with long-term predictions of RDX concentrations provided by a calibrated, probabilistic, numerical fate and transport model. The structure of the model is hierarchical, with the RDX Regional Aquifer (RA) groundwater model acting as the primary tool for analysis of downgradient RDX concentrations. The RA model is deeply informed by the conceptual site model (CSM) and is calibrated using site RDX concentration data and hydraulic head measurements, along with other analyses. The model is calibrated using data through December 2019. Where data are scarce other lines of evidence are used to inform inputs, including the multiphase RDX Vadose Zone (VZ) model and Pipe and Disk analytical screening tool. Model inputs are described with informative prior distributions using a robust approach to development that incorporates all available lines of evidence for every parameter used as an input to the RA model. Calibration is performed using a classical nonlinear optimization routine, which is then used to initialize a Bayesian calibration. The Bayesian calibration constrains the uncertainty in the classical calibration, ultimately providing posterior distributions for all model parameters. The challenges of the calibration include high-dimensional parameter space, including spatially heterogeneous hydraulic conductivities, comparatively sparse data, and low RDX concentrations. Posterior parameter distributions developed in the calibration process are then used for stochastic predictive model runs into the future. The result of the forward runs is spatially and temporally explicit estimates of head and concentration with uncertainty at all points in space and time. The probabilistic modeling approach presented here includes innovative computational and statistical methods that leverage high-performance computing (HPC) resources. It makes use of prior modeling work performed at the chromium plume site in the central LANL area, with extensive updates. The risk assessment will ultimately be used to support decision-making at the site, using multiple appropriately weighted sources of information, as well as uncertainty, sensitivity, and value-of-information analyses. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Implicit neural representations for experimental steering of advanced experiments

Scattering measurements using electrons, neutrons, or photons are essential for obtaining microscopic insights into materials. However, limited facility availability and high-dimensional scattering data necessitate more efficient experimental steering techniques. Here, we report a machine learning method that guides scattering data collection and facilitates real-time estimation of model parameters, given a reliable forward model to simulate experimental signals. We employ implicit neural representations as efficient surrogates that link model parameters with simulated spectroscopies. This enables a Bayesian optimal experimental design framework to estimate the probability distributions of parameters from high-dimensional scattering data. We demonstrate the proposed method using inelastic neutron scattering with simulated and real experimental data, highlighting the method’s ability to provide real-time parameter estimation with quantified uncertainties and to deliver informed experimental guidance that reduces experimental time while maximizing scientific output. This approach paves the way for accelerated discoveries in condensed matter through scattering measurements.

36 MATERIALS SCIENCE↗

Online Bayesian State Estimation for Real-Time Monitoring of Growth Kinetics in Thin Film Synthesis

Rapid validation of newly predicted materials through autonomous synthesis requires real-time adaptive control methods that exploit physics knowledge, a capability that is lacking in most systems. Here, in this study, we demonstrate an approach to enable real-time control of thin film synthesis by combining in situ optical diagnostics with a Bayesian state estimation method. We developed a physical model for film growth and applied the direct filter (DF) method for real-time estimation of nucleation and growth rates during pulsed laser deposition (PLD). We validated the approach using simulated and experimental reflectivity data for WSe 2 growth and ultimately deployed the algorithm on an autonomous PLD system during the growth of 1T'-MoTe 2 . The DF robustly estimates growth parameters in real time at early stages of growth, down to 15% monolayer area coverage. This fusion of in situ diagnostics, data assimilation, and physical modeling opens new opportunities in adaptive control of synthesis trajectories toward desired material states.

36 MATERIALS SCIENCE↗

BeyondPlanck: XV. Limits on large-scale polarized anomalous microwave emission from Planck LFI and WMAP

We constrained the level of polarized anomalous microwave emission (AME) on large angular scales using Planck Low-Frequency Instrument (LFI) and WMAP polarization data within a Bayesian cosmic microwave background (CMB) analysis framework. We modeled synchrotron emission with a power-law spectral energy distribution, as well as the sum of AME and thermal dust emission through linear regression with the Planck High-Frequency Instrument (HFI) 353 GHz data. This template-based dust emission model allowed us to constrain the level of polarized AME while making minimal assumptions on its frequency dependence. We neglected CMB fluctuations, but show through simulations that these fluctuations have a minor impact on the results. We find that the resulting AME polarization fraction confidence limit is sensitive to the polarized synchrotron spectral index prior. In addition, for prior means β s < -3.1 we find an upper limit of p AME max ≲ 0.6% (95% confidence). In contrast, for means β s = -3.0, we find a nominal detection of p AME = 2.5 ± 1.0% (95% confidence). These data are thus not strong enough to simultaneously and robustly constrain both polarized synchrotron emission and AME, and our main result is therefore a constraint on the AME polarization fraction explicitly as a function of β s . Combining the current Planck and WMAP observations with measurements from high-sensitivity low-frequency experiments such as C-BASS and QUIJOTE will be critical to improve these limits further.

79 ASTRONOMY AND ASTROPHYSICS↗

Pushing the limits of detectability: mixed dark matter from strong gravitational lenses

One of the frontiers for advancing what is known about dark matter lies in using strong gravitational lenses to characterize the population of the smallest dark matter haloes. There is a large volume of information in strong gravitational lens images – the question we seek to answer is to what extent we can refine this information. To this end, we forecast the detectability of a mixed warm and cold dark matter scenario using the anomalous flux ratio method from strong gravitational lensed images. The halo mass function of the mixed dark matter scenario is suppressed relative to cold dark matter but still predicts numerous low-mass dark matter haloes relative to warm dark matter. Since the strong lensing signal receives a contribution from a range of dark matter halo masses and since the signal is sensitive to the specific configuration of dark matter haloes, not just the halo mass function, degeneracies between different forms of suppression in the halo mass function, relative to cold dark matter, can arise. Here, we find that, with a set of lenses with different configurations of the main deflector and hence different sensitivities to different mass ranges of the halo mass function, the different forms of suppression of the halo mass function between the warm dark matter model and the mixed dark matter model can be distinguished with 40 lenses with Bayesian odds of 30:1.

79 ASTRONOMY AND ASTROPHYSICS↗

New constraints on warm dark matter from the Lyman- α forest power spectrum

The forest of Lyman-α absorption lines detected in the spectra of distant quasars encodes information on the nature and properties of dark matter and the thermodynamics of diffuse baryonic material. Its main observable—the 1D flux power spectrum (FPS)—should exhibit a suppression on small scales and an enhancement on large scales in warm dark matter (WDM) cosmologies compared to standard Λ⁢CDM. Here, we present an unprecedented suite of 1080 high-resolution cosmological hydrodynamical simulations run with the graphics processing unit-accelerated code cholla to study the evolution of the Lyman-α forest under a wide range of physically motivated gas thermal histories along with different free-streaming lengths of WDM thermal relics in the early Universe. A statistical comparison of synthetic data with the forest FPS measured down to the smallest velocity scales ever probed at redshifts 4.0≲z≲5.2 [E. Boera et al., Revealing reionization with the thermal history of the intergalactic medium: New constraints from the Ly⁢α flux power spectrum, Astrophys. J. 872, 101 (2019)] yields a lower-limit m WDM >3.1 keV (95% C.L.) for the WDM particle mass and constrains the amplitude and spectrum of the photoheating and photoionizing background produced by star-forming galaxies and active galactic nuclei at these redshifts. Interestingly, our Bayesian inference analysis appears to weakly favor WDM models with a peak likelihood value at the thermal relic mass of m WDM =4.5 keV. In conclusion, we find that the suppression of the FPS from free-streaming saturates at k≳0.1 s km -1 because of peculiar velocity smearing, and this saturated suppression combined with a slightly lower gas temperature provides a moderately better fit to the observed small-scale FPS for WDM cosmologies.

79 ASTRONOMY AND ASTROPHYSICS↗

Characterization of Partially Observed Epidemics - Application to COVID-19

This report documents a statistical method for the "real-time" characterization of partially observed epidemics. Observations consist of daily counts of symptomatic patients, diagnosed with the disease. Characterization, in this context, refers to estimation of epidemiological parameters that can be used to provide short-term forecasts of the ongoing epidemic, as well as to provide gross information for the time-dependent infection rate. The characterization problem is formulated as a Bayesian inverse problem, and is predicated on a model for the distribution of the incubation period. The model parameters are estimated as distributions using a Markov Chain Monte Carlo (MCMC) method, thus quantifying the uncertainty in the estimates. The method is applied to the COVID-19 pandemic of 2020, using data at the country, provincial (e.g., states) and regional (e.g. county) levels. The epidemiological model includes a stochastic component due to uncertainties in the incubation period. This model-form uncertainty is accommodated by a pseudo-marginal Metropolis-Hastings MCMC sampler, which produces posterior distributions that reflect this uncertainty. We approximate the discrepancy between the data and the epidemiological model using Gaussian and negative binomial error models; the latter was motivated by the over-dispersed count data. For small daily counts we find the performance of the calibrated models to be similar for the two error models. For large daily counts the negative-binomial approximation is numerically unstable unlike the Gaussian error model. Application of the model at the country level (for the United States, Germany, Italy, etc.) generally provided accurate forecasts, as the data consisted of large counts which suppressed the day-to-day variations in the observations. Further, the bulk of the data is sourced over the duration before the relaxation of the curbs on population mixing, and is not confounded by any discernible country-wide second wave of infections. At the state-level, where reporting was poor or which evinced few infections (e.g., New Mexico), the variance in the data posed some, though not insurmountable, difficulties, and forecasts were able to capture the data with large uncertainty bounds. The method was found to be sufficiently sensitive to discern the flattening of the infection and epidemic curve due to shelter-in-place orders after around 90% quantile for the incubation distribution (about 10 days for COVID-19). The proposed model was also used at a regional level to compare the forecasts for the central and north-west regions of New Mexico. Modeling the data for these regions illustrated different disease spread dynamics captured by the model. While in the central region the daily counts peaked in the late April, in the north-west region the ramp-up continued for approximately three more weeks.

59 BASIC BIOLOGICAL SCIENCES↗

Improving and Assessing the Quality of Uncertainty Quantification in Deep Learning

Deep learning (DL) models have enjoyed increased attention in recent years because of their powerful predictive capabilities. While many successes have been achieved, standard deep learning methods suffer from a lack of uncertainty quantification (UQ). While the development of methods for producing UQ from DL models is an active area of current research, little attention has been given to the quality of the UQ produced by such methods. In order to deploy DL models to high-consequence applications, high-quality UQ is necessary. This report details the research and development conducted as part of a Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. The focus of this project is to develop a framework of methods and metrics for the principled assessment of UQ quality in DL models. This report presents an overview of UQ quality assessment in traditional statistical modeling and describes why this approach is difficult to apply in DL contexts. An assessment on relatively simple simulated data is presented to demonstrate that UQ quality can differ greatly between DL models trained on the same data. A method for simulating image data that can then be used for UQ quality assessment is described. A general method for simulating realistic data for the purpose of assessing a model’s UQ quality is also presented. A Bayesian uncertainty framework for understanding uncertainty and existing metrics is described. Research that came out of collaborations with two university partners are discussed along with a software toolkit that is currently being developed to implement the UQ quality assessment framework as well as serve as a general guide to incorporating UQ into DL applications.

97 MATHEMATICS AND COMPUTING↗

Performance Optimization of the IOTA Duoplasmatron Proton Source

We present results from online optimization studies of a duoplasmatron ion source designed to produce 50~keV protons for acceleration to 2.5~MeV and subsequent injection into the Integrable Optics Test Accelerator (IOTA) at Fermilab. Using a Bayesian exploration technique, we developed multi-parameter models of the source s proton current and employed these models to optimize its performance. Depending on the spectrometer configuration used to isolate the proton beam and the chosen optimization objective, we identified three candidate operating points, achieving normalized 50~\% emittances between 0.57 and 1.3~\textmu m and a maximum proton current of $14.5 \pm 0.6$~mA.

Banerjee, Nilanjan [Fermilab] (ORCID:0000000344660↗

Signal processing for airborne doppler radar detection of hazardous wind shear as applied to NASA 1991 radar flight experiment data

Radar data collected during the 1991 NASA flight tests have been selectively analyzed to support research directed at developing both improved as well as new algorithms for detecting hazardous low-altitude windshear. Analysis of aircraft attitude data from several flights indicated that platform stability bandwidths were small compared to the data rate bandwidths which should support an assumption that radar returns can be treated as short time stationary. Various approaches at detection of weather returns in the presence of ground clutter are being investigated. Non-coventional clutter rejection through spectrum mode tracking and classification algorithms is a subject of continuing research. Based upon autoregressive modeling of the radar return time sequence, this approach may offer an alternative to overcome errors in conventional pulse-pair estimates. Adaptive filtering is being evaluated as a means of rejecting clutter with emphasis on low signal-to-clutter ratio situations, particularly in the presence of discrete clutter interference. An analysis of out-of-range clutter returns is included to illustrate effects of ground clutter interference due to range aliasing for aircraft on final approach. Data are presented to indicate how aircraft groundspeed might be corrected from the radar data as well as point to an observed problem of groundspeed estimate bias variation with radar antenna scan angle. A description of how recorded clutter return data are mixed with simulated weather returns is included. This enables the researcher to run controlled experiments to test signal processing algorithms. In the summary research efforts involving improved modelling of radar ground clutter returns and a Bayesian approach at hazard factor estimation are mentioned.

Baxa, Ernest G., Jr.↗

Perceptual learning through optimization of attentional weighting: human versus optimal Bayesian learner

Human performance in visual detection, discrimination, identification, and search tasks typically improves with practice. Psychophysical studies suggest that perceptual learning is mediated by an enhancement in the coding of the signal, and physiological studies suggest that it might be related to the plasticity in the weighting or selection of sensory units coding task relevant information (learning through attention optimization). We propose an experimental paradigm (optimal perceptual learning paradigm) to systematically study the dynamics of perceptual learning in humans by allowing comparisons to that of an optimal Bayesian algorithm and a number of suboptimal learning models. We measured improvement in human localization (eight-alternative forced-choice with feedback) performance of a target randomly sampled from four elongated Gaussian targets with different orientations and polarities and kept as a target for a block of four trials. The results suggest that the human perceptual learning can occur within a lapse of four trials (<1 min) but that human learning is slower and incomplete with respect to the optimal algorithm (23.3% reduction in human efficiency from the 1st-to-4th learning trials). The greatest improvement in human performance, occurring from the 1st-to-2nd learning trial, was also present in the optimal observer, and, thus reflects a property inherent to the visual task and not a property particular to the human perceptual learning mechanism. One notable source of human inefficiency is that, unlike the ideal observer, human learning relies more heavily on previous decisions than on the provided feedback, resulting in no human learning on trials following a previous incorrect localization decision. Finally, the proposed theory and paradigm provide a flexible framework for future studies to evaluate the optimality of human learning of other visual cues and/or sensory modalities.

Non-NASA Center↗