SEARCH · Engineering Papers

Results for “Bayesian modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

NASA NTRS2025

Mind the Gap: Addressing Data Gaps and Assessing Noise Mismodeling in LISA

Due to the sheer complexity of the Laser Interferometer Space Antenna (LISA) space mission, data gaps arising from instrumental irregularities and/or scheduled maintenance are unavoidable. Focusing on merger-dominated massive black hole binary signals, we test the appropriateness of the Whittle-likelihood on gapped data in a variety of cases. From first principles, we derive the likelihood valid for gapped data in both the time and frequency domains. Cheap-to-evaluate proxies to p-p plots are derived based on a Fisher-based formalism, and verified through Bayesian techniques. Our tools allow to predict the altered variance in the parameter estimates that arises from noise mismodeling, as well as the information loss represented by the broadening of the posteriors. The result of noise mismodeling with gaps is sensitive to the characteristics of the noise model, with strong low-frequency (red) noise and strong high-frequency (blue) noise giving statistically significant fluctuations in recovered parameters. We demonstrate that the introduction of a tapering window reduces statistical inconsistency errors, at the cost of less precise parameter estimates. We also show that the assumption of independence between inter-gap segments appears to be a fair approximation even if the data set is inherently coherent. However, if one instead assumes fictitious correlations in the data stream, when the data segments are actually independent, then the resultant parameter recoveries could be inconsistent with the true parameters. The theoretical and numerical practices that are presented in this work could readily be incorporated into global-fit pipelines operating on gapped data.

LISA↗

NASA NTRS2014

Statistical Modeling for Radiation Hardness Assurance

We cover the models and statistics associated with single event effects (and total ionizing dose), why we need them, and how to use them: What models are used, what errors exist in real test data, and what the model allows us to say about the DUT will be discussed. In addition, how to use other sources of data such as historical, heritage, and similar part and how to apply experience, physics, and expert opinion to the analysis will be covered. Also included will be concepts of Bayesian statistics, data fitting, and bounding rates.

Hardness Assurance↗

NASA NTRS2005

Nonlinear Attitude Filtering Methods

This paper provides a survey of modern nonlinear filtering methods for attitude estimation. Early applications relied mostly on the extended Kalman filter for attitude estimation. Since these applications, several new approaches have been developed that have proven to be superior to the extended Kalman filter. Several of these approaches maintain the basic structure of the extended Kalman filter, but employ various modifications in order to provide better convergence or improve other performance characteristics. Examples of such approaches include: filter QUEST, extended QUEST, the super-iterated extended Kalman filter, the interlaced extended Kalman filter, and the second-order Kalman filter. Filters that propagate and update a discrete set of sigma points rather than using linearized equations for the mean and covariance are also reviewed. A two-step approach is discussed with a first-step state that linearizes the measurement model and an iterative second step to recover the desired attitude states. These approaches are all based on the Gaussian assumption that the probability density function is adequately specified by its mean and covariance. Other approaches that do not require this assumption are reviewed, including particle filters and a Bayesian filter based on a non-Gaussian, finite-parameter probability density function on SO(3). Finally, the predictive filter, nonlinear observers and adaptive approaches are shown. The strengths and weaknesses of the various approaches are discussed.

F Landis Markley↗

NASA NTRS2022

Optimal Estimation Framework for Ocean Color Atmospheric Correction and Pixel-level Uncertainty Quantification

Ocean color remote sensing requires compensation for atmospheric scattering and absorption (aerosol, Rayleigh, and trace gases), referred to as atmospheric correction (AC). AC allows inference of parameters such as spectrally resolved remote sensing reflectance ( R rs )(λ) ; sr 1 ) at the ocean surface from the top-of-atmosphere reflectance. Often, the uncertainty of this process is not fully explored. Bayesian inference techniques provide a simultaneous AC and uncertainty assessment via a full posterior distribution of the relevant variables, given the prior distribution of those variables and the radiative transfer (RT) likelihood function. Given uncertainties in the algorithm inputs, the Bayesian framework enables better constraints on the AC process by using the complete spectral information compared to traditional approaches that use only a subset of bands for AC. This paper investigates a Bayesian inference research method (Optimal Estimation, OE) for ocean color AC by simultaneously retrieving atmospheric and ocean properties using all visible and near-infrared spectral bands. The OE algorithm analytically approximates the posterior distribution of parameters based on normality assumptions and provides a potentially viable operational algorithm with a reduced computational expense. We developed a Neural Network (NN) RT forward model look-up-table-based emulator to increase algorithm efficiency further and thus speed up the likelihood computations. We then applied the OE algorithm to synthetic data and observations from the MODerate resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua spacecraft. We compared the R rs )(λ) retrieval and its uncertainty estimates from the OE method with in-situ validation data from the SeaWiFS Bio-optical Archive and Storage System (SeaBASS) and Aerosol Robotic Network Ocean Color (AERONET-OC) datasets. The OE algorithm improved R rs )(λ) estimates relative to the NASA standard operational algorithm by improving all statistical metrics at 443, 555, and 667 nm. Unphysical negative R rs )(λ) , which often appear in complex water conditions, was reduced by a factor of 3. The OE-derived pixel-level R rs )(λ) uncertainty estimates were also assessed relative to in-situ data and were shown to have skill.

Atmospheric correction↗

NASA NTRS2006

What does Reflection from Cloud Sides tell us about Vertical Distribution of Cloud Droplet Sizes?

Cloud development, the onset of precipitation and the effect of aerosol on clouds depend on the structure of the cloud profiles of droplet size and phase. Aircraft measurements of cloud profiles are limited in their temporal and spatial extent. Satellites were used to observe cloud tops not cloud profiles with vertical profiles of precipitation-sized droplets anticipated from CloudSat. The recently proposed CLAIM-3D satellite mission (cloud aerosol interaction mission in 3-D) suggests to measure profiles of cloud microphysical properties by retrieving them from the solar and infrared radiation reflected or emitted from cloud sides. Inversion of measurements from the cloud sides requires rigorous understanding of the 3-dimentional(3-D) properties of clouds. Here we discuss the reflected sunlight from the cloud sides and top at two wavelengths: one nonabsorbing to solar radiation (0.67 microns) and one with liquid water efficient absorption of solar radiation (2.1 microns). In contrast to the plane-parallel approximation, a conventional approach to all current operational retrievals, 3-D radiative transfer is used for interpreting the observed reflectances. General properties of the radiation reflected from the sides of an isolated cloud are discussed. As a proof of concept, the paper shows a few examples of radiation reflected from cloud fields generated by a simple stochastic cloud model with the prescribed vertically resolved microphysics. To retrieve the information about droplet sizes, we propose to use the probability density function of the droplet size distribution and its first two moments instead of the assumption about fixed values of the droplet effective radius. The retrieval algorithm is based on the Bayesian theorem that combines prior information about cloud structure and microphysics with radiative transfer calculations.

Marshak, A.↗

NASA NTRS2005

What Does Reflection from Cloud Sides Tell Us About Vertical Distribution of Cloud Droplet Sizes?

Cloud development, the onset of precipitation and the effect of aerosol on clouds depend on the structure of the cloud profiles of droplet size and phase. Aircraft measurements of cloud profiles are limited in their temporal and spatial extent. Satellites were used to observe cloud tops not cloud profiles with vertical profiles of precipitation-sized droplets anticipated from Cloudsat. The recently proposed CLAIM-3D satellite mission (cloud aerosol interaction mission in 3D) suggests to measure profiles of cloud microphysical properties by retrieving them from the solar and infrared radiation reflected or emitted from cloud sides. Inversion of measurements from the cloud sides requires rigorous understanding of the 3-dimensional (3D) properties of clouds. Here we discuss the reflected sunlight from the cloud sides and top at two wavelengths: one nonabsorbing to solar radiation (0.67 micrometers) and one with liquid water efficient absorption of solar radiation (2.1 micrometers). In contrast to the plane-parallel approximation, a conventional approach to all current operational retrievals, 3D radiative transfer is used for interpreting the observed reflectances. General properties of the radiation reflected from the sides of an isolated cloud are discussed. As a proof of concept, the paper shows a few examples of radiation reflected from cloud fields generated by a simple stochastic cloud model with the prescribed vertically resolved microphysics. To retrieve the information about droplet sizes, we propose to use the probability density function of the droplet size distribution and its first two moments instead of the assumption about fixed values of the droplet effective radius. The retrieval algorithm is based on the Bayesian theorem that combines prior information about cloud structure and microphysics with radiative transfer calculations.

Marshak, Alexander↗

NASA NTRS2018

Assimilation of GMI and ATMS Observations in the Rainbands of Hurricanes

We propose a novel Bayesian Monte Carlo Integration (BMCI) technique to retrieve the profiles of temperature, water vapor, and cloud liquid/ice water content from microwave cloudy measurements in the presence of tropical cyclones (TC). These retrievals then can either be directly used by meteorologists to analyze the structure of TCs or be assimilated into numerical models to provide accurate initial conditions for the NWP models. The BMCI technique is applied to the data from the Advanced Technology Microwave Sounder (ATMS) onboard Suomi National Polar-orbiting Partnership (NPP) and Global Precipitation Measurement (GPM) Microwave Imager (GMI). The retrieved profiles are then assimilated into Hurricane WRF using GSI data assimilation system. This talk presents the development of the BMCI retrieval system as well as the preliminary results of assimilating the retrievals into NASA GEOS-5 model.

Moradi, Isaac↗

NASA NTRS2019

Assimilation of Microwave Observations in the Rainbands of Tropical Cyclones

We propose a novel Bayesian Monte Carlo Integration (BMCI) technique to retrieve the profiles of temperature, water vapor, and cloud liquid/ice water content from microwave cloudy measurements in the presence of tropical cyclones (TC). These retrievals then can either be directly used by meteorologists to analyze the structure of TCs or be assimilated into numerical models to provide accurate initial conditions for the NWP (Numerical Weather Prediction) models. The BMCI technique is applied to the data from the Advanced Technology Microwave Sounder (ATMS) onboard Suomi National Polar-orbiting Partnership (NPP) and Global Precipitation Measurement (GPM) Microwave Imager (GMI). The retrieved profiles are then assimilated into Hurricane WRF (Weather Research and Forecasting) using the GSI (Gridpoint Statistical Interpolation) data assimilation system.

Moradi, Isaac↗

NASA NTRS2019

Assimilation of Microwave Cloudy Observations over the Rainband of Hurricanes Using a Novel Bayesian Monte Carlo Technique

We propose a novel Bayesian Monte Carlo Integration (BMCI) technique to retrieve the profiles of temperature, water vapor, and cloud liquid/ice water content from microwave cloudy measurements in the rainbands of tropical cyclones (TC). These retrievals then can either be directly used by meteorologists to analyze the structure of TCs or be assimilated into numerical models to provide accurate initial conditions for the NWP models. The BMCI technique is applied to the data from the Advanced Technology Microwave Sounder (ATMS) onboard Suomi National Polar-orbiting Partnership (NPP) and Global Precipitation Measurement (GPM) Microwave Imager (GMI).

Moradi, Isaac↗

NASA NTRS2008

Joint Bayesian Component Separation and CMB Power Spectrum Estimation

We describe and implement an exact, flexible, and computationally efficient algorithm for joint component separation and CMB power spectrum estimation, building on a Gibbs sampling framework. Two essential new features are (1) conditional sampling of foreground spectral parameters and (2) joint sampling of all amplitude-type degrees of freedom (e.g., CMB, foreground pixel amplitudes, and global template amplitudes) given spectral parameters. Given a parametric model of the foreground signals, we estimate efficiently and accurately the exact joint foreground- CMB posterior distribution and, therefore, all marginal distributions such as the CMB power spectrum or foreground spectral index posteriors. The main limitation of the current implementation is the requirement of identical beam responses at all frequencies, which restricts the analysis to the lowest resolution of a given experiment. We outline a future generalization to multiresolution observations. To verify the method, we analyze simple models and compare the results to analytical predictions. We then analyze a realistic simulation with properties similar to the 3 yr WMAP data, downgraded to a common resolution of 3 deg FWHM. The results from the actual 3 yr WMAP temperature analysis are presented in a companion Letter.

numerical↗

NASA NTRS2009

Parametric Analysis of a Hover Test Vehicle using Advanced Test Generation and Data Analysis

Large complex aerospace systems are generally validated in regions local to anticipated operating points rather than through characterization of the entire feasible operational envelope of the system. This is due to the large parameter space, and complex, highly coupled nonlinear nature of the different systems that contribute to the performance of the aerospace system. We have addressed the factors deterring such an analysis by applying a combination of technologies to the area of flight envelop assessment. We utilize n-factor (2,3) combinatorial parameter variations to limit the number of cases, but still explore important interactions in the parameter space in a systematic fashion. The data generated is automatically analyzed through a combination of unsupervised learning using a Bayesian multivariate clustering technique (AutoBayes) and supervised learning of critical parameter ranges using the machine-learning tool TAR3, a treatment learner. Covariance analysis with scatter plots and likelihood contours are used to visualize correlations between simulation parameters and simulation results, a task that requires tool support, especially for large and complex models. We present results of simulation experiments for a cold-gas-powered hover test vehicle.

Gundy-Burlet, Karen↗

NASA NTRS2018

A Singular Value Decomposition Framework for Retrievals with Vertical Distribution Information from Greenhouse Gas Column Absorption Spectroscopy Measurements

We describe a variation of the Optimal Estimation (OE) method for greenhouse gas remote sensing retrievals using a singular value decomposition (SVD) and an uninformative prior. The SVD method is capable of discerning vertical information in column integrated absorption measurements. While traditional Bayesian optimal estimation (OE) assumes a prior distribution in order to regularize the inversion problem, the SVD approach identifies principal components that can be retrieved from the measurement without explicitly specifying a prior mean and prior covariance matrix. We discuss the method, illustrate its use on an integrated path differential absorption CO2 lidar measurement model, and compare it to traditional optimal estimation using numerical simulations. In the absence of forward model error, the mathematics behind the SVD method guarantee it to be bias-free, which is confirmed by the numerical simulations. In contrast, traditional OE retrievals exhibit bias when the prior mean used in the retrieval differs from the true mean. While the SVD approach can be used for most trace gas retrievals, it is particularly useful for situations where prior knowledge of the trace gas profile is poor. The SVD analysis is also useful in illustrating how vertical information is treated by the traditional OE approach.

Ramanathan, Anand K.↗

NASA NTRS2017

Assimilation of All-Weather GMI and ATMS Observations into HWRF

Moradi, Isaac↗

NASA NTRS2018

Assimilation of All-Weather GMI and ATMS Observations into HWRF

Moradi, Isaac↗

NASA NTRS2010

Initialization and Restart in Stochastic Local Search: Computing a Most Probable Explanation in Bayesian Networks

For hard computational problems, stochastic local search has proven to be a competitive approach to finding optimal or approximately optimal problem solutions. Two key research questions for stochastic local search algorithms are: Which algorithms are effective for initialization? When should the search process be restarted? In the present work we investigate these research questions in the context of approximate computation of most probable explanations (MPEs) in Bayesian networks (BNs). We introduce a novel approach, based on the Viterbi algorithm, to explanation initialization in BNs. While the Viterbi algorithm works on sequences and trees, our approach works on BNs with arbitrary topologies. We also give a novel formalization of stochastic local search, with focus on initialization and restart, using probability theory and mixture models. Experimentally, we apply our methods to the problem of MPE computation, using a stochastic local search algorithm known as Stochastic Greedy Search. By carefully optimizing both initialization and restart, we reduce the MPE search time for application BNs by several orders of magnitude compared to using uniform at random initialization without restart. On several BNs from applications, the performance of Stochastic Greedy Search is competitive with clique tree clustering, a state-of-the-art exact algorithm used for MPE computation in BNs.

Mengshoel, Ole J.↗

NASA NTRS1989

Filtering information from human experts

The authors propose a model, or filter, for debiasing opinions from multiple experts and combining them into a single consistent estimate of some variable of interest. A distinguishing feature of the approach consists of making the calibration of experts an integral part of filtering. This enables the filter to learn from previous experience with the experts. The theoretical development takes a Bayesian perspective, using de Finetti's (1964) notion of exchangeability. Experimental results with a preliminary computer implementation of the filter show that its estimates are better than those from comparable filters that do not involve calibration.

Mendel, Max B.↗

NASA NTRS2004

Bayesian Vision for Shape Recovery

We present a new Bayesian vision technique that aims at recovering a shape from two or more noisy observations taken under similar lighting conditions. The shape is parametrized by a piecewise linear height field, textured by a piecewise linear irradiance field, and we assume Gaussian Markovian priors for both shape vertices and irradiance variables. The observation process. also known as rendering, is modeled by a non-affine projection (e.g. perspective projection) followed by a convolution with a piecewise linear point spread function. and contamination by additive Gaussian noise. We assume that the observation parameters are calibrated beforehand. The major novelty of the proposed method consists of marginalizing out the irradiances considered as nuisance parameters, which is achieved by Laplace approximations. This reduces the inference to minimizing an energy that only depends on the shape vertices, and therefore allows an efficient Iterated Conditional Mode (ICM) optimization scheme to be implemented. A Gaussian approximation of the posterior shape density is computed, thus providing estimates both the geometry and its uncertainty. We illustrate the effectiveness of the new method by shape reconstruction results in a 2D case. A 3D version is currently under development and aims at recovering a surface from multiple images, reconstructing the topography by marginalizing out both albedo and shading.

Jalobeanu, Andre↗

NASA NTRSDate not supplied

A Framework for the Analysis of Deep Neural Networks in Autonomous Aerospace Applications using Bayesian Statistics

Deep Neural Networks (DNNs) are considered to be key components in many autonomous systems. Applications range from vision-based obstacle avoidance to intelligent/learning control and planning. Safety-critical applications as found in the aerospace domain require that the behavior of the DNN is validated and tested rigorously for safety of the autonomous system (AUS). In this paper, we present a framework to support testing of DNNs and the analysis of the network structure. Our framework employs techniques from statistical modeling and active learning to effectively generate test cases for DNN safety testing and performance analysis. We will present results of a case study on a physics-based Deep recurrent residual neural network (DR-RNN), which has been trained to emulate the aerodynamics behavior of a fixed-wing aircraft.

Deep Neural networks↗