Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

A mathematical model of diurnal variations in human plasma melatonin levels

Studies in animals and humans suggest that the diurnal pattern in plasma melatonin levels is due to the hormone's rates of synthesis, circulatory infusion and clearance, circadian control of synthesis onset and offset, environmental lighting conditions, and error in the melatonin immunoassay. A two-dimensional linear differential equation model of the hormone is formulated and is used to analyze plasma melatonin levels in 18 normal healthy male subjects during a constant routine. Recently developed Bayesian statistical procedures are used to incorporate correctly the magnitude of the immunoassay error into the analysis. The estimated parameters [median (range)] were clearance half-life of 23.67 (14.79-59.93) min, synthesis onset time of 2206 (1940-0029), synthesis offset time of 0621 (0246-0817), and maximum N-acetyltransferase activity of 7.17(2.34-17.93) pmol x l(-1) x min(-1). All were in good agreement with values from previous reports. The difference between synthesis offset time and the phase of the core temperature minimum was 1 h 15 min (-4 h 38 min-2 h 43 min). The correlation between synthesis onset and the dim light melatonin onset was 0.93. Our model provides a more physiologically plausible estimate of the melatonin synthesis onset time than that given by the dim light melatonin onset and the first reliable means of estimating the phase of synthesis offset. Our analysis shows that the circadian and pharmacokinetics parameters of melatonin can be reliably estimated from a single model.

NASA Discipline Number 70-10↗

Exploring the Connection Between Sampling Problems in Bayesian Inference and Statistical Mechanics

The Bayesian and statistical mechanical communities often share the same objective in their work - estimating and integrating probability distribution functions (pdfs) describing stochastic systems, models or processes. Frequently, these pdfs are complex functions of random variables exhibiting multiple, well separated local minima. Conventional strategies for sampling such pdfs are inefficient, sometimes leading to an apparent non-ergodic behavior. Several recently developed techniques for handling this problem have been successfully applied in statistical mechanics. In the multicanonical and Wang-Landau Monte Carlo (MC) methods, the correct pdfs are recovered from uniform sampling of the parameter space by iteratively establishing proper weighting factors connecting these distributions. Trivial generalizations allow for sampling from any chosen pdf. The closely related transition matrix method relies on estimating transition probabilities between different states. All these methods proved to generate estimates of pdfs with high statistical accuracy. In another MC technique, parallel tempering, several random walks, each corresponding to a different value of a parameter (e.g. "temperature"), are generated and occasionally exchanged using the Metropolis criterion. This method can be considered as a statistically correct version of simulated annealing. An alternative approach is to represent the set of independent variables as a Hamiltonian system. Considerab!e progress has been made in understanding how to ensure that the system obeys the equipartition theorem or, equivalently, that coupling between the variables is correctly described. Then a host of techniques developed for dynamical systems can be used. Among them, probably the most powerful is the Adaptive Biasing Force method, in which thermodynamic integration and biased sampling are combined to yield very efficient estimates of pdfs. The third class of methods deals with transitions between states described by rate constants. These problems are isomorphic with chemical kinetics problems. Recently, several efficient techniques for this purpose have been developed based on the approach originally proposed by Gillespie. Although the utility of the techniques mentioned above for Bayesian problems has not been determined, further research along these lines is warranted

Pohorille, Andrew↗

On-Board Battery Monitoring and Prognostics for Electric-Propulsion Aircraft

The reliability of the propulsion system of an aircraft is paramount for the aircraft safety and hence the aircraft health must be monitored continuously. In contrast to fuel- operated aircraft, electric battery-operated propulsion system poses specific problems, such as, the remaining battery power does not linearly decrease and cannot be measured directly. In this paper, we describe a combined monitoring and prognostics architecture that can continuously monitor all components of the electric propulsion system with respect to safety and performance properties as well as state of charge and rest of useful life for the battery. Our system combines a detailed electrochemical battery model for Li-ion batteries with a powerful prognostics engine based upon an Unscented Kalman Filter with the R2U2 monitoring device, which provides efficient observers for metric temporal logic and Bayesian reasoning. R2U2 is a real-time, realizable, responsive, unobtrusive unit, which continuously monitors sensor readings, outputs of the prognostics engine, as well as the ight software status for safety, performance, and security properties. We illustrate our architecture with two case studies, one reporting actual ight tests with an X8+ octocopter and the other a software-in-the-loop simulation with an unmanned Edge 540 electric aircraft model.

Kulkarni, Chetan↗

The statistical analysis of circadian phase and amplitude in constant-routine core-temperature data

Accurate estimation of the phases and amplitude of the endogenous circadian pacemaker from constant-routine core-temperature series is crucial for making inferences about the properties of the human biological clock from data collected under this protocol. This paper presents a set of statistical methods based on a harmonic-regression-plus-correlated-noise model for estimating the phases and the amplitude of the endogenous circadian pacemaker from constant-routine core-temperature data. The methods include a Bayesian Monte Carlo procedure for computing the uncertainty in these circadian functions. We illustrate the techniques with a detailed study of a single subject's core-temperature series and describe their relationship to other statistical methods for circadian data analysis. In our laboratory, these methods have been successfully used to analyze more than 300 constant routines and provide a highly reliable means of extracting phase and amplitude information from core-temperature data.

NASA Discipline Regulatory Physiology↗

Uncertainty in Soil Moisture Retrievals: an Ensemble Approach Using SMOS L-Band Microwave Data

The uncertainty of soil moisture (SM) retrievals from satellite brightness temperature (TB) observations depends primarily on the choice of radiative transfer model (RTM) parameters, prior SM information and TB inputs. This paper studies the sensitivity of several (quasi-)operational and experimental SM retrieval products from the Soil Moisture Ocean Salinity (SMOS) mission to these choices at 11 reference sites, located in 7 watersheds across the United States (US). Different literature-based RTM parameter sets cause large biases between retrievals. Whereas typical RTM parameter sets are calibrated for SM retrievals, it is shown that a parameter set carefully optimized for TB forward modeling can also be used for retrieving SM. It is also shown that the inclusion of dynamic prior SM estimates in a Bayesian retrieval scheme can strongly improve SM retrievals, regardless of the choice of RTM parameters, and that the use of multi-angular and multi-polarization TB does not necessarily lead to superior retrievals compared to retrievals based on TB data at a single incidence angle and polarization. The second part of this paper evaluates ensemble uncertainty metrics for SM retrievals obtained by propagating a wide range of RTM parameters through the RTM. As expected for bounded variables, the spread in the ensemble SM retrievals is smallest for wet and dry SM values and highest for intermediate SM values. After removal of the strong long-term mean bias associated with the RTM parameter values for individual ensemble members, the remaining anomaly ensemble SM spread of 0.037 cu m/cu m approximates the actual time series unbiased root-mean-square-difference of 0.042 cu m/cu m between ensemble mean retrievals and in situ reference data across the reference sites. However, the temporal variability in the anomaly ensemble spread reveals higher-order biases in the retrieval error, which should be accounted for when characterizing retrieval error.

Jan Quets↗

Effective structural impact detection and localization using convolutional neural network and Bayesian information fusion with limited sensors

Due to their unpredictable nature, many impact events (e.g., overheight vehicles striking on bridges) go unnoticed or get reported many hours later. However, they can induce structural failures or hidden damage that accelerates the structure’s long-term degradation. Therefore, prompt impact detection and localization strategies are essential for early warning of impact events and rapid maintenance of structures. Most existing impact detection strategies are developed for aircraft composite panels utilizing high-rate synchronized measurement from densely deployed sensors. Limited efforts have been made for infrastructure or human habitats which generally require large-scale but low-rate measurement. In particular, due to harsh environments (e.g., deep space habitats under meteoroids), structural impact localization must be robust to limited sensors (e.g., sensor damage during impacts) and multi-source errors (e.g., measurement errors). In this study, an effective impact detection and localization strategy is proposed using a limited number of vibration measurements, especially in harsh environments (e.g. in deep space). Convolutional neural networks are trained for each sensor node and are fused using Bayesian theory to improve the accuracy of impact localization. Special considerations are paid to evaluate the effect of both measurement error and modeling error in the analysis. The proposed strategy is illustrated using 1D structure, and further validated in 3D geodesic dome structure numerically. The results demonstrate that it can detect and localize impact events accurately and robustly on structures.

Yuguang Fu↗

Exoplanet Biosignatures: At the Dawn of a New Era of Planetary Observations

The rapid rate of discoveries of exoplanets has expanded the scope of the science possible for the remote detection of life beyond Earth. The Exoplanet Biosignatures Workshop-Without-Walls (EBWWW) held in 2016 engaged the international scientific community across diverse scientific disciplines, to assess the state of the science and technology in the search for life on exoplanets, and to identify paths for progress. The workshop activities resulted in five (5) major review papers which provide: 1) an encyclopedic review of known and proposed biosignatures and models used to ascertain them; 2) an in-depth review of O2 as a biosignature, rigorously examining the nuances of false positives and negatives for evidence of life; 3) a Bayesian framework to comprehensively organize current understanding to quantify confidence in biosignature assessments; 4) an extension of that Bayesian framework in anticipation of increasing planetary data and novel concepts of biosignatures, and 5) a review of the upcoming telescope capabilities to characterize exoplanets and their environment. Because of the immense content of these review papers, this summary provides a guide to their complementary scope and highlights salient features. Strong themes that emerged from the workshop were that biosignatures must be interpreted in the context of their environment, and that frameworks must be developed to link diverse forms of scientific understanding of that context to quantify the likelihood that a biosignature has been observed. Models are needed to explore the parameter space where measurements will be widespread but sparse in detail. Given the technological prospects for large ground-based telescopes and direct imaging from space-based observatories, the detection of atmospheric signatures of a few potentially habitable planets may come before 2030.

spectral imaging↗

Computational Inference of Vibratory System with Incomplete Modal Information Using Parallel, Interactive and Adaptive Markov Chains

Inverse analysis of vibratory system is an important subject in fault identification, model updating, and robust design and control. It is challenging subject because 1) the problem is oftentimes underdetermined while the measurements are limited and/or incomplete; 2) many combinations of parameters may yield results that are similar with respect to actual response measurements; and 3) uncertainties inevitably exist. The aim of this research is to leverage upon computational intelligence through statistical inference to facilitate an enhanced, probabilistic framework using incomplete modal response measurement. This new framework is built upon efficient inverse identification through optimization, whereas Bayesian inference is employed to account for the effect of uncertainties. To overcome the computational cost barrier, we adopt Markov chain Monte Carlo (MCMC) to characterize the target function/distribution. Instead of using single Markov chain in conventional Bayesian approach, we develop a new sampling theory with multiple parallel, interactive and adaptive Markov chains and incorporate it into Bayesian inference. This can harness the collective power of these Markov chains to realize the concurrent search of multiple local optima. The number of required Markov chains and their respective initial model parameters are automatically determined via Monte Carlo simulation-based sample pre-screening followed by K-means clustering analysis. These enhancements can effectively address the aforementioned challenges in finite element inverse analysis. The validity of this framework is systematically demonstrated through case studies.

K Zhou↗

The Rise and Fall of Star Formation Histories of Blue Galaxies at Redshifts 0.2 < z < 1.4

Popular cosmological scenarios predict that galaxies form hierarchically from the merger of many progenitor, each with their own unique star formation history (SFH). We use the approach recently developed by Pacifici et al. to constrain the SFHs of 4517 blue (presumably star-forming) galaxies with spectroscopic redshifts in the range O.2 < z < 1:4 from the All-Wavelength Extended Groth Strip International Survey (AEGIS). This consists in the Bayesian analysis of the observed galaxy spectral ' energy distributions with a comprehensive library of synthetic spectra assembled using state-of-the-art models of star formation and chemical enrichment histories, stellar population synthesis, nebular emission and attenuation by dust. We constrain the SFH of each galaxy in our sample by comparing the observed fluxes in the B, R,l and K(sub s) bands and rest-frame optical emission-line luminosities with those of one million model spectral energy distributions. We explore the dependence of the resulting SFH on galaxy stellar mass and redshift. We find that the average SFHs of high-mass galaxies rise and fall in a roughly symmetric bell-shaped manner, while those of low-mass galaxies rise progressively in time, consistent with the typically stronger activity of star formation in low-mass compared to high-mass galaxies. For galaxies of all masses, the star formation activity rises more rapidly at high than at low redshift. These findings imply that the standard approximation of exponentially declining SFHs wIdely used to interpret observed galaxy spectral energy distributions is not appropriate to constrain the physical parameters of star-forming galaxies at intermediate redshifts.

Pacifici, Camilla↗

Generating Exploration Mission-3 Trajectories to a 9:2 NRHO using Machine Learning

The purpose of this thesis is to design a machine learning algorithm platform that provides expanded knowledge of mission availability through a launch season by improving trajectory resolution and introducing launch mission forecasting. The specific scenario addressed in this paper is one in which data is provided for four deterministic translational maneuvers through a mission to a Near Rectilinear Halo Orbit (NRHO) with a 9:2 synodic frequency. Current launch availability knowledge under NASA's Orion Orbit Performance Team is established by altering optimization variables associated to given reference launch epochs. This current method can bean abstract task and relies on an orbit analyst to structure a mission based on an established mission design methodology associated to the performance of Orion and NASA's Space Launch System. Introducing a machine learning algorithm trained to construct mission scenarios within the feasible range of known trajectories reduces the required interaction of the orbit analyst by removing the needed step of optimizing the orbit to fit an expected translational response required of the spacecraft. In this study, k-Nearest Neighbor and Bayesian Linear Regression successfully predicted classical orbital elements for the launch windows observed. However both algorithms had limitations due to their approaches to model fitting. Training machine learning algorithms off of classical orbital elements introduced a repetitive approach to reconstructing mission segments for different arrival opportunities through the launch window and can prove to be a viable method of launch window scan generation for future missions.

Guzman, Esteban↗

A NICER View of the Massive Pulsar PSR J0740+6620 Informed by Radio Timing and XMM-Newton Spectroscopy

We report on Bayesian estimation of the radius, mass, and hot surface regions of the massive millisecond pulsar PSR J0740+6620, conditional on pulse-profile modeling of Neutron Star Interior Composition Explorer X-ray Timing Instrument event data. We condition on informative pulsar mass, distance, and orbital inclination priors derived from the joint North American Nanohertz Observatory for Gravitational Waves and Canadian Hydrogen Intensity Mapping Experiment/Pulsar wideband radio timing measurements of Fonseca et al. We use XMM-Newton European Photon Imaging Camera spectroscopic event data to inform our X-ray likelihood function. The prior support of the pulsar radius is truncated at 16 km to ensure coverage of current dense matter models. We assume conservative priors on instrument calibration uncertainty. We constrain the equatorial radius and mass of PSR J0740+6620 to be-+12.390.981.30km and-+2.0720.0660.067Me respectively, each reported as the posterior credible interval bounded by the 16% and 84% quantiles, conditional on surface hot regions that are non-overlapping spherical caps of fully ionized hydrogen atmosphere with uniform effective temperature; a posteriori, the temperature is=-+TlogK5.99100.060.05([])for each hot region. All software for the X-ray modeling framework is open-source and all data, model, and sample information is publicly available, including analysis notebooks and model modules in the Python language. Our marginal likelihood function of mass and equatorial radius is proportional to the marginal joint posterior density of those parameters(within the prior support)and can thus be computed from the posterior samples.

Millisecond pulsars↗

Automatic Generation of Algorithms for the Statistical Analysis of Planetary Nebulae Images

Analyzing data sets collected in experiments or by observations is a Core scientific activity. Typically, experimentd and observational data are &aught with uncertainty, and the analysis is based on a statistical model of the conjectured underlying processes, The large data volumes collected by modern instruments make computer support indispensible for this. Consequently, scientists spend significant amounts of their time with the development and refinement of the data analysis programs. AutoBayes [GF+02, FS03] is a fully automatic synthesis system for generating statistical data analysis programs. Externally, it looks like a compiler: it takes an abstract problem specification and translates it into executable code. Its input is a concise description of a data analysis problem in the form of a statistical model as shown in Figure 1; its output is optimized and fully documented C/C++ code which can be linked dynamically into the Matlab and Octave environments. Internally, however, it is quite different: AutoBayes derives a customized algorithm implementing the given model using a schema-based process, and then further refines and optimizes the algorithm into code. A schema is a parameterized code template with associated semantic constraints which define and restrict the template s applicability. The schema parameters are instantiated in a problem-specific way during synthesis as AutoBayes checks the constraints against the original model or, recursively, against emerging sub-problems. AutoBayes schema library contains problem decomposition operators (which are justified by theorems in a formal logic in the domain of Bayesian networks) as well as machine learning algorithms (e.g., EM, k-Means) and nu- meric optimization methods (e.g., Nelder-Mead simplex, conjugate gradient). AutoBayes augments this schema-based approach by symbolic computation to derive closed-form solutions whenever possible. This is a major advantage over other statistical data analysis systems which use numerical approximations even in cases where closed-form solutions exist. AutoBayes is implemented in Prolog and comprises approximately 75.000 lines of code. In this paper, we take one typical scientific data analysis problem-analyzing planetary nebulae images taken by the Hubble Space Telescope-and show how AutoBayes can be used to automate the implementation of the necessary anal- ysis programs. We initially follow the analysis described by Knuth and Hajian [KHO2] and use AutoBayes to derive code for the published models. We show the details of the code derivation process, including the symbolic computations and automatic integration of library procedures, and compare the results of the automatically generated and manually implemented code. We then go beyond the original analysis and use AutoBayes to derive code for a simple image segmentation procedure based on a mixture model which can be used to automate a manual preproceesing step. Finally, we combine the original approach with the simple segmentation which yields a more detailed analysis. This also demonstrates that AutoBayes makes it easy to combine different aspects of data analysis.

Fischer, Bernd↗

Effects of model deficiencies on parameter estimation

Reliable structural dynamic models will be required as a basis for deriving the reduced-order plant models used in control systems for large space structures. Ground vibration testing and model verification will play an important role in the development of these models; however, fundamental differences between the space environment and earth environment, as well as variations in structural properties due to as-built conditions, will make on-orbit identification essential. The efficiency, and perhaps even the success, of on-orbit identification will depend on having a valid model of the structure. It is envisioned that the identification process will primarily involve parametric methods. Given a correct model, a variety of estimation algorithms may be used to estimate parameter values. This paper explores the effects of modeling errors and model deficiencies on parameter estimation by reviewing previous case histories. The effects depend at least to some extent on the estimation algorithm being used. Bayesian estimation was used in the case histories presented here. It is therefore conceivable that the behavior of an estimation algorithm might be useful in detecting and possibly even diagnosing deficiencies. In practice, the task is complicated by the presence of systematic errors in experimental procedures and data processing and in the use of the estimation procedures themselves.

Hasselman, T. K.↗

Informed Source Separation: A Bayesian Tutorial

Source separation problems are ubiquitous in the physical sciences; any situation where signals are superimposed calls for source separation to estimate the original signals. In h s tutorial I will discuss the Bayesian approach to the source separation problem. This approach has a specific advantage in that it requires the designer to explicitly describe the signal model in addition to any other information or assumptions that go into the problem description. This leads naturally to the idea of informed source separation, where the algorithm design incorporates relevant information about the specific problem. This approach promises to enable researchers to design their own high-quality algorithms that are specifically tailored to the problem at hand.

Knuth, Kevin H.↗

Modelling the Greenland Ice Sheet's Committed Contribution to Sea Level During the 21st Century

Mass loss from the Greenland Ice Sheet can be partitioned between surface mass balance and discharge due to ice dynamics through its marine-terminating outlet glaciers. A perturbation to a glacier terminus (e.g., a calving event) results in both an instantaneous response in velocity and mass loss and a diffusive response due to the evolution of ice thickness over time. This diffusive response means the total impact of a retreat event can take decades to be fully realized. Here we model the committed response of the Greenland Ice Sheet by applying perturbations to the marine-terminating glacier termini that represent recent observed changes, and simulating the response over the 21st century, while holding the climate forcing constant. The sensitivity of the ice sheet response to model parameter uncertainty is explored within an ensemble framework, and Gravity Recovery and Climate Experiment data is used to constrain the results using a Bayesian calibration approach. We find that the Greenland Ice Sheet's committed contribution to 21st century sea level rise is at least 33.5 [17.5 52.4] mm (25th and 75th percentiles in brackets), with at least 6 mm being attributable directly to terminus retreat that occurred between 2007 and 2015. The spread in our projections is driven by uncertainty in the basal friction coefficient. Our results complement the ISMIP6 Greenland projections, which report the ice sheet response to future forcing, excluding the background response. In this way, we can obtain estimates of Greenland's total contribution to sea level rise in 2100.

Isabel J. Nias↗

Assimilation of microwave satellite observations over the rainbands of tropical cyclones

The potential of microwave observations in improving the weather forecasts is limited by the accuracy of all-sky radiative transfer calculations. We introduce a novel Bayesian MonteCarlo technique to improve the assimilation of microwave observations over the rainbands of tropical cyclones. The BMCI technique eliminates the need for a forward model in the data assimilation system. The technique includes three steps, (i) generating a comprehensive dataset using in-situ cloud measurements and atmospheric profiles, (ii) generating synthetic ATMS observations from the training dataset, and (iii) using real observations to estimate the geophysical variables over the rainbands of tropical cyclones. The retrieved profiles of temperature, relative humidity, and cloud water content as well assurface information such as SST were then assimilated into the model. The results show that assimilating the BMCI retrievals can influence the dynamical features of the cyclone, including a stronger warm core, a symmetric eye, and vertically aligned wind columns.

Monte Carlo↗

Dislocation model for aseismic fault slip in the transverse ranges of Southern California

Geodetic data at a plate boundary can reveal the pattern of subsurface displacements that accompany plate motion. These displacements are modelled as the sum of rigid block motion and the elastic effects of frictional interaction between blocks. The frictional interactions are represented by uniform dislocation on each of several rectangular fault patches. The block velocities and fault parameters are then estimated from geodetic data. Bayesian inversion procedure employs prior estimates based on geological and seismological data. The method is applied to the Transverse Ranges, using prior geological and seismological data and geodetic data from the USGS trilateration networks. Geodetic data imply a displacement rate of about 20 mm/yr across the San Andreas Fault, while the geologic estimates exceed 30 mm/yr. The prior model and the final estimates both imply about 10 mm/yr crustal shortening normal to the trend of the San Andreas Fault. Aseismic fault motion is a major contributor to plate motion. The geodetic data can help to identify faults that are suffering rapid stress accumulation; in the Transverse Ranges those faults are the San Andreas and the Santa Susana.

Cheng, A.↗