Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

orbitize! v3: Orbit fitting for the High-contrast Imaging Community

orbitize! is a package for Bayesian modeling of the orbital parameters of resolved binary objects from time series measurements. It was developed with the needs of the high-contrast imaging community in mind, and has since also become widely used in the binary star community. A generic orbitize! use case involves translating relative astrometric time series, optionally combined with radial velocity or astrometric time series, into a set of derived orbital posteriors. This paper is published alongside the release of orbitize! version 3.0, which has seen significant enhancements in functionality and accessibility since the release of version 1.0 (Blunt et al., 2020).

Sarah Blunt↗

Development and Execution of the RUNSAFE Runway Safety Bayesian Belief Network Model

One focus area of the National Aeronautics and Space Administration (NASA) is to improve aviation safety. Runway safety is one such thrust of investigation and research. The two primary components of this runway safety research are in runway incursion (RI) and runway excursion (RE) events. These are adverse ground-based aviation incidents that endanger crew, passengers, aircraft and perhaps other nearby people or property. A runway incursion is the incorrect presence of an aircraft, vehicle or person on the protected area of a surface designated for the landing and take-off of aircraft; one class of RI events simultaneously involves two aircraft, such as one aircraft incorrectly landing on a runway while another aircraft is taking off from the same runway. A runway excursion is an incident involving only a single aircraft defined as a veer-off or overrun off the runway surface. Within the scope of this effort at NASA Langley Research Center (LaRC), generic RI, RE and combined (RI plus RE, or RUNSAFE) event models have each been developed and implemented as a Bayesian Belief Network (BBN). Descriptions of runway safety issues from the literature searches have been used to develop the BBN models. Numerous considerations surrounding the process of developing the event models have been documented in this report. The event models were then thoroughly reviewed by a Subject Matter Expert (SME) panel through multiple knowledge elicitation sessions. Numerous improvements to the model structure (definitions, node names, node states and the connecting link topology) were made by the SME panel. Sample executions of the final RUNSAFE model have been presented herein for baseline and worst-case scenarios. Finally, a parameter sensitivity analysis for a given scenario was performed to show the risk drivers. The NASA and LaRC research in runway safety event modeling through the use of BBN technology is important for several reasons. These include: 1) providing a means to clearly understand the cause and effect patterns leading to safety issues, incidents and accidents, 2) enabling the prioritization of specialty areas needing more attention to improve aviation safety, and 3) enabling the identification of gaps within NASA's Aviation Safety funding portfolio

Green, Lawrence L.↗

System risk quantification and decision making support using functional modeling and dynamic Bayesian network

Risk-informed decision-making requires a probabilistic assessment of the likelihood of success of control action, given the system status. This paper presents a systematic state transition modeling approach integrating dynamic probabilistic risk assessment with a decision-making process using a dynamic Bayesian network (DBN) coupled with functional modeling. A functional model designed with multilevel flow modeling (MFM) technique was used to build a system state structure inferred by energy, mass, and information flow so that one can verify the developed model with respect to system functionality. The MFM model represents the causal relationship among the nodes, which captures the structure of process parameters and control units. Each node may have multiple possible states, and the DBN structured by the MFM model represents the time-domain transitions among the defined states. Furthermore, the MFM-DBN integrated state transition modeling is a white-box approach that allows one to draw the system's risk profile by updating the system states and supports the decisions probabilistically with physical inference. An example of a simple heating system has been used to illustrate this process, including decision-making support based on quantitative risk profile. For demonstrating its applicability to a complex system operational decision making, a case study of station blackout accident scenario leading to the seal loss of coolant accident in a nuclear power plant is presented. The proposed approach effectively provided the risk profile along time for each option so that the operators can make the best decision, which minimizes the plant risk.

42 ENGINEERING↗

Reduced-dimension Bayesian optimization for model calibration of transient vapor compression cycles

Development and calibration of first-principles dynamic models of vapor compression cycles (VCCs) is of critical importance for applications that include control design and fault detection and diagnostics. Nevertheless, the inherent complexity of models that are represented by large systems of differential–algebraic equations leads to significant challenges for model calibration processes that utilize classical gradient-based methods. Bayesian optimization (BO) is a sample-efficient and gradient-free approach using a probabilistic surrogate model and optimal search over a feasible parameter space. Despite the benefits of BO in reducing computational costs, challenges remain in dealing with a high-dimensional calibration task resulting from a large set of parameters that have significant impacts on system behavior and need to be calibrated simultaneously. This paper presents a reduced-dimension BO framework for calibrating transient VCCs models where the calibration space is projected to a low-dimensional subspace for accelerating convergence of the solution algorithm and consequently reducing the number of transient simulations. The proposed approach was demonstrated via two case studies associated with different VCC applications where 10 parameters were calibrated in each case using laboratory measurements. The reduced-dimension BO framework only required 1 / 8 th of the iterations associated with a standard BO method that deals with high-dimensional calibration parameters for converged solutions and yielded comparable accuracy. Furthermore, both calibrated models revealed significant accuracy improvements compared to uncalibrated models.

Ma, Jiacheng↗

AT2017gfo: Bayesian inference and model selection of multicomponent kilonovae and constraints on the neutron star equation of state

The joint detection of the gravitational wave GW170817, of the short γ-ray burst GRB170817A and of the kilonova AT2017gfo, generated by the the binary neutron star (NS) merger observed on 2017 August 17, is a milestone in multimessenger astronomy and provides new constraints on the NS equation of state. We perform Bayesian inference and model selection on AT2017gfo using semi-analytical, multicomponents models that also account for non-spherical ejecta. Observational data favour anisotropic geometries to spherically symmetric profiles, with a log-Bayes’ factor of ~104, and favour multicomponent models against single-component ones. The best-fitting model is an anisotropic three-component composed of dynamical ejecta plus neutrino and viscous winds. Using the dynamical ejecta parameters inferred from the best-fitting model and numerical–relativity relations connecting the ejecta properties to the binary properties, we constrain the binary mass ratio to q < 1.54 and the reduced tidal parameter to $120\lt \tilde{\Lambda }\lt 1110$. Finally, we combine the predictions from AT2017gfo with those from GW170817, constraining the radius of a NS of 1.4 M ⊙ to 12.2 ± 0.5 km (1σ level). This prediction could be further strengthened by improving kilonova models with numerical-relativity information.

79 ASTRONOMY AND ASTROPHYSICS↗

Simulation and Application of Bayesian Dose Uncertainty Modeling for Low-Boom Community Noise Surveys

In dose-response modeling, failing to account for dose uncertainty can cause artificial flattening of the estimated slope of the dose-response curve. Previous analyses of NASA sonic boom community noise survey data utilized a Bayesian multilevel logistic regression model, which did not account for dose uncertainty. The current work extends the model to account for either classical or Berkson dose uncertainty. The extended model is applied to two simulated dose-response datasets to illustrate conditions under which the dose uncertainty term does and does not correct for the artificial flattening introduced by dose uncertainty. Finally, the extended model is applied to two previous NASA sonic boom community noise surveys. The resulting dose-response curve slope for the average participant is 5 to 10% steeper, but the difference in the noise dose that elicits a 5% highly annoyed response is small (less than 1 dB). The difference remains insignificant when producing population summary dose-response curves. Commentary is included on applicability to future X-59 low-boom community noise survey data modeling and analysis.

X-59↗

Semi-Analytical Hierarchical Bayesian Inference of Nonlinear Model Structure in Stochastic Dynamics: Applied to Compartmental Models of Infectious Diseases

A Bayesian computational framework for parsimonious inference in stochastic nonlinear dynamical systems is presented. This framework enables the concurrent estimation of system states, time-varying parameters, time-invariant parameters, and the optimal sparsity structure of the model parameters. Because differential equation-based models are often simplified mechanistic or phenomenological representations, robust inference from noisy measurement data requires explicit treatment of model error and uncertainty. Model error and time-varying parameters can be represented as random processes, enabling inference while making minimal assumptions about the underlying sources of discrepancy and variability. Adopting stochastic differential equation representations affords the model significant flexibility, but can also render it susceptible to overfitting during statistical inversion, where the inferred model may track noise rather than the underlying signal. To alleviate the effects of overfitting and to enable the discovery of the optimal sparse representation of the time-invariant parameters, a Bayesian sparse learning algorithm is embedded within the framework. This sparse learning framework adopts an approximate hierarchical Bayesian setting defined by a series of semi-analytical expressions. The model structure inference framework is validated using a stochastic compartmental model for tracking and forecasting active cases of an infectious disease. Compartmental models describe population-level infectious disease dynamics through interactions among population fractions grouped by disease state. Mathematically, such models consist of a system of coupled ordinary differential equations. This example adopts an expressive compartmental model that includes multiple possible interactions between disease states, motivated by early uncertainty surrounding COVID-19 reinfection dynamics and their implications for long-term epidemic forecasting. The sparse learning exercise permits the inference of a priori unknown epidemiological dynamics from simulated public health data, discovering the nested compartmental model that optimizes the trade-off between average data-fit and model complexity. It is shown that inducing sparsity among the model parameters eliminates redundant interactions between compartments, equivalently revealing the optimal coupling structure between differential equations.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Quantification of GEOS-5 L-band Radiative Transfer Model Parameters Using Bayesian Inference and SMOS Observations

Uncertainties in L-band (1.4 GHz) radiative transfer modeling (RTM) affect the simulation of brightness temperatures (Tb) over land and the inversion of satellite-observed Tb into soil moisture retrievals. In particular, accurate estimates of the microwave soil roughness, vegetation opacity and scattering albedo for large-scale applications are difficult to obtain from field studies and often lack an uncertainty estimate. Here, a Markov Chain Monte Carlo (MCMC) simulation method is used to determine satellite-scale estimates of RTM parameters and their posterior uncertainty by minimizing the misfit between long-term averages and standard deviations of simulated and observed Tb at a range of incidence angles, at horizontal and vertical polarization, and for morning and evening overpasses. Tb simulations are generated with the Goddard Earth Observing System (GEOS-5) and confronted with Tb observations from the Soil Moisture Ocean Salinity (SMOS) mission. The MCMC algorithm suggests that the relative uncertainty of the RTM parameter estimates is typically less than 25 of the maximum a posteriori density (MAP) parameter value. Furthermore, the actual root-mean-square-differences in long-term Tb averages and standard deviations are found consistent with the respective estimated total simulation and observation error standard deviations of m3.1K and s2.4K. It is also shown that the MAP parameter values estimated through MCMC simulation are in close agreement with those obtained with Particle Swarm Optimization (PSO).

MCMC↗

Robust Parameter Design on Dual Stochastic Response Models With Constrained Bayesian Optimization

In engineering system design, minimizing the variations of the quality measurements while guaranteeing their overall quality up to certain levels, namely the robust parameter design (RPD), is crucial. Recent works have dealt with the design of a system whose response-control variables relationship is a deterministic function with a complex shape and function evaluation is expensive. In this work, we propose a Bayesian optimization method for the RPD of stochastic functions. Dual stochastic response models are carefully designed for stochastic functions. The heterogeneous variance of the sample mean is addressed by the predictive mean of the log variance surrogate model in a two-step approach. We establish an acquisition function that favors exploration across the feasible and optimality-improvable regions to effectively and efficiently solve the stochastic constrained optimization problem. Further, the performance of our proposed method is demonstrated by the extensive numerical and case studies. Note to Practitioners-Many manufacturing processes involve undesirable variations, which create variations in the final products. For example, many emerging manufacturing processes, such as nanomanufacturing, involve complex physical and chemical dynamics and transformation, creating variations in the manufacturing output. In such processes, it is crucial to design the manufacturing processes or products so that they have minimum variations in their quality. Meanwhile, it is also important to maintain the overall quality of the designed processes or products. Furthermore, acquiring data from many advanced manufacturing processes is often very costly, especially in the designing stage. In this work, we propose a data-driven method that automatically finds the best setting of manufacturing processes or products with the minimum variations of quality and a given constraint on the average quality satisfied. Our proposed method is used before conducting every experiment; It analyzes the historical data from previous experiments and provides a setting to be used in the next experiment. Our proposed method efficiently utilizes the historical data, and thus finds the best robust setting by conducting only a small number of experiments.

42 ENGINEERING↗

Inference of experimental radial impurity transport on Alcator C-Mod: Bayesian parameter estimation and model selection

We present a fully Bayesian approach for the inference of radial profiles of impurity transport coefficients and compare its results to neoclassical, gyrofluid and gyrokinetic modeling. Using nested sampling, the Bayesian Impurity Transport InferencE (BITE) framework can handle complex parameter spaces with multiple possible solutions, offering great advantages in interpretative power and reliability with respect to previously demonstrated methods. BITE employs a forward model based on the pySTRAHL package, built on the success of the well-known STRAHL code [Dux, IPP Report, 2004], to simulate impurity transport in magnetically-confined plasmas. In this paper, we focus on calcium (Ca, Z=20) Laser Blow-Off injections into Alcator C-Mod plasmas. Multiple Ca atomic lines are diagnosed via high-resolution X-ray Imaging Crystal Spectroscopy and Vacuum Ultra-Violet measurements. We analyze a sawtoothing I-mode discharge for which neoclassical and turbulent (quasilinear and nonlinear) predictions are also obtained. Here, we find good agreement in diffusion across the entire radial extent, while turbulent convection and density profile peaking are estimated to be larger in experiment than suggested by theory. Efforts and challenges associated with the inference of experimental pedestal impurity transport are discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Inference of Experimental Radial Impurity Transport on Alcator C-Mod: Bayesian Parameter Estimation and Model Selection.

We present a fully Bayesian approach for the inference of radial profiles of impurity transport coefficients and compare its results to neoclassical, gyrofluid and gyrokinetic modeling. Using nested sampling, the Bayesian Impurity Transport InferencE (BITE) framework can handle complex parameter spaces with multiple possible solutions, offering great advantages in interpretative power and reliability with respect to previously demonstrated methods. BITE employs a forward model based on the pySTRAHL package, built on the success of the well-known STRAHL code [Dux, IPP Report, 2004], to simulate impurity transport in magnetically-confined plasmas. In this paper, we focus on calcium (Ca, Z=20) Laser Blow-Off injections into Alcator C-Mod plasmas. Multiple Ca atomic lines are diagnosed via high-resolution X-ray Imaging Crystal Spectroscopy and Vacuum Ultra-Violet measurements. We analyze a sawtoothing I-mode discharge for which neoclassical and turbulent (quasilinear and nonlinear) predictions are also obtained. We find good agreement in diffusion across the entire radial extent, while turbulent convection and density profile peaking are estimated to be larger in experiment than suggested by theory. Efforts and challenges associated with the inference of experimental pedestal impurity transport are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Using Regionalized Air Quality Model Performance and Bayesian Maximum Entropy Data Fusion to Map Global Surface Ozone Concentration and Associated Uncertainty

Estimates of ground-level ozone concentrations have been improved through data fusion of observations and atmospheric chemistry models. Our previous global ozone estimates for the Global Burden of Disease study corrected for bias uniformly across continents and then corrected near monitoring stations using the Bayesian Maximum Entropy (BME) framework for data fusion. Here, we use the Regionalized Air Quality Model Performance (RAMP) framework to correct model bias over a much larger spatial range than BME can, accounting for the spatial inhomogeneity of bias and nonlinearity as a function of modeled ozone. RAMP bias correction is applied to a composite of 9 global chemistry-climate models, based on the nearest set of monitors. These estimates are then fused with observations using BME, which matches observations at measurement stations, with the influence of observations declining with distance in space and time. We create global ozone maps for each year from 1990 to 2017 at fine spatial resolution. RAMP is shown to create unrealistic discontinuities due to the spatial clustering of ozone monitors, which we overcome by applying a weighting for RAMP based on the number of monitors nearby. Incorporating RAMP before BME has little effect on model performance near stations, but strongly increases R 2 by 0.15 at locations farther from stations, shown through a checkerboard cross-validation. Corrections to estimates differ based on location in space and time, confirming heterogeneity. We quantify the likelihood of exceeding selected ozone levels, finding that parts of the Middle East, India, and China are most likely to exceed 55 parts per billion (ppb) in 2017. About 96% of the global population was exposed to ozone levels above the World Health Organization guideline of 60 µg m −3 (30 ppb) in 2017. Our annual fine-resolution ozone estimates may be useful for several applications including epidemiology and assessments of impacts on health, agriculture, and ecosystems.

Ozone↗

Traffic safety analysis and model updating for freeways using Bayesian method

Freeway crash prediction models are the basic of traffic safety research, yet crash occurrence and the influencing factors change over time. In order to make sure the implemented safety models fit the current traffic environment, this study conducts a comparative analysis of 2017 and 2020 datasets collected from freeways in Suzhou, China. Herein, considering the spatial correlation among analysis units and the hierarchical data structure, a Bayesian conditional autoregressive negative binomial (CAR-NB) model and a Bayesian hierarchical CAR-NB (HCAR-NB) model were used to explore the safety influencing factors, and a traditional NB model was developed for further comparison. To update the HCAR-NB model from 2017 to 2020, Bayesian inference with informative priors was used to improve its goodness of fit and efficiency. Preliminary results showed that 1) the HCAR-NB model outperformed the NB model and CAR-NB model in prediction accuracy, and 2) the number of crashes was significantly correlated with average speed, speed variance, road segment length, number of lanes, and presence of ramps. The potential for safety improvement (PSI) method was applied to the modeling results to identify hotspots for the two years. The results confirmed that the hotspots spatiotemporally shifted among the freeways. The proposed crash prediction model and updating method are expected to assist implementation of informed countermeasures for freeway safety improvement.

97 MATHEMATICS AND COMPUTING↗

Bayesian Safety Risk Modeling of Human-Flightdeck Automation Interaction

Usage of automatic systems in airliners has increased fuel efficiency, added extra capabilities, enhanced safety and reliability, as well as provide improved passenger comfort since its introduction in the late 80's. However, original automation benefits, including reduced flight crew workload, human errors or training requirements, were not achieved as originally expected. Instead, automation introduced new failure modes, redistributed, and sometimes increased workload, brought in new cognitive and attention demands, and increased training requirements. Modern airliners have numerous flight modes, providing more flexibility (and inherently more complexity) to the flight crew. However, the price to pay for the increased flexibility is the need for increased mode awareness, as well as the need to supervise, understand, and predict automated system behavior. Also, over-reliance on automation is linked to manual flight skill degradation and complacency in commercial pilots. As a result, recent accidents involving human errors are often caused by the interactions between humans and the automated systems (e.g., the breakdown in man-machine coordination), deteriorated manual flying skills, and/or loss of situational awareness due to heavy dependence on automated systems. This paper describes the development of the increased complexity and reliance on automation baseline model, named FLAP for FLightdeck Automation Problems. The model development process starts with a comprehensive literature review followed by the construction of a framework comprised of high-level causal factors leading to an automation-related flight anomaly. The framework was then converted into a Bayesian Belief Network (BBN) using the Hugin Software v7.8. The effects of automation on flight crew are incorporated into the model, including flight skill degradation, increased cognitive demand and training requirements along with their interactions. Besides flight crew deficiencies, automation system failures and anomalies of avionic systems are also incorporated. The resultant model helps simulate the emergence of automation-related issues in today's modern airliners from a top-down, generalized approach, which serves as a platform to evaluate NASA developed technologies

Ancel, Ersin↗

Theoretical and methodological challenges in hierarchical Bayesian inference for model-form uncertainty

This report describes challenges associated with the hierarchical Bayesian approach to inform model-form uncertainty (MFU) representations, which are parameterized modifications to a mathematical models’ governing equations to express uncertainty in form of the equations. To inform model-form uncertainties, hierarchical Bayesian inference is often employed. Here, the MFU parameters are distributed parametrically, and the hyperparameters of the parametric distribution are informed through Bayesian inference, with the aim of determining the MFU parameter distribution that best agrees with calibration data. In practice, however, we have found the hierarchical Bayesian approach falls short of this aim. We discuss theoretical and methodological challenges of the approach, and we present several numerical demonstrations of these challenges. To conclude, we suggest promising alternative approaches for future investigation.

97 MATHEMATICS AND COMPUTING↗

Fully Bayesian Analysis With Model Inadequacy Correction For Nuclear Graphite Property Models With Hierarchical Variance Structure

Nuclear-grade graphites are extensively utilized in the core designs of various advanced nuclear reactors. Within the reactor environment, graphite is subjected to prolonged exposure to extreme conditions, including high temperatures, radiation, and potentially molten salt and oxygen. Such exposure can induce several degradation mechanisms in graphite, such as nonuniform volumetric strains caused by irradiation and thermal expansion, leading to stresses that may compromise the performance of graphite components. Assessing component integrity, forecasting component performance over the reactor's lifespan, and developing design standards necessitate robust tools for predicting fracture initiation and propagation in graphite structural components within nuclear reactors. This code enables the Bayesian calibration of properties for nuclear-grade graphites. Using a hierarchical Bayesian approach, multiple experimental data sources are combined to develop Gaussian process models for the properties. Using the Kennedy O'Hagan framework, the uncertainties due inadequacies in the model and the inherent spread in the experimental data are quantified.

Dhulipala, Som Lakshmi NarasimhaLakshmi Narasimha ↗

Bayesian-Motivated Probabilistic Model of Hurricane-Induced Multimechanism Flood Hazards

Multimechanism floods (MMFs) are caused by the simultaneous occurrence of more than one flood mechanism such as storm surge, precipitation, tides, and waves. MMFs can lead to more severe or differing impacts than single-mechanism floods. As a result, comprehensive risk assessments require the ability to assess the multivariate probabilistic behaviors of hazards from MMFs. Here this study introduces a novel Bayesian-motivated approach for the probabilistic assessment of hurricane-induced hazards from the combination of the surge, precipitation, tides, and river antecedent flow. A Bayesian network (BN) is developed to capture the physical (conditional) relationship between variables and facilitate the generation of a hazard curve for river discharge that captures the contributions from multiple flood drivers. A case study located along the Delaware River is used to illustrate the proposed approach. Five computationally efficient representative predictive models are developed to estimate the conditional distributions required for the BN as a means of demonstrating the overall framework. The predictive models used in this study act as placeholders and can be replaced with more sophisticated and high-fidelity models depending on the desired accuracy level. While the predictive models are intended to be representative and illustrative, the model performance is evaluated using three historical storms that affected the area. Overall, the proposed framework is shown to be transparent, effective, and adaptable.

54 ENVIRONMENTAL SCIENCES↗