Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probability and statistical methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Neural Network-Based Electric Vehicle Range Prediction for Smart Charging Optimization

Range prediction is a standard feature in most modern road vehicles, allowing drivers to make informed decisions about when to refuel. Most vehicles make range predictions through data- or model-driven means, monitoring the average fuel consumption rate or using a tuned vehicle model to predict fuel consumption. The uncertainty of future driving conditions makes the range prediction problem challenging, particularly for less pervasive battery electric vehicles (BEV). Most contemporary machine learning-based methods attempt to forecast the battery SOC discharge profile to predict vehicle range. In this work, we propose a novel approach using two recurrent neural networks (RNNs) to predict the remaining range of BEVs and the minimum charge required to safely complete a trip. Each RNN has two outputs that can be used for statistical analysis to account for uncertainties; the first loss function leads to mean and variance estimation (MVE), while the second results in bounded interval estimation (BIE). These outputs of the proposed RNNs are then used to predict the probability of a vehicle completing a given trip without charging, or if charging is needed, the remaining range and minimum charging required to finish the trip with high probability. Training data was generated using a low-order physics model to estimate vehicle energy consumption from historical drive cycle data collected from medium-duty last-mile delivery vehicles. Here, the proposed method demonstrated high accuracy in the presence of day-to-day route variability, with the root-mean-square error (RMSE) below 6% for both RNN models.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The statistical theory of the fracture of fragile bodies. Part 2: The integral equation method

It is demonstrated how with the aid of a bending test, the Weibull fracture risk function can be determined - without postulating its analytical form - by resolving an integral equation. The respective solutions for rectangular and circular section beams are given. In the first case the function is expressed as an algorithm and in the second, in the form of series. Taking into account that the cumulative fracture probability appearing in the solution to the integral equation must be continuous and monotonically increasing, any case of fabrication or selection of samples can be treated.

Kittl, P.↗

Frame synchronization methods based on channel symbol measurements

The current DSN frame synchronization procedure is based on monitoring the decoded bit stream for the appearance of a sync marker sequence that is transmitted once every data frame. The possibility of obtaining frame synchronization by processing the raw received channel symbols rather than the decoded bits is explored. Performance results are derived for three channel symbol sync methods, and these are compared with results for decoded bit sync methods reported elsewhere. It is shown that each class of methods has advantages or disadvantages under different assumptions on the frame length, the global acquisition strategy, and the desired measure of acquisition timeliness. It is shown that the sync statistics based on decoded bits are superior to the statistics based on channel symbols, if the desired operating region utilizes a probability of miss many orders of magnitude higher than the probability of false alarm. This operating point is applicable for very large frame lengths and minimal frame-to-frame verification strategy. On the other hand, the statistics based on channel symbols are superior if the desired operating point has a miss probability only a few orders of magnitude greater than the false alarm probability. This happens for small frames or when frame-to-frame verifications are required.

Dolinar, S.↗

Statistical computation of tolerance limits

Based on a new theory, two computer codes were developed specifically to calculate the exact statistical tolerance limits for normal distributions within unknown means and variances for the one-sided and two-sided cases for the tolerance factor, k. The quantity k is defined equivalently in terms of the noncentral t-distribution by the probability equation. Two of the four mathematical methods employ the theory developed for the numerical simulation. Several algorithms for numerically integrating and iteratively root-solving the working equations are written to augment the program simulation. The program codes generate some tables of k's associated with the varying values of the proportion and sample size for each given probability to show accuracy obtained for small sample sizes.

Wheeler, J. T.↗

Data Analysis with Graphical Models: Software Tools

Probabilistic graphical models (directed and undirected Markov fields, and combined in chain graphs) are used widely in expert systems, image processing and other areas as a framework for representing and reasoning with probabilities. They come with corresponding algorithms for performing probabilistic inference. This paper discusses an extension to these models by Spiegelhalter and Gilks, plates, used to graphically model the notion of a sample. This offers a graphical specification language for representing data analysis problems. When combined with general methods for statistical inference, this also offers a unifying framework for prototyping and/or generating data analysis algorithms from graphical specifications. This paper outlines the framework and then presents some basic tools for the task: a graphical version of the Pitman-Koopman Theorem for the exponential family, problem decomposition, and the calculation of exact Bayes factors. Other tools already developed, such as automatic differentiation, Gibbs sampling, and use of the EM algorithm, make this a broad basis for the generation of data analysis software.

Buntine, Wray L.↗

Role of metabolic gases in bubble formation during hypobaric exposures

Our hypothesis is that metabolic gases play a role in the initial explosive growth phase of bubble formation during hypobaric exposures. Models that account for optimal internal tensions of dissolved gases to predict the probability of occurrence of venous gas emboli were statistically fitted to 426 hypobaric exposures from National Aeronautics and Space Administration tests. The presence of venous gas emboli in the pulmonary artery was detected with an ultrasound Doppler detector. The model fit and parameter estimation were done by using the statistical method of maximum likelihood. The analysis results were as follows. 1) For the model without an input of noninert dissolved gas tissue tension, the log likelihood (in absolute value) was 255.01. 2) When an additional parameter was added to the model to account for the dissolved noninert gas tissue tension, the log likelihood was 251.70. The significance of the additional parameter was established based on the likelihood ratio test (P < 0.012). 3) The parameter estimate for the dissolved noninert gas tissue tension participating in bubble formation was 19. 1 kPa (143 mmHg). 4) The additional gas tissue tension, supposedly due to noninert gases, did not show an exponential decay as a function of time during denitrogenation, but it remained constant. 5) The positive sign for this parameter term in the model is characteristic of an outward radial pressure of gases in the bubble. This analysis suggests that dissolved gases other than N2 in tissues may facilitate the initial explosive bubble-growth phase.

NASA Center JSC↗

Surveillance system and method having an adaptive sequential probability fault detection test

System and method providing surveillance of an asset such as a process and/or apparatus by providing training and surveillance procedures that numerically fit a probability density function to an observed residual error signal distribution that is correlative to normal asset operation and then utilizes the fitted probability density function in a dynamic statistical hypothesis test for providing improved asset surveillance.

Herzog, James P.↗

Surveillance system and method having an adaptive sequential probability fault detection test

System and method providing surveillance of an asset such as a process and/or apparatus by providing training and surveillance procedures that numerically fit a probability density function to an observed residual error signal distribution that is correlative to normal asset operation and then utilizes the fitted probability density function in a dynamic statistical hypothesis test for providing improved asset surveillance.

Bickford, Randall L.↗

Surveillance System and Method having an Adaptive Sequential Probability Fault Detection Test

System and method providing surveillance of an asset such as a process and/or apparatus by providing training and surveillance procedures that numerically fit a probability density function to an observed residual error signal distribution that is correlative to normal asset operation and then utilizes the fitted probability density function in a dynamic statistical hypothesis test for providing improved asset surveillance.

Bickford, Randall L.↗

Automated Monitoring with a BSP Fault-Detection Test

The figure schematically illustrates a method and procedure for automated monitoring of an asset, as well as a hardware- and-software system that implements the method and procedure. As used here, asset could signify an industrial process, power plant, medical instrument, aircraft, or any of a variety of other systems that generate electronic signals (e.g., sensor outputs). In automated monitoring, the signals are digitized and then processed in order to detect faults and otherwise monitor operational status and integrity of the monitored asset. The major distinguishing feature of the present method is that the fault-detection function is implemented by use of a Bayesian sequential probability (BSP) technique. This technique is superior to other techniques for automated monitoring because it affords sensitivity, not only to disturbances in the mean values, but also to very subtle changes in the statistical characteristics (variance, skewness, and bias) of the monitored signals.

Bickford, Randall L.↗

Use of Design of Experiments and Rule-Based Inference in Determining Neural Network Architectures for Loss of Control Detection

In this work, we describe methods for selecting the neural network architectures and input spaces to implement belief state inference on generic commercial transport aircraft. First, we highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). We present a structured method that can be used in a number of aerospace applications, to optimize the structure and training parameters of the CVAE for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from a NASA T-2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications. While theoretically, we could create a single CVAE with an input space the size of all measurable flight variables and environmental dynamics, it becomes intractable to use such a neural network in an in-situ intelligent multi-agent system. Using the recommendations from our case study, we introduce a technical approach for feasibly describing the belief space by (1) identifying significant statistical relationships among flight variables using rule induction, (2) using a set of rules that cover all features to define the input space of multiple CVAEs, and (3) forming a belief space based on the joint probability density of their collective latent spaces. This results in a series of relatively small matrix multiplications that can be performed in real time, as opposed to large matrix computations in a single CVAE. We demonstrate the application of this approach on the T-2 flight loss-of control experiments, using the architecture and hyperparameter recommendations from the case study. We compare the utilities of an individual CVAE trained on all flight variables and multiple CVAEs defined on subsets of flight variables for detecting qualitative changes in flight. We demonstrate that the use of multiple CVAEs with smaller input spaces permits the CVAE to capture more granular relationships in the latent space, permitting better state space characterization and loss-of-control detection.

Design of experiments↗

Discovery of Activities via Statistical Clustering of Fixation Patterns

Human behavior often consists of a series of distinct activities, each characterized by a unique pattern of interaction with the visual environment. This is true even in a restricted domain, such as a pilot flying an airplane; in this case, activities with distinct visual signatures might be things like communicating, navigating, monitoring, etc. We propose a novel analysis method for gaze-tracking data, to perform blind discovery of these hypothetical activities. We compare, not individual fixations, but groups of fixations aggregated over a fixed time interval (Tau). We assume that the environment has been divided into a finite set of discrete areas-of-interest (AOIs). For a given time interval, we compute the proportion of time spent fixating each AOI, resulting in an N-dimensional vector, where N is the number of AOIs. These proportions can be converted to integer counts by multiplying by Tau divided by the average fixation duration, a parameter that we fix at 283 milliseconds. We compare different intervals by computing the chi-squared statistic. The p-value associated with the statistic is the likelihood of observing the data under the hypothesis that the data in the two intervals were generated by a single process with a single set of probabilities governing the fixation of each AOI. We cluster the intervals, first by merging adjacent intervals that are sufficiently similar, optionally shifting the boundary between non-merged intervals to maximize the difference. Then we compare and cluster non-adjacent intervals. The method is evaluated using synthetic data generated by a hand-crafted set of activities. While the method generally finds more activities than put into the simulation, we have obtained agreement as high as 80 percent between the inferred activity labels and ground truth.

Eye Movements↗

Uncertainty Quantification for a Multi-phase Carbon Equation of State Model

Many physics models have tunable parameters that are calibrated by matching the model output to experimental or calculated data. However, given that calibration data often contain uncertainty and that different model parameter sets might result in a very similar simulated output for a finite calibration data set, it is advantageous to provide an ensemble of parameter sets that are consistent with the calibration data. Uncertainty quantification (UQ) provides a means to generate such an ensemble in a statistically rigorous fashion. In this work, we perform UQ for a multi-phase equation of state (EOS) model for carbon containing the diamond, graphite, and liquid phases. We use a Bayesian framework for the UQ and introduce a novel strategy for including phase diagram information in the calibration. The method is highly general and accurately reproduces the calibration data without any material-specific prior knowledge of the EOS model parameters.

36 MATERIALS SCIENCE↗

Spectrum of embrittling potencies and relation to properties of symmetric-tilt grain boundaries

Grain boundaries in metallic materials can exist in a wide range of stable and metastable structures. In addition, the properties of a grain boundary may be altered through solute segregation. In this work, we present a formulation that combines the spectrum of embrittling potencies associated with solute segregation with site-occupancy statistics. As a prototype problem, we illustrate the relation between segregation and embrittlement in the case of S segregation to grain boundaries in Ni. To obtain a population of site segregation energies, we perform molecular statics calculations on 378 different symmetric-tilt grain boundaries and their free surface equivalents, using an embedded-atom method interatomic potential developed specifically for studying embrittlement. Our results show that it is important to consider both the energies associated with embrittlement and the probability of occupancy to describe the general embrittling nature of a grain boundary. When analyzed in isolation, certain grain boundaries show large embrittling potencies; however, that effect is diminished when the probability of S segregation to that grain boundary is considered within a polycrystal. We propose a new quantity, the embrittling estimator, which not only categorizes grain boundaries as embrittling or strengthening, but also considers site occupancy probabilities, so that the embrittlement behavior of grain boundaries within a network of grain boundaries can be compared. Finally, we examine the relationship between embrittlement behavior and innate grain boundary properties, such as the free volume, and find statistical evidence that the complex nature of embrittlement cannot be explained by linear correlations with excess volumes or energies. Ultimately, this combined approach provides a theoretical tool to assist grain boundary engineering of metastable alloys.

36 MATERIALS SCIENCE↗

A probabilistic creep model incorporating test condition, initial damage, and material property uncertainty

Uncertainty is prevalent in the creep resistance of alloys, where at elevated temperature and low pressure, rupture can range across logarithmic decades. In this study, a probabilistic continuum-damage-mechanics (CDM)-based model is derived to capture the uncertainty of creep resistance. To meet this objective, creep data for alloy 304 Stainless Steel is gathered. A constitutive model, “Sinh”, is calibrated deterministically to determine the statistical variability of the material properties. Three sources of uncertainty are injected into the model: test condition (stress and temperature), initial damage, and material properties. Probabilistic simulations are carried out by (a) calibrating probability distribution functions (pdfs) for each source of uncertainty (b) randomly sampling the pdfs using Monte Carlo methods and (c) executing simulations to replicate the uncertain creep behavior. A sensitivity analysis is performed to evaluate the relative effect of each source of uncertainty. In full probabilistic simulations, the cumulative uncertainty of creep behavior is evaluated. The probabilistic model accurately predicts the creep deformation and rupture of the available experiments. The probabilistic model is validated for interpolation but lacks extrapolation ability. Several future works are proposed to further improve the model.

36 MATERIALS SCIENCE↗

Uncertainty Propagation within Chained Models for Machine Learning Reconstruction of Neutrino-LAr Interactions

Sequential or chained models are increasingly prevalent in machine learning for scientific applications, due to their flexibility and ease of development. Chained models are particularly useful when a task is separable into distinct steps with a hierarchy of meaningful intermediate representations. In reliability-critical tasks, it is important to quantify the confidence of model inferences. However, chained models pose an additional challenge for uncertainty quantification, especially when input uncertainties need to be propagated. In such cases, a fully uncertainty-aware chain of models is required, where each step accepts a probability distribution over the input space, and produces a probability distribution over the output space. In this work, we present a case study for adapting a single model within an existing chain, designed for reconstruction within neutrino-Argon interactions, developed for neutrino oscillation experiments such as MicroBooNE, ICARUS, and the future DUNE experiment. We test the performance of an input uncertainty-enabled model against an uncertainty-blinded model using a method for generating synthetic noise. By comparing these two, we assess the increase in inference quality achieved by exposing models to upstream uncertainty estimates.

97 MATHEMATICS AND COMPUTING↗

Λ Baryon Production in ν¯µ Interactions in the MicroBooNE Detector

The Cabibbo suppressed production of $\Lambda$ baryons in anti-neutrino interactions with nuclei is a rare process that is yet to be measured with a modern neutrino detector with automated reconstruction. The cross section for this process is sensitive to a number of unique nuclear effects, most notably the secondary interactions of the produced hyperon while attempting to escape from the nucleus. Other interactions within the nuclear remnant can impact the estimation of neutrino energy in oscillation measurements, and thus an accurate description of the nuclear environment is required. The strangeness violating hyperon production process is only available to anti-neutrinos. The model of this interaction is implemented into the NuWro neutrino interaction Monte Carlo simulation, and some predictions are presented, focusing on the role of nuclear effects. This model introduces a hyperon-nucleus potential, which calculations from hypernuclear theory permit to be strongly repulsive in th e case of $\Sigma$ baryons. The presence of this potential is found to sculpt the shape of the differential cross section in some variables. The MicroBooNE detector will be described, followed by a description of a measurement of the flux averaged, restricted phase space cross section of Cabibbo suppressed $\Lambda$ baryon production. A sophisticated event selection is employed, as a very large quantity of background neutrino interactions must be removed to perform the measurement with any sensitivity. This selection introduces some novel techniques such as the island finding method, and achieves a background reduction of $\sim 10^6$, with an efficiency of around 7\%. The calculation of the systematic uncertainties will be explained, including two procedures explored to handle sources of background with extremely poor simulation statistics: an in-situ constraint using data from sidebands, and a visual inspection of the data and simulation to remove the troublesome background events. The sensitivity to the $\Lambda$ baryon production cross section is calculated in the form of Bayesian posterior probability distributions, combining the systematic uncertainties with data and simulation statistical uncertainties. As a rare process, the statistical uncertainties are highly non-Gaussian, and the Bayesian approach is applied to include the full shapes of these uncertainties. Data corresponding to $2.2 \times 10^{20}$ protons on target of neutrino mode running and $4.9 \times 10^{20}$ protons on target of anti-neutrino running is analysed. When the data was unblinded, five $\Lambda$ production candidates were selected from the data, consistent with the MC simulation prediction of $5.3 \pm 1.1$ events. The final estimated cross section is $1.8^{+2.0}_{-1.6} \times 10^{-40}$cm$^2/$Ar when employing the sideband constraint procedure. A similar result of $2.0^{+2.2}_{-1.8} \times 10^{-40}$cm$^2/$Ar is obtained when performing the visual scan instead. The methods used in t his analysis are intended to be easily exported to other LArTPC detectors such as the Short Baseline Near Detector.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Star formation characteristics of CNN-identified post-mergers in the Ultraviolet Near Infrared Optical Northern Survey (UNIONS)

ABSTRACT The importance of the post-merger epoch in galaxy evolution has been well documented, but post-mergers are notoriously difficult to identify. While the features induced by mergers can sometimes be distinctive, they are frequently missed by visual inspection. In addition, visual classification efforts are highly inefficient because of the inherent rarity of post-mergers (~1 per cent in the low-redshift Universe), and non-parametric statistical merger selection methods do not account for the diversity of post-mergers or the environments in which they appear. To address these issues, we deploy a convolutional neural network (CNN) that has been trained and evaluated on realistic mock observations of simulated galaxies from the IllustrisTNG simulations, to galaxy images from the Canada France Imaging Survey, which is part of the Ultraviolet Near Infrared Optical Northern Survey. We present the characteristics of the galaxies with the highest CNN-predicted post-merger certainties, as well as a visually confirmed subset of 699 post-mergers. We find that post-mergers with high CNN merger probabilities [p(x) > 0.8] have an average star formation rate that is 0.1 dex higher than a mass- and redshift-matched control sample. The SFR enhancement is even greater in the visually confirmed post-merger sample, a factor of 2 higher than the control sample.

79 ASTRONOMY AND ASTROPHYSICS↗