Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “analysis and statistical methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Estimation of process steady state with autoregressive models and Bayesian inference

To improve efficiency, separations engineers will typically design process circuits containing recirculating streams, which mix one or more of the process outputs with the feed material. Doing so can improve efficiency, but will cause a delay in the system reaching steady state conditions until the recirculating load mass flows stabilize. In testing separation circuits, engineers will often test a variety of factors and complete an analysis from sample results. Knowledge of if a process is at steady state, as well as the steady state conditions of a process, is essential for a valid techno-economic analysis. However, the definition of process steady state is often poorly defined, or does not include uncertainty quantification. If the performance of a process operating under two different sets of conditions are compared, an engineer who does not test for steady state or quantify steady state conditions risks producing a faulty analysis. In this work, a Bayesian statistical method for testing if all streams are at steady state is further motivated and then derived. Then after testing for steady state, the same model is used with a prior distribution that enforces a steady state assumption to estimate steady state conditions. Further, these methods were validated in a solvent extraction pilot plant where steady state conditions for all outflows were inferred with uncertainty quantification. Analysis is completed with functions available to the reader as part of the BayesMassBal (V 1.1.0) software package written in R.

01 COAL, LIGNITE, AND PEAT↗

Linear statistical analysis of maneuver optimization techniques

It is shown how a method for maneuver design during the Jovian satellite tour phase of the Galileo mission requires a full-scale redesign of the tour at each maneuver. Software was developed to provide insight into the statistical properties of this process; it is based on the use of linear perturbations to provide trajectory propagation and a least squares representation of the optimization. The result is a Monte Carlo program, making it possible to evaluate the proposed strategy.

Maize, Earl H.↗

Experiences using DAKOTA stochastic expansion methods in computational simulations

Uncertainty quantification (UQ) methods bring rigorous statistical connections to the analysis of computational and experiment data, and provide a basis for probabilistically assessing margins associated with safety and reliability. The DAKOTA toolkit developed at Sandia National Laboratories implements a number of UQ methods, which are being increasingly adopted by modeling and simulation teams to facilitate these analyses. This report disseminates results as to the performance of DAKOTA's stochastic expansion methods for UQ on a representative application. Our results provide a number of insights that may be of interest to future users of these methods, including the behavior of the methods in estimating responses at varying probability levels, and the expansion levels for the methodologies that may be needed to achieve convergence.

99 GENERAL AND MISCELLANEOUS↗

Scaled Vecchia Approximation for Fast Computer-Model Emulation

Many scientific phenomena are studied using computer experiments consisting of multiple runs of a computer model while varying the input settings. Gaussian processes (GPs) are a popular tool for the analysis of computer experiments, enabling interpolation between input settings, but direct GP inference is computationally infeasible for large datasets. We adapt and extend a powerful class of GP methods from spatial statistics to enable the scalable analysis and emulation of large computer experiments. Specifically, we apply Vecchia’s ordered conditional approximation in a transformed input space, with each input scaled according to how strongly it relates to the computer-model response. The scaling is learned from the data by estimating parameters in the GP covariance function using Fisher scoring. Our methods are highly scalable, enabling estimation, joint prediction, and simulation in near-linear time in the number of model runs. In several numerical examples, our approach substantially outperformed existing methods.

97 MATHEMATICS AND COMPUTING↗

Advanced Statistical Methods in Spacecraft Flight Software Cost Estimation: Bayesian Regression and Nonlinear Principal Components Analysis to Support System Engineering in the Early Project Lifecycle

This paper provides an overview of the new features and model updates in the upcoming release of the NASA Analogy Software Cost Tool (ASCoT). ASCoT, hosted within the Online NASA Space Estimation Tools (ONSET) on the One NASA Cost Engineering (ONCE) Database, is a web-based tool that provides a suite of estimation tools to support early lifecycle NASA flight software cost analysis. In addition to the traditional parametric flight software costing method COCOMO II, ASCoT contains a Bayesian linear regression to predict total flight software development cost as a function of total spacecraft cost, as well as four analogic methods: k-Nearest Neighbors (kNN) and Clustering models to predict Effort (in work-months) and total source lines of code (SLOC). These methods are designed to work primarily with system-level inputs such as mission type (orbiter, lander, etc.), mission destination (Earth, Inner Planetary, etc.), and the number of instruments and deployables. Nonlinear principal components analysis (NLPCA) is performed to find the principal features of the data composed of both categorical and numerical variables and is necessary prior to defining our analogic methods. Sensitivity analyses and in- and out-of-sample model performance results are presented for the Bayesian CER and the analogic models.

Johnson, James K.↗

An introduction to the significance of sample size in particle analyses for nuclear forensics and radiological investigations

Particulate isotopic analysis in nuclear forensics has developed rapidly during the past two decades due to technical advances in determining the isotopic composition of individual particles. This paper introduces basic statistical concepts that can be applied by analysts to understand the importance of statistical adequacy when interpretating particle data. While these basic statistical methods provide a useful point-of-entry to particle data analysis, more sophisticated statistical and modeling approaches are needed to extract maximal information from such datasets in the future.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Photometric redshift uncertainties in weak gravitational lensing shear analysis: models and marginalization

ABSTRACT Recovering credible cosmological parameter constraints in a weak lensing shear analysis requires an accurate model that can be used to marginalize over nuisance parameters describing potential sources of systematic uncertainty, such as the uncertainties on the sample redshift distribution n(z). Due to the challenge of running Markov chain Monte Carlo (MCMC) in the high-dimensional parameter spaces in which the n(z) uncertainties may be parametrized, it is common practice to simplify the n(z) parametrization or combine MCMC chains that each have a fixed n(z) resampled from the n(z) uncertainties. In this work, we propose a statistically principled Bayesian resampling approach for marginalizing over the n(z) uncertainty using multiple MCMC chains. We self-consistently compare the new method to existing ones from the literature in the context of a forecasted cosmic shear analysis for the HSC three-year shape catalogue, and find that these methods recover statistically consistent error bars for the cosmological parameter constraints for predicted HSC three-year analysis, implying that using the most computationally efficient of the approaches is appropriate. However, we find that for data sets with the constraining power of the full HSC survey data set (and, by implication, those upcoming surveys with even tighter constraints), the choice of method for marginalizing over n(z) uncertainty among the several methods from the literature may modify the 1σ uncertainties on Ωm–S8 constraints by ∼4 per cent, and a careful model selection is needed to ensure credible parameter intervals.

Zhang, Tianqing (ORCID:000000025596198X)↗

Bayesian analysis of the flutter margin method in aeroelasticity

A Bayesian statistical framework is presented for Zimmerman and Weissenburger flutter margin method which considers the uncertainties in aeroelastic modal parameters. The proposed methodology overcomes the limitations of the previously developed least-square based estimation technique which relies on the Gaussian approximation of the flutter margin probability density function (pdf). Using the measured free-decay responses at subcritical (preflutter) airspeeds, the joint non-Gaussain posterior pdf of the modal parameters is sampled using the Metropolis–Hastings (MH) Markov chain Monte Carlo (MCMC) algorithm. The posterior MCMC samples of the modal parameters are then used to obtain the flutter margin pdfs and finally the flutter speed pdf. The usefulness of the Bayesian flutter margin method is demonstrated using synthetic data generated from a two-degree-of-freedom pitch-plunge aeroelastic model. The robustness of the statistical framework is demonstrated using different sets of measurement data. In conclusion, it will be shown that the probabilistic (Bayesian) approach reduces the number of test points required in providing a flutter speed estimate for a given accuracy and precision.

97 MATHEMATICS AND COMPUTING↗

SU-E-T-603: Analysis of Optical Tracked Head Inter-Fraction Movements Within Masks to Access Intracranial Immobilization Techniques in Proton Therapy

Purpose: We present a quantitative methodology utilizing an optical tracking system for monitoring head inter-fraction movements within brain masks to assess the effectiveness of two intracranial immobilization techniques. Methods and Materials: A 3-point-tracking method was developed to measure the mask location for a treatment field at each fraction. Measured displacement of mask location to its location at first fraction is equivalent to the head movement within the mask. Head movements for each of treatment fields were measured over about 10 fractions at each patient for seven patients; five treated in supine and two treated in prone. The Q-fix Base-of-Skull head frame was used in supine while the CIVCO uni-frame baseplate was used in prone. Displacements of recoded couch position of each field post imaging at each fraction were extracted for those seven patients. Standard deviation (S.D.) of head movements and couch displacements was scored for statistical analysis. Results: The accuracy of 3PtTrack method was within 1.0 mm by phantom measurements. Patterns of head movement and couch displacement were similar for patients treated in either supine or prone. In superior-inferior direction, mean value of scored standard deviations over seven patients were 1.6 mm and 3.4 mm for the head movement and the couch displacement, respectively. The result indicated that the head movement combined with a loose fixation between the mask-to-head frame results large couch displacements for each patient, and also large variation between patients. However, the head movement is the main cause for the couch displacement with similar magnitude of around 1.0 mm in anterior-posterior and lateral directions. Conclusions: Optical-tracking methodology independently quantifying head movements could improve immobilization devices by correctly acting on causes for head motions within mask. A confidence in the quality of intracranial immobilization techniques could be more efficient by eliminating the need for frequent imaging.

60 APPLIED LIFE SCIENCES↗

An Analysis Methodology for the Gamma-ray Large Area Space Telescope

The Large Area Telescope (LAT) instrument on the Gamma Ray Large Area Space Telescope (GLAST) has been designed to detect high-energy gamma rays and determine their direction of incidence and energy. We propose a reconstruction algorithm based on recent advances in statistical methodology. This method, alternative to the standard event analysis inherited from high energy collider physics experiments, incorporates more accurately the physical processes occurring in the detector, and makes full use of the statistical information available. It could thus provide a better estimate of the direction and energy of the primary photon.

Morris, Robin D.↗

Uncertainty quantification for nuclear density functional theory and information content of new measurements

Statistical tools of uncertainty quantification can be used to assess the information content of measured observables with respect to present-day theoretical models, to estimate model errors and thereby improve predictive capability, to extrapolate beyond the regions reached by experiment, and to provide meaningful input to applications and planned measurements. To showcase new opportunities offered by such tools, we make a rigorous analysis of theoretical statistical uncertainties in nuclear density functional theory using Bayesian inference methods. By considering the recent mass measurements from the Canadian Penning Trap at Argonne National Laboratory, we demonstrate how the Bayesian analysis and a direct least-squares optimization, combined with high-performance computing, can be used to assess the information content of the new data with respect to a model based on the Skyrme energy density functional approach. Employing the posterior probability distribution computed with a Gaussian process emulator, we apply the Bayesian framework to propagate theoretical statistical uncertainties in predictions of nuclear masses, two-neutron dripline, and fission barriers. Overall, we find that the new mass measurements do not impose a constraint that is strong enough to lead to significant changes in the model parameters. In addition, the example discussed in this study sets the stage for quantifying and maximizing the impact of new measurements with respect to current modeling and guiding future experimental efforts, thus enhancing the experiment-theory cycle in the scientific method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Estimating maximum instantaneous distortion from inlet total pressure rms and PSD measurements

An inexpensive method is developed to determine the extreme values of instantaneous inlet distortion. This method also provides insight into the basic mechanics of unsteady inlet flow and the associated engine reaction. The analysis is based on fundamental fluid dynamics and statistical methods to provide an understanding of the turbulent inlet flow and quantitatively relate the rms level and power spectral density (PSD) function of the measured time variant total pressure fluctuations to the strength and size of the low pressure regions. The most probable extreme value of the instantaneous distortion is then synthesized from this information in conjunction with the steady state distortion. Results of the analysis show the extreme values to be dependent upon the steady state distortion, the measured turbulence rms level and PSD function, the time on point, and the engine response characteristics. Analytical projections of instantaneous distortion are presented and compared with data obtained by a conventional, highly time correlated, 40 probe instantaneous pressure measurement system.

Melick, H. C., Jr.↗

Self-calibrating the look-elsewhere effect: fast evaluation of the statistical significance using peak heights

In experiments where one searches a large parameter space for an anomaly, one often finds many spurious noise-induced peaks in the likelihood. This is known as the look-elsewhere effect, and must be corrected for when performing statistical analysis. Here, this paper introduces a method to calibrate the false alarm probability (FAP), or p-value, for a given dataset by considering the heights of the highest peaks in the likelihood. Specifically, we derive an equation relating the global p-value to the rank and height of local maxima. In the simplest form of self-calibration, the look-elsewhere-corrected $\chi^2$ of a physical peak is approximated by the $\chi^2$ of the peak minus the $\chi^2$ of the highest noise-induced peak, with accuracy improved by considering lower peaks. In contrast to alternative methods, this approach has negligible computational cost as peaks in the likelihood are a byproduct of every peak-search analysis. We apply to examples from astronomy, including planet detection, periodograms, and cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗

Rapid acquisition of data dense solid-state CPMG NMR spectral sets using multi-dimensional statistical analysis

The development of multi-dimensional statistical methods has been demonstrated on variable contact time (VCT) 29 Si{ 1 H} cross-polarization magic angle spinning (CP/MAS) data sets collected using Carr–Purcell–Meiboom–Gill (CPMG) type acquisition. These methods utilize the transformation of the collected 2D VCT data set into a 3D data set and use tensor-rank decomposition to extract the spectral components that vary as a function of transverse relaxation time ( T 2 ) and CP contact time. The result is a data dense spectral set that can be used to reconstruct CP/MAS spectra at any contact time with a high signal to noise ratio and with an excellent agreement to 29 Si{ 1 H} CP/MAS spectra collected using conventional acquisition. These CPMG data can be collected in a fraction of time that would be required to collect a conventional VCT data set. Here, we demonstrate the method on samples of functionalized mesoporous silica materials and show that the method can provide valuable surface specific information about their functional chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

On Evaluating Cycling and Movement of Conventional Generators for Balancing Services with Large Solar Penetration

Abstract— The increasing uncertainty caused by a higher penetration level of renewable energy points to the need for sufficient balancing services to ensure secure operation. It is thus of necessity to accurately quantify these services and evaluate the cycling and movement of conventional generators providing load following and regulation services for optimally planning and scheduling multiple resources. This paper first introduces a systematic approach to calculating load following and regulation requirements with a large amount of solar integration. Then, two methods to quantitatively determine the cycling of conventional generators are proposed, including (1) mileage and number of direction changes in balancing service and (2) ramp statistics (or half-cycle) analysis. The proposed methods are tested on the NV Energy power system model. Simulation results demonstrate a significant impact of increased solar capacity on balancing service and cycling of conventional generators. Busy hours are identified for different study scenarios with various solar penetration levels. This study provides a basis for evaluating the wear and tear of the conventional generators in the solar integration process in the Nevada power system. Index Terms—balancing requirement, conventional generator, cycling and movement, load following, regulation, renewable energy, solar integration

ok↗

Disaggregating measurement uncertainty from population variability and Bayesian treatment of uncensored results

In making low-level radioactivity measurements of populations, it is commonly observed that a substantial portion of net results are negative. Furthermore, the observed variance of the measurement results arises from a combination of measurement uncertainty and population variability. This paper presents a method for disaggregating measurement uncertainty from population variability to produce a probability density function (PDF) of possibly true results. To do this, simple, justifiable, and reasonable assumptions are made about the relationship of the measurements to the measurands (the 'true values'). The measurements are assumed to be unbiased, that is, that their average value is the average of the measurands. Using traditional estimates of each measurement's uncertainty to disaggregate population variability from measurement uncertainty, a PDF of measurands for the population is produced. Then, using Bayes's theorem, the same assumptions, and all the data from the population of individuals, a prior PDF is computed for each individual's measurand. These PDFs are non-negative, and their average is equal to the average of the measurement results for the population. The uncertainty in these Bayesian posterior PDFs is all Berkson with no remaining classical component. The methods are applied to baseline bioassay data from the Hanford site. The data include 90Sr urinalysis measurements on 128 people, 137Cs in vivo measurements on 5,337 people, and 239Pu urinalysis measurements on 3,270 people. The method produces excellent results for the 90Sr and 137Cs measurements, since there are nonzero concentrations of these global fallout radionuclides in people who have not been occupationally exposed. The method does not work for the 239Pu measurements in non-occupationally exposed people because the population average is essentially zero.

61 RADIATION PROTECTION AND DOSIMETRY↗

Quantifying Safety Margin Using the Risk-Informed Safety Margin Characterization (RISMC)

The Risk-Informed Safety Margin Characterization (RISMC), developed by Idaho National Laboratory as part of the Light-Water Reactor Sustainability Project, utilizes a probabilistic safety margin comparison between a load and capacity distribution, rather than a deterministic comparison between two values, as is usually done in best-estimate plus uncertainty analyses. The goal is to determine the failure probability, or in other words, the probability of the system load equaling or exceeding the system capacity. While this method has been used in pilot studies, there has been little work conducted investigating the statistical significance of the resulting failure probability. In particular, it is difficult to determine how many simulations are necessary to properly characterize the failure probability. This work uses classical (frequentist) statistics and confidence intervals to examine the impact in statistical accuracy when the number of simulations is varied. Two methods are proposed to establish confidence intervals related to the failure probability established using a RISMC analysis. The confidence interval provides information about the statistical accuracy of the method utilized to explore the uncertainty space, and offers a quantitative method to gauge the increase in statistical accuracy due to performing additional simulations.

Grabaskas, David↗