Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty Propagation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗

The role of collisional energy transfer in the thermal and prompt dissociation of 1-methyl allyl

Collisional energy transfer plays a pivotal role in a-priori calculations of the pressure-dependent rate constants obtained from a master equation. However, accurate determinations of collisional energy transfer parameters are rare and so most kinetic studies rely on best-fits of these parameters to experimental measurements (if available) or estimates guided from literature studies. In this work, we have quantified the effect of the uncertainty in energy transfer parameters on the thermal and prompt dissociation kinetics of a resonance stabilized radical, 1-methyl allyl (1MA), of relevance to the combustion of 1- and 2-butene isomers. Simulations using literature kinetics models were performed to assess the impact of these uncertainties on flame propagation and speciation data in laminar flames of 1- and 2-butene. Analyses of the uncertainty propagated by the energy transfer parameters for 1MA dissociation to the flame simulations, in particular the laminar flame speed, indicate an intricate coupling between the kinetics of 1MA dissociation (chain propagation) and its reaction with H-atoms (chain-termination). Ab-initio based theoretical calculations were also performed to obtain pressure-dependent kinetics for the reaction of 1MA with H-atoms. Lastly, theoretically calculated energy transfer parameters were used to best characterize the kinetics and branching between the chain propagating 1MA dissociation and the chain-terminating reaction 1MA + H.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncertainty and Sensitivity Analyses of Duct Propagation Models

This paper presents results of uncertainty and sensitivity analyses conducted to assess the relative merits of three duct propagation codes. Results from this study are intended to support identification of a "working envelope" within which to use the various approaches underlying these propagation codes. This investigation considers a segmented liner configuration that models the NASA Langley Grazing Incidence Tube, for which a large set of measured data was available. For the uncertainty analysis, the selected input parameters (source sound pressure level, average Mach number, liner impedance, exit impedance, static pressure and static temperature) are randomly varied over a range of values. Uncertainty limits (95% confidence levels) are computed for the predicted values from each code, and are compared with the corresponding 95% confidence intervals in the measured data. Generally, the mean values of the predicted attenuation are observed to track the mean values of the measured attenuation quite well and predicted confidence intervals tend to be larger in the presence of mean flow. A two-level, six factor sensitivity study is also conducted in which the six inputs are varied one at a time to assess their effect on the predicted attenuation. As expected, the results demonstrate the liner resistance and reactance to be the most important input parameters. They also indicate the exit impedance is a significant contributor to uncertainty in the predicted attenuation.

Nark, Douglas M.↗

Detecting Trend and Seasonal Changes in Bathymetry Derived from HICO Imagery: A Case Study of Shark Bay, Western Australia

The Hyperspectral Imager for the Coastal Ocean (HICO) aboard the International Space Station has offered for the first time a dedicated space-borne hyperspectral sensor specifically designed for remote sensing of the coastal environment. However, several processing steps are required to convert calibrated top-of-atmosphere radiances to the desired geophysical parameter(s). These steps add various amounts of uncertainty that can cumulatively render the geophysical parameter imprecise and potentially unusable if the objective is to analyze trends and/or seasonal variability. This research presented here has focused on: (1) atmospheric correction of HICO imagery; (2) retrieval of bathymetry using an improved implementation of a shallowwater inversion algorithm; (3) propagation of uncertainty due to environmental noise through the bathymetry retrieval process; (4) issues relating to consistent geo-location of HICO imagery necessary for time series analysis, and; (5) tide height corrections of the retrieved bathymetric dataset. The underlying question of whether a temporal change in depth is detectable above uncertainty is also addressed. To this end, nine HICO images spanning November 2011 to August 2012, over the Shark Bay World Heritage Area, Western Australia, were examined. The results presented indicate that precision of the bathymetric retrievals is dependent on the shallow water inversion algorithm used.Within this study, an average of 70% of pixels for the entire HICO-derived bathymetry dataset achieved a relative uncertainty of less than +/-20%. A per-pixel t-test analysis between derived bathymetry images at successive timestamps revealed observable changes in depth to as lowas 0.4 m. However, the present geolocation accuracy of HICO is relatively poor and needs further improvements before extensive time series analysis can be performed.

Geolocations accuracy↗

A Tutorial on Bayesian analysis of linear shock compression data

Gas gun and other shock compression experiments often produce shock wave velocity measurements that are linearly associated with particle velocity. Traditionally, this empirical relationship is quantified with a single Hugoniot curve that is estimated using least squares regression. However, for downstream modeling and simulation tasks, it is often more useful to have multiple Hugoniot curves in the pressure–volume plane that are consistent with the data. We employ Bayesian uncertainty quantification methods as a framework for propagating measurement uncertainty through to model parameters and predictions. Specifically, this Tutorial shows how to sample multiple Hugoniot curves in the pressure–volume plane that are consistent with the shock wave-particle velocity measurements in a two-step Bayesian approach. First, we obtain an analytical expression for the posterior distribution of the linear model parameters using Bayesian linear regression. Second, we propagate samples from the posterior distribution through the Rankine–Hugoniot equations to yield Hugoniot curves in the pressure–volume plane. The procedure is demonstrated with publicly available data on argon, copper, and nickel, and compared against bootstrapping and linear regression. The Bayesian procedure is shown to be interpretable, computationally inexpensive, and less sensitive than an alternative bootstrapping approach to the removal of the point in the copper dataset that has the largest particle velocity. As a Tutorial on Bayesian methodology for the shock compression community, we provide several derivations and explanations that make this paper self-contained, and make all code and data available at github.com/llnl/BALSCD.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Uncertainty Analysis on Heat Transfer Correlations for RP-1 Fuel in Copper Tubing

NASA is studying kerosene (RP-1) for application in Next Generation Launch Technology (NGLT). Accurate heat transfer correlations in narrow passages at high temperatures and pressures are needed. Hydrocarbon fuels, such as RP-1, produce carbon deposition (coke) along the inside of tube walls when heated to high temperatures. A series of tests to measure the heat transfer using RP-1 fuel and examine the coking were performed in NASA Glenn Research Center's Heated Tube Facility. The facility models regenerative cooling by flowing room temperature RP-1 through resistively heated copper tubing. A Regression analysis is performed on the data to determine the heat transfer correlation for Nusselt number as a function of Reynolds and Prandtl numbers. Each measurement and calculation is analyzed to identify sources of uncertainty, including RP-1 property variations. Monte Carlo simulation is used to determine how each uncertainty source propagates through the regression and an overall uncertainty in predicted heat transfer coefficient. The implications of these uncertainties on engine design and ways to minimize existing uncertainties are discussed.

Driscoll, E. A.↗

Performance and Reliability Optimization for Aerospace Systems subject to Uncertainty and Degradation

This report summarizes work performed by the Space Systems Laboratory (SSL) for NASA Langley Research Center in the field of performance optimization for systems subject to uncertainty. The objective of the research is to develop design methods and tools to the aerospace vehicle design process which take into account lifecycle uncertainties. It recognizes that uncertainty between the predictions of integrated models and data collected from the system in its operational environment is unavoidable. Given the presence of uncertainty, the goal of this work is to develop means of identifying critical sources of uncertainty, and to combine these with the analytical tools used with integrated modeling. In this manner, system uncertainty analysis becomes part of the design process, and can motivate redesign. The specific program objectives were: 1. To incorporate uncertainty modeling, propagation and analysis into the integrated (controls, structures, payloads, disturbances, etc.) design process to derive the error bars associated with performance predictions. 2. To apply modern optimization tools to guide in the expenditure of funds in a way that most cost-effectively improves the lifecycle productivity of the system by enhancing the subsystem reliability and redundancy. The results from the second program objective are described. This report describes the work and results for the first objective: uncertainty modeling, propagation, and synthesis with integrated modeling.

Miller, David W.↗

Driving mode analysis—How uncertain functional inputs propagate to an output

Abstract Driving mode analysis elucidates how correlated features of uncertain functional inputs jointly propagate to produce uncertainty in the output of a computation. Uncertain input functions are decomposed into three terms: the mean functions, a zero‐mean driving mode, and zero‐mean residual. The random driving mode varies along a single direction, having fixed functional shape and random scale. It is uncorrelated with the residual, and under linear error propagation, it produces an output variance equal to that of the full input uncertainty. Finally, the driving mode best represents how input uncertainties propagate to the output because it minimizes expected squared Mahalanobis distance amongst competitors. These characteristics recommend interpretation of the driving mode as the single‐degree‐of‐freedom component of input uncertainty that drives output uncertainty. We derive the functional driving mode, show its superiority to other seemingly sensible definitions, and demonstrate the utility of driving mode analysis in an application. The application is the simulation of neutron transport in criticality experiments. The uncertain input functions are nuclear data that describe how Pu reacts to bombardment by neutrons. Visualization of the driving mode helps scientists understand what aspects of correlated functional uncertainty have effects that either reinforce or cancel one another in propagating to the output of the simulation.

97 MATHEMATICS AND COMPUTING↗

Opinion: The importance of historical and paleoclimate aerosol radiative effects

Abstract. Estimating past aerosol radiative effects and their uncertainties is an important topic in climate science. Aerosol radiative effects propagate into large uncertainties in estimates of how present and future climate evolves with changing greenhouse gas emissions. A deeper understanding of how aerosols affected the atmospheric energy budget under past climates is hindered in part by a lack of relevant paleo-observations and in part because less attention has been paid to the problem. Because of the lack of information we do not seek here to determine the change in the radiative forcing due to aerosol changes but rather to estimate the uncertainties in those changes. Here we argue that current uncertainties from emission uncertainties (90 % confidence interval range spanning 2.8 W m−2) are just as large as model spread uncertainties (2.8 W m−2) in calculating preindustrial to present-day aerosol radiative effects. There are no estimates of radiative forcing for important aerosols such as wildfire and dust aerosols in most paleoclimate time periods. However, qualitative analysis of paleoclimate proxies suggests that changes in aerosols between different past climates are similar in magnitude to changes in aerosols between the preindustrial and present day; plus, there is the added uncertainty from the variability in aerosols and fires in the preindustrial. From the limited literature we crudely estimate a paleoclimate aerosol uncertainty for the Last Glacial Maximum relative to preindustrial of 4.8 W m−2, and we estimate the uncertainty in the aerosol feedback in the natural Earth system over the paleoclimate (Last Glacial Maximum to preindustrial) to be about 3.2 W m−2 K−1. In order to more accurately assess the uncertainty in historical aerosol radiative effects, we propose a new model intercomparison project, which would include multiple plausible emission scenarios tested across a range of state-of-the-art climate models over the historical period. These emission scenarios would then be compared to the available independent aerosol observations to constrain which are most probable. In addition, future efforts should work to characterize and constrain paleo-aerosol forcings and uncertainties. Careful propagation of aerosol uncertainties in the literature is required to ensure an accurate quantification of uncertainties in projections of future climate changes.

Environmental Sciences & Ecology↗

Linear systematics mitigation in galaxy clustering in the Dark Energy Survey Year 1 Data

ABSTRACT We implement a linear model for mitigating the effect of observing conditions and other sources of contamination in galaxy clustering analyses. Our treatment improves upon the fiducial systematics treatment of the Dark Energy Survey (DES) Year 1 (Y1) cosmology analysis in four crucial ways. Specifically, our treatment (1) does not require decisions as to which observable systematics are significant and which are not, allowing for the possibility of multiple maps adding coherently to give rise to significant bias even if no single map leads to a significant bias by itself, (2) characterizes both the statistical and systematic uncertainty in our mitigation procedure, allowing us to propagate said uncertainties into the reported cosmological constraints, (3) explicitly exploits the full spatial structure of the galaxy density field to differentiate between cosmology-sourced and systematics-sourced fluctuations within the galaxy density field, and (4) is fully automated, and can therefore be trivially applied to any data set. The updated correlation function for the DES Y1 redMaGiC catalogue minimally impacts the cosmological posteriors from that analysis. Encouragingly, our analysis does improve the goodness-of-fit statistic of the DES Y1 3 × 2pt data set (Δχ2 = −6.5 with no additional parameters). This improvement is due in nearly equal parts to both the change in the correlation function and the added statistical and systematic uncertainties associated with our method. We expect the difference in mitigation techniques to become more important in future work as the size of cosmological data sets grows.

79 ASTRONOMY AND ASTROPHYSICS↗

Methods for evaluating the predictive accuracy of structural dynamic models

Modeling uncertainty is defined in terms of the difference between predicted and measured eigenvalues and eigenvectors. Data compiled from 22 sets of analysis/test results was used to create statistical databases for large truss-type space structures and both pretest and posttest models of conventional satellite-type space structures. Modeling uncertainty is propagated through the model to produce intervals of uncertainty on frequency response functions, both amplitude and phase. This methodology was used successfully to evaluate the predictive accuracy of several structures, including the NASA CSI Evolutionary Structure tested at Langley Research Center. Test measurements for this structure were within + one-sigma intervals of predicted accuracy for the most part, demonstrating the validity of the methodology and computer code.

Hasselman, Timothy K.↗

On the quantification and efficient propagation of imprecise probabilities with copula dependence

This paper addresses the problem of quantification and propagation of uncertainties associated with dependence modeling when data for characterizing probability models are limited. Practically, the system inputs are often assumed to be mutually independent or correlated by a multivariate Gaussian distribution. However, this subjective assumption may introduce bias in the response estimate if the real dependence structure deviates from this assumption. In this work, we overcome this limitation by introducing a flexible copula dependence model to capture complex dependencies. Here, a hierarchical Bayesian multimodel approach is proposed to quantify uncertainty in dependence model-form and model parameters that result from small data sets. This approach begins by identifying, through Bayesian multimodel inference, a set of candidate marginal models and their corresponding model probabilities, and then estimating the uncertainty in the copula-based dependence structure, which is conditional on the marginals and their parameters. The overall uncertainties integrating marginals and copulas are probabilistically represented by an ensemble of multivariate candidate densities. A novel importance sampling reweighting approach is proposed to efficiently propagate the overall uncertainties through a computational model. Through an example studying the influence of constituent properties on the out-of-plane properties of transversely isotropic E-glass fiber composites, we show that the composite property with copula-based dependence model converges to the true estimate as data set size increases, while an independence or arbitrary Gaussian correlation assumption leads to a biased estimate.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Non-Thermal Hard X-Ray Emission in Galaxy Clusters Observed with the BeppoSAX PDS

We studied the X-ray emission in a sample of clusters using the BeppoSAX PDS instrument in the 20 -- 80 keV energy band. We estimated the non-thermal cluster emission (HXR) by modeling the thermal contribution from the cluster gas and the non-thermal contamination from the AGN in the field, and propagating the corresponding uncertainties. We also evaluated and propagated the systematic uncertainties due to the background fluctuations. The resulting non-thermal component is detected at a sigma level in approx. 50 % of the non-significantly AGN-contaminated clusters, i.e. in clusters A2142, A2256, A3376, Coma, Ophiuchus and Virgo. Furthermore, Virgo is detected at a 4 sigma level. All the clusters detected at a 2 sigma level exhibit some degree of merger signatures, i.e. deviations from the azimuthally symmetric brightness and temperature distributions, while the relaxed clusters are detected at a lower confidence. The data are consistent with a scenario whereby relaxed clusters have no non-thermal hard X-ray component, whereas merger clusters do, with a 20 -- 80 keV luminosity of approx. 10(exp 42-44)((h(sub 50))(exp -2))(erg/s). Consistent with merger boosting of cluster temperatures, the non-thermal luminosity increases by 2-3 orders of magnitude between the average cluster temperatures 2 and 10 keV, as L(sub NTE) is proportional to T(sup j) with j = 2.4+/-0.3. These results corroborate the assumption which is the essential element in most non-thermal hard X-ray emission models. The co-added spectrum of all non-significantly AGN-contaminated clusters indicates a power-law spectrum for the non-thermal component with a photon index of 1.5+/-0.25 at 1 sigma confidence level. Unless there is a high energy cut-off in the electron velocity distribution, the total spectrum implies that Inverse Compton scatter of Cosmic Microwave Background photons from electron population dominates over the non-thermal bremsstrahlung in producing hard X-rays in clusters on the merger shock acceleration of electrons in clusters.

Nevalainen, Jukka H.↗

Deducing neutron star equation of state parameters directly from telescope spectra with uncertainty-aware machine learning

Neutron stars provide a unique laboratory for studying matter at extreme pressures and densities. While there is no direct way to explore their interior structure, X-rays emitted from these stars can indirectly provide clues to the equation of state (EOS) of the superdense nuclear matter through the inference of the star's mass and radius. However, inference of EOS directly from a star's X-ray spectra is extremely challenging and is complicated by systematic uncertainties. The current state of the art is to use simulation-based likelihoods in a piece-wise method which relies on certain theoretical assumptions and simplifications about the uncertainties. It first infers the star's mass and radius to reduce the dimensionality of the problem, and from those quantities infer the EOS. Here we demonstrate a series of enhancements to the state of the art, in terms of realistic uncertainty quantification and a path towards circumventing the need for theoretical assumptions to infer physical properties with machine learning. We also demonstrate novel inference of the EOS directly from the high-dimensional spectra of observed stars, avoiding the intermediate mass-radius step. Our network is conditioned on the sources of uncertainty of each star, allowing for natural and complete propagation of uncertainties to the EOS.

79 ASTRONOMY AND ASTROPHYSICS↗

Sources of Uncertainty in the Prediction of LAI / fPAR from MODIS

To explicate the sources of uncertainty in the prediction of biophysical variables over space, consider the general equation: where z is a variable with values on some nominal, ordinal, interval or ratio scale; y is a vector of input variables; u is the spatial support of y and z ; x and u are the spatial locations of y and z , respectively; f is a model and B is the vector of the parameters of this model. Any y or z has a value and a spatial extent which is called its support. Viewed in this way, categories of uncertainty are from variable (e.g. measurement), parameter, positional. support and model (e.g. structural) sources. The prediction of Leaf Area Index (LAI) and the fraction of absorbed photosynthetically active radiation (fPAR) are examples of z variables predicted using model(s) as a function of y variables and spatially constant parameters. The MOD15 algorithm is an example of f, called f(sub 1), with parameters including those defined by one of six biome types and solar and view angles. The Leaf Canopy Model (LCM)2, a nested model that combines leaf radiative transfer with a full canopy reflectance model through the phase function, is a simpler though similar radiative transfer approach to f(sub 1). In a previous study, MOD15 and LCM2 gave similar results for the broadleaf forest biome. Differences between these two models can be used to consider the structural uncertainty in prediction results. In an effort to quantify each of the five sources of uncertainty and rank their relative importance for the LAI/fPAR prediction problem, we used recent data for an EOS Core Validation Site in the broadleaf biome with coincident surface reflectance, vegetation index, fPAR and LAI products from the Moderate Resolution Imaging Spectrometer (MODIS). Uncertainty due to support on the input reflectance variable was characterized using Landsat ETM+ data. Input uncertainties were propagated through the LCM2 model and compared with published uncertainties from the MOD15 algorithm.

Dungan, Jennifer L.↗