SEARCH · Engineering Papers

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Statistical Uncertainty in Paleoclimate Proxy Reconstructions

A quantitative analysis of any environment older than the instrumental record relies on proxies. Uncertainties associated with proxy reconstructions are often underestimated, which can lead to artificial conflict between different proxies, and between data and models. In this paper, using ordinary least squares linear regression as a common example, we describe a simple, robust and generalizable method for quantifying uncertainty in proxy reconstructions. We highlight the primary controls on the magnitude of uncertainty, and compare this simple estimate to equivalent estimates from Bayesian, nonparametric and fiducial statistical frameworks. We discuss when it may be possible to reduce uncertainties, and conclude that the unexplained variance in the calibration must always feature in the uncertainty in the reconstruction. This directs future research toward explaining as much of the variance in the calibration data as possible. We also advocate for a “data-forward” approach, that clearly decouples the presentation of proxy data from plausible environmental inferences.

58 GEOSCIENCES↗

DOE OSTI2021

Sequential Learning of Active Subspaces

This study shows that in recent years, active subspace methods (ASMs) have become a popular means of performing subspace sensitivity analysis on black-box functions. Naively applied, however, ASMs require gradient evaluations of the target function. In the event of noisy, expensive, or stochastic simulators, evaluating gradients via finite differencing may be infeasible. In such cases, often a surrogate model is employed, on which finite differencing is performed. When the surrogate model is a Gaussian process (GP), we show that the ASM estimator is available in closed form, rendering the finite-difference approximation unnecessary. We use our closed-form solution to develop acquisition functions focused on sequential learning tailored to sensitivity analysis on top of ASMs. We also show that the traditional ASM estimator may be viewed as a method of moments estimator for a certain class of GPs. We demonstrate how uncertainty on GP hyperparameters may be propagated to uncertainty on the sensitivity analysis, allowing model-based confidence intervals on the active subspace. Our methodological developments are illustrated on several examples.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1998

On the Numerical Formulation of Parametric Linear Fractional Transformation (LFT) Uncertainty Models for Multivariate Matrix Polynomial Problems

Robust control system analysis and design is based on an uncertainty description, called a linear fractional transformation (LFT), which separates the uncertain (or varying) part of the system from the nominal system. These models are also useful in the design of gain-scheduled control systems based on Linear Parameter Varying (LPV) methods. Low-order LFT models are difficult to form for problems involving nonlinear parameter variations. This paper presents a numerical computational method for constructing and LFT model for a given LPV model. The method is developed for multivariate polynomial problems, and uses simple matrix computations to obtain an exact low-order LFT representation of the given LPV system without the use of model reduction. Although the method is developed for multivariate polynomial problems, multivariate rational problems can also be solved using this method by reformulating the rational problem into a polynomial form.

Belcastro, Christine M.↗

NASA NTRS2005

Performance of a Checkerboard Liner With Uncertain Impedances

The current fleet of large commercial aircraft has successfully achieved FAA noise certifications because of, in part, the successful application of uniform passive duct liner treatments to control engine system noise. One goal of NASA's engine system noise reduction program is to develop technologies to improve the sound absorbing properties of duct liner treatments so that they remain effective in modern turbo fan engines. One such technology being studied is checkerboard or periodic axially and circumferentially segmented liners. A preliminary assessment of the potential of this technology was conducted by applying uncertainties associated with manufacturing, installation, source structure, and tonal frequency to a liner developed using deterministic design methods and generating a measure of improvement with respect to a uniform liner subjected to the same uncertainties. Deterministic design and analysis of the candidate checkerboard liner showed that it obtains a 1.5 dB per duct aspect ratio improvement in liner attenuation over a similarly designed uniform liner. When uncertainties in liner impedances, source structure, and frequency are considered, the performance of the checkerboard liner drops off dramatically. The final results of this paper show that the candidate checkerboard liner has a less than 25 percent chance of outperforming the uniform liner when moderate levels of uncertainty are considered. It is important to note that this study did not include the effects of mean flow on liner performance and, more important to note, that as a gradient based optimization process was used to design the checkerboard liner, it is almost certain that a global optimal design was not found for the candidate checkerboard liner. Had it been possible to find a better deterministically performing checkerboard liner, the probability that this candidate liner would outperform the uniform liner would certainly have been higher.

Robinson, J. H.↗

NASA NTRS2010

Multiple Velocity Profile Measurements in Hypersonic Flows using Sequentially-Imaged Fluorescence Tagging

Nitric-oxide planar laser-induced fluorescence (NO PLIF) was used to perform velocity measurements in hypersonic flows by generating multiple tagged lines which fluoresce as they convect downstream. For each laser pulse, a single interline, progressive scan intensified CCD camera was used to obtain separate images of the initial undelayed and delayed NO molecules that had been tagged by the laser. The CCD configuration allowed for sub-microsecond acquisition of both images, resulting in sub-microsecond temporal resolution as well as sub-mm spatial resolution (0.5-mm x 0.7-mm). Determination of axial velocity was made by application of a cross-correlation analysis of the horizontal shift of individual tagged lines. Quantification of systematic errors, the contribution of gating/exposure duration errors, and influence of collision rate on fluorescence to temporal uncertainty were made. Quantification of the spatial uncertainty depended upon the analysis technique and signal-to-noise of the acquired profiles. This investigation focused on two hypersonic flow experiments: (1) a reaction control system (RCS) jet on an Orion Crew Exploration Vehicle (CEV) wind tunnel model and (2) a 10-degree half-angle wedge containing a 2-mm tall, 4-mm wide cylindrical boundary layer trip. The experiments were performed at the NASA Langley Research Center's 31-inch Mach 10 wind tunnel.

Bathel, Brett F.↗

NASA NTRS2004

Uncertainty-Based Approach for Dynamic Aerodynamic Data Acquisition and Analysis

Development of improved modeling methods to provide increased fidelity of flight predictions for aircraft motions during flight in flow regimes with large nonlinearities requires improvements in test techniques for measuring and characterizing wind tunnel data. This paper presents a method for providing a measure of data integrity for static and forced oscillation test techniques. Data integrity is particularly important when attempting to accurately model and predict flight of today s high performance aircraft which are operating in expanded flight envelopes, often maneuvering at high angular rates at high angles-of-attack, even above maximum lift. Current aerodynamic models are inadequate in predicting flight characteristics in the expanded envelope, such as rapid aircraft departures and other unusual motions. Present wind tunnel test methods do not factor changes of flow physics into data acquisition schemes, so in many cases data are obtained over more iterations than required, or insufficient data may be obtained to determine a valid estimate with statistical significance. Additionally, forced oscillation test techniques, one of the primary tools used to develop dynamic models, do not currently provide estimates of the uncertainty of the results during an oscillation cycle. A method to optimize the required number of forced oscillation cycles based on decay of uncertainty gradients and balance tolerances is also presented.

Heim, Eugene H. D.↗

DOE OSTI2026

Toward the Neutrino Discovery Platform: An Auditable, Uncertainty-Bearing Toolchain for MINERvA Open-Data Cross-Section Analysis

The Neutrino Discovery Platform (NDP) aims to accelerate DUNE-era science by making the neutrino program's existing datasets analyzable through fast, reproducible, and auditable workflows. We report a working version of two of its layers, data curation and agentic orchestration, built and tested end to end on MINERvA open data. The guiding lesson throughout is that a cross section is a measurement, and not just a plotted shape, only if it carries a defensible systematic-uncertainty budget, a trustworthy unfolding, and a reproducible record. Using a single medium-energy playlist pair from the MINERvA open-data release (about $2.05\times10^{17}$ protons on target of data), we first reproduced the shapes of two published charged-current inclusive $\nu_\mu$ measurements through a complete extraction ladder: selection, background subtraction, D'Agostini unfolding, efficiency correction, and flux normalization. These shape-level reproductions ran and tracked the published results, but they lacked the systematic-uncertainty machinery that defines a MINERvA cross section. To supply it, we vendored and built the MINERvA Analysis Toolkit and developed a many-universe systematic-uncertainty tool that produces a portable covariance artifact, a parallel event-loop runner, and a per-run auditability harness. Validated against a published covariance release, the toolchain reproduces the released statistical, flux, and muon-energy-scale terms and shows that they account for roughly 63\% of the total variance, with the remainder unreleased. Using this same infrastructure, we then performed a measurement of our own design, the hadronic recoil-energy distribution of low-energy ($E_\nu<2.5$~GeV) charged-current inclusive events, and found data/simulation shape agreement of $\chi^2/\mathrm{ndf}=1.26$. Together these results show that the platform supports original physics and not only reproductions.

Breaux, Auto [Tulane U. (main)]↗

NASA NTRS2006

Crash Certification by Analysis - Are We There Yet?

This paper addresses the issue of crash certification by analysis. This broad topic encompasses many ancillary issues including model validation procedures, uncertainty in test data and analysis models, probabilistic techniques for test-analysis correlation, verification of the mathematical formulation, and establishment of appropriate qualification requirements. This paper will focus on certification requirements for crashworthiness of military helicopters; capabilities of the current analysis codes used for crash modeling and simulation, including some examples of simulations from the literature to illustrate the current approach to model validation; and future directions needed to achieve "crash certification by analysis."

Jackson, Karen E.↗

DOE OSTI2022

Uncertainty in Atlantic Multidecadal Oscillation derived from different observed datasets and their possible causes

As a leading mode of sea surface temperature (SST) variability over the North Atlantic in both observations and model simulations, the Atlantic Multidecadal Oscillation (AMO) can have a substantial influence on regional and global climate. By using Low-Frequency Component Analysis, we explore the uncertainties of the resulting AMO indices and the corresponding spatial patterns derived from three observational SST datasets. We found that the known coherent spatial pattern of the AMO at the basin scale over the North Atlantic appears in two out of the three datasets. Further analysis indicates that both the warming trend and the different techniques used to construct these observed gridded SSTs contribute to the AMO’s spatial coherence over the North Atlantic, especially during periods of sparse data sampling. The SST in the Extended Reconstructed SST dataset version 5 (ERSSTv5), changes from being systematically below the other datasets during the dense sampling periods on either side of the Second World War (WWII), to systematically above the other datasets during WWII, thereby introducing an artificial 10–20-year variability that affects the AMO’s spatial coherence. This coherence in the AMO’s spatial pattern is also affected by bias adjustment in ERSSTv5 at relative cool (i.e., non-summer) seasons, and by the heterogeneous North Atlantic warming pattern. The different AMO patterns can induce the different effects of wind, surface heat fluxes, and then drive ocean circulation and its heat transport convergence, especially for some seasons. For AMO indices, both the different detrending methods and different observational data result in uncertainty for the period 1935–1950. Such SST uncertainty is important to detect the relative role of the atmosphere and ocean in shaping the AMO.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2019

Statistical optical link budget analysis

In this paper, we describe work on extending statistical analysis methods to optical communications links, with a primary focus on intensity modulated, direct detected photon-counting channel utilizing pulse-position-modulation (PPM). We performed analysis on the relationship between bit error rate (BER) requirement, statistical characteristics of the received signal power and noise power, and the coded performance curves. We presented link analysis results with preliminary uncertainty quantifications of signal power and noise power. We used the Consultative Committee for Space Data Systems (CCSDS) Serially Concatenated convolutionally coded Pulse Position Modulation (SCPPM) prototype software [1] to obtain coded performance curves under different operating conditions with varying signal power, background noise power, code rates,and PPM modulation orders. Comparison with traditional, deterministic analysis shows that extra margin needs to be reserved to compensate for the performance losses caused by uncertainties of the link parameters.

Cheung, Kar-Ming↗

NASA NTRS1975

Dispersion analysis for baseline reference mission 3A using powered explicit guidance

A dispersion analysis considering 3 sigma uncertainties (or perturbations) in platform, vehicle, and environmental parameters was performed for baseline reference mission 3A. Powered explicit guidance (PEG) was used to develop closed loop steering commands for this dispersion analysis. The nominal profile for the dispersion analysis is identical to the nominal profile of Reference 1 ascent trajectory with the exception that generalized linear tangent (GLT) guidance is used in Reference 1. Nominal trajectory differences which result from using PEG instead of GLT were determined and dispersion data were developed using PEG for comparison with similar data developed using GLT guidance.

Snow, L. S.↗

NASA NTRS2007

Accounting for Uncertainties in Strengths of SiC MEMS Parts

A methodology has been devised for accounting for uncertainties in the strengths of silicon carbide structural components of microelectromechanical systems (MEMS). The methodology enables prediction of the probabilistic strengths of complexly shaped MEMS parts using data from tests of simple specimens. This methodology is intended to serve as a part of a rational basis for designing SiC MEMS, supplementing methodologies that have been borrowed from the art of designing macroscopic brittle material structures. The need for this or a similar methodology arises as a consequence of the fundamental nature of MEMS and the brittle silicon-based materials of which they are typically fabricated. When tested to fracture, MEMS and structural components thereof show wide part-to-part scatter in strength. The methodology involves the use of the Ceramics Analysis and Reliability Evaluation of Structures Life (CARES/Life) software in conjunction with the ANSYS Probabilistic Design System (PDS) software to simulate or predict the strength responses of brittle material components while simultaneously accounting for the effects of variability of geometrical features on the strength responses. As such, the methodology involves the use of an extended version of the ANSYS/CARES/PDS software system described in Probabilistic Prediction of Lifetimes of Ceramic Parts (LEW-17682-1/4-1), Software Tech Briefs supplement to NASA Tech Briefs, Vol. 30, No. 9 (September 2006), page 10. The ANSYS PDS software enables the ANSYS finite-element-analysis program to account for uncertainty in the design-and analysis process. The ANSYS PDS software accounts for uncertainty in material properties, dimensions, and loading by assigning probabilistic distributions to user-specified model parameters and performing simulations using various sampling techniques.

Nemeth, Noel↗

DOE OSTI2022

Uncertainty Quantification in High-Low Dynamic System Coupling using RAVEN and TRANSFORM

This work demonstrates new functionality and applications stemming from the development of high-fidelity to low-fidelity (high-low) coupling for system simulations and to further explore the capabilities of the Risk Analysis Virtual Environment (RAVEN) in the performance of uncertainty quantification in this kind of high-low coupled system models. The work builds from previous work on high-low coupling that utilized COBRA-TF (CTF), the high-fidelity subchannel analysis code, with a low fidelity model built in ORNL’s TRANSFORM, the system analysis code, utilizing the Functional Mock-Up Interface (FMI). Steady-state and transient analysis examples using the high/low coupled models generated from CTF and TRANSFORM/FMI are investigated. The workflows for both steady-state and transient coupled simulations are described. A steady-state parameter sweep and uncertainty analysis of the primary flow rates and reactor power are demonstrated. Likewise, a transient pump trip and power ramp sensitivity studies are also demonstrated. This work elucidates some of the potential benefits and future needs of using RAVEN for high/low system coupling analysis of energy systems. It also shows some of the difficulties that can be encountered in coupling system simulations.

Williams, Wesley↗

DOE OSTI2024

Nuclear safety Enhanced: A Deep dive into current and future RAVEN applications

As the horizon of nuclear energy expands with the advent of small modular reactors, IV generation reactors, and fusion reactors, there is a growing perspective that the licensing process could benefit from a more comprehensive approach. Moving beyond traditional deterministic and PRA analysis might pave the way for a novel safety analysis paradigm propelled by the increasing computational power at our disposal. This paper explores different methodologies that can improve the outcomes of nuclear safety analysis. These range from uncertainty quantification techniques, aimed at enhancing the precision of safety margins, to deploying dynamic event trees by driving system code simulations, capturing the potential evolutions of severe accidents. These methodologies introduce innovative dimensions to safety analysis, considering the consequences of postulated events and the dynamics of accident sequences. However, they also bring forth challenges, especially in managing the complexity and sheer volume of potential scenarios. The paper touches upon some strategies to counter these challenges, emphasizing the importance of adaptability and continuous evolution in the face of emerging nuclear safety concerns. Additionally, the paper sheds light on the need for advanced tools to apply these methodologies. Among these tools is RAVEN, an open-source software designed for parametric and probabilistic analyses. Its core components, including distribution, sampler, and reduced order model, enable various applications, from risk assessment and mitigation to dynamic learning and plant control logic simulations.

97 - MATHEMATICS AND COMPUTING↗

NASA NTRS1987

Challenges in modeling the X-29 flight test performance

Presented are methods, instrumentation, and difficulties associated with drag measurement of the X-29A aircraft. The initial performance objective of the X-29A program emphasized drag polar shapes rather than absolute drag levels. Priorities during the flight envelope expansion restricted the evaluation of aircraft performance. Changes in aircraft configuration, uncertainties in angle-of-attack calibration, and limitations in instrumentation complicated the analysis. Limited engine instrumentation with uncertainties in overall in-flight thrust accuracy made it difficult to obtain reliable values of coefficient of parasite drag. The aircraft was incapable of tracking the automatic camber control trim schedule for optimum wing flaperon deflection during typical dynamic performance maneuvers; this has also complicated the drag polar shape modeling. The X-29A was far enough off the schedule that the developed trim drag correction procedure has proven inadequate. However, good drag polar shapes have been developed throughout the flight envelope. Preliminary flight results have compared well with wind tunnel predictions. A more comprehensive analysis must be done to complete performance models. The detailed flight performance program with a calibrated engine will benefit from the experience gained during this preliminary performance phase.

John W Hicks↗

NASA NTRS1987

Challenges in modeling the X-29A flight test performance

The paper presents the methods, instrumentation, and difficulties associated with drag measurement of the X-29A aircraft. The initial performance objective of the X-29A program emphasized drag polar shapes rather than absolute drag levels. Priorities during the flight envelope expansion restricted the evaluation of aircraft performance. Changes in aircraft configuration, uncertainties in angle-of-attack calibration, and limitations in instrumentation complicated the analysis. Limited engine instrumentation with uncertainties in overall in-flight thrust accuracy made it difficult to obtain reliable values of coefficient of parasite drag. The aircraft was incapable of tracking the automatic camber control trim schedule for optimum wing flaperon deflection during typical dynamic performance maneuvers; this has also complicated the drag polar shape modeling. The X-29A was far enough off the schedule that the developed trim drag correction procedure has proven inadequate. Despite these obstacles, good drag polar shapes have been developed throughout the flight envelope. Preliminary flight results have compared well with wind tunnel predictions. A more comprehensive analysis must be done to complete the performance models. The detailed flight performance program with a calibrated engine will benefit from the experience gained during this preliminary performance phase.

Hicks, John W.↗

NASA NTRS1976

Dispersion analysis for baseline reference mission 3A with 400,000 foot entry interface altitude

A dispersion analysis considering 3 beta uncertainties in platform, vehicle, and environmental parameters is described. Powered explicit guidance used to develop closed loop steering commands, the nominal profile, and entry interface conditions are discussed. The groundrules and assumptions for the analysis are reviewed. The results presented include dispersion data at specific time slices from liftoff to entry interface, covariance matrices, summary data, and exchange ratios.

Snow, L. S.↗

DOE OSTI2020

BioSTEAM-LCA: An Integrated Modeling Framework for Agile Life Cycle Assessment of Biorefineries under Uncertainty

Biorefineries will play a critical role in sustainable bioeconomies, but projections of their environmental impacts vary widely. A core challenge with life cycle assessments (LCAs) of biorefineries is that they are often disconnected from biorefinery design, simulation, and techno-economic analysis (TEA). This lack of integration is a barrier to early stage technology and process evaluations, reducing consistency and transparency across sustainability indicators while limiting our understanding of the relative importance of individual factors (e.g., design decisions, greenhouse gas emission accounting procedures), how these factors interact, and trade-offs or synergies with process economics. In this study, we propose a new agile LCA framework, BioSTEAMLCA, which layers onto BioSTEAM (Biorefinery Simulation and Techno-Economic Analysis Modules, which automates biorefinery design, simulation, and TEA) to characterize the environmental impacts of biorefineries across a landscape of designs, technology performance assumptions, and contexts. Inventory databases and impact assessment methods are integrated to enable flexible user defined LCA system models, and the implications of uncertainties throughout the production system are characterized via Monte Carlo simulation. To demonstrate the capabilities of BioSTEAMLCA, we present a case study for sugarcane ethanol production. Overall, BioSTEAM-LCA enables computationally efficient, agile gate-to-gate LCA to evaluate biorefinery processes, the production of candidate biofuels and bioproducts, and trade-offs among productivity, economics, and environmental impacts under uncertainty.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗