Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

Measurement of Helium and Xenon Knudsen permeability in graphite IG-11

Here, understanding the flow and diffusion (transport) of gases through nuclear graphite is of interest in both the prismatic and pebble bed high-temperature gas reactors (HTGRs), for normal operation and under accident conditions, for example, as related to graphite oxidation. Both the laminar and turbulent gaseous transport are of interest. It has also been noted that nuclear graphite can have pore sizes that can possibly lead to non-continuum transport, as the pore size can be comparable to the gaseous mean free path. We report measurements and analyzes of experiments performed with IG-11 graphite in the pressure range of 10 Pa to 14,700 Pa, 293 K, using Helium, and research grade xenon (99.999%), respectively. These values are in fair agreement with those reported for different graphites and gases by other investigators, but are also higher by six orders of magnitude than those reported for Kr permeability in a developmental very low permeability graphite-HXT-90. Our measured ratio of the Helium and Xenon permeabilities is about 4, different from $\sqrt{\frac{m_{Xe}}{m_{He}}}$ ≈ 5.72 that corresponds to diffuse reflection at the graphite surface for both gases. Simple analysis indicates that the two gases have slightly different accommodation coefficients (about 25%) with the graphite surface. However, there could also be other reasons, such as experimental uncertainties or the need for a more detailed analysis.

36 MATERIALS SCIENCE↗

Using a commercial CAD system for simultaneous input to theoretical aerodynamic programs and wind-tunnel model construction

The Computer Aided Design (CAD) system's common geometry database was used to generate input for theoretical programs and numerically controlled (NC) tool paths for wind tunnel part fabrication. This eliminates the duplication of work in generating separate geometry databases for each type of analysis. Another advantage is that it reduces the uncertainty due to geometric differences when comparing theoretical aerodynamic data with wind tunnel data. The system was adapted to aerodynamic research by developing programs written in Design Analysis Language (DAL). These programs reduced the amount of time required to construct complex geometries and to generate input for theoretical programs. Certain shortcomings of the Design, Drafting, and Manufacturing (DDM) software limited the effectiveness of these programs and some of the Calma NC software. The complexity of aircraft configurations suggests that more types of surface and curve geometry should be added to the system. Some of these shortcomings may be eliminated as improved versions of DDM are made available.

Enomoto, F.↗

Generating Accurate and Consistent Top-Of-Atmosphere Reflectance Products from the New Generation Geostationary Satellite Sensors

GeoNEX is a collaborative project by scientists from NASA, NOAA, JAXA, and other organizations around the world with the purpose of generating a suite of Earth-monitoring products using data streams from the latest geostationary (GEO) sensors including the GOES-16/17 ABI and the Himawari-8/9 AHI. An accurate and consistent top-of-atmosphere (TOA) reflectance product, in particular the bidirectional reflectance factor (BRF), is the starting point in the scientific processing chain. We describe the main considerations and corresponding algorithms in generating the GeoNEX TOA BRF product. First, a special advantage of geostationary data streams is their high temporal resolution (~10 minutes per full-disk scan), providing a key source of information for many downstream products. To fully utilize this high temporal frequency demands a high georegistration accuracy for every acquired image. Our analysis shows that there can be substantial georegistration uncertainties in both GOES and Himawari L1b data which we addressed by implementing a phase-based correction algorithm to remove residual errors. Second, geostationary sensors have distinct illumination-view geometry features in that the solar angle changes for every pixel. Therefore, to accurately derive a BRF requires a solar position algorithm and the estimation of the pixel-wise acquisition time within an uncertainty of 10 seconds. Third, we discuss the measures we adopted to check and correct residual radiometric calibration issues of individual sensors to enable time-series analysis as well as the cross calibration between different satellite sensors (including those from low-Earth orbit). Finally, we also explain the rationale for the choice of the global grid/tile system of the GeoNEX TOA BRF product.

Wang, Weile↗

Techniques in Assessing Random Uncertainty of Wind Tunnel Replicate Test Data

The preferred method to determine the random uncertainty of variables of interest during wind tunnel tests is by direct analysis of replicate data. However, current information is limited to analysis of a single replicate set condition that does not consider data covariance. This paper provides additional information on considerations for quantifying random uncertainty including the evaluation and correction of replicate data covariance, the selection of replicate set conditions for the test, and the interpolation of random uncertainty at other than replicate set conditions. The analysis and techniques are supported by data from a conventional aircraft configuration test at the Oran Nicks Low-Speed Wind Tunnel and an ASME nozzle flow characterization at the Propulsion Systems Laboratory.

Uncertainty↗

Orbit determination error analysis and comparison of station-keeping costs for Lissajous and halo-type libration point orbits and sensitivity analysis using experimental design techniques

Spacecraft in orbit near libration point L1 in the Sun-Earth system are excellent platforms for research concerning solar effects on the terrestrial environment. One spacecraft mission launched in 1978 used an L1 orbit for nearly 4 years, and future L1 orbital missions are also being planned. Orbit determination and station-keeping are, however, required for these orbits. In particular, orbit determination error analysis may be used to compute the state uncertainty after a predetermined tracking period; the predicted state uncertainty levels then will impact the control costs computed in station-keeping simulations. Error sources, such as solar radiation pressure and planetary mass uncertainties, are also incorporated. For future missions, there may be some flexibility in the type and size of the spacecraft's nominal trajectory, but different orbits may produce varying error analysis and station-keeping results. The nominal path, for instance, can be (nearly) periodic or distinctly quasi-periodic. A periodic 'halo' orbit may be constructed to be significantly larger than a quasi-periodic 'Lissajous' path; both may meet mission requirements, but perhaps the required control costs for these orbits are probably different. Also for this spacecraft tracking and control simulation problem, experimental design methods can be used to determine the most significant uncertainties. That is, these methods can determine the error sources in the tracking and control problem that most impact the control cost (output); it also produces an equation that gives the approximate functional relationship between the error inputs and the output.

Gordon, Steven C.↗

Round Robin Measurements of Molten Salt Properties for LiF-NaF-KF (FLiNaK) and NaCl-KCl Mixtures

The development, operation, and regulation of nuclear reactors that utilize molten salts as fuel or as heat transfer media require knowledge of the thermal properties of the salt systems and quantification of the corresponding uncertainties. Knowledge of molten salt properties is also necessary for applications in material synthesis, processing, separations, solar thermal power generation, and energy storage. A round robin was conducted with national laboratory and university participants from twenty-one laboratories in five countries to compare property measurements, to better understand uncertainties, and to identify possible best practices. Two salt mixtures, each from a common batch, were distributed to participants for evaluation: equimolar NaCl-KCl and 45.0LiF-13.7NaF-41.3KF mol % (FLiNaK). Measurements were performed to determine the major constituent composition, oxygen content, density, thermal expansivity, melting point, and thermal conductivity. Error analysis was performed on each measurement for uncertainty quantification for each type of property that was explored. Finally, the resulting discussion of the methodologies used in this work is meant to lay the groundwork for the development of standard methods and reference materials for future high-temperature property measurements on halide melts.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty Quantification Framework for Predicting Material Response with Large Number of Parameters: Application to Creep Prediction in Ferritic-Martensitic Steels Using Combined Crystal Plasticity and Grain Boundary Models

This paper presents an uncertainty quantification (UQ) framework for the physics-based model prediction of material response with a large number of parameters. The application problem presented in this work is that of predicting creep in Grade 91 steel at 600°C. The material response is defined with a physically based microstructural model with constitutive equations emulating several observed phenomena in Grade 91 and embodied into an explicit geometry mesoscale finite element model for prior austenite grains and grain boundaries. Creep within the grains and in grain boundaries are represented by crystal plasticity for dislocation motion and a physics-based model for cavity growth and nucleation, respectively. The creep behavior of this material is influenced by several parameters, some of which have a wide range of variation based on experimental data. UQ combined with microstructural modeling can discover the core microstructural causes of experimental variability, leading to improved materials with lower variability in critical long-term material properties. In this study, we investigate the model's uncertainty to identify material properties that may be modified during production to increase creep life and analyze different components of the crystal plasticity model for improvements. For this purpose, a quantity of interest is defined as time to minimum creep rate, which correlates well to the creep failure of the material. A deep neural network model was trained and validated to be used as a surrogate for the finite element model. Then, a variance-based sensitivity analysis is performed on the surrogate model to find the Sobol indices of the input parameters in respect to the output quantity of interest. The Sobol indices are used to reduce the dimensionality of the model. Generalized polynomial chaos expansion is used on the reduced basis models to propagate the uncertainty from the input parameters to the quantity of interest using the deep neural network surrogate model. These results are benchmarked against uncertainty propagation using Monte Carlo simulations. In conclusion, the UQ performed through the reduced basis model captures almost all the uncertainty in the model with significantly fewer simulations, making it possible to perform the UQ directly via simulations with the finite element model rather than surrogate machine-learned models.

36 MATERIALS SCIENCE↗

The development of aerodynamic uncertainties for the space shuttle orbiter

The Shuttle Program development schedule and the management decision to perform an orbital, manned mission on the first launch resulted in a requirement to develop realistic aerodynamic uncertainties for the preflight aerodynamic predictions. This paper addresses the methodology in developing two types of aerodynamic uncertainties. One involves the ability to reproduce aerodynamic results between various wind tunnel tests. The second addresses the difference between preflight aerodynamic predictions and flight results derived from analysis of past aircraft programs. Both types of uncertainties for pitching moment, lateral-directional stability, rudder power, and aileron power are presented. In addition, the application of uncertainties to flight control design and fight test planning is briefly reviewed.

Young, J. C.↗

Accounting for Epistemic Uncertainty in Mission Supportability Assessment: A Necessary Step in Understanding Risk and Logistics Requirements

Future crewed missions to Mars present a maintenance logistics challenge that is unprecedented in human spaceflight. Mission endurance – defined as the time between resupply opportunities – will be significantly longer than previous missions, and therefore logistics planning horizons are longer and the impact of uncertainty is magnified. Maintenance logistics forecasting typically assumes that component failure rates are deterministically known and uses them to represent aleatory uncertainty, or uncertainty that is inherent to the process being examined. However, failure rates cannot be directly measured; rather, they are estimated based on similarity to other components or statistical analysis of observed failures. As a result, epistemic uncertainty – that is, uncertainty in knowledge of the process – exists in failure rate estimates that must be accounted for. Analyses that neglect epistemic uncertainty tend to significantly underestimate risk. Epistemic uncertainty can be reduced via operational experience; for example, the International Space Station (ISS) failure rate estimates are refined using a Bayesian update process. However, design changes may re-introduce epistemic uncertainty. Thus, there is a tradeoff between changing a design to reduce failure rates and operating a fixed design to reduce uncertainty. This paper examines the impact of epistemic uncertainty on maintenance logistics requirements for future Mars missions, using data from the ISS Environmental Control and Life Support System (ECLS) as a baseline for a case study. Sensitivity analyses are performed to investigate the impact of variations in failure rate estimates and epistemic uncertainty on spares mass. The results of these analyses and their implications for future system design and mission planning are discussed.

Owens, Andrew↗

Finite Element Model Calibration Approach for Area I-X

Ares I-X is a pathfinder vehicle concept under development by NASA to demonstrate a new class of launch vehicles. Although this vehicle is essentially a shell of what the Ares I vehicle will be, efforts are underway to model and calibrate the analytical models before its maiden flight. Work reported in this document will summarize the model calibration approach used including uncertainty quantification of vehicle responses and the use of non-conventional boundary conditions during component testing. Since finite element modeling is the primary modeling tool, the calibration process uses these models, often developed by different groups, to assess model deficiencies and to update parameters to reconcile test with predictions. Data for two major component tests and the flight vehicle are presented along with the calibration results. For calibration, sensitivity analysis is conducted using Analysis of Variance (ANOVA). To reduce the computational burden associated with ANOVA calculations, response surface models are used in lieu of computationally intensive finite element solutions. From the sensitivity studies, parameter importance is assessed as a function of frequency. In addition, the work presents an approach to evaluate the probability that a parameter set exists to reconcile test with analysis. Comparisons of pretest predictions of frequency response uncertainty bounds with measured data, results from the variance-based sensitivity analysis, and results from component test models with calibrated boundary stiffness models are all presented.

Horta, Lucas G.↗

Calibrating the Helium Pressurization System for the Space Shuttle Liquid-Hydrogen Tank

Analysis of the results from the STS-114 tanking tests and subsequent launch called into question existing thermal and mass models of helium pressurization of the liquid hydrogen tank. This hydrogen tank, which makes up the bottom two-thirds of the External Tank, is pressurized prior to launch to avoid cavitation in the Shuttle Main Engine pumps. At about 2 minutes prior to launch, the main vent valve is closed, and pressurized helium flows into the tank ullage space to achieve set point pressure. As the helium gas cools, its pressure drops, calling for additional helium. Subsequent helium flows are provided in short, timed pulses. The number of pulses is taken as a rough leak indicator. An analysis of thermal models by Marshall Space Flight Center showed considerable uncertainty in the pressure-versus-time behavior of the helium ullage space and the ability to predict the number of pulses normally expected. Kennedy Space Center proposed to calibrate the dime-sized orifice, which together with valves, controls the helium flow quantity (Figure 1). Pressure and temperature sensors were installed to provide upstream and downstream measurements necessary to compute flow rate based on the orifice discharge coefficient. An assessment of flow testing with helium indicated an extremely costly use of this critical resource. In order to reduce costs, we proposed removing the orifices from each Mobile Launcher Platform (MLP) and asking Colorado Engineering Experiment Station Inc. (CEESI) to calibrate the flow. CEESI has a high-pressure air flow system with traceable flow meters capable of handling the large flow rates. However, literature research indicated that square-edged orifices of small diameters often exhibit significant hysteresis and nonrepeatability in the vicinity of choked or sonic flow. Fortunately, the MLP orifices behaved relatively well in testing (Figure 2). Using curve fitting of the air-flow data, in conjunction with ASME orifice modeling equations, a method of relating the helium mass flow to measured air flow data was obtained. This analysis showed that the highest uncertainty in flow occurred in the vicinity of the choking pressure ratio, as would be expected. In addition, analysis of typical flow pulses showed that most of the helium flow occurred either well below or well above this uncertain area. The final result is the ability to provide postlaunch estimates of helium mass flows that are within 1.5 percent of the actual value.

Source record↗

Improving helium abundance determinations with Leo P as a case study

Currently, the primordial helium abundance is best estimated through spectroscopic observations of H II regions in metal-poor galaxies. However these determinations are limited by several systematic uncertainties which ultimately limit our ability to accurately ascertain the primordial abundance. In this study, we improve the methodologies for solving for the reddening, the emission contributions from collisional excitation of the H I atoms, the effects underlying absorption in the H I and He I emission lines, and the treatment of the blended H I and He I emission at λ3889 with the aim of lowering the systematic uncertainties in helium abundance determinations. To apply these methods, we have obtained observations of the He I λ10830 emission line in the brightest H II region in the extremely metal-poor (3% Z ⊙ ) galaxy Leo P with the LUCI1 instrument on the LBT. We combine this measurement with previous MODS/LBT observations to derive an improved helium abundance. In doing so, our present analysis results in a decrease in the uncertainty in the helium abundance of Leo P by approximately 70%. Furthermore, this result is combined with data from other observations to estimate the primordial helium mass fraction, Yp= 0.2453 ± 0.0034.

79 ASTRONOMY AND ASTROPHYSICS↗

Fast Computational Algorithms for Partial Differential Equations and Uncertainty Quantifications

This project concerned the construction, testing and analysis of computational algorithms for solving parameterized and stochastic partial differential equations. The study and understanding of equations of this type is of fundamental importance in numerous engineering and scientific applications. Examples include simulation of plasma dynamics in models of electric propulsion and nuclear fusion, simulation of multiphase flows, such as the flow of water, gas and oil in reservoirs, and structural analysis of the dependence of structures on materials. Parametrization is used in such settings when properties of the models such as viscosity of fluids or electric resistivity of materials are not precisely understood and instead are treated as random variables. The resulting solutions are themselves random, and having such solutions will enable engineers to use probabilistic methods to assess the likelihood of events, for example, whether a pollutant in a liquid will exceed a limit, and to use such analyses to develop ways to ensure positive outcomes. Construction of accurate (high resolution) computational solutions is expensive, requiring significant computer time and computational resources, and there is need to reduce computational cost to make simulation useful and effective. The aim of the project was to construct algorithms to efficiently compute surrogate solutions to parameterized problems to allow for efficient and accurate simulation. The technical approach used focused on two related strategies, based on rank-reduction methods and reduced-order models. These methods construct surrogate solutions of parameter-dependent models by projection or interpolation into low-dimensional approximation spaces. Cost savings are achieved if the low-dimensional spaces can be identified and constructed efficiently and if the resulting low-dimensional algebraic systems can be solved cheaply. Accomplishments include: Theoretical and empirical demonstration of the effectiveness of fast multigrid solution strategies for computing low-rank representations of parameter-dependent solutions to discrete partial differential equations, including the first proof establishing so-called textbook convergence properties for low-rank methods. Development of efficient solution algorithms for solving nonlinear parameter-dependent partial differential equations used in models of fluid dynamics. Developent of efficient algorithms for low-rank representation of solutions of time-dependent simulations of fluid dynamics using multi-dimensional tensor representations of solutions.

97 MATHEMATICS AND COMPUTING↗

Development of a sensitivity analysis technique for multiloop flight control systems

This report presents the development and application of a sensitivity analysis technique for multiloop flight control systems. This analysis yields very useful information on the sensitivity of the relative-stability criteria of the control system, with variations or uncertainties in the system and controller elements. The sensitivity analysis technique developed is based on the computation of the singular values and singular-value gradients of a feedback-control system. The method is applicable to single-input/single-output as well as multiloop continuous-control systems. Application to sampled-data systems is also explored. The sensitivity analysis technique was applied to a continuous yaw/roll damper stability augmentation system of a typical business jet, and the results show that the analysis is very useful in determining the system elements which have the largest effect on the relative stability of the closed-loop system. As a secondary product of the research reported here, the relative stability criteria based on the concept of singular values were explored.

Vaillard, A. H.↗

Reconciling Scientific Aspirations and Engineering Constraints for a Lunar Mission via Hyperdimensional Interpolation

Virtually every NASA space-exploration mission represents a compromise between the interests of two expert, dedicated, but very different communities: scientists, who want to go quickly to the places that interest them most and spend as much time there as possible conducting sophisticated experiments, and the engineers and designers charged with maximizing the probability that a given mission will be successful and cost-effective. Recent work at NASA's Jet Propulsion Laboratory (JPL) seeks to enhance communication between these two groups, and to help them reconcile their interests, by developing advanced modeling capabilities with which they can analyze the achievement of science goals and objectives against engineering design and operational constraints. The analyses conducted prior to this study have been point-design driven. Each analysis has been of one hypothetical case which addresses the question: Given a set of constraints, how much science can be done? But the constraints imposed by the architecture team-e.g., rover speed, time allowed for extravehicular activity (EVA), number of sites at which science experiments are to be conducted- are all in early development and carry a great deal of uncertainty. Variations can be incorporated into the analysis, and indeed that has been done in sensitivity studies designed to see which constraint variations have the greatest impact on results. But if a very large number of variations can be analyzed all at once, producing a table that includes virtually the entire trade space under consideration, then we have a tool that enables scientists and mission architects to ask the inverse question: For a given desired level of science (or any other objective), what is the range of constraints that would be needed? With this tool, mission architects could determine, for example, what combinations of rover speed, EVA duration, and other constraints produce the desired results. Further, this tool would help them identify which technology-improvement investments would be likely to produce the largest or most important return. However, the number of variations that need to be considered for such analysis quickly balloons to an unwieldy size. If three variations are considered for each of six constraints-a very modest example-there are a total of 243 variations to consider. If it takes 40 minutes to compute each variation, as it does with HURON, our automated optimization system, then it would take 162 hours or nearly 7 days of round-the-clock computing to calculate the results. Adding further constraints or variations exponentially increases the amount of time that is needed.

Weisbin, Charles R.↗

A New Track Trigger for Characterization of the Antiproton-Induced Background in the Mu2e Experiment

The Mu2e experiment at Fermilab will enable the search for the neutrinoless muon to electron conversion in the field of an Al nucleus, a charged lepton flavor violating process. If observed, there would be a clear indication of physics beyond the Standard Model. Mu2e aims to reach a single event sensitivity of $3 /times 10^{-17}$, improving from the previous limit by 4 orders of magnitude. This improvement relies on the development of trigger selection systems, designed to discard data from background-induced events by placing kinematic, topological cuts on a particle’s reconstructed track. One of the largest sources of background Mu2e faces is proton-antiproton annihilation. These annihilations produce a 2 GeV shower of particles, among which there could be an electron that mimics the conversion electron signal, with an expected number of 0.010 ± 0.010. The large uncertainty on this number is dominated by the systematic uncertainty associated with the theoretical production model. To better characterize this background, we have developed an antiproton trigger selection by taking advantage of the track multiplicity and topology of these events. We discuss the steps taken in this development and the first performance study of this trigger, evaluating the signal efficiency and background rate. This trigger is essential to enable a data-driven analysis targeting the reduction of the systematic uncertainty of the antiproton-induced background in the Mu2e experiment.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

CFD Validation Study of a Hypersonic Cone-Slice-Flap Configuration

Model validation is the process of determining the degree of accuracy between the real world and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap geometry configuration given uncertainty in both the simulation and experimental data. A procedure will be presented that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs. The work will also assess the impact between using different high-fidelity solvers and different turbulence models.The goal of performing this comparison is to provide a quantifiable measurement for the accuracy of each solver and turbulence model for this type of design. A low-fidelity analysis will also be performed to get a model-form uncertainty for the lower fidelity analysis. The two high-fidelty CFD solvers used are VULCAN-CFD and FUN3D and the low-fidelity results will come from Cart3D. The experimental data came from the 20-inch Mach 6Tunnel located at NASA Langley Research Center.

Laura M. White↗

Advancements in Constitutive Model Calibration: Leveraging the Power of Full‐Field DIC Measurements and In Situ Load Path Selection for Reliable Parameter Inference

Accurate material characterization and model calibration are essential for computationally supported high-consequence engineering decisions. Historically, characterization and calibration methods (1) use simplified test specimen geometries and global data, (2) cannot guarantee that sufficient characterization data are collected for a specific model of interest, (3) use deterministic methods that provide best-fit parameter values with no uncertainty quantification, and (4) are sequential, inflexible, and time-consuming. This work brings together several recent advancements into an improved workflow called interlaced characterization and calibration (ICC) that advances the state-of-the-art in constitutive model calibration. The ICC paradigm (1) employs tools to efficiently use full-field data to calibrate high-fidelity material models, (2) aligns the data needed with the data collected by adopting an optimal experimental design protocol, (3) quantifies parameter uncertainty through Bayesian inference and (4) incorporates these advancements into a quasi real-time feedback loop. The ICC framework is demonstrated here on the calibration of a material model using simulated full-field data for an aluminium cruciform specimen being deformed biaxially. The cruciform is actively driven through the myopically preferred load path using Bayesian optimal experimental design, which selects load steps that yield the maximum expected information gain (EIG). Principal component analysis (PCA) is performed on the model predictions of full-field displacements, and fast surrogate models are built to approximate the input-output relationships of the expensive finite element model. Furthermore, the tools developed and demonstrated here show that high-fidelity constitutive models can be efficiently and reliably calibrated with quantified uncertainty, thus supporting credible decision-making and potentially increasing the agility of solid mechanics modelling by enabling utilization of computational simulations at earlier stages of the design cycle.

Bayesian optimal experimental design↗