Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

Finite Element Model Calibration Approach for Area I-X

Ares I-X is a pathfinder vehicle concept under development by NASA to demonstrate a new class of launch vehicles. Although this vehicle is essentially a shell of what the Ares I vehicle will be, efforts are underway to model and calibrate the analytical models before its maiden flight. Work reported in this document will summarize the model calibration approach used including uncertainty quantification of vehicle responses and the use of non-conventional boundary conditions during component testing. Since finite element modeling is the primary modeling tool, the calibration process uses these models, often developed by different groups, to assess model deficiencies and to update parameters to reconcile test with predictions. Data for two major component tests and the flight vehicle are presented along with the calibration results. For calibration, sensitivity analysis is conducted using Analysis of Variance (ANOVA). To reduce the computational burden associated with ANOVA calculations, response surface models are used in lieu of computationally intensive finite element solutions. From the sensitivity studies, parameter importance is assessed as a function of frequency. In addition, the work presents an approach to evaluate the probability that a parameter set exists to reconcile test with analysis. Comparisons of pretest predictions of frequency response uncertainty bounds with measured data, results from the variance-based sensitivity analysis, and results from component test models with calibrated boundary stiffness models are all presented.

Horta, Lucas G.↗

A Statistics-Based Material Property Analysis to Support TPS Characterization

Accurate characterization of entry capsule heat shield material properties is a critical component in modeling and simulating Thermal Protection System (TPS) response in a prescribed aerothermal environment. The thermal decomposition of the TPS material during the pyrolysis and charring processes is poorly characterized and typically results in large uncertainties in material properties as inputs for ablation models. These material property uncertainties contribute to large design margins on flight systems and cloud re- construction efforts for data collected during flight and ground testing, making revision to existing models for entry systems more challenging. The analysis presented in this work quantifies how material property uncertainties propagate through an ablation model and guides an experimental test regimen aimed at reducing these uncertainties and characterizing the dependencies between properties in the virgin and charred states for a Phenolic Impregnated Carbon Ablator (PICA) based TPS. A sensitivity analysis identifies how the high-fidelity model behaves in the expected flight environment, while a Monte Carlo based uncertainty propagation strategy is used to quantify the expected spread in the in-depth temperature response of the TPS. An examination of how perturbations to the input probability density functions affect output temperature statistics is accomplished using a Kriging response surface of the high-fidelity model. Simulations are based on capsule configuration and aerothermal environments expected during the Mars Science Laboratory (MSL) entry sequence. We identify and rank primary sources of uncertainty from material properties in a flight-relevant environment, show the dependence on spatial orientation and in-depth location on those uncertainty contributors, and quantify how sensitive the expected results are.

Copeland, Sean R.↗

Summary and Annotated Bibliography of Measurement Error Corrections with Potential Application in Future Quesst Mission Community Noise Studies

This document is motivated by likely needs of the Quesst mission community response tests, which will culminate in data collection and estimation of dose-response regression relationships for consideration by domestic and international aviation regulators. Furthermore, basic research questions evaluating interactions between rates of community annoyance, dose levels, and indicators of the presence of rattle, vibration, and startle hinge on hypothesis testing in the context of regression models. For a variety of reasons, noise doses may be known only imprecisely and may not reflect the actual level experienced by responding subjects. These differences between true dose and estimated dose, be they systematic or random, constitute covariate measurement error. Available statistics literature speaks to the impacts of measurement error on regression models, both in terms of bias in estimated coefficients and predicted values, and in terms of the loss of statistical power for hypothesis testing. Given the particulars of a categorical annoyance response variable and a continuous noise dose predictor variable subject to measurement error during testing, the emphasis of this report is on findings and methods pertinent to generalized linear (and mixed) models likely to be employed during the Quesst mission community tests. We reach the following conclusions: 1. Of four reviewed methods, structural Bayesian measurement error models and simulation extrapolation (SIMEX) may be the most readily applicable to Quesst mission community noise study objectives. 2. If warranted, a linear measurement model can help model systematic sources of measurement error that the classical measurement error does not. 3. For its ready implementation and small additional input requirements, simulation extrapolation may be ideally suited for addressing secondary research questions involving interactions between annoyance, noise dose, and other factors through hypothesis testing. 4. For their flexibility and ability to propagate uncertainty, structural Bayesian hierarchical models have great appeal for mission purposes; some care may be needed in developing appropriate probability models describing actual noise exposure during testing. An annotated bibliography logs additional papers and resources that may be of value to analysts in other projects and disciplines.

Dose-Response Model↗

GMAO OSSE Framework in Support of PBL Mission Science

The planetary boundary layer is the bottom layer of the troposphere where most of human activities take place. Atmospheric pollutants are capped by the temperature inversion layer in PBL. The thickness of PBL, ranging from tens of meter to several kilometer, affects pollutant dispersion and air quality. The thickness of PBL typically shows a strong diurnal cycle but it is difficult to model and predict its change because complicated dynamic and thermodynamic processes involved with air-surface exchange of temperature and moisture, convective mixing, surface friction, topography, advection and radiation heating and cooling influence the PBL height. Various parameterization schemes for PBL were developed but the underlying processes of PBL are neither clearly understood nor represented in NWP models and adding large uncertainty into weather and climate predictions. There are no systematic global observations to provide information on thermodynamic structure of PBL and efforts to explore new spaceborne instruments and measurement techniques are growing. This study aims to develop a PBL OSSE framework leveraging existing GMAO’s OSSE system that utilizes GEOS data assimilation and global forecast model (1) to evaluate existing and potential new observation types for the PBL structure analysis and prediction and (2) to test sensitivity of PBL parameterization schemes to PBL forecasts.

Min-Jeong Kim↗

Parameter identification of material constants in a composite shell structure

One of the basic requirements in engineering analysis is the development of a mathematical model describing the system. Frequently comparisons with test data are used as a measurement of the adequacy of the model. An attempt is typically made to update or improve the model to provide a test verified analysis tool. System identification provides a systematic procedure for accomplishing this task. The terms system identification, parameter estimation, and model correlation all refer to techniques that use test information to update or verify mathematical models. The goal of system identification is to improve the correlation of model predictions with measured test data, and produce accurate, predictive models. For nonmetallic structures the modeling task is often difficult due to uncertainties in the elastic constants. A finite element model of the shell was created, which included uncertain orthotropic elastic constants. A modal survey test was then performed on the shell. The resulting modal data, along with the finite element model of the shell, were used in a Bayes estimation algorithm. This permitted the use of covariance matrices to weight the confidence in the initial parameter values as well as confidence in the measured test data. The estimation procedure also employed the concept of successive linearization to obtain an approximate solution to the original nonlinear estimation problem.

Martinez, David R.↗

Observations of PKS 2155-304 with the Extreme Ultraviolet Explorer

We present a high-accuracy light curve for the BL Lac object PKS 2155-304, observed with the Extreme Ultraviolet Explorer. The light curve shows variations of about 10 percent over a 1.3 d observing period. The observed EUV flux is a factor of 1.7 fainter than when PKS 2155-304 was observed by the ROSAT Wide Field Camera (WFC) during the EUV survey. The optical flux during our observations is about a factor of 2 fainter than during the WFC observations, so we conclude that the overall spectral shape is invariant as the flux varies. These observations support the model in which the spectrum from the optical to the X-ray band is given by a synchrotron spectrum. Extrapolating an X-ray power-law spectrum with an energy index of 1.66 into the EUV only slightly overpredicts the observed EUV count rates so that changing any one of several spectral parameters within the uncertainties gives an acceptable model.

Marshall, H. L.↗

Models of the structure of the atmosphere of Venus from the surface to 100 kilometers altitude

From a critical comparison and synthesis of data from the four Pioneer Venus Probes, the Pioneer Venus Orbiter, and the Venera 10, 12, and 13 landers, models of the lower and middle atmosphere of Venus are derived. The models are consistent with the data sets within the measurement uncertainties and established variability of the atmosphere. The models represent the observed variations of state properties with latitude, and preserve the observed static stability. The rationale and the approach used to derive the models are discussed, and the remaining uncertainties are estimated.

Seiff, A.↗

Transfer Function Identification Using Orthogonal Fourier Transform Modeling Functions

A method for transfer function identification, including both model structure determination and parameter estimation, was developed and demonstrated. The approach uses orthogonal modeling functions generated from frequency domain data obtained by Fourier transformation of time series data. The method was applied to simulation data to identify continuous-time transfer function models and unsteady aerodynamic models. Model fit error, estimated model parameters, and the associated uncertainties were used to show the effectiveness of the method for identifying accurate transfer function models from noisy data.

Morelli, Eugene A.↗

Multi Model Monte Carlo with Python (MXMCPy)

Multi Model Monte Carlo with Python (\mxmc {}) is a software package developed as a general capability for computing the statistics of outputs from an expensive, high-fidelity model by leveraging faster, low-fidelity models for speedup. Motivated by uncertainty propagation problems where classical Monte Carlo (MC) simulation is computationally intractable, various multi-model MC approaches have recently emerged that yield unbiased estimators with significantly reduced variance relative to MC for the same cost. These existing methods include multi-level Monte Carlo (MLMC), multi-fidelity Monte Carlo (MFMC), and approximate control variates (ACV). Given a fixed computational budget and a collection of models with varying cost/accuracy, each method seeks a sample allocation strategy across the models that results in an estimator with optimal variance reduction. \mxmc {} is a versatile tool that enables convenient access to many existing multi-model MC approaches within one modular and extensible package. With \mxmc {}, users can easily compare existing methods to determine the best choice for their particular problem, while developers have a basis for implementing and sharing new variance reduction approaches. This report introduces the \mxmc {} software, providing a summary of the problem-solving workflow for users as well as a brief overview of the code layout for developers.

Geoffrey F Bomarito↗

Final Dawn Reaction Control System (RCS) propulsion system in-flight characterization

The Dawn spacecraft concluded eleven years of operations on 31-Oct-2018, upon depletion of its hydrazine supply in Ceres orbit during the second extended mission. Dawn’s Reaction Control System performed admirably during this lengthy campaign, including years of unanticipated and novel operation given Reaction Wheel Assembly failures during flight. New and modified modes of thruster operations were implemented during the mission. Pressure transducer drift was negligible, consumable limits were generally not exceeded (except for minor violations in Reaction Control System thruster cycles), and thruster performance was nominal throughout this long interplanetary journey. Tank models of hydrazine remaining mass were consistent with depletion within uncertainties, although thruster consumption-based models ended up being conservative by 15%. Unexpectedly, apparent nitrogen permeation through the hydrazine tank elastomer diaphragm allowed hydrazine in the lines below the tank to be pressurized and subsequently utilized during the final days of the mission.

Mizukami, Masashi↗

Final Dawn Reaction Control System (RCS) propulsion system in-flight characterization

The Dawn spacecraft concluded eleven years of operations on 31-Oct-2018, upon depletion of its hydrazine supply in Ceres orbit during the second extended mission. Dawn’s Reaction Control System performed admirably during this lengthy campaign, including years of unanticipated and novel operation given Reaction Wheel Assembly failures during flight. New and modified modes of thruster operations were implemented during the mission. Pressure transducer drift was negligible, consumable limits were generally not exceeded (except for minor violations in Reaction Control System thruster cycles), and thruster performance was nominal throughout this long interplanetary journey. Tank models of hydrazine remaining mass were consistent with depletion within uncertainties, although thruster consumption-based models ended up being conservative by 15%. Unexpectedly, apparent nitrogen permeation through the hydrazine tank elastomer diaphragm allowed hydrazine in the lines below the tank to be pressurized and subsequently utilized during the final days of the mission.

Mizukami, Masashi↗

Why Is Improvement of Earth System Models so Elusive? Challenges and Strategies from Dust Aerosol Modeling

Past decades have seen an accelerating increase in computing efficiency, while climate models are representing a rapidly widening set of physical processes. Yet simulations of some fundamental aspects of climate like precipitation or aerosol forcing remain highly uncertain and resistant to progress. Dust aerosol modeling of soil particles lofted by wind erosion has seen a similar conflict between increasing model sophistication and remaining uncertainty. Dust aerosols perturb the energy and water cycles by scattering radiation and acting as ice nuclei, while mediating atmospheric chemistry and marine photosynthesis (and thus the carbon cycle). These effects take place across scales from the dimensions of an ice crystal to the planetary-scale circulation that disperses dust far downwind of its parent soil. Representing this range leads to several modeling challenges. Should we limit complexity in our model, which consumes computer resources and inhibits interpretation? How do we decide if a process involving dust is worthy of inclusion within our model? Can we identify a minimal representation of a complex process that is efficient yet retains the physics relevant to climate? Answering these questions about the appropriate degree of representation is guided by model evaluation, which presents several more challenges. How do we proceed if the available observations do not directly constrain our process of interest? (This could result from competing processes that influence the observed variable and obscure the signature of our process of interest.) Examples will be presented from dust modeling, with lessons that might be more broadly applicable. The end result will either be clinical depression or there assuring promise of continued gainful employment as the community confronts these challenges.

Climate models↗

Cirrus Cloud Radiative and Microphysical Properties from Ground Observations and In Situ Measurements During FIRE 1991 and Their Application to Exhibit Problems in Cirrus Solar Radiative Transfer Modeling

Measurements from the FIRE 1991 cirrus cloud field experiment in the central United States are presented and analyzed. The first part focuses on cirrus microphysical properties. Aircraft 2D-probe in situ data at different cloud altitudes were evaluated for cirrus cases on four different days. Also presented are simultaneous data samples from balloonborne videosondes. Only these balloonsondes could detect the smaller crystals. Their data suggest (at least for midlatitude altitudes below 10 km) that ice crystals smaller than 15 microns in size are rare and that small ice crystals not detected by 2D-probe measurements are radiatively of minor importance, as overlooked 2D-probe crystals account for about 10% of the total extinction. The second part focuses on the link between cirrus cloud properties and radiation. With cloud macrophysical properties from surface remote sensing added to the microphysical data and additional radiation measurements at the surface, testbeds for radiative transfer models were created. To focus on scattering processes, model evaluations were limited to the solar radiative transfer by comparing calculated and measured transmissions of sunlight at the surface. Comparisons under cloud-free conditions already reveal a model bias of about +45 W/sq m for the hemispheric solar downward broadband flux. This discrepancy, which is (at least in part) difficult to explain, has to be accounted for in comparisons involving clouds. Comparisons under cirrus cloud conditions identify as the major obstacle in cirrus solar radiative transfer modeling the inability of one-dimensional radiative transfer models to account for horizontal inhomogeneities. The successful incorporation of multidimensional radiative transfer effects will depend not only on better models but critically on the ability to measure and to define characteristic inhomogeneity scales of cloud fields. The relative minor error related to the microphysical treatment is in part a reflection of the improved understanding on solar scattering on ice crystals over the last decade and of the available wealth on ice-crystal size and shape data for this study. In absence of this information, uncertainties from microphysical cirrus model assumptions will remain high.

Kinne, Stefan↗

Preliminary Convective-Radiative Heating Environments for a Neptune Aerocapture Mission

Convective and radiative heating environments have been computed for a three-dimensional ellipsled configuration which would perform an aerocapture maneuver at Neptune. This work was performed as part of a one-year Neptune aerocapture spacecraft systems study that also included analyses of trajectories, atmospheric modeling, aerodynamics, structural design, and other disciplines. Complementary heating analyses were conducted by separate teams using independent sets of aerothermodynamic modeling tools (i.e. Navier-Stokes and radiation transport codes). Environments were generated for a large 5.50 m length ellipsled and a small 2.88 m length ellipsled. Radiative heating was found to contribute up to 80% of the total heating rate at the ellipsled nose depending on the trajectory point. Good agreement between convective heating predictions from the two Navier-Stokes solvers was obtained. However, the radiation analysis revealed several uncertainties in the computational models employed in both sets of codes, as well as large differences between the predicted radiative heating rates.

Hollis, Brian R.↗

Small Body GN&C Research Report: A Robust Model Predictive Control Algorithm with Guaranteed Resolvability

A robustly stabilizing MPC (model predictive control) algorithm for uncertain nonlinear systems is developed that guarantees the resolvability of the associated finite-horizon optimal control problem in a receding-horizon implementation. The control consists of two components; (i) feedforward, and (ii) feedback part. Feed-forward control is obtained by online solution of a finite-horizon optimal control problem for the nominal system dynamics. The feedback control policy is designed off-line based on a bound on the uncertainty in the system model. The entire controller is shown to be robustly stabilizing with a region of attraction composed of initial states for which the finite-horizon optimal control problem is feasible. The controller design for this algorithm is demonstrated on a class of systems with uncertain nonlinear terms that have norm-bounded derivatives, and derivatives in polytopes. An illustrative numerical example is also provided.

model predictive control algorithm (MPC)↗

A Modeling and Verification Study of Summer Precipitation Systems Using NASA Surface Initialization Datasets

One of the most challenging weather forecast problems in the southeastern U.S. is daily summertime pulse-type convection. During the summer, atmospheric flow and forcing are generally weak in this region; thus, convection typically initiates in response to local forcing along sea/lake breezes, and other discontinuities often related to horizontal gradients in surface heating rates. Numerical simulations of pulse convection usually have low skill, even in local predictions at high resolution, due to the inherent chaotic nature of these precipitation systems. Forecast errors can arise from assumptions within parameterization schemes, model resolution limitations, and uncertainties in both the initial state of the atmosphere and land surface variables such as soil moisture and temperature. For this study, it is hypothesized that high-resolution, consistent representations of surface properties such as soil moisture, soil temperature, and sea surface temperature (SST) are necessary to better simulate the interactions between the surface and atmosphere, and ultimately improve predictions of summertime pulse convection. This paper describes a sensitivity experiment using the Weather Research and Forecasting (WRF) model. Interpolated land and ocean surface fields from a large-scale model are replaced with high-resolution datasets provided by unique NASA assets in an experimental simulation: the Land Information System (LIS) and Moderate Resolution Imaging Spectroradiometer (MODIS) SSTs. The LIS is run in an offline mode for several years at the same grid resolution as the WRF model to provide compatible land surface initial conditions in an equilibrium state. The MODIS SSTs provide detailed analyses of SSTs over the oceans and large lakes compared to current operational products. The WRF model runs initialized with the LIS+MODIS datasets result in a reduction in the overprediction of rainfall areas; however, the skill is almost equally as low in both experiments using traditional verification methodologies. Output from object-based verification within NCAR s Meteorological Evaluation Tools reveals that the WRF runs initialized with LIS+MODIS data consistently generated precipitation objects that better matched observed precipitation objects, especially at higher precipitation intensities. The LIS+MODIS runs produced on average a 4% increase in matched precipitation areas and a simultaneous 4% decrease in unmatched areas during three months of daily simulations.

Jonathan L. Case↗

Hybrid Adaptive Flight Control with Model Inversion Adaptation

This study investigates a hybrid adaptive flight control method as a design possibility for a flight control system that can enable an effective adaptation strategy to deal with off-nominal flight conditions. The hybrid adaptive control blends both direct and indirect adaptive control in a model inversion flight control architecture. The blending of both direct and indirect adaptive control provides a much more flexible and effective adaptive flight control architecture than that with either direct or indirect adaptive control alone. The indirect adaptive control is used to update the model inversion controller by an on-line parameter estimation of uncertain plant dynamics based on two methods. The first parameter estimation method is an indirect adaptive law based on the Lyapunov theory, and the second method is a recursive least-squares indirect adaptive law. The model inversion controller is therefore made to adapt to changes in the plant dynamics due to uncertainty. As a result, the modeling error is reduced that directly leads to a decrease in the tracking error. In conjunction with the indirect adaptive control that updates the model inversion controller, a direct adaptive control is implemented as an augmented command to further reduce any residual tracking error that is not entirely eliminated by the indirect adaptive control.

Nguyen, Nhan↗

Efficient Global Aerodynamic Modeling from Flight Data

A method for identifying global aerodynamic models from flight data in an efficient manner is explained and demonstrated. A novel experiment design technique was used to obtain dynamic flight data over a range of flight conditions with a single flight maneuver. Multivariate polynomials and polynomial splines were used with orthogonalization techniques and statistical modeling metrics to synthesize global nonlinear aerodynamic models directly and completely from flight data alone. Simulation data and flight data from a subscale twin-engine jet transport aircraft were used to demonstrate the techniques. Results showed that global multivariate nonlinear aerodynamic dependencies could be accurately identified using flight data from a single maneuver. Flight-derived global aerodynamic model structures, model parameter estimates, and associated uncertainties were provided for all six nondimensional force and moment coefficients for the test aircraft. These models were combined with a propulsion model identified from engine ground test data to produce a high-fidelity nonlinear flight simulation very efficiently. Prediction testing using a multi-axis maneuver showed that the identified global model accurately predicted aircraft responses.

Morelli, Eugene A.↗