Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

A frequency-domain estimator for use in adaptive control systems

This paper presents a frequency-domain estimator that can identify both a parametrized nominal model of a plant as well as a frequency-domain bounding function on the modeling error associated with this nominal model. This estimator, which we call a robust estimator, can be used in conjunction with a robust control-law redesign algorithm to form a robust adaptive controller.

Lamaire, Richard O.↗

Choosing Meteorological Input for the Global Modeling Initiative Assessment of High Speed Aircraft

The Global Modeling Initiative (GMI) science team is developing a three dimensional chemistry and transport model (CTM) to be used in assessment of the atmospheric effects of aviation. Requirements are that this model be documented, be validated against observations, use a realistic atmospheric circulation, and contain numerical transport and photochemical modules representing atmospheric processes. The model must also retain computational efficiency to be tractable to use for multiple scenarios and sensitivity studies. To meet these requirements, a facility model concept was developed in which the different components of the CTM are evaluated separately. The first use of the GMI model will be to evaluate the impact of the exhaust of supersonic aircraft on the stratosphere. The assessment calculations will depend strongly on the wind and temperature fields used by the CTM. Three meteorological data sets for the stratosphere are available to GMI: the National Center for Atmospheric Research Community Climate Model (CCM2), the Goddard Earth Observing System Data Assimilation System (GEOS DAS), and the Goddard Institute for Space Studies general circulation model (GISS). Objective criteria were established by the GMI team to identify the data set which provides the best representation of the stratosphere. Simulations of gases with simple chemical control were chosen to test various aspects of model transport. The three meteorological data sets were evaluated and graded based on their ability to simulate these aspects of stratospheric measurements. This paper describes the criteria used in grading the meteorological fields. The meteorological data set which has the highest score and therefore was selected for GMI is CCM2. This type of objective model evaluation establishes a physical basis for interpretation of differences between models and observations. Further, the method provides a quantitative basis for defining model errors, for discriminating between different models, and for ready re-evaluation of improved models. These in turn will lead to a higher level of confidence in assessment calculations.

Douglas, A. R.↗

Choosing Meteorological Input for the Global Modeling Initiative Assessment of High Speed Aircraft

The Global Modeling Initiative (GMI) science team is developing a three dimensional chemistry and transport model (CTM) to be used in assessment of the atmospheric effects of aviation. Requirements are that this model be documented be validated against observations, use a realistic atmospheric circulation, and contain numerical transport and photochemical modules representing atmospheric processes. The model must also retain computational efficiency to be tractable to use for multiple scenarios and sensitivity studies. To meet these requirements, a facility model concept was developed in which the different components of the CTM are evaluated separately. The first use of the GMI model will be to evaluate the impact of the exhaust of supersonic aircraft on the stratosphere. The assessment calculations will depend strongly on the wind and temperature fields used by the CTM. Three meteorological data sets for the stratosphere are available to GMI: the National Center for Atmospheric Research Community Climate Model (CCM2), the Goddard Earth Observing System Data Assimilation System (GEOS DAS), and the Goddard Institute for Space Studies general circulation model (GISS). Objective criteria were established by the GMI team to identify the data set which provides the best representation of the stratosphere. Simulations of gases with simple chemical control were chosen to test various aspects of model transport. The three meteorological data sets were evaluated and graded based on their ability to simulate these aspects of stratospheric measurements. This paper describes the criteria used in grading the meteorological fields. The meteorological data set which has the highest score and therefore was selected for GMI is CCM2. This type of objective model evaluation establishes a physical basis for interpretation of differences between models and observations. Further, the method provides a quantitative basis for defining model errors, for discriminating between different models, and for ready re-evaluation of improved models. These in turn will lead to a higher level of confidence in assessment calculations.

Douglass, A. R.↗

MODEST: A Tool for Geodesy and Astronomy

Features of the JPL VLBI modeling and estimation software "MODEST" are reviewed. Its main advantages include thoroughly documented model physics, portability, and detailed error modeling. Two unique models are included: modeling of source structure and modeling of both spatial and temporal correlations in tropospheric delay noise. History of the code parallels the development of the astrometric and geodetic VLBI technique and the software retains many of the models implemented during its advancement. The code has been traceably maintained since the early 1980s, and will continue to be updated with recent IERS standards. Scripts are being developed to facilitate user-friendly data processing in the era of e-VLBI.

Sovers, Ojars J.↗

Application of FUN3D and CFL3D to the Third Workshop on CFD Uncertainty Analysis

Two Reynolds-averaged Navier-Stokes computer codes - one unstructured and one structured - are applied to two workshop cases (for the 3rd Workshop on CFD Uncertainty Analysis, held at Instituto Superior Tecnico, Lisbon, in October 2008) for the purpose of uncertainty analysis. The Spalart-Allmaras turbulence model is employed. The first case uses the method of manufactured solution and is intended as a verification case. In other words, the CFD solution is expected to approach the exact solution as the grid is refined. The second case is a validation case (comparison against experiment), for which modeling errors inherent in the turbulence model and errors/uncertainty in the experiment may prevent close agreement. The results from the two computer codes are also compared. This exercise verifies that the codes are consistent both with the exact manufactured solution and with each other. In terms of order property, both codes behave as expected for the manufactured solution. For the backward facing step, CFD uncertainty on the finest grid is computed and is generally very low for both codes (whose results are nearly identical). Agreement with experiment is good at some locations for particular variables, but there are also many areas where the CFD and experimental uncertainties do not overlap.

Rumsey, C. L.↗

The Performance of Current Atmospheric Radiation Codes in Phase I of CIRC

The Continual Intercomparison of Radiation Codes (CIRC) is intended as an evolving and regularly updated reference source for evaluation of radiative transfer (RT) codes used in Global Climate Models and other atmospheric applications. In our presentation we will discuss our evaluation of the performance of 13 shortwave and 11 longwave RT codes that participated in Phase I of CIRC. CIRC differs from previous intercomparisons in that it relies on an observationally validated catalogue of cases. The seven CIRC Phase I baseline cases, five cloud-free, and two with overcast liquid clouds, are built around observations by the Atmospheric Radiation Measurements (ARM) program that satisfy the goals .of Phase I, namely to examine RT model performance in realistic, yet not overly complex, atmospheric conditions. Besides the seven baseline cases, additional idealized "subcases" are also examined to facilitate interpretation of model errors. We will quantify individual model performance with respect to reference line-by-line calculations, and will also highlight RT code behavior for conditions of doubled CO2 , aspects of utilizing a spectral specification of surface albedo, and the impact of the inclusion of scattering in the thermal infrared. Our analysis suggests that RT codes should work towards improving their calculation of diffuse shortwave flux, shortwave absorption, treatment of spectral surface albedo, and shortwave CO2 forcing. Despite practical difficulties in comparing our results to previous results by the Intercomparison of Radiation Codes in Climate Models (ICRCCM) conducted about 20 years ago, it appears that the current generation of RT codes do indeed perform better than the codes of the ICRCCM era. By enhancing the range of conditions under which participating codes are tested, future CIRC phases will hopefully allow even more rigorous examination of RT code performance.

Oreopoulos, L.↗

Generation of Simulated Tracking Data for LADEE Operational Readiness Testing

Operational Readiness Tests were an important part of the pre-launch preparation for the LADEE mission. The generation of simulated tracking data to stress the Flight Dynamics System and the Flight Dynamics Team was important for satisfying the testing goal of demonstrating that the software and the team were ready to fly the operational mission. The simulated tracking was generated in a manner to incorporate the effects of errors in the baseline dynamical model, errors in maneuver execution and phenomenology associated with various tracking system based components. The ability of the mission team to overcome these challenges in a realistic flight dynamics scenario indicated that the team and flight dynamics system were ready to fly the LADEE mission. Lunar Atmosphere and Dust Environment.

Tracking↗

Attitude determination error analysis - General model and specific application

This paper presents a comprehensive approach to filter and dynamics modeling for attitude determination error analysis. The discussion includes models for both batch least-squares and sequential estimators, a specific dynamic model for attitude determination error analysis of a three-axis stabilized spacecraft equipped with strapdown gyros, and the incorporation of general attitude sensor observations. An analyst using this approach to perform an error analysis chooses a subset of the spacecraft parameters to be 'solve-for' parameters, which are to be estimated, and another subset to be 'consider' parameters, which are assumed to have errors but not to be estimated. The result of the error analysis is an indication of overall uncertainties in the 'solve-for' parameters, as well as the contributions of the various error sources to these uncertainties, including those of errors in the a priori 'solve-for' estimates, of measurement noise, of dynamic noise (also known as process noise or plant noise), and of 'consider' parameter uncertainties. The analysis of attitude, star tracker alignment, and gyro bias uncertainties for the Gamma Ray Observatory spacecraft provide a specific example of the use of a general-purpose software package incorporating these models.

Markley, F. Landis↗

Assessing Impacts of Waves on Hub-Height Winds off the U.S. West Coast Using Lidar Buoys and Coupled Modeling Approaches

Given the importance of offshore wind energy development to the U.S. clean energy targets, it is vital to be able to characterize the wind resource in that environment accurately. Toward that end, two Bureau of Ocean Energy Management buoys equipped with Doppler lidar are being maintained by Pacific Northwest National Laboratory on behalf of the Department of Energy and deployed to regions of potential offshore wind development. In addition to standard meteorological and oceanographic measurements, the buoys document the wind profile between about 40 m and 250 m above the sea surface through Doppler lidar retrievals. After a multiyear deployment of two buoys along the U.S. East Coast, the buoys were redeployed to the U.S. West coast from 2020 – 2022 to locations near the Humboldt and Morro Bay lease areas. The buoys provide nearly continuous, multiyear datasets that can be used to evaluate predictions of hub-height (~100 m) wind speed for standard atmospheric models in the region. In the absence of measurements at the study site, offshore wind developers rely on model-based data to assess site conditions. Potential sources of model error in this environment include under-resolution or misrepresentation of coastal topographically forced flows, marine boundary layer dynamics and the evolution of their associated cloud and turbulence fields, the role of upwelling and other currents on surface heat fluxes into the boundary layer, and the impact of wave fields on surface momentum fluxes and thus the wind speed profile. In particular, most predictive models of wind speed do not predict wave fields at all, relying on parameterizations to represent their effects. In thus study, we focus on evaluating the role of wind / wave interactions on modeled hub-height wind speed and error by using the Coupled Ocean–Atmosphere–Wave–Sediment–Transport Modeling System to capture two-way interactions between an atmospheric model (Weather Research and Forecasting (WRF)) and a wave model (WAVEWATCHIII (WW3)) and compare to both stand-alone WRF and one-way coupled WRF / WW3 configurations. Our approach is similar to that used in Gaudet et al. (2022) to evaluate wind / wave coupling over the U.S. East Coast, but applied to the very different environment of the U.S. West Coast. We show examples for two cases, a cold-season frontal case and a warm-season low-level jet case. We find that wind / wave coupling makes little impact on model error for these cases at the location of the lidar buoys, for which other misrepresentations of model physics seems to be responsible for model-observation discrepancies. However, domain-wide evaluations, which also make use of the National Buoy Data Center network, show that a two-way coupling approach is less prone to systematic errors in the hub-height wind field than the one-way coupled approach. WRF resolution of kilometer-scale or less is needed to properly capture the sharp wind speed gradients that can be found along the coastline, and WW3 simulations driven by the downscaled WRF produce better bulk and spectral wave fields when compared to observations. Implications of the results for wind resource characterization are then discussed.

17 WIND ENERGY↗

BayesMT: A Probabilistic Bayesian Framework for the Seismic Moment Tensor

Moment tensors (MTs) have long been used in earthquake and explosion source analysis, and there has been a renewed interest in how they can inform us about the seismic source, particularly in the geophysical monitoring community due to its application in event identification and yield analysis. However, parameter uncertainties in seismic MT inversion are rarely available. The inverse procedure often does not quantify MT model errors such as event location, data noise and Earth model that are essential for estimating solution robustness. To address this need, we propose to adopt the Bayesian probabilistic framework to incorporate uncertainties in MT inversions. In this study, we present the theoretical background of a probabilistic Bayesian framework for MT inversion accounting for model and measurements errors and illustrate the implementation of the method using a synthetic example.

58 GEOSCIENCES↗

Variational Continuous Assimilation of TMI and SSM/I Rain Rates: Impact on GEOS-3 Hurricane Analyses and Forecasts

We describe a variational continuous assimilation (VCA) algorithm for assimilating tropical rainfall data using moisture and temperature tendency corrections as the control variable to offset model deficiencies. For rainfall assimilation, model errors are of special concern since model-predicted precipitation is based on parameterized moist physics, which can have substantial systematic errors. This study examines whether a VCA scheme using the forecast model as a weak constraint offers an effective pathway to precipitation assimilation. The particular scheme we exarnine employs a '1+1' dimension precipitation observation operator based on a 6-h integration of a column model of moist physics from the Goddard Earth Observing System (GEOS) global data assimilation system DAS). In earlier studies, we tested a simplified version of this scheme and obtained improved monthly-mean analyses and better short-range forecast skills. This paper describes the full implementation ofthe 1+1D VCA scheme using background and observation error statistics, and examines how it may improve GEOS analyses and forecasts of prominent tropical weather systems such as hurricanes. Parallel assimilation experiments with and without rainfall data for Hurricanes Bonnie and Floyd show that assimilating 6-h TMI and SSM/I surfice rain rates leads to more realistic storm features in the analysis, which, in turn, provide better initial conditions for 5-day storm track prediction and precipitation forecast. These results provide evidence that addressing model deficiencies in moisture tendency may be crucial to making effective use of precipitation information in data assimilation.

Hou, Arthur Y.↗

The Impact of Model and Rainfall Forcing Errors on Characterizing Soil Moisture Uncertainty in Land Surface Modeling

The contribution of rainfall forcing errors relative to model (structural and parameter) uncertainty in the prediction of soil moisture is investigated by integrating the NASA Catchment Land Surface Model (CLSM), forced with hydro-meteorological data, in the Oklahoma region. Rainfall-forcing uncertainty is introduced using a stochastic error model that generates ensemble rainfall fields from satellite rainfall products. The ensemble satellite rain fields are propagated through CLSM to produce soil moisture ensembles. Errors in CLSM are modeled with two different approaches: either by perturbing model parameters (representing model parameter uncertainty) or by adding randomly generated noise (representing model structure and parameter uncertainty) to the model prognostic variables. Our findings highlight that the method currently used in the NASA GEOS-5 Land Data Assimilation System to perturb CLSM variables poorly describes the uncertainty in the predicted soil moisture, even when combined with rainfall model perturbations. On the other hand, by adding model parameter perturbations to rainfall forcing perturbations, a better characterization of uncertainty in soil moisture simulations is observed. Specifically, an analysis of the rank histograms shows that the most consistent ensemble of soil moisture is obtained by combining rainfall and model parameter perturbations. When rainfall forcing and model prognostic perturbations are added, the rank histogram shows a U-shape at the domain average scale, which corresponds to a lack of variability in the forecast ensemble. The more accurate estimation of the soil moisture prediction uncertainty obtained by combining rainfall and parameter perturbations is encouraging for the application of this approach in ensemble data assimilation systems.

Maggioni, V.↗

Determining Aircraft Moments of Inertia from Flight Test Data

Flight test maneuver design and dynamic modeling techniques were developed for determining aircraft moments of inertia from flight test data. Full nonlinear rigid-body rotational equations of motion were used in the analysis, with aerodynamic moment dependencies modeled by linear expansions in the aircraft states and controls. Aerodynamic parameters were estimated simultaneously with inertia parameters using equation-error modeling applied to flight test data from maneuvers designed specifically for this problem. The approach was demonstrated using a nonlinear F-16 simulation, then applied to a remotely-piloted subscale aircraft flight test. Errors in the aircraft moment of inertia parameters determined from simulated F-16 flight test maneuver data were less than 6 percent compared to the true values in the simulation. Flight test results for the subscale aircraft were within 6 percent of ground-test values obtained using the same aircraft.

moments of inertia↗

Quantifying and Visualizing Uncertainty for Source Localisation in Electrocardiographic Imaging

Electrocardiographic imaging (ECGI) presents a clinical opportunity to noninvasively understand the sources of arrhythmias for individual patients. To help increase the effectiveness of ECGI, we provide new ways to visualise associated measurement and modelling errors. Here, we study source localisation uncertainty in two steps: First, we perform Monte Carlo simulations of a simple inverse ECGI source localisation model with error sampling to understand the variations in ECGI solutions. Second, we present multiple visualisation techniques, including confidence maps, level-sets, and topology-based visualisations, to better understand uncertainty in source localization. Our approach offers a new way to study uncertainty in the ECGI pipeline.

47 OTHER INSTRUMENTATION↗

Robust Optimal Experimental Design of Infinite-Dimensional Bayesian Nonlinear Inverse Problems

Abstract. We consider robust optimal experimental design (ROED) for nonlinear Bayesian inverse problems governed by partial differential equations (PDEs). An optimal design is one that maximizes some utility quantifying the quality of the solution of an inverse problem. However, the optimal design is dependent on elements of the inverse problem such as the simulation model, the prior, or the measurement error model. ROED aims to produce an optimal design that is aware of the additional uncertainties encoded in the inverse problem and remains optimal even after variations in them. We follow a worst-case scenario approach to develop a new framework for robust optimal design of nonlinear Bayesian inverse problems. The proposed framework (a) is scalable and designed for infinite-dimensional Bayesian nonlinear inverse problems constrained by PDEs; (b) develops efficient approximations of the utility, namely the expected information gain; (c) employs eigenvalue sensitivity techniques to develop analytical forms and efficient evaluation methods of the gradient of the utility with respect to the uncertainties against which we wish to be robust; and (d) employs a probabilistic optimization paradigm that properly defines and efficiently solves the resulting combinatorial max-min optimization problem. The effectiveness of the proposed approach is illustrated for optimal sensor placement problem in an inverse problem governed by an elliptic PDE.

Chowdhary, Abhijit↗

Turbulent Processes that Influence Boundary-Layer Cloud Structure (Final Technical Report)

Many models of the atmosphere simulate vertical profiles of observable fields, such as temperature, moisture, and vertical velocity. To assess the realism of such model output, it is important to evaluate the modeled profiles against observations. However, many extant evaluations consist of comparing time averaged profiles from the model and the observations. Such time averages can smooth out unrealistic features that appear in instantaneous profiles. In this way, the time averages may obscure certain model errors from detection. For instance, many models misrepresent turbulent processes, leading to profiles that are too smoothed out or too noisy. E.g., if a model has coarse vertical resolution and overly strong diffusion, then the model may be unable to produce observed sharp peaks. On the other hand, a model may have artificial approximations that produce spurious jumps in the vertical. Much can be learned by browsing through instantaneous snapshots of model output. But the volume of output produced by a global model is far too great to rely purely on visual inspection. In addition, we need a way to statistically characterize the profiles, so that anomalies can be detected more conveniently.

54 ENVIRONMENTAL SCIENCES↗

ASTP ranging system mathematical model

A mathematical model is presented of the VHF ranging system to analyze the performance of the Apollo-Soyuz test project (ASTP). The system was adapted for use in the ASTP. The ranging system mathematical model is presented in block diagram form, and a brief description of the overall model is also included. A procedure for implementing the math model is presented along with a discussion of the validation of the math model and the overall summary and conclusions of the study effort. Detailed appendices of the five study tasks are presented: early late gate model development, unlock probability development, system error model development, probability of acquisition and model development, and math model validation testing.

Ellis, M. R.↗

Application of the CINGEN program a thermal network data generator

The application of the CINGEN computer program and two of its supporting programs for the evaluation of structural and thermal performance of physical systems was described. The CINGEN program was written and implemented to avoid the duplication effort of performing a finite element approach for structural analysis and a finite differencing technique for thermal analysis, as well as the desire for a geometrical representation of the thermal model to reduce modeling errors. The program simplifies the thermal modeling process by performing all of the capacitance and conductance calculations normally done by the analyst. Each solid element is divided into five tetrahedrons, allowing the total volume to be calculated precisely. A sample problem was illustrated.

Shultz, W. E.↗