Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Comparison of Response Surface and Kriging Models in the Multidisciplinary Design of an Aerospike Nozzle

The use of response surface models and kriging models are compared for approximating non-random, deterministic computer analyses. After discussing the traditional response surface approach for constructing polynomial models for approximation, kriging is presented as an alternative statistical-based approximation method for the design and analysis of computer experiments. Both approximation methods are applied to the multidisciplinary design and analysis of an aerospike nozzle which consists of a computational fluid dynamics model and a finite element analysis model. Error analysis of the response surface and kriging models is performed along with a graphical comparison of the approximations. Four optimization problems are formulated and solved using both approximation models. While neither approximation technique consistently outperforms the other in this example, the kriging models using only a constant for the underlying global model and a Gaussian correlation function perform as well as the second order polynomial response surface models.

Simpson, Timothy W.↗

Comparison of Response Surface and Kriging Models for Multidisciplinary Design Optimization

In this paper, we compare and contrast the use of second-order response surface models and kriging models for approximating non-random, deterministic computer analyses. After reviewing the response surface method for constructing polynomial approximations, kriging is presented as an alternative approximation method for the design and analysis of computer experiments. Both methods are applied to the multidisciplinary design of an aerospike nozzle which consists of a computational fluid dynamics model and a finite-element model. Error analysis of the response surface and kriging models is performed along with a graphical comparison of the approximations, and four optimization problems m formulated and solved using both sets of approximation models. The second-order response surface models and kriging models-using a constant underlying global model and a Gaussian correlation function-yield comparable results.

Simpson, Timothy W.↗

Models of Sector Flows Under Local, Regional and Airport Weather Constraints

Recently, the ATM community has made important progress in collaborative trajectory management through the introduction of a new FAA traffic management initiative called a Collaborative Trajectory Options Program (CTOP). FAA can use CTOPs to manage air traffic under multiple constraints (manifested as flow constrained areas or FCAs) in the system, and it allows flight operators to indicate their preferences for routing and delay options. CTOPs also permits better management of the overall trajectory of flights by considering both routing and departure delay options simultaneously. However, adoption of CTOPs in airspace has been hampered by many factors that include challenges in how to identify constrained areas and how to set rates for the FCAs. Decision support tools providing assistance would be particularly helpful in effective use of CTOPs. Such DSTs tools would need models of demand and capacity in the presence of multiple constraints. This study examines different approaches to using historical data to create and validate models of maximum flows in sectors and other airspace regions in the presence of multiple constraints. A challenge in creating an empirical model of flows under multiple constraints is a lack of sufficient historical data that captures diverse situations involving combinations of multiple constraints especially those with severe weather. The approach taken here to deal with this is two-fold. First, we create a generalized sector model encompassing multiple sectors rather than individual sectors in order to increase the amount of data used for creating the model by an order of magnitude. Secondly, we decompose the problem so that the amount of data needed is reduced. This involves creating a baseline demand model plus a separate weather constrained flow reduction model and then composing these into a single integrated model. A nominal demand model is a flow model (gdem) in the presence of clear local weather. This defines the flow as a function of weather constraints in neighboring regions, airport constraints and weather in locations that can cause re-routes to the location of interest. A weather constrained flow reduction model (fwx-red) is a model of reduction in baseline counts as a function of local weather. Because the number of independent variables associated with each of the two decomposed models is smaller than that with a single model, need for amount of data is reduced. Finally, a composite model that combines these two can be represented as fwx-red (gdem(e), l) where e represents non-local constraints and l represents local weather. The approaches studied to developing these models are divided into three categories: (1) Point estimation models (2) Empirical models (3) Theoretical models. Errors in predictions of these different types of models have been estimated. In situations when there is abundant data, point estimation models tend to be very accurate. In contrast, empirical models do better than theoretical models when there is some data available. The biggest benefit of theoretical models is their general applicability in wider range situations once the degree of accuracy of these has been established.

Kulkarni, Deepak↗

Models of Sector Aircraft Counts in the Presence of Local, Regional and Airport Constraints

Recently, the ATM community has made important progress in collaborative trajectory management through the introduction of a new FAA traffic management initiative called a Collaborative Trajectory Options Program (CTOP). FAA can use CTOPs to manage air traffic under multiple constraints (manifested as flow constrained areas or FCAs) in the system, and it allows flight operators to indicate their preferences for routing and delay options. CTOPs also permits better management of the overall trajectory of flights by considering both routing and departure delay options simultaneously. However, adoption of CTOPs in airspace has been hampered by many factors that include challenges in how to identify constrained areas and how to set rates for the FCAs. Decision support tools providing assistance would be particularly helpful in effective use of CTOPs. Such DSTs tools would need models of demand and capacity in the presence of multiple constraints. This study examines different approaches to using historical data to create and validate models of maximum flows in sectors and other airspace regions in the presence of multiple constraints. A challenge in creating an empirical model of flows under multiple constraints is a lack of sufficient historical data that captures diverse situations involving combinations of multiple constraints especially those with severe weather. The approach taken here to deal with this is two-fold. First, we create a generalized sector model encompassing multiple sectors rather than individual sectors in order to increase the amount of data used for creating the model by an order of magnitude. Secondly, we decompose the problem so that the amount of data needed is reduced. This involves creating a baseline demand model plus a separate weather constrained flow reduction model and then composing these into a single integrated model. A nominal demand model is a flow model (gdem) in the presence of clear local weather. This defines the flow as a function of weather constraints in neighboring regions, airport constraints and weather in locations that can cause re-routes to the location of interest. A weather constrained flow reduction model (fwx-red) is a model of reduction in baseline counts as a function of local weather. Because the number of independent variables associated with each of the two decomposed models is smaller than that with a single model, need for amount of data is reduced. Finally, a composite model that combines these two can be represented as fwx-red (gdem(e), l) where e represents non-local constraints and l represents local weather. The approaches studied to developing these models are divided into three categories: (1) Point estimation models (2) Empirical models (3) Theoretical models. Errors in predictions of these different types of models have been estimated. In situations when there is abundant data, point estimation models tend to be very accurate. In contrast, empirical models do better than theoretical models when there is some data available. The biggest benefit of theoretical models is their general applicability in wider range situations once the degree of accuracy of these has been established.

Kulkarni, Deepak↗

Attribution of multi-annual to decadal changes in the climate system: The Large Ensemble Single Forcing Model Intercomparison Project (LESFMIP)

Multi-annual to decadal changes in climate are accompanied by changes in extreme events that cause major impacts on society and severe challenges for adaptation. Early warnings of such changes are now potentially possible through operational decadal predictions. However, improved understanding of the causes of regional changes in climate on these timescales is needed both to attribute recent events and to gain further confidence in forecasts. Here we document the Large Ensemble Single Forcing Model Intercomparison Project that will address this need through coordinated model experiments enabling the impacts of different external drivers to be isolated. We highlight the need to account for model errors and propose an attribution approach that exploits differences between models to diagnose the real-world situation and overcomes potential errors in atmospheric circulation changes. The experiments and analysis proposed here will provide substantial improvements to our ability to understand near-term changes in climate and will support the World Climate Research Program Lighthouse Activity on Explaining and Predicting Earth System Change.

decadal climate↗

Cloud Influence on ERA5 and AMPS Surface Downwelling Longwave Radiation Biases in West Antarctica

The surface downwelling longwave radiation component (LW[down arrow]) is crucial for the determination of the surface energy budget and has significant implications for the resilience of ice surfaces in the polar regions. Accurate model evaluation of this radiation component requires knowledge about the phase, vertical distribution, and associated temperature of water in the atmosphere, all of which control the LW[down arrow] signal measured at the surface. In this study, we examine the LW[down arrow] model errors found in the Antarctic Mesoscale Prediction System (AMPS) operational forecast model and the ERA5 reanalysis model relative to observations from the AWARE campaign at McMurdo Station and the West Antarctic Ice Sheet (WAIS) Divide. The errors are calculated separately for observed clear-sky conditions, ice-cloud occurrences, and liquid-bearing cloud layer (LBCL) occurrences. The analysis results show a tendency in both models at each site to underestimate the LW[down arrow] during clear sky conditions, high error variability (standard deviations > 20 W/m[exp2]) during any type of cloud occurrence, and negative LW biases when LBCLs are observed (bias magnitudes > 15 W/m[exp2] in tenuous LBCL cases; > 43 W/m[exp2] in optically thick/opaque LBCLs instances). We suggest that a generally dry and liquid-deficient atmosphere responsible for the identified LW[down arrow] biases in both models is the result of excessive ice formation and growth, which could stem from model initial and lateral boundary conditions, microphysics scheme, aerosol representation, and/or limited vertical resolution.

Israel Silber↗

Structural error and identifiability

In most identification problems, the possibility of identifying a model from the observation of input and output is approached by first assuming that the model is an exact representation of the process. Since models are only approximations to a real process, this paper presents a concrete way of taking into account the difference in structure between the model and the process it represents. The identifiability problem is reformulated on the basis of equivalence and near-equivalence between model and process. Necessary and sufficient conditions under which the differences between the outputs of the process and a model remains within a desired bound in the presence of modeling error are given. Necessary and sufficient conditions for the identifiability of parameters are presented.

Hadaegh, F. Y.↗

A multi-year short-range hindcast experiment with CESM1 for evaluating climate model moist processes from diurnal to interannual timescales

Abstract. We present a multi-year short-range hindcast experiment and its experimental design for better evaluation of both the mean state and variability of atmospheric moist processes in climate models from diurnal to interannual timescales and facilitate model development. We used the Community Earth System Model version 1 as the base model and performed a suite of 3 d hindcasts initialized every day starting at 00:00 Z from 1997 to 2012. Three processes – the diurnal cycle of clouds during different cloud regimes over the central US, precipitation and diabatic heating associated with the Madden–Julian Oscillation (MJO), and the response of precipitation, surface radiative and heat fluxes, as well as zonal wind stress to sea surface temperature anomalies associated with the El Niño–Southern Oscillation – are evaluated as examples to demonstrate how one can better utilize simulations from this experiment to gain insights into model errors and their connection to physical parameterizations or large-scale state. This is achieved by comparing the hindcasts with corresponding long-term observations for periods based on different phenomena. These analyses can only be done through this multi-year hindcast approach to establish robust statistics of the processes under well-controlled large-scale environment because these phenomena are either a result of interannual climate variability or only happen a few times in a given year (e.g., MJO, or cloud regime types). Furthermore, comparison of hindcasts to the typical simulations in climate mode with the same model allows one to infer what portion of a model's climate error directly comes from fast errors in the parameterizations of moist processes. As demonstrated here, model biases in the mean state and variability associated with parameterized moist processes usually develop within a few days and manifest within weeks to affect the simulations of large-scale circulation and ultimately the climate mean state and variability. Therefore, model developers can achieve additional useful understanding of the underlying problems in model physics by conducting a multi-year hindcast experiment.

54 ENVIRONMENTAL SCIENCES↗

Dark Energy Survey Year 6 Results: Point-Spread Function Modeling

We present the point-spread function (PSF) modeling for weak lensing shear measurement using the full six years of the Dark Energy Survey (DES Y6) data. We review the PSF estimation procedure using the PIFF (PSFs In the Full FOV) software package and describe the key improvements made to PIFF and modeling diagnostics since the DES year three (Y3) analysis: (i) use of external Gaia and infrared photometry catalogs to ensure higher purity of the stellar sample used for model fitting, (ii) addition of color-dependent PSF modeling, the first for any weak lensing analysis, and (iii) inclusion of model diagnostics inspecting fourth-order moments, which can bias weak lensing measurements to a similar degree as second-order modeling errors. Through a comprehensive set of diagnostic tests, we demonstrate the improved accuracy of the Y6 models evident in significantly smaller systematic errors than those of the Y3 analysis, in which all g band data were excluded due to insufficiently accurate PSF models. For the Y6 weak lensing analysis, we include g band photometry data in addition to the riz bands, providing a fourth band for photometric redshift estimation. Looking forward to the next generation of wide-field surveys, we describe several ongoing improvements to PIFF, which will be the default PSF modeling software for weak lensing analyses for the Vera C. Rubin Observatory’s Legacy Survey of Space and Time.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Modeling human response errors in synthetic flight simulator domain

This paper presents a control theoretic approach to modeling human response errors (HRE) in the flight simulation domain. The human pilot is modeled as a supervisor of a highly automated system. The synthesis uses the theory of optimal control pilot modeling for integrating the pilot's observation error and the error due to the simulation model (experimental error). Methods for solving the HRE problem are suggested. Experimental verification of the models will be tested in a flight quality handling simulation.

Ntuen, Celestine A.↗

The rigorous upscaling of advection-dominated transport in heterogeneous porous media via the Method of Finite Averages

Systems involving advection-dominated transport through heterogeneous porous and fractured media are ubiquitous in subsurface engineering applications. However, upscaling such systems continues to challenge rigorous modeling efforts, particularly when advection is stronger than diffusion at fine spatial scales (i.e., when the Péclet number is greater than one at length scales that characterize a system’s unit-cells, representative elementary volumes, or averaging regions). Here, in this work, we propose and validate a strategy for extending the Method of Finite Averages (MoFA), a rigorous upscaling methodology for heterogeneous porous media, to upscale transport systems experiencing stronger advection than diffusion at fine scales (i.e., fine-scale Péclet numbers greater than one). We detail the strategy, the physical conditions under which it can be applied while retaining a priori modeling error guarantees, and implement the strategy to obtain a MoFA model for advective-diffusive transport that accommodates advective physics at fine spatial scales. We then perform two numerical experiments considering systems with system-scale Péclet numbers of 300 and 1000 — which correspond to fine-scale Péclet numbers of 30 and 100, respectively — to verify that the error guarantees are met under the strategy. After, we conduct a numerical study to demonstrate the strategy’s advantages over the original MoFA methodology. The results suggest that rigorously-upscaled transport models for heterogeneous porous media experiencing advective physics at finer spatial scales can be derived through MoFA and resolved orders of magnitude faster than their pore-scale counterparts. The results also suggest that the presented strategy is limited to modeling shallow concentration gradients when there are large differences between the time scales related to advection and a system’s temporally-varying boundary conditions. This limitation hinders the strategy’s practicality in modeling more advective systems, and as such, opportunity exists for developing additional strategies that accommodate rapidly-varying boundary conditions — and consequentially, steeper concentration gradients — while modeling advective systems with MoFA.

36 MATERIALS SCIENCE↗

TQEA: Temporal Quantum Error Analysis

For the last few years quantum computers have captured researchers’ interest in solving complicated problems in finance, chemistry, machine learning, and many other NP problems. Quantum computing benefits from parallel computation, entanglement, and calculation speedup compared to classical computing. Even though the operations and number of qubits in quantum computers are limited, previous research showed that using quantum computers can be beneficial. These benefits gained researchers’ interest to work on the improvement of quantum computers and overcome the limitations by building more advanced quantum computers with fault tolerance capability, more physical qubits, and better operational gates. In practice, Quantum applications would be translated into Quantum Circuits and each circuit can contain one or many entanglements (s), single qubits operations, and readouts. The importance of running Quantum applications with controlled errors or without errors is critical to the desired result from Quantum readout. In this paper, we study the characteristics of superconducting quantum machines along with the previously proposed methods of Quantum error detection/correction and in order to build a better error model we propose a temporal method for analyzing the the behavior of qubits errors (T1 and T2), frequency of operation, entanglement errors, and readout errors. In order to detect and predict the behavior of each machine, we use simple exponential smoothing analysis on heuristic calibration data. Finally, based on observation, we show that based on frequency, qubits, readout and single operation errors we can build a temporal based model to study and predict the outcome of runs on each Quantum machine.

Baheri, Betis↗

Line-of-sight control of the CSI evolutionary model - mu control

The design, analysis, and simulation of a control law that guarantees a fine pointing performance under external disturbances and model uncertainties are investigated. The authors examine the achievable performance and modeling errors for the control-structure interaction (CSI) evolutionary model structure and highlight the importance of accurate knowledge of structural frequencies and damping values for very lightly damped structures. Numerical results indicate that a limited but significant line-of-sight pointing performance robustness can be attained in spite of modeled structured and unstructured uncertainties in the system. The simulation results reported demonstrate typical performance levels, types of uncertainties and their magnitudes, and design tradeoffs for a realistic laboratory model of a large flexible space structure.

Lim, K. B.↗

Progress in simulating industrial flows using two-equation models: Can more be achieved with further research?

This viewgraph presentation provides a brief review of two-equation eddy-viscosity models (TEM's) from the perspective of applied CFD. It provides objective assessment of both well-known and newer models, compares model predictions from various TEM's with experiments, identifies sources of modeling error and gives historical perspective of their effects on model performance and assessment, and recommends directions for future research on TEM's.

Haroutunian, Vahe↗

Advanced Payload Transfer Measurement System (APT-MS) Mechanical Features

During the last two feet or so of transfer, for a large or heavy payload to its restraining fixture, the consequences of unplanned contact (or impact) between payload and support structure can range from merely annoying to something approaching disaster. Current transfer methods employ technicians with meter sticks stationed at the various hold-down locations to estimate the distances to contact. This information is communicated orally to the crane operator. It is understandable that this work proceeds carefully and therefore slowly. The objectives of this study are (1) to explore mechanical sources of measurement error; and (2) to develop an improved prototype design that is compact, inexpensive, and addresses the measurement error issues. APT is a relatively inexpensive electro-mechanical device that reduces both time and manpower required to make shuttle payload transfers. APT measurement system would provide a GUI for the 'move-conductor' (crane operator) so he could see the displacements of all hold-down interfaces as they move together and thus have a more accurate, comprehensive and 'real-time' picture of the engagement activity. An error model attempts to include all estimatable sources of mechanical error and design features were introduced to reduce or eliminate major sources of error.

Brewer, William V.↗

An IR Sounding-Based Analysis of the Saharan Air Layer in North Africa

Intense daytime surface heating over barren-to-sparsely vegetated surfaces results in dry convective mixing. In the absence of external forcing such as mountain waves, the dry convection can produce a deep, well-mixed, nearly isentropic boundary layer that becomes a well-mixed residual layer in the evening. These well-mixed layers (WML) retain their unique mid-tropospheric thermal and humidity structure for several days. To detect the SAL and characterize its properties, AIRS Level 2 Ver. 6 temperature and humidity products (2003-Present) are evaluated against rawinsondes and compared to model analysis at each of the 55 rawinsonde stations in northern Africa. To distinguish WML from Saharan air layers (WMLs of Saharan origin), the detection involved a two-step process: 1) algorithm-based detection of WMLs in dry environments (less than 7 g per kilogram mixing ratio) 2) identification of Sahara air layers (SAL) by applying Hybrid Single Particle Lagrangian Integrated Trajectory (HYSPLIT) back trajectories to determine the history of each WML. WML occurrence rates from AIRS closely resemble that from rawinsondes, yet rates from model analysis were up to 30% higher than observations in the Sahara due to model errors. Despite the overly frequent occurrence of WMLs from model analysis, HYSPLIT trajectory analysis showed that SAL occurrence rates (given a WML exists) from rawinsondes, AIRS, and model analysis were nearly identical. Although the number of WMLs varied among the data sources, the proportion of WMLs which were classified as SAL was nearly the same. The analysis of SAL bulk properties showed that AIRS and model analysis exhibited a slight warm and moist bias relative to rawinsondes in non-Saharan locations, but model analysis was notably warmer than rawinsondes and AIRS within the Sahara. The latter result is likely associated with the dearth of available data assimilated by model analysis in the Sahara. The variability of SAL thicknesses was reasonably captured by both AIRS and model analysis, but the former favor layers than are thinner than observations. Finally, further analysis of HYSPLIT trajectories revealed that fewer than 10% and 33% of all SAL back trajectories passed through regions with notable precipitation (>100 mm accumulated along the trajectory path) or Aerosol Optical Depth (AOD greater than 0.4, 75th percentile of AOD) on average, respectively. Trajectory analysis indicated that only 57% of Saharan and 24% of non-Saharan WMLs are definitively of Saharan origin (Saharan requirement: Two consecutive days in Sahara and 24 or more of those hours within 72 hours of detection). Non-SAL WMLs either originate from local-to-regionally generated residual layers or from mid-latitude air streams that do not linger over the Sahara for a sufficient time period. Initial analysis shows these non-SAL WMLs tend to be both notably cooler and slightly moister than their SAL counter parts. Continuing analysis will address what role Saharan and non-Saharan air masses characteristics may play on local and regional environmental conditions.

Nicholls, Stephen D.↗

Effect of Cross-Correlation of Orbital Error on Probability of Collision Determination

This paper discusses the effect of global model error on probability of collision (Pc) determination. Modifications to the Pc formulation for cross-correlation of orbital error in prediction are developed and assessed for recent conjunctions. While specific geometries can be identified or constructed to produce significant change in Pc for the modified formulation, it is of operational interest to quantify the relative occurrence of such cases for satellite conjunction risk assessment. Such analysis is feasible per data collections in place over the past year.

Cross-correlation↗