Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

Exactly solvable model of light-scattering errors in quantum simulations with metastable trapped-ion qubits

Here, we analytically solve a model for light scattering in Ising dynamics of metastable atomic qubits, generalizing the approach of Foss-Feig et al. to include leakage outside the qubit manifold. We analyze the influence of these fundamental errors in simulations of proposed experiments with metastable levels of 40 Ca + ions in a Penning trap. We find that “effective magnetic fields” generated by leaked qubits have significant impacts on spin-spin correlation functions for Greenberger-Horne-Zeilinger state preparation or for quantum simulations with strong coupling, while spin squeezing uses a much weaker coupling and is largely insensitive to the simulated leakage errors, even with a few hundred ions. Our theory and results are expected to be useful in modeling a variety of metastable qubit experiments in the future.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Uncertainty analysis of correlated parameters in automated reaction mechanism generation

Abstract Uncertainty analysis is a useful tool for inspecting and improving detailed kinetic mechanisms because it can identify the greatest sources of model output error. Owing to the very nonlinear relationship between kinetic and thermodynamic parameters and computed concentrations, model predictions can be extremely sensitive to uncertainties in some parameters while uncertainties in other parameters can be irrelevant. Error propagation becomes even more convoluted in automatically generated kinetic models, where input uncertainties are correlated through kinetic rate rules and thermodynamic group values. Local and global uncertainty analyses were implemented and used to analyze error propagation in Reaction Mechanism Generator (RMG), an open‐source software for generating kinetic models. A framework for automatically assigning parameter uncertainties to estimated thermodynamics and kinetics was created, enabling tracking of correlated uncertainties. Local first‐order uncertainty propagation was implemented using sensitivities computed natively within RMG. Global uncertainty analysis was implemented using adaptive Smolyak pseudospectral approximations as implemented in the MIT Uncertainty Quantification Library to efficiently compute and construct polynomial chaos expansions to approximate the dependence of outputs on a subset of uncertain inputs. Cantera was used as a backend for simulating the reactor system in the global analysis. Analyses were performed for a phenyldodecane pyrolysis model. Local and global methods demonstrated similar trends; however, many uncertainties were significantly overestimated by the local analysis. Both local and global analyses show that correlated uncertainties based on kinetic rate rules and thermochemical groups drastically reduce a model's degrees of freedom and have a large impact on the determination of the most influential input parameters. These results highlight the necessity of incorporating uncertainty analysis in the mechanism generation workflow.

Gao, Connie W.↗

A model study of potential sampling errors due to data scatter around expendable bathythermograph transects in the tropical Pacific

A linear multiple vertical-mode model described by McPhaden et al. (1988) is used to examine potential errors due to data scatter around expendable bathythermograph (XBT) transects in the tropical Pacific. Two methods of sampling are compared. In the first, the model was sampled along approximately straight lines of grid points corresponding to the mean positions of XBT tracks in the eastern, central, and western Pacific; in the second, the model was sampled again at the dates and locations of actual XTB casts for 1979-1983. The model indicates that the data scattered zonally around XBT transects in general can lead to about 2 dyn cm error in dynamic height in composite sections of XBT data. Errors larger than 2 dyn cm occurred in regions where XBT sample spacing in the zonal direction was insufficient to resolve Rossby wave variations in the model.

Mcphaden, Michael J.↗

Organic Photovoltaic Efficiency Predictor: Data-Driven Models for Non-Fullerene Acceptor Organic Solar Cells

In the design of organic solar cells, there has been a need for materials with high power conversion efficiencies. Scharber’s model is commonly used to predict efficiency; however, it exhibits poor performance with new non-fullerene acceptor (NFA) devices, since it was designed for fullerene-based devices. In this work, an empirical model is proposed that can be a more accurate alternative for NFA organic solar cells. Additionally, many screening studies use computationally expensive methods. A model based on using semiempirical simplified time-dependent density functional theory (sTD-DFT) as an alternative method can accelerate the calculations and yield a similar accuracy. The models presented in this paper, termed organic photovoltaic efficiency predictor (OPEP) models, have shown significantly lower errors than previous models, with OPEP/B3LYP yielding errors of 1.53% and OPEP/sTD- DFT of 1.55%. As a result, the proposed computational models can be used for the fast and accurate screening of new high-efficiency NFAs/donor pairs.

14 SOLAR ENERGY↗

Results from a Sting Whip Correction Verification Test at the Langley 16-Foot Transonic Tunnel

In recent years, great strides have been made toward correcting the largest error in inertial Angle of Attack (AoA) measurements in wind tunnel models. This error source is commonly referred to as 'sting whip' and is caused by aerodynamically induced forces imparting dynamics on sting-mounted models. These aerodynamic forces cause the model to whip through an arc section in the pitch and/or yaw planes, thus generating a centrifugal acceleration and creating a bias error in the AoA measurement. It has been shown that, under certain conditions, this induced AoA error can be greater than one third of a degree. An error of this magnitude far exceeds the target AoA goal of 0.01 deg established at NASA Langley Research Center (LaRC) and elsewhere. New sting whip correction techniques being developed at LaRC are able to measure and reduce this sting whip error by an order of magnitude. With this increase of accuracy, the 0.01 deg AoA target is achievable under all but the most severe conditions.

Crawford, B. L.↗

Modeling Ring Current Proton Fluxes Using Artificial Neural Network and Van Allen Probe Measurements

Abstract Terrestrial ring current dynamics are a critical part of the near‐space environment, in that they directly drive geomagnetic field variations that control particle drifts, and define geomagnetic storms. The present study aims to specify a global and time‐varying distribution of ring current proton using geomagnetic indices and solar wind parameters with their history as input. We train an artificial neural network (ANN) model to reproduce proton fluxes measured by the Radiation Belt Storm Probes Ion Composition Experiment instrument onboard Van Allen Probes. By choosing optimal feature parameters and their history length, the model results show a high correlation and a small error between model specifications and satellite measurements. The modeled results well capture energy‐dependent proton dynamics in association with geomagnetic storms, including inward radial diffusion, acceleration and decay. Our ANN model produces proton fluxes with their corresponding 3D spatiotemporal variations, capturing the latitudinal distribution and local time asymmetry that are consistent with observations and that can further inform theory.

Li, Jinxing↗

Application of a new criterion for modeling systems

A new criterion is proposed for modeling systems which promises to be useful in deciding how complex a model should be. The criterion is based on the expected model response error instead of the error in fitting the data used for estimating the model parameters. The new criterion also does not require withholding data to be used exclusively for testing. There remains, however, the difficulty of testing a large number of candidate models that correspond to the combinations of terms used in the dynamic equations. A computational approach is suggested which greatly reduces the computations required in searching for the best model. In the suggested approach the gradient of the response with respect to the model coefficients is held fixed and numerous combinations of terms are assessed. After determining the most promising candidate model, the gradient is updated and the process is repeated. This procedure gives greater assurance that the best model is selected and does not rely on the analyst's judgement.

Taylor, L. W., Jr.↗

The application of sensitivity analysis to models of large scale physiological systems

A survey of the literature of sensitivity analysis as it applies to biological systems is reported as well as a brief development of sensitivity theory. A simple population model and a more complex thermoregulatory model illustrate the investigatory techniques and interpretation of parameter sensitivity analysis. The role of sensitivity analysis in validating and verifying models, and in identifying relative parameter influence in estimating errors in model behavior due to uncertainty in input data is presented. This analysis is valuable to the simulationist and the experimentalist in allocating resources for data collection. A method for reducing highly complex, nonlinear models to simple linear algebraic models that could be useful for making rapid, first order calculations of system behavior is presented.

Leonard, J. I.↗

Investigations of stability and dynamic performances of switching regulators employing current-injected control

The stability and dynamic performances of a buck/boost regulator employing a current-injected control are examined. Small-signal models for the power state, the multi-loop error processor and the duty-cycle pulse-modulator are developed. The error-processor model which incorporates the current-injected loop, the dc loop and the compensation network permits evaluation of the effects of each individual control loop and their combined efforts toward shaping the performance characteristics of the closed-loop system. Comparisons are made between this modeling approach and earlier approaches. Some important yet subtle dissimilarities are discussed. This model predicts the constant-frequency 50 percent duty-cycle instability which is inherent to the current-injected control.

Lee, F. C.↗

Evaluation of dual-weighted residual and machine learning error estimation for projection-based reduced-order models of steady partial differential equations

Projection-based reduced-order models (pROMs) show great promise as a means to accelerate many-query applications such as forward error propagation, solving inverse problems, and design optimization. In order to deploy pROMs in the context of high-consequence decision making, accurate error estimates are required to determine the region(s) of applicability in the parameter space. The following paper considers the dual-weighted residual (DWR) error estimate for pROMs and compares it to another promising pROM error estimate, machine learned error models (MLEM). Here, we show how DWR can be applied to ROMs and then evaluate DWR on two partial differential equations (PDEs): a two-dimensional linear convection–reaction–diffusion equation, and a three-dimensional static hyper-elastic beam. It is shown that DWR is able to estimate errors for pROMs extrapolating outside of their training set while MLEM is best suited for pROMs used to interpolate within the pROM training set.

42 ENGINEERING↗

Analysis and forecast intercomparisons using the FGGE SOP-1 data base

The First GARP Global Experiment (FGGE) data base has provided the research community with the most complete global coverage of meteorological informaiton since measurements were first taken. It is important to understand the characteristics of the FGGE data base in terms of its accuracy and representativeness compared to the true state of the atmosphere. The uncertainty associated with the initial conditions used in a numerical model plays a significant role in subsequent error growth as shown by predictability theory. The ultimate limit of forecast skill is directly related to the initial uncertainty. The accuracy of analyses using FGGE data base coupled with the errors due to modeling imperfections determines the present skill of numerical models. An estimte of initial uncertainty is determined by examining differences in several FGGE analyses. The estimate is then used to determine an ultimate limit of forecast skill from derived predictability error growth rates. Several different calculations of predictability error growth are also compared. Finally, present-day forecast skill using FGGE analyses is contrasted to the estimates of ultimate skill, and the partition of model error versus initial uncertainty is discussed.

Baumhefner, D. P.↗

System identification and model reduction using modulating function techniques

Weighted least squares (WLS) and adaptive weighted least squares (AWLS) algorithms are initiated for continuous-time system identification using Fourier type modulating function techniques. Two stochastic signal models are examined using the mean square properties of the stochastic calculus: an equation error signal model with white noise residuals, and a more realistic white measurement noise signal model. The covariance matrices in each model are shown to be banded and sparse, and a joint likelihood cost function is developed which links the real and imaginary parts of the modulated quantities. The superior performance of above algorithms is demonstrated by comparing them with the LS/MFT and popular predicting error method (PEM) through 200 Monte Carlo simulations. A model reduction problem is formulated with the AWLS/MFT algorithm, and comparisons are made via six examples with a variety of model reduction techniques, including the well-known balanced realization method. Here the AWLS/MFT algorithm manifests higher accuracy in almost all cases, and exhibits its unique flexibility and versatility. Armed with this model reduction, the AWLS/MFT algorithm is extended into MIMO transfer function system identification problems. The impact due to the discrepancy in bandwidths and gains among subsystem is explored through five examples. Finally, as a comprehensive application, the stability derivatives of the longitudinal and lateral dynamics of an F-18 aircraft are identified using physical flight data provided by NASA. A pole-constrained SIMO and MIMO AWLS/MFT algorithm is devised and analyzed. Monte Carlo simulations illustrate its high-noise rejecting properties. Utilizing the flight data, comparisons among different MFT algorithms are tabulated and the AWLS is found to be strongly favored in almost all facets.

Shen, Yan↗

Techno-economic implications and cost of forecasting errors in solar PV power production using optimized deep learning models

Accurate solar Photovoltaic (PV) power forecasting is important for enhancing both the performance and economic feasibility of PV systems. This study evaluates several deep learning models, including Dense Neural Networks (DNN), Long Short-Term Memory (LSTM), Convolutional Neural Networks (CNN), and a hybrid LSTMCNN model, for predicting PV power production one day in advance. Prior to optimization, the models exhibited relatively high errors, with the best model (DNN) achieving a Root Mean Square Error (RMSE) of 31.13 kW and a coefficient of determination (R 2 ) of 62.15 %. After employing Bayesian optimization, the LSTM-CNN model demonstrated the best performance, with the RMSE reduced to 9.79 kW and R 2 improved to 97.62 %, showcasing significant enhancement in predictive accuracy. Here, the economic evaluation considered three cases: rewards for underestimation (0.08 USD/kWh), no rewards, and penalties for both over-and underestimation (120 % of the utility tariff). In the rewards scenario, the LSTM-CNN model reduced the Levelized Cost of Electricity (LCOE) by 4 %, while in the penalty scenario, a backup diesel generator would have increased the LCOE by 49 %. Additionally, the LSTM-CNN model minimized financial losses, achieving the lowest penalties and maximizing net cash flow compared to other models, demonstrating its overall technical and economic superiority.

Deep learning↗

Robust Controller Synthesis for Vision-based Spacecraft Guidance and Control

This work develops a method for Robust Controller for Vision-based Spacecraft (RCVS) guidance and control, integral to the robust autonomy framework for multi-spacecraft for- mation control and reconfiguration applications. The method is built around the use of a photo-realistic simulator, where a camera is deployed on a tracking spacecraft (ego) in order to observe an uncontrolled spacecraft (target) in a Low Earth Orbit (LEO). In this direction, the proposed approach performs the relative state (attitude and position) estimation of the target spacecraft using Convolutional Neural Network (CNN). The state estimation error is then modeled and the corresponding error-bounds are obtained around a nominal trajectory of the ego and target spacecraft. Next, this work proposes a linear matrix inequalities (LMIs) based approach to controller synthesis, guaranteed to be robust against both model uncertainties and measurement errors, resulting from vision-based estimation. This controller is comprised of two distinct components, one synthesized based on the nominal trajectory, while the “robust” component corrects for deviations from the nominal trajectory. Finally, a tracking scenario that directly utilize the image data for spacecraft guidance and control, is presented to showcase the performance of the proposed robust autonomy framework.

Rahmani, Amir↗

Synoptic scale forecast skill and systematic errors in the MASS 2.0 model

The synoptic scale performance characteristics of MASS 2.0 are determined by comparing filtered 12-24 hr model forecasts to same-case forecasts made by the National Meteorological Center's synoptic-scale Limited-area Fine Mesh model. Characteristics of the two systems are contrasted, and the analysis methodology used to determine statistical skill scores and systematic errors is described. The overall relative performance of the two models in the sample is documented, and important systematic errors uncovered are presented.

Koch, S. E.↗

Sampling Versus Filtering in Large-Eddy Simulations

A LES formalism in which the filter operator is replaced by a sampling operator is proposed. The unknown quantities that appear in the LES equations originate only from inadequate resolution (Discretization errors). The resulting viewpoint seems to make a link between finite difference approaches and finite element methods. Sampling operators are shown to commute with nonlinearities and to be purely projective. Moreover, their use allows an unambiguous definition of the LES numerical grid. The price to pay is that sampling never commutes with spatial derivatives and the commutation errors must be modeled. It is shown that models for the discretization errors may be treated using the dynamic procedure. Preliminary results, using the Smagorinsky model, are very encouraging.

Debliquy, O.↗

Streamlining Ocean Dynamics Modeling with Fourier Neural Operators: A Multiobjective Hyperparameter and Architecture Optimization Approach

Training an effective deep learning model to learn ocean processes involves careful choices of various hyperparameters. We leverage DeepHyper’s advanced search algorithms for multiobjective optimization, streamlining the development of neural networks tailored for ocean modeling. The focus is on optimizing Fourier neural operators (FNOs), a data-driven model capable of simulating complex ocean behaviors. Selecting the correct model and tuning the hyperparameters are challenging tasks, requiring much effort to ensure model accuracy. DeepHyper allows efficient exploration of hyperparameters associated with data preprocessing, FNO architecture-related hyperparameters, and various model training strategies. We aim to obtain an optimal set of hyperparameters leading to the most performant model. Moreover, on top of the commonly used mean squared error for model training, we propose adopting the negative anomaly correlation coefficient as the additional loss term to improve model performance and investigate the potential trade-off between the two terms. The numerical experiments show that the optimal set of hyperparameters enhanced model performance in single timestepping forecasting and greatly exceeded the baseline configuration in the autoregressive rollout for long-horizon forecasting up to 30 days. Utilizing DeepHyper, we demonstrate an approach to enhance the use of FNO in ocean dynamics forecasting, offering a scalable solution with improved precision.

97 MATHEMATICS AND COMPUTING↗

Parametric Cost Modeling of Space Missions Using the Develop New Projects (DMP) Implementation Process

This paper presents an overview of a parametric cost model that has been built at JPL to estimate costs of future, deep space, robotic science missions. Due to the recent dramatic changes in JPL business practices brought about by an internal reengineering effort known as develop new products (DNP), high-level historic cost data is no longer considered analogous to future missions. Therefore, the historic data is of little value in forecasting costs for projects developed using the DNP process. This has lead to the development of an approach for obtaining expert opinion and also for combining actual data with expert opinion to provide a cost database for future missions. In addition, the DNP cost model has a maximum of objective cost drivers which reduces the likelihood of model input error. Version 2 is now under development which expands the model capabilities, links it more tightly with key design technical parameters, and is grounded in more rigorous statistical techniques. The challenges faced in building this model will be discussed, as well as it's background, development approach, status, validation, and future plans.

Rosenberg, Leigh↗