Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Comparisons of Two Spatial Implementations of a Crop Model Using Remotely Sensed Observations over Southeastern United States

Global food security is one of the most pressing issues of the current century, particularly for developing nations. Agricultural simulation models can be a key component in testing new technologies, seeds and cultivars etc. However, inaccurate input information, model related errors and the mode of implementation can also add to model uncertainties. In this study, the crop model is implemented in two separate fashions: a)gridded (GriDSSAT model) and b) using random spatial ensembles (RHEAS model). This is done in the Southeastern US to evaluate and understand the modelperformance over a region data availabilities. Once the model performance is assessed, multiple satellite based earth observation parameters such as soil moisture, vegetation index etc. can be assimilated into crop models to reduce input and model related uncertainties particularly in data limited regions. In this study, the National Agricultural Statistical Services (NASS) reported yield data at county levels are used for comparison andvalidation purposes. The GriDSSAT model estimation of corn yields in comparison with the reported NASS yields showed an overall RMSD of nearly 3720 (kg/ha) whereas RMSD for the RHEAS model implementation was 3550 (kg/ha). Overall the GriDSSAT model had negative bias of nearly 2400 kg/ha (except for 2013) while RHEAS had a slight positive bias of 400 kg/ha (approx.).

SERVIR↗
NASA NTRSDate not supplied

TPSAS-NF1676L-17931-DND

Many geophysical variables including temperature, clouds, and precipitation exhibit robust diurnal cycles in response to the daily cycle of solar insolation. Due to the fundamental nature of this variability, it is critical that weather and climate models accurately represent the diurnal cycle. Numerical model, however, have difficulty reproducing this observed diurnal cycle behavior, which leads to systematic errors in model representation of earth energy budget terms: including TOA and surface radiation, precipitation, and surface latent and sensible heat fluxes. This study evaluates the regional diurnal cycle in the Tropics within reanalysis models (ERA-Interim and MERRA) and quantifies systematic errors in the simulated TOA flux and precipitation due to biases in the diurnal cycle representation. The focus of this study is to quantify the importance of diurnal cycle simulation to systematic bias in reanalysis data set climatologies.

Patrick C Taylor↗
DOE OSTI2021

Case study: Accounting for response measurement error in fitting a regression model

This article presents a case study motivated by a plot of data that suggested an emerging trend that the authors were faced with explaining. When the measurement error of the data is accounted for, it turns out there was no real trend. Furthermore, this article shows how to use a Bayesian modeling approach to account for the measurement error.

42 ENGINEERING↗
NASA NTRS1995

A Reduced Dimension Static, Linearized Kalman Filter and Smoother

An approximate Kalman filter and smoother, based on approximations of the state estimation error covariance matrix, is described. Approximations include a reduction of the effective state dimension, use of a static asymptotic error limit, and a time-invariant linearization of the dynamic model for error integration. The approximations lead to dramatic computational savings in applying estimation theory to large complex systems. Examples of use come from TOPEX/POSEIDON.

Kalman filter smoother modeling ocean simulation↗
NASA NTRS1994

NCAR CCM2 simulation of the modern Antarctic climate

The National Center for Atmospheric Research (NCAR) community climate model version 2 (CCM2) simulation of the circumpolar trough, surface air temperature, the polar vortex, cloudiness, winds, and atmospheric moisture and energy budgets are examined to validate the model's representation of the present-day Antarctic climate. The results show that the CCM2 can well simulate many important climate features over Antarctica, such as the location and intensity of the circumpolar trough, the coreless winter over the plateau, the intensity and horizontal distribution of the surface inversion, the speed and streamline pattern of the katabatic winds, the double jet stream feature over the southern Indian and Pacific oceans, and the arid climate over the continent. However, there are also some serious errors in the model. Some are due to old problems but some are caused by the new parameterizations in the model. The model errors over high southern latitudes can be summarized as follows: The circumpolar trough, the polar vertex, and the westerlies in midlatitudes are too strong; the semiannual cycle of the circumpolar trough is distorted compared to the observations; the low centers of the circumpolar trough and the troughs in the middle and upper troposphere are shifted eastward by 15 deg - 40 deg longitude; the surface temperatures are too cold over the plateau in summer and over the coastline in winter; the polar tropopause continues to have a cold bias; and the cloudiness is too high over the continent. These biases are induced by two major factors: (1) the cloud optical properties in tropical and middle latitudes, which cause the eastward shift of troughs and surface low centers and the error in the semiannual cycle, and (2) the cold bias of the surface air temperature, which is attributed to the oversimulation of cloudiness over the continent, especially during summer, and the uniform 2-m-thick sea ice. The constant thickness of sea ice suppresses the energy flux from the ocean to the atmosphere and hence reduces the air temperature near the coast during winter. Finally, although the simulated Antarctic climate still suffers these biases, the overall performance of the CCM2 is much better than that of the CCM1-T42. Therefore the CCM2 is good enough to be used for climate change studies, especially over Antarctica.

Tzeng, Ren-Yow↗
NASA NTRS2012

Error Reduction Methods for Integrated-path Differential-absorption Lidar Measurements

We report new modeling and error reduction methods for differential-absorption optical-depth (DAOD) measurements of atmospheric constituents using direct-detection integrated-path differential-absorption lidars. Errors from laser frequency noise are quantified in terms of the line center fluctuation and spectral line shape of the laser pulses, revealing relationships verified experimentally. A significant DAOD bias is removed by introducing a correction factor. Errors from surface height and reflectance variations can be reduced to tolerable levels by incorporating altimetry knowledge and "log after averaging", or by pointing the laser and receiver to a fixed surface spot during each wavelength cycle to shorten the time of "averaging before log".

averging before log↗
NASA NTRS1982

Evaluation of Thompson-type trend and monthly weather data models for corn yields in Iowa, Illinois, and Indiana

An evaluation was made of Thompson-Type models which use trend terms (as a surrogate for technology), meteorological variables based on monthly average temperature, and total precipitation to forecast and estimate corn yields in Iowa, Illinois, and Indiana. Pooled and unpooled Thompson-type models were compared. Neither was found to be consistently superior to the other. Yield reliability indicators show that the models are of limited use for large area yield estimation. The models are objective and consistent with scientific knowledge. Timely yield forecasts and estimates can be made during the growing season by using normals or long range weather forecasts. The models are not costly to operate and are easy to use and understand. The model standard errors of prediction do not provide a useful current measure of modeled yield reliability.

French, V.↗
NASA NTRS1983

Analysis of shuttle oscillation in the Mach Number = 1.7 to Mach Number = 1.0 range

The first five flights of the Space Transportation System (STS) have exhibited unexpected lateral oscillations in the Mach Number = 1.7 to Mach Number = 1.0 region of the descent trajectory. These oscillations can be split into two parts: a predominantly rolling oscillation referred to as the quarter hertz motion and a long-priod, large-amplitude oscillation in sideslips, roll rate, and yaw rate. These motions are analyzed in this paper in order to determine their source and the mechanism driving them. They will first be examined to determine how much of the motion can be explained using the set of equations that contain linear aerodynamic parameters. Then differences between measured moments and those calculated using linear aerodynamics which are considered to be due to unmodeled moments will be exained. Possible error sources such as not inluding nonlinear aerodynamics in the vehicle model, measurement errors, and the effect of pressure gradients will be considered. Based on these analyses, conclusions as to the nature and cause of the Shuttle lateral oscillations will be drawn.

Suit, W. T.↗
NASA NTRS2003

Modeling Aircraft Wing Loads from Flight Data Using Neural Networks

Neural networks were used to model wing bending-moment loads, torsion loads, and control surface hinge-moments of the Active Aeroelastic Wing (AAW) aircraft. Accurate loads models are required for the development of control laws designed to increase roll performance through wing twist while not exceeding load limits. Inputs to the model include aircraft rates, accelerations, and control surface positions. Neural networks were chosen to model aircraft loads because they can account for uncharacterized nonlinear effects while retaining the capability to generalize. The accuracy of the neural network models was improved by first developing linear loads models to use as starting points for network training. Neural networks were then trained with flight data for rolls, loaded reversals, wind-up-turns, and individual control surface doublets for load excitation. Generalization was improved by using gain weighting and early stopping. Results are presented for neural network loads models of four wing loads and four control surface hinge moments at Mach 0.90 and an altitude of 15,000 ft. An average model prediction error reduction of 18.6 percent was calculated for the neural network models when compared to the linear models. This paper documents the input data conditioning, input parameter selection, structure, training, and validation of the neural network models.

Allen, Michael J.↗
NASA NTRS2004

Model Update of a Micro Air Vehicle (MAV) Flexible Wing Frame with Uncertainty Quantification

This paper describes a procedure to update parameters in the finite element model of a Micro Air Vehicle (MAV) to improve displacement predictions under aerodynamics loads. Because of fabrication, materials, and geometric uncertainties, a statistical approach combined with Multidisciplinary Design Optimization (MDO) is used to modify key model parameters. Static test data collected using photogrammetry are used to correlate with model predictions. Results show significant improvements in model predictions after parameters are updated; however, computed probabilities values indicate low confidence in updated values and/or model structure errors. Lessons learned in the areas of wing design, test procedures, modeling approaches with geometric nonlinearities, and uncertainties quantification are all documented.

Reaves, Mercedes C.↗
DOE OSTI2021

Can Simple Machine Learning Tools Extend and Improve Temperature-Based Methods to Infer Streambed Flux?

Temperature-based methods have been developed to infer 1D vertical exchange flux between a stream and the subsurface. Current analyses rely on fitting physically based analytical and numerical models to temperature time series measured at multiple depths to infer daily average flux. These methods have seen wide use in hydrologic science despite strong simplifying assumptions including a lack of consideration of model structural error or the impacts of multidimensional flow or the impacts of transient streambed hydraulic properties. We performed a “perfect-model experiment” investigation to examine whether regression trees, with and without gradient boosting, can extract sufficient information from model-generated subsurface temperature time series, with and without added measurement error, to infer the corresponding exchange flux time series at the streambed surface. Using model-generated, synthetic data allowed us to assess the basic limitations to the use of machine learning; further examination of real data is only warranted if the method can be shown to perform well under these ideal conditions. We also examined whether the inherent feature importance analyses of tree-based machine learning methods can be used to optimize monitoring networks for exchange flux inference.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1992

Dynamic performance of an aero-assist spacecraft - AFE

Dynamic performance of the Aero-assist Flight Experiment (AFE) spacecraft was investigated using a high-fidelity 6-DOF simulation model. Baseline guidance logic, control logic, and a strapdown navigation system to be used on the AFE spacecraft are also modeled in the 6-DOF simulation. During the AFE mission, uncertainties in the environment and the spacecraft are described by an error space which includes both correlated and uncorrelated error sources. The principal error sources modeled in this study include navigation errors, initial state vector errors, atmospheric variations, aerodynamic uncertainties, center-of-gravity off-sets, and weight uncertainties. The impact of the perturbations on the spacecraft performance is investigated using Monte Carlo repetitive statistical techniques. During the Solid Rocket Motor (SRM) deorbit phase, a target flight path angle of -4.76 deg at entry interface (EI) offers very high probability of avoiding SRM casing skip-out from the atmosphere. Generally speaking, the baseline designs of the guidance, navigation, and control systems satisfy most of the science and mission requirements.

Chang, Ho-Pen↗
NASA NTRS1988

A study for systematic errors of the GLA forecast model in tropical regions

From the sensitivity studies performed with the Goddard Laboratory for Atmospheres (GLA) analysis/forecast system, it was revealed that the forecast errors in the tropics affect the ability to forecast midlatitude weather in some cases. Apparently, the forecast errors occurring in the tropics can propagate to midlatitudes. Therefore, the systematic error analysis of the GLA forecast system becomes a necessary step in improving the model's forecast performance. The major effort of this study is to examine the possible impact of the hydrological-cycle forecast error on dynamical fields in the GLA forecast system.

Chen, Tsing-Chang↗
DOE OSTI2021

Utilizing physics-based input features within a machine learning model to predict wind speed forecasting error

Machine learning is quickly becoming a commonly used technique for wind speed and power forecasting. Many machine learning methods utilize exogenous variables as input features, but there remains the question of which atmospheric variables are most beneficial for forecasting, especially in handling non-linearities that lead to forecasting error. This question is addressed via creation of a hybrid model that utilizes an autoregressive integrated moving-average (ARIMA) model to make an initial wind speed forecast followed by a random forest model that attempts to predict the ARIMA forecasting error using knowledge of exogenous atmospheric variables. Variables conveying information about atmospheric stability and turbulence as well as inertial forcing are found to be useful in dealing with non-linear error prediction. Streamwise wind speed, time of day, turbulence intensity, turbulent heat flux, vertical velocity, and wind direction are found to be particularly useful when used in unison for hourly and 3 h timescales. The prediction accuracy of the developed ARIMA–random forest hybrid model is compared to that of the persistence and bias-corrected ARIMA models. The ARIMA–random forest model is shown to improve upon the latter commonly employed modeling methods, reducing hourly forecasting error by up to 5 % below that of the bias-corrected ARIMA model and achieving an R 2 value of 0.84 with true wind speed.

17 WIND ENERGY↗
NASA NTRS1982

Modeling methodology for MLS range navigation system errors using flight test data

Flight test data was used to develop a methodology for modeling MLS range navigation system errors. The data used corresponded to the constant velocity and glideslope approach segment of a helicopter landing trajectory. The MLS range measurement was assumed to consist of low frequency and random high frequency components. The random high frequency component was extracted from the MLS range measurements. This was done by appropriate filtering of the range residual generated from a linearization of the range profile for the final approach segment. This range navigation system error was then modeled as an autoregressive moving average (ARMA) process. Maximum likelihood techniques were used to identify the parameters of the ARMA process.

Karmali, M. S.↗
DOE OSTI2022

Short–Term Forecasting of Wind Gusts at Airports Across CONUS Using Machine Learning

Short–term forecasting of wind gusts, particularly those of higher intensity, is of great societal importance but is challenging due to the presence of multiple gust generation mechanisms. Wind gust observations from eight high–passenger–volume airports across the continental United States (CONUS) are summarized and used to develop predictive models of wind gust occurrence and magnitude. These short–term (same hour) forecast models are built using multiple logistic and linear regression, as well as artificial neural networks (ANNs) of varying complexity. A suite of 19 upper–air predictors drawn from the ERA5 reanalysis and an autoregressive (AR) term are used. Stepwise procedures instruct predictor selection, and resampling is used to quantify model stability. All models are developed separately for the warm (April–September) and cold (October–March) seasons. Results show that ANNs of 3–5 hidden layers (HLs) generally exhibit higher hit rates than logistic regression models and also improve skill with respect to wind gust magnitudes. However, deeper networks with more HLs increase false alarm rates in occurrence models and mean absolute error in magnitude models due to model overfitting. For model skill, inclusion of the AR term is critical while the majority of the remaining skill derives from wind speeds and lapse rates. A predictive ceiling is also clearly demonstrated, particularly for the strong and damaging gust magnitudes, which appears to be partially due to ERA5 predictor characteristics and the presence of mixed wind climates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Machine learning predictions of high-Curie-temperature materials

Technologies that function at room temperature often require magnets with a high Curie temperature, $T$ C , and can be improved with better materials. Discovering magnetic materials with a substantial $T$ C is challenging because of the large number of candidates and the cost of fabricating and testing them. Using the two largest known datasets of experimental Curie temperatures, we develop machine-learning models to make rapid $T$ C predictions solely based on the chemical composition of a material. We train a random-forest model and a k -NN one and predict on an initial dataset of over 2500 materials and then validate the model on a new dataset containing over 3000 entries. The accuracy is compared for multiple compounds' representations (“descriptors”) and regression approaches. A random-forest model provides the most accurate predictions and is not improved by dimensionality reduction or by using more complex descriptors based on atomic properties. Further, a random-forest model trained on a combination of both datasets shows that cobalt-rich and iron-rich materials have the highest Curie temperatures for all binary and ternary compounds. An analysis of the model reveals systematic error that causes the model to over-predict low-$T$ C materials and under-predict high-$T$ C materials. For exhaustive searches to find new high-$T$ C materials, analysis of the learning rate suggests either that much more data is needed or that more efficient descriptors are necessary.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Many-body expansion based machine learning models for octahedral transition metal complexes

Abstract Graph-based machine learning (ML) models for material properties show great potential to accelerate virtual high-throughput screening of large chemical spaces. However, in their simplest forms, graph-based models do not include any 3D information and are unable to distinguish stereoisomers such as those arising from different orderings of ligands around a metal center in coordination complexes. In this work we present a modification to revised autocorrelation descriptors, a molecular graph featurization method, for predicting spin state dependent properties of octahedral transition metal complexes (TMCs). Inspired by analytical semi-empirical models for TMCs, the new modeling strategy is based on the many-body expansion (MBE) and allows one to tune the captured stereoisomer information by changing the truncation order of the MBE. We present the necessary modifications to include this approach in two commonly used ML methods, kernel ridge regression and feed-forward neural networks. On a test set composed of all possible isomers of binary TMCs, the best MBE models achieve mean absolute errors (MAEs) of 2.75 kcal mol −1 on spin-splitting energies and 0.26 eV on frontier orbital energy gaps, a 30%–40% reduction in error compared to models based on our previous approach. We also observe improved generalization to previously unseen ligands where the best-performing models exhibit MAEs of 4.00 kcal mol −1 (i.e. a 0.73 kcal mol −1 reduction) on the spin-splitting energies and 0.53 eV (i.e. a 0.10 eV reduction) on the frontier orbital energy gaps. Because the new approach incorporates insights from electronic structure theory, such as ligand additivity relationships, these models exhibit systematic generalization from homoleptic to heteroleptic complexes, allowing for efficient screening of TMC search spaces.

Meyer, Ralf (ORCID:0000000322360261)↗