SEARCH · Engineering Papers
Results for “Model error”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
How Well Do Multisatellite Products Capture the Space–Time Dynamics of Precipitation? Part II: Building an Error Model through Spectral System Identification
Explore the source record for details and available documents.
The Impact of Atmospheric Modeling Errors on GRACE Estimates of Mass Loss in Greenland and Antarctica
Explore the source record for details and available documents.
Sensitivity of the model error parameter specification in weak-constraint four-dimensional variational data assimilation
Explore the source record for details and available documents.
Diagnosing Near-Surface Model Errors with Candidate Physics Parameterization Schemes for the Multiphysics Rapid Refresh Forecast System (RRFS) Ensemble during Winter over the Northeastern United States and Southern Great Plains
Explore the source record for details and available documents.
Efficient Sampling Methods for Machine Learning Error Models with Application to Surrogates of Steady Hypersonic Flows.
Abstract not provided.
Advanced Resource Estimation through Lattice Surgery Compilation and Logical Error Modeling
Explore the source record for details and available documents.
Modeling the Errors of a Time Series Algorithm for Retrieving Soil Moisture in the NISAR Mission
The National Aeronautics and Space Administration (NASA) - Indian Space Research Organization (ISRO) Synthetic Aperture Radar (NISAR) mission plan to launch a SAR operating at L- and S-band with a 12-day repeat frequency. A global soil moisture product at 200 m spatial resolution derived from 200 m NISAR radar measurements is currently under development. Although several retrieval algorithms are being investigated, this paper focuses on a “time series ratio” retrieval approach. In order to understand and assess the performance of this algorithm, an error model has been developed and is reported in this paper. The model is applied to examine errors as a function of the instrument characteristics and for a given location. Initial progress in including vegetation effects and in predicting errors as a function of spatial location is also described.
Identifying Meteorological Drivers for Errors in Modeled Winds along the Northern California Coast
Abstract An accurate wind resource dataset is required for assessing the potential energy yield of floating offshore wind farms that are expected along the California outer continental shelf. The National Renewable Energy Laboratory has developed and disseminated an updated wind resource dataset offshore of California, using the Weather Research and Forecasting Model, referred to as the CA20 dataset. As compared to buoy lidar measurements that have become available recently, the CA20 dataset showed significant positive biases for 100-m wind speeds along Northern California wind energy lease areas. To investigate the meteorological drivers for the model errors, we first consider two 1-yr simulations run with two different planetary boundary layer (PBL) parameterizations: the Mellor–Yamada–Nakanishi–Niino (MYNN) PBL scheme (the chosen configuration in the CA20 dataset) and the Yonsei University PBL scheme (which significantly reduces the bias in modeled winds). By comparing the 1-yr simulations to the concurrent lidar buoy observations, we find that errors are larger with the MYNN PBL scheme in warm seasons. We then dive deeper into the analysis by running simulations for short-term (3-day) case studies to evaluate the sensitivity of initial/boundary condition forcings on model results. By analyzing the short-term simulations, we find that during synoptic-scale northerly flows driven by the North Pacific high and inland thermal low, a coastal warm bias in the MYNN simulation is mainly responsible for the modeled wind speed bias by altering the boundary layer thermodynamics. The results of our analysis will help guide the creation of an updated version of the CA20 dataset.
A Goal-oriented Approach to Model Form Error for Constitutive Models.
Explore the source record for details and available documents.
SWOT Data Assimilation with Correlated Error Reduction: Fitting Model and Error Together
Explore the source record for details and available documents.
Structural Error and Identifiability in Mathematical Models
Errors and previously implicit assumptions treated explicitly. Paper discusses errors in mathematical models of physical systems and problem of identifying model from system input and output. Problem approached by explicitly taking account of erroneous choices of model structure. Paper concerned specifically with linear or weakly nonlinear models.
Modeling Measurement Error in Dose-Response Models of Community Annoyance to Low-Noise Supersonic Flight
The primary research goal of the forthcoming NASA Quesst mission community test campaign is to collect representative community response data in support of the development of supersonic overflight noise certification standards. Beginning in 2026, NASA will fly the novel X-59 demonstrator aircraft over select communities in United States in order to demonstrate the possibility of low-noise supersonic flight over land and to collect objective measurements and subjective data on the perceptual experience of this new noise source. It is believed that a regression of a binary perceptual response (‘highly annoyed’ or ‘not’) on estimated noise levels (doses, measured in decibels) will provide a useful dose-response relationship for regulators. However, as these estimated doses will be subject to measurement error, naïve estimators of regression coefficients are inconsistent and slopes may be subject to attenuation bias. In this presentation, I contrast functional modeling of measurement error via simulation extrapolation (SIMEX) with structural Bayesian measurement error models. These methods are applied to available data collected during two NASA risk reduction studies in California in 2011 and Texas in 2018. I’ll conclude noting that in the presence of nonnegligible measurement errors, probabilities of annoyance may be overpredicted for low noise levels and underpredicted for high noise levels, therefore, methods of correcting for measurement error will be necessary to improve the utility of the dose-response relationship for policy-making purposes.
Sensitivity, optimal scaling and minimum roundoff errors in flexible structure models
Traditional modeling notions presume the existence of a truth model that relates the input to the output, without advanced knowledge of the input. This has led to the evolution of education and research approaches (including the available control and robustness theories) that treat the modeling and control design as separate problems. The paper explores the subtleties of this presumption that the modeling and control problems are separable. A detailed study of the nature of modeling errors is useful to gain insight into the limitations of traditional control and identification points of view. Modeling errors need not be small but simply appropriate for control design. Furthermore, the modeling and control design processes are inevitably iterative in nature.
PYOED: AN ETENSIBLE SUITE FOR DATA ASSIMILATION AND MODEL-CONSTRAINED OPTIMAL DESIGN OF EXPERIMENTS
SF-23-005 PyOED is a highly extensible scientific package that enables developing and testing model-constrained optimal experimental design (OED) for inverse problems. Specifically, PyOED aims to be a comprehensive Python toolkit for model-constrained OED. The package targets scientists and researchers interested in understanding the details of OED formulations and approaches. It is also meant to enable researchers to experiment with standard and innovative OED technologies with a wide range of test problems (e.g., simulation models). OED, inverse problems (e.g., Bayesian inversion), and data assimilation (DA) are closely related research fields, and their formulations overlap significantly. Thus, PyOED is continuously being expanded with a plethora of Bayesian inversion, DA, and OED methods as well as new scientific simulation models, observation error models, and observation operators. These pieces are added such that they can be permuted to enable testing OED methods in various settings of varying complexities. The PyOED core is completely written in Python and utilizes the inherent object-oriented capabilities; however, PyOED is meant to be extensible rather than scalable. Specifically, PyOED is developed to ``enable rapid development and benchmarking of OED methods with minimal coding effort and to maximize code reutilization.'' PyOED will be continuously expanded with a plethora of Bayesian inversion, DA, and OED methods as well as new scientific simulation models, observation error models, and observation operators.
Estimating model-form errors using random field models
Explore the source record for details and available documents.
Effects of machine learning errors on human decision-making: manipulations of model accuracy, error types, and error importance
Abstract This study addressed the cognitive impacts of providing correct and incorrect machine learning (ML) outputs in support of an object detection task. The study consisted of five experiments that manipulated the accuracy and importance of mock ML outputs. In each of the experiments, participants were given the T and L task with T-shaped targets and L-shaped distractors. They were tasked with categorizing each image as target present or target absent. In Experiment 1, they performed this task without the aid of ML outputs. In Experiments 2–5, they were shown images with bounding boxes, representing the output of an ML model. The outputs could be correct (hits and correct rejections), or they could be erroneous (false alarms and misses). Experiment 2 manipulated the overall accuracy of these mock ML outputs. Experiment 3 manipulated the proportion of different types of errors. Experiments 4 and 5 manipulated the importance of specific types of stimuli or model errors, as well as the framing of the task in terms of human or model performance. These experiments showed that model misses were consistently harder for participants to detect than model false alarms. In general, as the model’s performance increased, human performance increased as well, but in many cases the participants were more likely to overlook model errors when the model had high accuracy overall. Warning participants to be on the lookout for specific types of model errors had very little impact on their performance. Overall, our results emphasize the importance of considering human cognition when determining what level of model performance and types of model errors are acceptable for a given task.
Accuracy Criterion for Structural Calculations
Simple method of establishing an accuracy criterion based on comparing allowable errors and modeling errors. On basis of comparison, amounts of change required to improve modeling error used in convergence criterion.