SWOT Data Assimilation with Correlated Error Reduction: Fitting Model and Error Together
Explore the source record for details and available documents.
Sarah T. Gille↗
SEARCH · Engineering Papers
Results for “error modeling”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Structural Error and Identifiability in Mathematical Models
Errors and previously implicit assumptions treated explicitly. Paper discusses errors in mathematical models of physical systems and problem of identifying model from system input and output. Problem approached by explicitly taking account of erroneous choices of model structure. Paper concerned specifically with linear or weakly nonlinear models.
Hadaegh, F. Y.↗
Modeling Measurement Error in Dose-Response Models of Community Annoyance to Low-Noise Supersonic Flight
The primary research goal of the forthcoming NASA Quesst mission community test campaign is to collect representative community response data in support of the development of supersonic overflight noise certification standards. Beginning in 2026, NASA will fly the novel X-59 demonstrator aircraft over select communities in United States in order to demonstrate the possibility of low-noise supersonic flight over land and to collect objective measurements and subjective data on the perceptual experience of this new noise source. It is believed that a regression of a binary perceptual response (‘highly annoyed’ or ‘not’) on estimated noise levels (doses, measured in decibels) will provide a useful dose-response relationship for regulators. However, as these estimated doses will be subject to measurement error, naïve estimators of regression coefficients are inconsistent and slopes may be subject to attenuation bias. In this presentation, I contrast functional modeling of measurement error via simulation extrapolation (SIMEX) with structural Bayesian measurement error models. These methods are applied to available data collected during two NASA risk reduction studies in California in 2011 and Texas in 2018. I’ll conclude noting that in the presence of nonnegligible measurement errors, probabilities of annoyance may be overpredicted for low noise levels and underpredicted for high noise levels, therefore, methods of correcting for measurement error will be necessary to improve the utility of the dose-response relationship for policy-making purposes.
simulation↗
Sensitivity, optimal scaling and minimum roundoff errors in flexible structure models
Traditional modeling notions presume the existence of a truth model that relates the input to the output, without advanced knowledge of the input. This has led to the evolution of education and research approaches (including the available control and robustness theories) that treat the modeling and control design as separate problems. The paper explores the subtleties of this presumption that the modeling and control problems are separable. A detailed study of the nature of modeling errors is useful to gain insight into the limitations of traditional control and identification points of view. Modeling errors need not be small but simply appropriate for control design. Furthermore, the modeling and control design processes are inevitably iterative in nature.
Skelton, Robert E.↗
PYOED: AN ETENSIBLE SUITE FOR DATA ASSIMILATION AND MODEL-CONSTRAINED OPTIMAL DESIGN OF EXPERIMENTS
SF-23-005 PyOED is a highly extensible scientific package that enables developing and testing model-constrained optimal experimental design (OED) for inverse problems. Specifically, PyOED aims to be a comprehensive Python toolkit for model-constrained OED. The package targets scientists and researchers interested in understanding the details of OED formulations and approaches. It is also meant to enable researchers to experiment with standard and innovative OED technologies with a wide range of test problems (e.g., simulation models). OED, inverse problems (e.g., Bayesian inversion), and data assimilation (DA) are closely related research fields, and their formulations overlap significantly. Thus, PyOED is continuously being expanded with a plethora of Bayesian inversion, DA, and OED methods as well as new scientific simulation models, observation error models, and observation operators. These pieces are added such that they can be permuted to enable testing OED methods in various settings of varying complexities. The PyOED core is completely written in Python and utilizes the inherent object-oriented capabilities; however, PyOED is meant to be extensible rather than scalable. Specifically, PyOED is developed to ``enable rapid development and benchmarking of OED methods with minimal coding effort and to maximize code reutilization.'' PyOED will be continuously expanded with a plethora of Bayesian inversion, DA, and OED methods as well as new scientific simulation models, observation error models, and observation operators.
ATTIA, AHMEDMOHAMED↗
Estimating model-form errors using random field models
Explore the source record for details and available documents.
Ray, Jaideep↗
Effects of machine learning errors on human decision-making: manipulations of model accuracy, error types, and error importance
Abstract This study addressed the cognitive impacts of providing correct and incorrect machine learning (ML) outputs in support of an object detection task. The study consisted of five experiments that manipulated the accuracy and importance of mock ML outputs. In each of the experiments, participants were given the T and L task with T-shaped targets and L-shaped distractors. They were tasked with categorizing each image as target present or target absent. In Experiment 1, they performed this task without the aid of ML outputs. In Experiments 2–5, they were shown images with bounding boxes, representing the output of an ML model. The outputs could be correct (hits and correct rejections), or they could be erroneous (false alarms and misses). Experiment 2 manipulated the overall accuracy of these mock ML outputs. Experiment 3 manipulated the proportion of different types of errors. Experiments 4 and 5 manipulated the importance of specific types of stimuli or model errors, as well as the framing of the task in terms of human or model performance. These experiments showed that model misses were consistently harder for participants to detect than model false alarms. In general, as the model’s performance increased, human performance increased as well, but in many cases the participants were more likely to overlook model errors when the model had high accuracy overall. Warning participants to be on the lookout for specific types of model errors had very little impact on their performance. Overall, our results emphasize the importance of considering human cognition when determining what level of model performance and types of model errors are acceptable for a given task.
97 MATHEMATICS AND COMPUTING↗
Accuracy Criterion for Structural Calculations
Simple method of establishing an accuracy criterion based on comparing allowable errors and modeling errors. On basis of comparison, amounts of change required to improve modeling error used in convergence criterion.
Chen, J. C.↗
Information transmission with continuous variable quantum erasure channels
Quantum capacity, as the key figure of merit for a given quantum channel, upper bounds the channel's ability in transmitting quantum information. Identifying different types of channels, evaluating the corresponding quantum capacity, and finding the capacity-approaching coding scheme are the major tasks in quantum communication theory. Quantum channel in discrete variables has been discussed enormously based on various error models, while error model in the continuous variable channel has been less studied due to the infinite dimensional problem. In this paper, we investigate a general continuous variable quantum erasure channel. By defining an effective subspace of the continuous variable system, we find a continuous variable random coding model. We then derive the quantum capacity of the continuous variable erasure channel in the framework of decoupling theory. The discussion in this paper fills the gap of a quantum erasure channel in continuous variable setting and sheds light on the understanding of other types of continuous variable quantum channels.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Obtaining consistent models of helicopter flight-data measurement errors using kinematic-compatibility and state-reconstruction methods
A new method was developed for application of Kalman Filter/Smoothers to post-flight processing of helicopter flight test dynamic measurements. This processing includes checking for kinematic compatibility among the measurements, identification of a measurement error model, and reconstruction of both measured and unmeasured time histories. Emphasis is placed on identification of a parametric measurement error model which is valid for a set of flight test data. This is facilitated through a new method of concatenating several maneuver time histories. The method also includes a model structure determination step which ensures that a physically realistic parameterization has been achieved. Application of the method to a set of BO-105 flight test data is illustrated. The resulting minimally parameterized error model is shown to characterize the measurement errors of the entire data set with very little variation in the parameter values. Reconstructed time histories are shown to have increased bandwidths and signal to noise ratios.
Fletcher, Jay W.↗
Error control in the GCF: An information-theoretic model for error analysis and coding
The structure of data-transmission errors within the Ground Communications Facility is analyzed in order to provide error control (both forward error correction and feedback retransmission) for improved communication. Emphasis is placed on constructing a theoretical model of errors and obtaining from it all the relevant statistics for error control. No specific coding strategy is analyzed, but references to the significance of certain error pattern distributions, as predicted by the model, to error correction are made.
Adeyemi, O.↗
Model Form Error Correction for a Black-Box Thermal Battery Heat Transfer Simulation
Thermal batteries are crucial for supplying power to high-consequence engineering applications such as rockets. Computational simulations have been developed to predict thermal battery behavior, but these simulations often suffer from modeling errors, including model form uncertainty. Addressing this uncertainty can be achieved by quantifying either the model discrepancy in the output or the model form error (MFE) in the governing equation. MFE is particularly valuable as it can be better extrapolated beyond observed outputs, which is essential for predictions involving changes in external system loading, system configuration and geometry, or output quantities. This paper employs a state estimation approach to estimate MFE using experimental data and then utilizes machine learning (ML) to model its relationship with state variables. A nonintrusive technique is used to estimate MFE in a black-box thermal battery heat transfer simulation. The trained machine learning model for MFE is then applied to correct simulation predictions under extrapolated initial conditions and battery configurations. In conclusion, the methodology's performance is evaluated using additional experimental data, demonstrating its effectiveness in improving prediction accuracy.
Batteries↗
Dominant modes of mechanical systems
To obtain a reduced model of a mechanical system, one can identify the dominant modes and retain those as the reduced model. Two widely used schemes for selection of dominant modes are modal cost analysis (MCA) and balancing, but neither of these methods guarantees that the model error is small, where model error measures the difference between the output of the full model and the output of the reduced model. The authors introduce a set of coordinates called pseudo uncorrelated modal coordinates (PUnc) that can be used in conjunction with component cost analysis to select dominant modes yielding a reduced model with minimum model error. Furthermore, unlike MCA and balancing, the accuracy of the reduced model (the model error) in PUnc coordinates can be evaluated before reduction.
Breida, M.↗
Precision X-band radio Doppler and ranging navigation: Mars Observer interplanetary cruise scenario
This article describes an error covariance analysis based on a Mars Observer mission scenario; the study was performed to establish the navigation performance that can potentially be achieved in a demonstration of precision two-way X-band (8.4-GHz) Doppler and ranging with the Mars Observer spacecraft planned for next year, and to evaluate the sensitivity of the predicted performance to variations in ground system error modeling assumptions. Orbit determination error statistics computed for a 182-day Doppler and ranging data arc predicted Mars approach orbit determination accuracies of about 0.45 micro-rad in an angular sense, using a conservative ground system error model as a baseline. When less-conservative error model assumptions were employed, it was found that orbit determination accuracies of 0.19 to 0.30 micro-rad could be obtained; the level of accuracy of the assumed Mars ephemeris is about 0.11 micro-rad. In comparison, Doppler-only performance with the baseline error model was predicted to be about 1.30 to 1.51 micro-rad, although it was found that when improved station location accuracies and Global Positioning System-based tropospheric calibration accuracies were assumed, accuracies of 0.44 to 0.52 micro-rad were predicted. In the Doppler plus ranging cases, the results were relatively insensitive to variations in ranging system and station delay calibration uncertainties of a few meters and tropospheric zenith delay calibration uncertainties of a few centimeters.
Estefan, J. A.↗
Data for A Hybrid Biophysical-Machine Learning Framework for Diurnal Surface Energy Flux Estimation Using Proximal Sensing
Thermal infrared-based remote sensing of surface energy fluxes has traditionally relied on high spatial resolution satellite data with revisit frequencies on the order of weeks. In this study, we evaluate a biophysics-based analytical surface energy balance model for predicting latent energy (LE) and sensible heat (H) fluxes using proximal sensing observations. The Surface Temperature Initiated Closure (STIC1.2) model has been extensively validated across a wide range of spatial and temporal scales using various satellite-derived thermal infrared data sets. Here we extend this validation by applying STIC at sub-hourly temporal resolution over multiple growing seasons for four distinct agricultural systems. We further develop and evaluate novel STIC variants that incorporate machine learning (ML) techniques to eliminate the need for surface energy balance observations, specifically net radiation and soil heat flux, thereby enhancing model applicability in data-sparse settings. The integration of a ML component to estimate surface available energy is shown to have strong predictive performance for both LE (R2 = 0.81–0.94) and H (R2 = 0.46–0.72) across all agricultural systems examined here, demonstrating the potential of hybrid biophysical-machine learning approaches for surface energy balance modeling with minimal data requirements. This study concludes with a novel application of explainable machine learning (exML) to diagnose sources of model error. This exML framework attributes residual prediction errors to both model input variables and environmental drivers not explicitly included in the simulation experiments. This approach provides a new pathway for improving model design and integrating previously overlooked yet influential variables into future model iterations.
AI/ML↗
Error Propagation Analysis in the SAE Architecture Analysis and Design Language (AADL) and the EDICT Tool Framework
This report documents the capabilities of the EDICT tools for error modeling and error propagation analysis when operating with models defined in the Architecture Analysis & Design Language (AADL). We discuss our experience using the EDICT error analysis capabilities on a model of the Scalable Processor-Independent Design for Enhanced Reliability (SPIDER) architecture that uses the Reliable Optical Bus (ROBUS). Based on these experiences we draw some initial conclusions about model based design techniques for error modeling and analysis of highly reliable computing architectures.
LaValley, Brian W.↗
Is There an Optimal CO2 Partial Column for Flux Inversions?
The fidelity of flux estimates from an atmospheric inversion depends on the ability of atmospheric transport models to simulate the measured quantity. For species such as CO2, with surface fluxes and a large network of surface measurements, this means correctly simulating the dynamics of the planetary boundary layer (PBL), which is one of the most uncertain aspects of atmospheric transport modeling. In contrast, the simulated total column average mole fraction of CO2 (XCO2) is largely insensitive to simulated PBL dynamics. Therefore, measurements of XCO2 provided by current and future short wave infrared (SWIR) greenhouse gas (GHG) satellites such as GOSAT and the OCO family would seem to be more appropriate to flux inversions, as far as minimizing transport model errors (the "noise") is concerned. Unfortunately, the flux-induced variation of CO2 (the "signal") is the largest within the PBL and smallest in XCO2. Therefore, assimilating XCO2 as opposed to PBL CO2 need not give us the strongest "signal to noise" in flux inversions. Recent work on GOSAT and OCO2 retrievals suggest that SWIR satellite spectra may be used to estimate a lower partial column CO2, which could be assimilated in a flux inversion, instead of XCO2.Here we report on a study to assess whether there is an optimal partial column average CO2, intermediate between PBL CO2 and XCO2, whose assimilation might yield the best signal to noise in flux inversions, where (as before) "signal" is the flux-induced variation and "noise" is the error in transport modeling. We simulate atmospheric CO2 with five different global transport models and a common surface CO2 flux over ten years. We consider the spread across the five models to be a proxy for transport model error (the "noise"), and the common variation of CO2 in all five models to be a proxy for the "signal". We compare these signals and noises at different spatiotemporal scales for different partial column specifications to investigate whether there exists an optimal partial column that has large surface flux-driven variations and yet is relatively insensitive to errors in transport models. Finally, we comment on the feasibility of estimating such a partial column from current and future SWIR GHG satellites in the light of recent work on vertically resolved CO2 from current SWIR GHG satellites.
Basu, Sourish↗
An error bound for a discrete reduced order model of a linear multivariable system
The design of feasible controllers for high dimension multivariable systems can be greatly aided by a method of model reduction. In order for the design based on the order reduction to include a guarantee of stability, it is sufficient to have a bound on the model error. Previous work has provided such a bound for continuous-time systems for algorithms based on balancing. In this note an L-infinity bound is derived for model error for a method of order reduction of discrete linear multivariable systems based on balancing.
Al-Saggaf, Ubaid M.↗