NASA NTRS · 20160013303
Performance Metrics, Error Modeling, and Uncertainty Quantification
Abstract
A common set of statistical metrics has been used to summarize the performance of models or measurements- the most widely used ones being bias, mean square error, and linear correlation coefficient. They assume linear, additive, Gaussian errors, and they are interdependent, incomplete, and incapable of directly quantifying uncertainty. The authors demonstrate that these metrics can be directly derived from the parameters of the simple linear error model. Since a correct error model captures the full error information, it is argued that the specification of a parametric error model should be an alternative to the metrics-based approach. The error-modeling methodology is applicable to both linear and nonlinear errors, while the metrics are only meaningful for linear errors. In addition, the error model expresses the error structure more naturally, and directly quantifies uncertainty. This argument is further explained by highlighting the intrinsic connections between the performance metrics, the error model, and the joint distribution between the data and the reference.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Tian, Yudong, Nearing, Grey S., Peters-Lidard, Christa D., Harrison, Kenneth W., Tang, Ling. 2016-02-01. Performance Metrics, Error Modeling, and Uncertainty Quantification. https://engineeringpapers.com/record/nasa%3A20160013303/performance-metrics-error-modeling-and-uncertainty-quantification
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Engineering Papers by Indiciae: BibTeX · RIS.