Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Global Surface Temperature Change and Uncertainties Since 1861

The objective of this talk is to analyze the warming trend and its uncertainties of the global and hemi-spheric surface temperatures. By the method of statistical optimal averaging scheme, the land surface air temperature and sea surface temperature observational data are used to compute the spatial average annual mean surface air temperature. The optimal averaging method is derived from the minimization of the mean square error between the true and estimated averages and uses the empirical orthogonal functions. The method can accurately estimate the errors of the spatial average due to observational gaps and random measurement errors. In addition, quantified are three independent uncertainty factors: urbanization, change of the in situ observational practices and sea surface temperature data corrections. Based on these uncertainties, the best linear fit to annual global surface temperature gives an increase of 0.61 +/- 0.16 C between 1861 and 2000. This lecture will also touch the topics on the impact of global change on nature and environment. as well as the latest assessment methods for the attributions of global change.

Shen, Samuel S. P.↗

Upward Flame Propagation and Wire Insulation Flammability: 2006 Round Robin Data Analysis

This viewgraph document reviews test results from tests of different material used for wire insulation for flame propagation and flammability. The presentation focused on investigating data variability both within and between laboratories; evaluated the between-laboratory consistency through consistency statistic h, which indicates how one laboratory s cell average compares with averages from other labs; evaluated the within-laboratory consistency through the consistency statistic k, which is an indicator of how one laboratory s within-laboratory variability compares with the variability of other labs combined; and extreme results were tested to determine whether they resulted by chance or from nonrandom causes (human error, instrument calibration shift, non-adherence to procedures, etc.)

Hirsch, David B.↗

Generalized Linear Covariance Analysis

We review and extend in two directions the results of prior work on generalized covariance analysis methods. This prior work allowed for partitioning of the state space into "solve-for" and "consider" parameters, allowed for differences between the formal values and the true values of the measurement noise, process noise, and a priori solve-for and consider covariances, and explicitly partitioned the errors into subspaces containing only the influence of the measurement noise, process noise, and a priori solve-for and consider covariances. In this work, we explicitly add sensitivity analysis to this prior work, and relax an implicit assumption that the batch estimator s anchor time occurs prior to the definitive span. We also apply the method to an integrated orbit and attitude problem, in which gyro and accelerometer errors, though not estimated, influence the orbit determination performance. We illustrate our results using two graphical presentations, which we call the "variance sandpile" and the "sensitivity mosaic," and we compare the linear covariance results to confidence intervals associated with ensemble statistics from a Monte Carlo analysis.

Carpenter, J. Russell↗

Generalized Linear Covariance Analysis

This talk presents a comprehensive approach to filter modeling for generalized covariance analysis of both batch least-squares and sequential estimators. We review and extend in two directions the results of prior work that allowed for partitioning of the state space into solve-for'' and consider'' parameters, accounted for differences between the formal values and the true values of the measurement noise, process noise, and textita priori solve-for and consider covariances, and explicitly partitioned the errors into subspaces containing only the influence of the measurement noise, process noise, and solve-for and consider covariances. In this work, we explicitly add sensitivity analysis to this prior work, and relax an implicit assumption that the batch estimator's epoch time occurs prior to the definitive span. We also apply the method to an integrated orbit and attitude problem, in which gyro and accelerometer errors, though not estimated, influence the orbit determination performance. We illustrate our results using two graphical presentations, which we call the variance sandpile'' and the sensitivity mosaic,'' and we compare the linear covariance results to confidence intervals associated with ensemble statistics from a Monte Carlo analysis.

n/a↗

Data Assimilation to Extract Soil Moisture Information From SMAP Observations

Statistical techniques permit the retrieval of soil moisture estimates in a model climatology while retaining the spatial and temporal signatures of the satellite observations. As a consequence, they can be used to reduce the need for localized bias correction techniques typically implemented in data assimilation (DA) systems that tend to remove some of the independent information provided by satellite observations. Here, we use a statistical neural network (NN) algorithm to retrieve SMAP (Soil Moisture Active Passive) surface soil moisture estimates in the climatology of the NASA Catchment land surface model. Assimilating these estimates without additional bias correction is found to significantly reduce the model error and increase the temporal correlation against SMAP CalVal in situ observations over the contiguous United States. A comparison with assimilation experiments using traditional bias correction techniques shows that the NN approach better retains the independent information provided by the SMAP observations and thus leads to larger model skill improvements during the assimilation. A comparison with the SMAP Level 4 product shows that the NN approach is able to provide comparable skill improvements and thus represents a viable assimilation approach.

Eclipse timings of the low-mass X-ray binary EXO 0748-676: Statistical arguments against orbital period changes

EXO 0748-676, an eclipsing low-mass X-ray binary, is one of only about four or five low-mass X-ray binaries for which orbital period evolution has been reported. We observed a single eclipse egress with ROSAT . The time of this egress is consistent with the apparent increase in P(sub orb) previously reported on the basis of EXOSAT and Ginga observations. Standard analysis, in which O-C (observed minus calculated) timing residuals are examined for deviations from a constant period, implicitly assume that the only uncertainty in each residual is measurement error and that these errors are independent. We argue that the variable eclipse durations and profiles observed in EXO 0748-676 imply that there is an additional source of uncertainty in timing measurements, that this uncertainty is intrinsic to the binary system, and that it is correlated from observation to observation with a variance which increases as a function of the number of binary cycles between observations. This intrinsic variability gives rise to spurious trends in O-C residuals which are misinterpreted as changes in the orbital period. We describe several statistics tests which can be used to test for the presence of intrinsic variability. We apply those statistical tests which are suitable to the EXO 0748-676 observations. The apparent changes in the orbital period of EXO 0748-676 can be completely accounted for by intrinsic variability with an rms variability of approximately 0.35 s per orbital cycle. The variability appears to be correlated from cycle-to-cycle on timescales of less than 1 yr. We suggest that the intrinsic variability is related to slow changes in either the source's X-ray luminosity or the structure of the companion star's atmosphere. We note that several other X-ray binaries and cataclysmic variables have previously reported orbital period changes which may also be due to intrinsic variability rather than orbital period evolution.

Hertz, Paul↗

Statistical tests for closure of plate motion circuits

Two methods, one based on a chi-square test and the second on an F-ratio test, of testing for the plate motion circuit closures are described and evaluated. The chi-square test is used to evaluate goodness of fit, and it is assumed that the assigned errors are accurate estimates of the true errors in the data. The F-ratio test is used to compare variances of distributions, and it is assumed that the relative values of assigned error are accurate. The two methods are applied to the data of Minster and Jordan (1978) on the motion of the three plates that meet at the Galapagos Triple Junction, and the motion of the three plates that meet at the Indian Ocean Triple Junction. It is noted that the F-ratio plate circuit closure test is more useful than the chi-square test for identifying systematic misfits in data because the chi-square test overestimates the errors of plate motion data.

Gordon, Richard G.↗

The Accuracy of Radio Interferometric Measurements of Earth Rotation

The accuracy of very long base interferometry earth rotation (UT1) measurements is examined by intercomparing TEMPO and POLARIS data for 1982 and the first half of 1983. None of these data are simultaneous, and so a proper intercomparison requires accounting for the scatter introduced by the rapid, unpredictable, UT1 variations driven by exchanges of angular momentum with the atmosphere. A statistical model of these variations, based on meteorological estimates of the Atmospheric Angular Momentum is derived, and the optimal linear (Kalman) smoother for this model is constructed. The scatter between smoothed and independent raw data is consistent with the residual formal errors, which do not depend upon the actual scatter of the UT1 data. This represents the first time that an accurate prediction of the scatter between UT1 data sets were possible.

Eubanks, T. M.↗

Coherent Lidar Design and Performance Verification

This final report summarizes the investigative results from the 3 complete years of funding and corresponding publications are listed. The first year saw the verification of beam alignment for coherent Doppler lidar in space by using the surface return. The second year saw the analysis and computerized simulation of using heterodyne efficiency as an absolute measure of performance of coherent Doppler lidar. A new method was proposed to determine the estimation error for Doppler lidar wind measurements without the need for an independent wind measurement. Coherent Doppler lidar signal covariance, including wind shear and turbulence, was derived and calculated for typical atmospheric conditions. The effects of wind turbulence defined by Kolmogorov spatial statistics were investigated theoretically and with simulations. The third year saw the performance of coherent Doppler lidar in the weak signal regime determined by computer simulations using the best velocity estimators. Improved algorithms for extracting the performance of velocity estimators with wind turbulence included were also produced.

Frehlich, Rod↗

Comparison of Response Surface and Kriging Models in the Multidisciplinary Design of an Aerospike Nozzle

The use of response surface models and kriging models are compared for approximating non-random, deterministic computer analyses. After discussing the traditional response surface approach for constructing polynomial models for approximation, kriging is presented as an alternative statistical-based approximation method for the design and analysis of computer experiments. Both approximation methods are applied to the multidisciplinary design and analysis of an aerospike nozzle which consists of a computational fluid dynamics model and a finite element analysis model. Error analysis of the response surface and kriging models is performed along with a graphical comparison of the approximations. Four optimization problems are formulated and solved using both approximation models. While neither approximation technique consistently outperforms the other in this example, the kriging models using only a constant for the underlying global model and a Gaussian correlation function perform as well as the second order polynomial response surface models.

Simpson, Timothy W.↗

Technical Report Series on Global Modeling and Data Assimilation: Soil Moisture Active Passive (SMAP) Project Assessment Report for the Beta-Release L4_SM Data Product - Volume 40

During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public beta release scheduled for 30 October 2015. The primary objective of the beta release is to allow users to familiarize themselves with the data product before the validated product becomes available. The beta release also allows users to conduct their own assessment of the data and to provide feedback to the L4_SM science data product team. The assessment of the L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to upscaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 1 validation and supports the beta release of the data. The validation against sparse network measurements and the evaluation of the assimilation diagnostics address Stage 2 validation criteria by expanding the assessment to regional and global scales.

ubRMSE↗

Quantifying the Relative Impact of Model Microphysics Parameterizations and Scattering Models in Simulating Synthetic Radar and Microwave Radiometer Observations

Output from numerical weather models is often used to simulate observations from remote sensing instruments, for purposes ranging from data assimilation, synthetic retrievals of geophysical quantities, and optimization of observing systems. However, when hydrometeors are present, the level of detail provided by the weather model is generally insufficient to fully constrain the input to the radiative transfer model (RTM), and further assumptions must be made by the RTM user in order to produce synthetic observations. Using a hierarchy of models including cloud-resolving, double-moment, bin microphysical, and ice-habit predicting models, along with scattering properties from the OpenSSP, Atmospheric Radiative Transfer Simulator (ARTS) databases, as well as relatively simple geometries (e.g., cylindrical plates and columns), we demonstrate the spread in synthetic observation output and the extent to which it is reduced when microphysics is more strongly constrained by the model. As an intermediate step, an error budget for the RTM simulations was derived and from that we developed and will describe best practices for observation simulation (e.g., optimal number of hydrometeor size bins, truncation of the particle size distribution, angular resolution of scattering phase function). Some statistical comparisons with observations will also be presented.

Munchak, S. Joseph↗

Evaluation of High Mountain Asia-Land Data Assimilation System (version 1) from 2003 to 2016: 2. The impact of assimilating satellite-based snow cover and freeze/thaw observations into a land surface model

This second paper of the two-part series focuses on demonstrating the impact of assimilating satellite-based snow cover and freeze/thaw observations into the hyper-resolution, offline terrestrial modeling system used for the High Mountain Asia (HMA) region from 2003 to 2016. To this end, this study systematically evaluates a total of six sets of 0.01° (∼1 km) model simulations forced by different precipitation forcings, with and without the dual assimilation scheme enabled, at point-scale, basin-scale, and domain-scale. The key variables of interest include surface net shortwave radiation, surface net longwave radiation, skin temperature, near-surface soil temperature, snow depth, snow water equivalent (SWE), and total runoff. First, the point-scale assessment is mainly conducted via evaluating against ground-based measurements. In general, the assimilation enabled estimates are better than no-assimilation counterparts. Second, the basin-scale runoff assessment demonstrates that across three snow-dominated basins, the assimilation enabled experiment yields systematic improvements in all goodness-of-fit statistics through mitigating the negative effects brought by the fixed long-term precipitation correction factors. For example, when forced by the bias-corrected precipitation, the assimilation-enabled experiment improves the bias by 69%, the root-mean-squared error by 30%, and the unbiased root-mean-squared error by 18% (relative to the no-assimilation counterpart). Finally, the domainscale assessment is conducted via evaluating against satellite-based SWE and skin temperature products. Both sets of domain-scale analysis further corroborate the findings in the point-scale evaluations. Overall, this study suggests the benefits of the proposed multi-variate assimilation system in improving the cryospherichydrological process within a land surface model for use in HMA.

Yuan Xue↗

Evaluation of High Mountain Asia-Land Data Assimilation System (version 1) from 2003 to 2016: 2. The impact of assimilating satellite-based snow cover and freeze/thaw observations into a land surface model

This second paper of the two-part series focuses on demonstrating the impact of assimilating satellite-based snow cover and freeze/thaw observations into the hyper-resolution, offline terrestrial modeling system used for the High Mountain Asia (HMA) region from 2003 to 2016. To this end, this study systematically evaluates a total of six sets of 0.01° (∼1 km) model simulations forced by different precipitation forcings, with and without the dual assimilation scheme enabled, at point-scale, basin-scale, and domain-scale. The key variables of interest include surface net shortwave radiation, surface net longwave radiation, skin temperature, near-surface soil temperature, snow depth, snow water equivalent (SWE), and total runoff. First, the point-scale assessment is mainly conducted via evaluating against ground-based measurements. In general, the assimilation enabled estimates are better than no-assimilation counterparts. Second, the basin-scale runoff assessment demonstrates that across three snow-dominated basins, the assimilation enabled experiment yields systematic improvements in all goodness-of-fit statistics through mitigating the negative effects brought by the fixed long-term precipitation correction factors. For example, when forced by the bias-corrected precipitation, the assimilation-enabled experiment improves the bias by 69%, the root-mean-squared error by 30%, and the unbiased root-mean-squared error by 18% (relative to the no-assimilation counterpart). Finally, the domain-scale assessment is conducted via evaluating against satellite-based SWE and skin temperature products. Both sets of domain-scale analysis further corroborate the findings in the point-scale evaluations. Overall, this study suggests the benefits of the proposed multi-variate assimilation system in improving the cryospheric-hydrological process within a land surface model for use in HMA.

Yuan Xue↗

Calibration improvements to electronically scanned pressure systems and preliminary statistical assessment

Orifice-to-orifice inconsistencies in data acquired with an electronically-scanned pressure system at the beginning of a wind tunnel experiment forced modifications to the standard, instrument calibration procedures. These modifications included a large increase in the number of calibration points which would allow a critical examination of the calibration curve-fit process, and a subsequent post-test reduction of the pressure data. Evaluation of these data has resulted in an improved functional representation of the pressure-voltage signature for electronically-scanned pressures sensors, which can reduce the errors due to calibration curve fit to under 0.10 percent of reading compared to the manufacturer specified 0.10 percent of full scale. Application of the improved calibration function allows a more rational selection of the calibration set-point pressures. These pressures should be adjusted to achieve a voltage output which matches the physical shape of the pressure-voltage signature of the sensor. This process is conducted in lieu of the more traditional approach where a calibration pressure is specified and the resulting sensor voltage is recorded. The fifteen calibrations acquired over the two-week duration of the wind tunnel test were further used to perform a preliminary, statistical assessment of the variation in the calibration process. The results allowed the estimation of the bias uncertainty for a single instrument calibration; and, they form the precursor for more extensive and more controlled studies in the laboratory.

Everhart, Joel L.↗

Temperature dependence of emission measure in solar X-ray plasmas. 1: Non-flaring active regions

X-ray and ultraviolet line emission from hot, optically thin material forming coronal active regions on the sun may be described in terms of an emission measure distribution function, Phi (T). A relationship is developed between line flux and Phi (T), a theory which assumes that the electron density is a single-valued function of temperature. The sources of error involved in deriving Phi (T) from a set of line fluxes are examined in some detail. These include errors in atomic data (collisional excitation rates, assessment of other mechanisms for populating excited states of transitions, element abundances, ion concentrations, oscillator strengths) and errors in observed line fluxes arising from poorly - known instrumental responses. Two previous analyses are discussed in which Phi (T) for a non-flaring active region is derived. A least squares method of Batstone uses X-ray data of low statistical significance, a fact which appears to influence the results considerably. Two methods for finding Phi (T) ab initio are developed. The coefficients are evaluated by least squares. These two methods should have application not only to active-region plasmas, but also to hot, flare-produced plasmas.

Phillips, K. J. H.↗

Projection of school district enrollments

The objectives were to provide a better statistical basis for enrollment projections, to attempt to model the school district's enrollment, and to produce a single estimate of enrollment for each grade, grade group, and ethnic group, and for the total by year. Efforts were also made to provide error estimates for the projections, to design a simple, user-oriented computer program for use by school district administrators, and to work with real data from local school districts and aid them in making projections on an experimental basis. The study at Jet Propulsion Laboratory was concerned with projection methodology and production of a generally usable computer program.

Van Dillen, S. L.↗

Evaluation criteria for software classification inventories, accuracies, and maps

Statistical criteria are presented for modifying the contingency table used to evaluate tabular classification results obtained from remote sensing and ground truth maps. This classification technique contains information on the spatial complexity of the test site, on the relative location of classification errors, on agreement of the classification maps with ground truth maps, and reduces back to the original information normally found in a contingency table.

Jayroe, R. R., Jr.↗