Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

JSC Safety and Mission Assurance Data Analysis Overview

These slides describe the data analysis methods that are used to determine inputs for probabilistic risk models supporting the Space Shuttle Program. Other applications can follow a similar path probably using different data sources. Statistical approaches are different and not addressed here. Topics included here: 1) Prior Distribution; 2) Likelihood Data; 3) Bayesian Updating; and 4) Uncertainty and Error. Note: This is a high-level discussion and is not intended to be a tutorial.

Roelant, Henk↗

Comparison of Force and Moment Coefficients for the Same Test Article in Multiple Wind Tunnels

This paper compares the results of force and moment measurements made on the same test article and with the same balance in three transonic wind tunnels. Comparisons are made for the same combination of Reynolds number, Mach number, sideslip angle, control surface configuration, and angle of attack range. Between-tunnel force and moment differences are quantified. An analysis of variance was performed at four unique sites in the design space to assess the statistical significance of between-tunnel variation and any interaction with angle of attack. Tunnel to tunnel differences too large to attribute to random error were detected were observed for all forces and moments. In some cases these differences were independent of angle of attack and in other cases they changed with angle of attack.

Deloach, Richard↗

Impact of Scattering Model on Disdrometer Derived Attenuation Scaling

NASA Glenn Research Center (GRC), the Air Force Research Laboratory (AFRL), and the Politecnico di Milano (POLIMI) are currently entering the third year of a joint propagation study in Milan, Italy utilizing the 20 and 40 GHz beacons of the Alphasat TDP#5 Aldo Paraboni scientific payload. The Ka- and Q-band beacon receivers were installed at the POLIMI campus in June of 2014 and provide direct measurements of signal attenuation at each frequency. Collocated weather instrumentation provides concurrent measurement of atmospheric conditions at the receiver; included among these weather instruments is a Thies Clima Laser Precipitation Monitor (optical disdrometer) which records droplet size distributions (DSD) and droplet velocity distributions (DVD) during precipitation events. This information can be used to derive the specific attenuation at frequencies of interest and thereby scale measured attenuation data from one frequency to another. Given the ability to both predict the 40 gigahertz attenuation from the disdrometer and the 20 gigahertz time-series as well as to directly measure the 40 gigahertz attenuation with the beacon receiver, the Milan terminal is uniquely able to assess these scaling techniques and refine the methods used to infer attenuation from disdrometer data. In order to derive specific attenuation from the DSD, the forward scattering coefficient must be computed. In previous work, this has been done using the Mie scattering model, however, this assumes a spherical droplet shape. The primary goal of this analysis is to assess the impact of the scattering model and droplet shape on disdrometer-derived attenuation predictions by comparing the use of the Mie scattering model to the use of the T-matrix method, which does not assume a spherical droplet. In particular, this paper will investigate the impact of these two scattering approaches on the error of the resulting predictions as well as on the relationship between prediction error and rain rate.

Radio Transmission↗

TPSAS-NF1676L-17940-DND

The NASA/GEWEX SRB (Global Energy and Water Exchanges, Surface Radiation Budget) project produces and archives shortwave and longwave radiation budget flux estimates at the top of the atmosphere and at the Earth's surface. The latest version in the archive, Release 3.0, is available as 3-hourly, 3-hourly-monthly, daily and monthly means continuously over the period from July 1983 to December 2007 on a quasi-equal-area grid system of 44016 grid boxes. SRB Release 4 with further improvements in data quality and higher spatial resolution is being developed. The SRB shortwave/longwave fluxes at the Earth's surface from the algorithm GSW(V3.0)/GLW(V3.1) have been extensively validated against high-quality ground-based observations, in particular observed data from the Baseline Surface Radiation Network (BSRN). Comparisons with nearly 6000 site-months of both shortwave and longwave data from 52 BSRN sites show generally good agreement. In addition, the GEWEX SRB data have also been found to compare favorably with the World Radiation Data Centre (WRDC) data and the Global Energy Balance Archive (GEBA) data. In spite of the fact that the BSRN sites are scattered on all seven continents, the validation of the SRB data over the vast oceans had not been done until recently. In this paper, we present comparisons of the GEWEX-SRB data shortwave/longwave data with observations made on arrays moored in tropical oceans. Specifically, we have data from 21 buoys, or moorings, from Predictions and Research Moored Array in the Atlantic (PIRATA), 14 buoys from the Research Moored Array for African-Asian-Australian Monsoon Analysis and Prediction (RAMA) in the Indian Ocean, 20 buoys from the Tropical Atmosphere Ocean (TAO) array in the Pacific, and 3 buoys from the Woods Hole Oceanographic Institute (WHOI) (2 in the Pacific and 1 in the Atlantic). The data from these buoys span 12 years from 2000 to 2011, though not necessarily continuously. It is found that except for occasional outliers, the majority of the comparable pairs of data points agree well. Further examination of the outliers is necessary to determine whether they can be attributed to wind-driven tilt and/or aerosol accumulation on the instruments. In order to see how the ocean-based validation compares with land-based validation, we made SRB-BSRN monthly mean shortwave/longwave radiation comparisons in the tropical region only, where all the buoys are moored. The results show that in the case of shortwave radiation, the bias error from the ocean-based validation is somewhat larger than its land-based counterpart, but their RMS errors are not significantly different. In the case of longwave radiation, the ocean-based and land-based validations show nearly identical comparison statistics.

Taiping Zhang↗

Estimating Model Error Using Observation Residuals

This presentation discusses an approach to estimate model error using observation residuals. Based on the sequential fixed-lag smoother; we introduce a diagnostic procedure to allow estimating model error over a dense observing system. Optimality considerations are examined in light of the sequential results. The procedure is re-interpreted in the language of variational assimilation, such as 4d-Var. Illustrations of the approach are given by studying both identical-twin and fraternal-twin experimental settings for a system governed by Lorenz-type dynamics. Preliminary results by looking at observation residual statistics for the ECMWF data assimilation system are also shown. The presentation will be part of a series of discussions on issues related to four-dimensional data assimilation under weak-constraint and methodologies to estimate model error.

Todling, Ricardo↗

Assessment of Error in Synoptic-Scale Diagnostics Derived from Wind Profiler and Radiosonde Network Data

A topic of current practical interest is the accurate characterization of the synoptic-scale atmospheric state from wind profiler and radiosonde network observations. We have examined several related and commonly applied objective analysis techniques for performing this characterization and considered their associated level of uncertainty both from a theoretical and a practical standpoint. A case study is presented where two wind profiler triangles with nearly identical centroids and no common vertices produced strikingly different results during a 43-h period. We conclude that the uncertainty in objectively analyzed quantities can easily be as large as the expected synoptic-scale signal. In order to quantify the statistical precision of the algorithms, we conducted a realistic observing system simulation experiment using output from a mesoscale model. A simple parameterization for estimating the uncertainty in horizontal gradient quantities in terms of known errors in the objectively analyzed wind components and temperature is developed from these results.

Mace, Gerald G.↗

Stochastic Models of Tropical Rain-Rate Fields

Because of the extreme variability of rain rate in space and time and the difficulties with remote sensing methods of measuring rain rates, accurate determination of rainfall over large areas and time periods has long been a problem for hydrologists, meteorogists, and climatologists. A number of statistical models of rain have been developed in order to investigate the impact of rain variability on satellite remote sensing methods, validation of satellite rain products, and generation of rain maps with accompanying error estimates. These models may be useful in examining 'sub-grid scale' issues in representing precipitation in numerical mdoels. A stochastic model will first be described which can generate time-dependent high-resolution spatial rain fields with space and time correlations similar to those seen in rain data, as well as representing the presence of areas with zero rain rate and log-normally distributed rain rates where there is rain. A simpler model derived from this, formulated in the spectral domain, seems to imply fractal-like rain statistics at small scales when fit to rain data.

Bell, Thomas L.↗

Predicting the Earth encounters of (99942) Apophis

Arecibo delay-Doppler measurements of (99942) Apophis in 2005 and 2006 resulted in a five standard-deviation trajectory correction to the optically predicted close approach distance to Earth in 2029. The radar measurements reduced the volume of the statistical uncertainty region entering the encounter to 7.3% of the pre-radar solution, but increased the trajectory uncertainty growth rate across the encounter by 800% due to the closer predicted approach to the Earth. A small estimated Earth impact probability remained for 2036. With standard-deviation plane-of-sky position uncertainties for 2007-2010 already less than 0.2 arcsec, the best near-term ground-based optical astrometry can only weakly affect the trajectory estimate. While the potential for impact in 2036 will likely be excluded in 2013 (if not 2011) using ground-based optical measurements, approximations within the Standard Dynamical Model (SDM) used to estimate and predict the trajectory from the current era are sufficient to obscure the difference between a predicted impact and a miss in 2036 by altering the dynamics leading into the 2029 encounter. Normal impact probability assessments based on the SDM become problematic without knowledge of the object's physical properties; impact could be excluded while the actual dynamics still permit it. Calibrated position uncertainty intervals are developed to compensate for this by characterizing the minimum and maximum effect of physical parameters on the trajectory. Uncertainty in accelerations related to solar radiation can cause between 82 and 4720 Earth-radii of trajectory change relative to the SDM by 2036. If an actionable hazard exists, alteration by 2-10% of Apophis' total absorption of solar radiation in 2018 could be sufficient to produce a six standard-deviation trajectory change by 2036 given physical characterization; even a 0.5% change could produce a trajectory shift of one Earth-radius by 2036 for all possible spin-poles and likely masses. Planetary ephemeris uncertainties are the next greatest source of systematic error, causing up to 23 Earth-radii of uncertainty. The SDM Earth point-mass assumption introduces an additional 2.9 Earth-radii of prediction error by 2036. Unmodeled asteroid perturbations produce as much as 2.3 Earth-radii of error. We find no future small-body encounters likely to yield an Apophis mass determination prior to 2029. However, asteroid (144898) 2004 VD17, itself having a statistical Earth impact in 2102, will probably encounter Apophis at 6.7 lunar distances in 2034, their uncertainty regions coming as close as 1.6 lunar distances near the center of both SDM probability distributions.

Orbit determination↗

Application of Statistical Methods of Rain Rate Estimation to Data From The TRMM Precipitation Radar

The TRMM Precipitation Radar is well suited to statistical methods in that the measurements over any given region are sparsely sampled in time. Moreover, the instantaneous rain rate estimates are often of limited accuracy at high rain rates because of attenuation effects and at light rain rates because of receiver sensitivity. For the estimation of the time-averaged rain characteristics over an area both errors are relevant. By enlarging the space-time region over which the data are collected, the sampling error can be reduced. However. the bias and distortion of the estimated rain distribution generally will remain if estimates at the high and low rain rates are not corrected. In this paper we use the TRMM PR data to investigate the behavior of 2 statistical methods the purpose of which is to estimate the rain rate over large space-time domains. Examination of large-scale rain characteristics provides a useful starting point. The high correlation between the mean and standard deviation of rain rate implies that the conditional distribution of this quantity can be approximated by a one-parameter distribution. This property is used to explore the behavior of the area-time-integral (ATI) methods where fractional area above a threshold is related to the mean rain rate. In the usual application of the ATI method a correlation is established between these quantities. However, if a particular form of the rain rate distribution is assumed and if the ratio of the mean to standard deviation is known, then not only the mean but the full distribution can be extracted from a measurement of fractional area above a threshold. The second method is an extension of this idea where the distribution is estimated from data over a range of rain rates chosen in an intermediate range where the effects of attenuation and poor sensitivity can be neglected. The advantage of estimating the distribution itself rather than the mean value is that it yields the fraction of rain contributed by the light and heavy rain rates. This is useful in estimating the fraction of rainfall contributed by the rain rates that go undetected by the radar. The results at high rain rates provide a cross-check on the usual attenuation correction methods that are applied at the highest resolution of the instrument.

Meneghini, R.↗

Assessing the Impact of Pre-gpm Microwave Precipitation Observations in the Goddard WRF Ensemble Data Assimilation System

The forthcoming Global Precipitation Measurement (GPM) Mission will provide next generation precipitation observations from a constellation of satellites. Since precipitation by nature has large variability and low predictability at cloud-resolving scales, the impact of precipitation data on the skills of mesoscale numerical weather prediction (NWP) is largely affected by the characterization of background and observation errors and the representation of nonlinear cloud/precipitation physics in an NWP data assimilation system. We present a data impact study on the assimilation of precipitation-affected microwave (MW) radiances from a pre-GPM satellite constellation using the Goddard WRF Ensemble Data Assimilation System (Goddard WRF-EDAS). A series of assimilation experiments are carried out in a Weather Research Forecast (WRF) model domain of 9 km resolution in western Europe. Sensitivities to observation error specifications, background error covariance estimated from ensemble forecasts with different ensemble sizes, and MW channel selections are examined through single-observation assimilation experiments. An empirical bias correction for precipitation-affected MW radiances is developed based on the statistics of radiance innovations in rainy areas. The data impact is assessed by full data assimilation cycling experiments for a storm event that occurred in France in September 2010. Results show that the assimilation of MW precipitation observations from a satellite constellation mimicking GPM has a positive impact on the accumulated rain forecasts verified with surface radar rain estimates. The case-study on a convective storm also reveals that the accuracy of ensemble-based background error covariance is limited by sampling errors and model errors such as precipitation displacement and unresolved convective scale instability.

microwave observations↗

Cosmic ray composition measurements and high energy ionization spectrometers

Element abundances of cosmic rays Li through Si with energy above 0.8 GeV/amu were measured on a balloon borne instrument containing a total absorption ionization spectrometer. Statistical techniques were used to analyze the five measurements of each particle to determine its charge and energy. The technique allows a determination of systematic errors to be made. Corrections for Landau fluctuations, spark chamber inefficiency, and background particles were included. Comparison with other published results is made. Differences in the shape of the spectrum determined from measurements of different workers indicate that the absolute intensity is still known to only plus or minus 15% between 2 and 10 GV/c rigidity.

Arens, J. F.↗

Cosmic-ray composition measurements with high-energy ionization spectrometers

Element abundances of cosmic rays for elements Li through Si with energy above 0.8 GeV/amu were measured on a balloon-borne instrument containing a total absorption ionization spectrometer. Statistical techniques were used to analyze the five measurements of each particle to determine its charge and energy. The technique allows a determination of systematic errors to be made. Corrections for Landau fluctuations, spark-chamber inefficiency, and background particles were included. Comparison with other published results is made. There are differences in the shapes of the differential spectra determined from measurements using different techniques, and our intensities still lie somewhat below those of other workers.

Arens, J. F.↗

A study of the comparative effects of various means of motion cueing during a simulated compensatory tracking task

NASA's Langley Research Center conducted a simulation experiment to ascertain the comparative effects of motion cues (combinations of platform motion and g-seat normal acceleration cues) on compensatory tracking performance. In the experiment, a full six-degree-of-freedom YF-16 model was used as the simulated pursuit aircraft. The Langley Visual Motion Simulator (with in-house developed wash-out), and a Langley developed g-seat were principal components of the simulation. The results of the experiment were examined utilizing univariate and multivariate techniques. The statistical analyses demonstrate that the platform motion and g-seat cues provide additional information to the pilot that allows substantial reduction of lateral tracking error. Also, the analyses show that the g-seat cue helps reduce vertical error.

Mckissick, B. T.↗

Using foreground/background analysis to determine leaf and canopy chemistry

Spectral Mixture Analysis (SMA) has become a well established procedure for analyzing imaging spectrometry data, however, the technique is relatively insensitive to minor sources of spectral variation (e.g., discriminating stressed from unstressed vegetation and variations in canopy chemistry). Other statistical approaches have been tried e.g., stepwise multiple linear regression analysis to predict canopy chemistry. Grossman et al. reported that SMLR is sensitive to measurement error and that the prediction of minor chemical components are not independent of patterns observed in more dominant spectral components like water. Further, they observed that the relationships were strongly dependent on the mode of expressing reflectance (R, -log R) and whether chemistry was expressed on a weight (g/g) or are basis (g/sq m). Thus, alternative multivariate techniques need to be examined. Smith et al. reported a revised SMA that they termed Foreground/Background Analysis (FBA) that permits directing the analysis along any axis of variance by identifying vectors through the n-dimensional spectral volume orthonormal to each other. Here, we report an application of the FBA technique for the detection of canopy chemistry using a modified form of the analysis.

Pinzon, J. E.↗

Accuracy Assessment of Aqua-MODIS Aerosol Optical Depth Over Coastal Regions: Importance of Quality Flag and Sea Surface Wind Speed

Coastal regions around the globe are a major source for anthropogenic aerosols in the atmosphere, but the underlying surface characteristics are not favorable for the Moderate Resolution Imaging Spectroradiometer (MODIS) algorithms designed for retrieval of aerosols over dark land or open-ocean surfaces. Using data collected from 62 coastal stations worldwide from the Aerosol Robotic Network (AERONET) from approximately 2002-2010, accuracy assessments are made for coastal aerosol optical depth (AOD) retrieved from MODIS aboard Aqua satellite. It is found that coastal AODs (at 550 nm) characterized respectively by the MODIS Dark Land (hereafter Land) surface algorithm, the Open-Ocean (hereafter Ocean) algorithm, and AERONET all exhibit a log-normal distribution. After filtering by quality flags, the MODIS AODs respectively retrieved from the Land and Ocean algorithms are highly correlated with AERONET (with R(sup 2) is approximately equal to 0.8), but only the Land algorithm AODs fall within the expected error envelope greater than 66% of the time. Furthermore, the MODIS AODs from the Land algorithm, Ocean algorithm, and combined Land and Ocean product show statistically significant discrepancies from their respective counterparts from AERONET in terms of mean, probability density function, and cumulative density function, which suggest a need for future improvement in retrieval algorithms. Without filtering with quality flag, the MODIS Land and Ocean AOD dataset can be degraded by 30-50% in terms of mean bias. Overall, the MODIS Ocean algorithm overestimates the AERONET coastal AOD by 0.021 for AOD less than 0.25 and underestimates it by 0.029 for AOD greater than 0.25. This dichotomy is shown to be related to the ocean surface wind speed and cloud contamination effects on the satellite aerosol retrieval. The Modern Era Retrospective-Analysis for Research and Applications (MERRA) reveals that wind speeds over the global coastal region 25 (with a mean and median value of 2.94 meters per second and 2.66 meters per second, respectively) are often slower than 6 meters per second assumed in the MODIS Ocean algorithm. As a result of high correlation (R(sup 2) greater than 0.98) between the bias in binned MODIS AOD and the corresponding binned wind speed over the coastal sea surface, an empirical scheme for correcting the bias of AOD retrieved from the MODIS Ocean algorithm is formulated and is shown to be effective over the majority of the coastal AERONET stations, and hence can be used in future analysis of AOD trend and MODIS AOD data assimilation.

Anderson, J. C.↗

Effects of Version 2 of the International Sunspot Number on Naive Predictions of Solar Cycle 25

The recalibration of the International Sunspot Number brings new challenges to predictions of Solar Cycle 25. One is that the list of extrema for the original series is no longer usable because the values of all maxima and minima are different for the new version of the sunspot number. Timings of extrema are less sensitive to the recalibration but are a natural result of the calculation. Predictions of Solar Cycle 25 published before 2016 must be converted to the new version of the sunspot number. Any prediction method that looks across the entire time span will have to be reconsidered because values in the nineteenth century were corrected by a larger factor than those in the twentieth century. We report a list of solar maxima and minima values and timings based on the recalibrated sunspot number. Naïve forecasts that depend only on the current values of the time series are common in economic studies. Several naïve predictions of Solar Cycle 25, the climatological average (180 ± 60), two versions of the inertial forecast, and two versions of the even-odd forecast, are derived from that table. The climatological average forecast is the baseline for more accurate predictions and the initial forecast in assimilative models of the Sun. It also provides the error estimate for Monte Carlo techniques that anticipate the long-term effects on the terrestrial environment. The other four predictions are shown to be statistically insignificant.

Pesnell, W. Dean↗

The NANOGrav 12.5 yr Data Set: The Frequency Dependence of Pulse Jitter in Precision Millisecond Pulsars

Low-frequency gravitational-wave experiments require the highest timing precision from an array of the moststable millisecond pulsars. Several known sources of noise on short timescales in single radio pulsar observationsare well described by a simple model of three components: template fitting from a finite signal-to-noise ratio, pulsephase/amplitude jitter from single-pulse stochasticity, and scintillation errors from short-timescale interstellarscattering variations. Currently template-fitting errors dominate, but as radio telescopes push toward higher signalto-noise ratios, jitter becomes the next dominant term for most millisecond pulsars. Understanding the statistics ofjitter becomes crucial for properly characterizing arrival time uncertainties. We characterize the radio frequencydependence of jitter using data on 48 pulsars in the North American Nanohertz Observatory for GravitationalWaves timing program. We detect significant jitter in 43 of the pulsars and test several functional forms for itsfrequency dependence; we find significant frequency dependence for 30 pulsars. We find moderate correlations ofrms jitter with pulse width (R = 0.62) and number of profile components (R = 0.40); the single-pulse rms jitter istypically 1% of pulse phase. The average frequency dependence for all pulsars using a power-law model hasindex 0.42. We investigate the jitter variations for the interpulse of PSR B1937+21 and find no significantdeviations from the main pulse rms jitter. We also test the time variation of jitter in two pulsars and find thatsystematics likely bias the results for high-precision pulsars. Pulsar timing array analyses must properly modeljitter as a significant component of the noise within the detector.

Lam, M. T.↗

Quality Control of Meteorological Observations

For the first time, a problem of the meteorological observation quality control (QC) was formulated by L.S. Gandin at the Main Geophysical Observatory in the 70's. Later in 1988 L.S. Gandin began adapting his ideas in complex quality control (CQC) to the operational environment at the National Centers for Environmental Prediction. The CQC was first applied by L.S.Gandin and his colleagues to detection and correction of errors in rawinsonde heights and temperatures using a complex of hydrostatic residuals.Later, a full complex of residuals, vertical and horizontal optimal interpolations and baseline checks were added for the checking and correction of a wide range of meteorological variables. some other of Gandin's ideas were applied and substantially developed at other meteorological centers. A new statistical QC was recently implemented in the Goddard Data Assimilation System. The central component of any quality control is a buddy check which is a test of individual suspect observations against available nearby non-suspect observations. A novel feature of this test is that the error variances which are used for QC decision are re-estimated on-line. As a result, the allowed tolerances for suspect observations can depend on local atmospheric conditions. The system is then better able to accept extreme values observed in deep cyclones, jet streams and so on. The basic statements of this adaptive buddy check are described. Some results of the on-line QC including moisture QC are presented.

Collins, William↗