Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Visual Data Analysis for Satellites

The Visual Data Analysis Package is a collection of programs and scripts that facilitate visual analysis of data available from NASA and NOAA satellites, as well as dropsonde, buoy, and conventional in-situ observations. The package features utilities for data extraction, data quality control, statistical analysis, and data visualization. The Hierarchical Data Format (HDF) satellite data extraction routines from NASA's Jet Propulsion Laboratory were customized for specific spatial coverage and file input/output. Statistical analysis includes the calculation of the relative error, the absolute error, and the root mean square error. Other capabilities include curve fitting through the data points to fill in missing data points between satellite passes or where clouds obscure satellite data. For data visualization, the software provides customizable Generic Mapping Tool (GMT) scripts to generate difference maps, scatter plots, line plots, vector plots, histograms, timeseries, and color fill images.

Lau, Yee↗

The Distribution of the Orbits in the Geminid Meteoroid Stream Based on the Dispersion of their Periods

Geminid meteoroids, selected from a large set of precisely-reduced meteor orbits from the photographic and radar catalogues of the IAU Meteor Data Center (Lindblad et al. 2003), and from the Japanese TV meteor shower catalogue (SonotaCo 2010), have been analyzed with the aim of determining the orbits distribution in the stream, based on the dispersion of their periods P . The values of the reciprocal semi-major axis 1/a in the stream showed small errors in the velocity measurements. Thus, it was statistically possible to also determine the relation between the observed and the real dispersion of the Geminids.

Hajdukova, M., Jr.↗

Comparison of soil dielectric mixing models for Soil Moisture Retrieval using SMAP Brightness Temperature over croplands in India

The accurate estimation of soil moisture (SM) using microwave remote sensing depends mostly on careful selection of retrieval parameters among which the soil dielectric mixing model is the important one. These models are often categorized into empirical, semi-empirical or volumetric based on their methodologies and input data requirements. To study in detail, the comparative performance of four dielectric mixing models -- Wang & Schmugge model, Hallikainen model, Dobson model and Mironov model were used with Soil Moisture Active Passive (SMAP) L-band brightness temperature and Single Channel Algorithm for SM retrieval over agricultural landscapes in India. The highest performance statistics combination in terms of Root Mean Square Error (RMSE), correlation coefficient (R^(2)) and percentage bias (PBIAS) against the concurrent in-situ SM measurements were calculated at the selected validation sites. The overall results indicate that the best performance was given by the Mironov model (RMSE = 0.07 cu. m/cu. m), followed by Wang & Schmugge model (RMSE = 0.08 cu. m3/cu. m), Hallikainen model (RMSE = 0.09 cu. m/cu. m), Dobson model (RMSE = 0.10 cu. m/cu. m) and original SMAP radiometer SM (RMSE = 0.12 cu. m/cu. m). Findings of this study provides important insights into application and performance of dielectric mixing models in mapping surface SM variations. This study also underlines the pivotal role of local conditions for SM retrieval which should be carefully included in the algorithms.

Swati Suman↗

A Categorization of Dynamic Analyzers

Program analysis techniques and tools are essential to the development process because of the support they provide in detecting errors and deficiencies at different phases of development. The types of information rendered through analysis includes the following: statistical measurements of code, type checks, dataflow analysis, consistency checks, test data,verification of code, and debugging information. Analyzers can be broken into two major categories: dynamic and static. Static analyzers examine programs with respect to syntax errors and structural properties., This includes gathering statistical information on program content, such as the number of lines of executable code, source lines. and cyclomatic complexity. In addition, static analyzers provide the ability to check for the consistency of programs with respect to variables. Dynamic analyzers in contrast are dependent on input and the execution of a program providing the ability to find errors that cannot be detected through the use of static analysis alone. Dynamic analysis provides information on the behavior of a program rather than on the syntax. Both types of analysis detect errors in a program, but dynamic analyzers accomplish this through run-time behavior. This paper focuses on the following broad classification of dynamic analyzers: 1) Metrics; 2) Models; and 3) Monitors. Metrics are those analyzers that provide measurement. The next category, models, captures those analyzers that present the state of the program to the user at specified points in time. The last category, monitors, checks specified code based on some criteria. The paper discusses each classification and the techniques that are included under them. In addition, the role of each technique in the software life cycle is discussed. Familiarization with the tools that measure, model and monitor programs provides a framework for understanding the program's dynamic behavior from different, perspectives through analysis of the input/output data.

Lujan, Michelle R.↗

Carrier arraying: Revisited

Depending on the basis used for comparison, it is possible to predict different gains when applying carrier arraying to a conventional coherent receiver. In the past, the specific performance comparisons were made between the arrayed and nonarrayed cases assuming a fixed carrier-tracking closed-loop bandwidth. While the notion of loop bandwidth for the nonarrayed loop with a single input is well defined and meaningful, the comparable notion for an arrayed loop with multiple inputs is not uniquely defined since it depends on the knowledge of the statistical relation, e.g., degree of correlation, among the various antenna inputs. To circumvent the need for such knowledge, which is often not completely available, we suggest in this article an alternate criterion for comparing arrayed and nonarrayed loops, namely, fixed steady-state phase error, which, in the arrayed case, is independent of the statistical relation among the antenna inputs. We show that, in this case, the gain derived from carrier arraying is quite different from that obtained under the assumption of fixed-loop bandwidth, which suggests that one should exercise care when comparing arrayed and unarrayed loops in that the criterion used for comparison should be directly applicable to the situation at hand.

Simon, M. K.↗

A Practical Methodology for Quantifying Random and Systematic Components of Unexplained Variance in a Wind Tunnel

This paper documents a check standard wind tunnel test conducted in the Langley 0.3-Meter Transonic Cryogenic Tunnel (0.3M TCT) that was designed and analyzed using the Modern Design of Experiments (MDOE). The test designed to partition the unexplained variance of typical wind tunnel data samples into two constituent components, one attributable to ordinary random error, and one attributable to systematic error induced by covariate effects. Covariate effects in wind tunnel testing are discussed, with examples. The impact of systematic (non-random) unexplained variance on the statistical independence of sequential measurements is reviewed. The corresponding correlation among experimental errors is discussed, as is the impact of such correlation on experimental results generally. The specific experiment documented herein was organized as a formal test for the presence of unexplained variance in representative samples of wind tunnel data, in order to quantify the frequency with which such systematic error was detected, and its magnitude relative to ordinary random error. Levels of systematic and random error reported here are representative of those quantified in other facilities, as cited in the references.

Deloach, Richard↗

Asteroid orbital error analysis: Theory and application

We present a rigorous Bayesian theory for asteroid orbital error estimation in which the probability density of the orbital elements is derived from the noise statistics of the observations. For Gaussian noise in a linearized approximation the probability density is also Gaussian, and the errors of the orbital elements at a given epoch are fully described by the covariance matrix. The law of error propagation can then be applied to calculate past and future positional uncertainty ellipsoids (Cappellari et al. 1976, Yeomans et al. 1987, Whipple et al. 1991). To our knowledge, this is the first time a Bayesian approach has been formulated for orbital element estimation. In contrast to the classical Fisherian school of statistics, the Bayesian school allows a priori information to be formally present in the final estimation. However, Bayesian estimation does give the same results as Fisherian estimation when no priori information is assumed (Lehtinen 1988, and reference therein).

Muinonen, K.↗

A function space approach to state and model error estimation for elliptic systems

An approach is advanced for the concurrent estimation of the state and of the model errors of a system described by elliptic equations. The estimates are obtained by a deterministic least-squares approach that seeks to minimize a quadratic functional of the model errors, or equivalently, to find the vector of smallest norm subject to linear constraints in a suitably defined function space. The minimum norm solution can be obtained by solving either a Fredholm integral equation of the second kind for the case with continuously distributed data or a related matrix equation for the problem with discretely located measurements. Solution of either one of these equations is obtained in a batch-processing mode in which all of the data is processed simultaneously or, in certain restricted geometries, in a spatially scanning mode in which the data is processed recursively. After the methods for computation of the optimal estimates are developed, an analysis of the second-order statistics of the estimates and of the corresponding estimation error is conducted. Based on this analysis, explicit expressions for the mean-square estimation error associated with both the state and model error estimates are then developed.

Rodriguez, G.↗

A function space approach to state and model error estimation for elliptic systems

An approach is advanced for the concurrent estimation of the state and of the model errors of a system described by elliptic equations. The estimates are obtained by a deterministic least-squares approach that seeks to minimize a quadratic functional of the model errors, or equivalently, to find the vector of smallest norm subject to linear constraints in a suitably defined function space. The minimum norm solution can be obtained by solving either a Fredholm integral equation of the second kind for the case with continuously distributed data or a related matrix equation for the problem with discretely located measurements. Solution of either one of these equations is obtained in a batch-processing mode in which all of the data is processed simultaneously or, in certain restricted geometries, in a spatially scanning mode in which the data is processed recursively. After the methods for computation of the optimal esimates are developed, an analysis of the second-order statistics of the estimates and of the corresponding estimation error is conducted. Based on this analysis, explicit expressions for the mean-square estimation error associated with both the state and model error estimates are then developed. While this paper focuses on theoretical developments, applications arising in the area of large structure static shape determination are contained in a closely related paper (Rodriguez and Scheid, 1982).

Rodriguez, G.↗

Advanced Water Vapor Lidar Detection System

In the present water vapor lidar system, the detected signal is sent over long cables to a waveform digitizer in a CAMAC crate. This has the disadvantage of transmitting analog signals for a relatively long distance, which is subjected to pickup noise, leading to a decrease in the signal to noise ratio. Generally, errors in the measurement of water vapor with the DIAL method arise from both random and systematic sources. Systematic errors in DIAL measurements are caused by both atmospheric and instrumentation effects. The selection of the on-line alexandrite laser with a narrow linewidth, suitable intensity and high spectral purity, and its operation at the center of the water vapor lines, ensures minimum influence in the DIAL measurement that are caused by the laser spectral distribution and avoid system overloads. Random errors are caused by noise in the detected signal. Variability of the photon statistics in the lidar return signal, noise resulting from detector dark current, and noise in the background signal are the main sources of random error. This type of error can be minimized by maximizing the signal to noise ratio. The increase in the signal to noise ratio can be achieved by several ways. One way is to increase the laser pulse energy, by increasing its amplitude or the pulse repetition rate. Another way, is to use a detector system with higher quantum efficiency and lower noise, on the other hand, the selection of a narrow band optical filter that rejects most of the day background light and retains high optical efficiency is an important issue. Following acquisition of the lidar data, we minimize random errors in the DIAL measurement by averaging the data, but this will result in the reduction of the vertical and horizontal resolutions. Thus, a trade off is necessary to achieve a balance between the spatial resolution and the measurement precision. Therefore, the main goal of this research effort is to increase the signal to noise ratio by a factor of 10 over the current system, using a newly evaluated, very low noise avalanche photo diode detector and constructing a 10 MHz waveform digitizer which will replace the current CAMAC system.

Elsayed-Ali, Hani↗

Spatial Statistical Data Fusion (SSDF)

As remote sensing for scientific purposes has transitioned from an experimental technology to an operational one, the selection of instruments has become more coordinated, so that the scientific community can exploit complementary measurements. However, tech nological and scientific heterogeneity across devices means that the statistical characteristics of the data they collect are different. The challenge addressed here is how to combine heterogeneous remote sensing data sets in a way that yields optimal statistical estimates of the underlying geophysical field, and provides rigorous uncertainty measures for those estimates. Different remote sensing data sets may have different spatial resolutions, different measurement error biases and variances, and other disparate characteristics. A state-of-the-art spatial statistical model was used to relate the true, but not directly observed, geophysical field to noisy, spatial aggregates observed by remote sensing instruments. The spatial covariances of the true field and the covariances of the true field with the observations were modeled. The observations are spatial averages of the true field values, over pixels, with different measurement noise superimposed. A kriging framework is used to infer optimal (minimum mean squared error and unbiased) estimates of the true field at point locations from pixel-level, noisy observations. A key feature of the spatial statistical model is the spatial mixed effects model that underlies it. The approach models the spatial covariance function of the underlying field using linear combinations of basis functions of fixed size. Approaches based on kriging require the inversion of very large spatial covariance matrices, and this is usually done by making simplifying assumptions about spatial covariance structure that simply do not hold for geophysical variables. In contrast, this method does not require these assumptions, and is also computationally much faster. This method is fundamentally different than other approaches to data fusion for remote sensing data because it is inferential rather than merely descriptive. All approaches combine data in a way that minimizes some specified loss function. Most of these are more or less ad hoc criteria based on what looks good to the eye, or some criteria that relate only to the data at hand.

Braverman, Amy J.↗

Scale Dependence of Statistics of Spatially Averaged Rain Rate Seen in TOGA COARE Comparison with Predictions from a Stochastic Model

A characteristic feature of rainfall statistics is that they in general depend on the space and time scales over which rain data are averaged. As a part of an earlier effort to determine the sampling error of satellite rain averages, a space-time model of rainfall statistics was developed to describe the statistics of gridded rain observed in GATE. The model allows one to compute the second moment statistics of space- and time-averaged rain rate which can be fitted to satellite or rain gauge data to determine the four model parameters appearing in the precipitation spectrum - an overall strength parameter, a characteristic length separating the long and short wavelength regimes and a characteristic relaxation time for decay of the autocorrelation of the instantaneous local rain rate and a certain 'fractal' power law exponent. For area-averaged instantaneous rain rate, this exponent governs the power law dependence of these statistics on the averaging length scale $L$ predicted by the model in the limit of small $L$. In particular, the variance of rain rate averaged over an $L \times L$ area exhibits a power law singularity as $L \rightarrow 0$. In the present work the model is used to investigate how the statistics of area-averaged rain rate over the tropical Western Pacific measured with ship borne radar during TOGA COARE (Tropical Ocean Global Atmosphere Coupled Ocean Atmospheric Response Experiment) and gridded on a 2 km grid depends on the size of the spatial averaging scale. Good agreement is found between the data and predictions from the model over a wide range of averaging length scales.

Kundu, Prasun K.↗

Unsteady Pressure-Sensitive-Paint Shot Noise Reduction

In the study of unsteady Pressure-Sensitive Paint (uPSP) image data sets, pixel intensity values collected by Phantom cameras from multiple perspectives are used to calculate the surface pressure of an experimental model. This paper focuses on mitigation of shot noise which is introduced into the image data set by the cameras. Shot noise impacts the quality of data collected, increasing the system error in its pressure value calculations. This paper characterises statistical methods to reduce shot noise within experimental data by taking an average or weighted average across an area of pixels of their respective counts. Each combined-pixel has a higher total effective intensity value and therefore exhibits reduced noise throughout its time history. This is demonstrated by calculating the standard deviations of the combined pixel values through time, which decrease as the combined pixel area increases. Finally, these methods are compared across experimental wind tunnel conditions to examine their effectiveness at different Mach numbers. Ultimately, the results are used to recommend a blur filter type and size which will be applied to the raw image data prior to processing, as well as a minimum camera resolution for future experiments. Downstream of the filter application, the software to convert the 2D image data sets into surface pressure readings on a 3D grid use a ratio of decimation that assigns multiple pixels to each 3D grid node. This decimation ratio will also be aligned with the size of the blur filter, resulting in a more manageable data set size and compromised spatial resolution. Combined with the effect of the blur filter, the resulting pixel intensity readings will exhibit significantly reduced shot noise, reducing the magnitude of uncertainty and error in the final calculated pressure. For future tests, the camera spatial resolution must be sufficient to capture small flow and model features even after the recommended blur filter is applied. The image data set is taken from a uPSP experiment of the Space Launch System Block 1 cargo vehicle model in September 2019.

Lucy Tang↗

Unsteady Pressure-Sensitive Paint (UPSP) Shot Noise Reduction

In the study of unsteady Pressure-Sensitive Paint (uPSP) image data sets, pixel intensity values collected by Phantom cameras from multiple perspectives are used to calculate the surface pressure of an experimental model. This paper focuses on mitigation of shot noise which is introduced into the image data set by the cameras. Shot noise impacts the quality of data collected, increasing the system error in its pressure value calculations. This paper characterises statistical methods to reduce shot noise within experimental data by taking an average or weighted average across an area of pixels of their respective counts. Each combined-pixel has a higher total effective intensity value and therefore exhibits reduced noise throughout its time history. This is demonstrated by calculating the standard deviations of the combined pixel values through time, which decrease as the combined pixel area increases. Finally, these methods are compared across experimental wind tunnel conditions to examine their effectiveness at different Mach numbers. Ultimately, the results are used to recommend a blur filter type and size which will be applied to the raw image data prior to processing, as well as a minimum camera resolution for future experiments. Downstream of the filter application, the software to convert the 2D image data sets into surface pressure readings on a 3D grid use a ratio of decimation that assigns multiple pixels to each 3D grid node. This decimation ratio will also be aligned with the size of the blur filter, resulting in a more manageable data set size and compromised spatial resolution. Combined with the effect of the blur filter, the resulting pixel intensity readings will exhibit significantly reduced shot noise, reducing the magnitude of uncertainty and error in the final calculated pressure. For future tests, the camera spatial resolution must be sufficient to capture small flow and model features even after the recommended blur filter is applied. The image data set is taken from a uPSP experiment of the Space Launch System Block 1 cargo vehicle model in September 2019.

Lucy Tang↗

Analytical Assessment of Simultaneous Parallel Approach Feasibility from Total System Error

In a simultaneous paired approach to closely-spaced parallel runways, a pair of aircraft flies in close proximity on parallel approach paths. The aircraft pair must maintain a longitudinal separation within a range that avoids wake encounters and, if one of the aircraft blunders, avoids collision. Wake avoidance defines the rear gate of the longitudinal separation. The lead aircraft generates a wake vortex that, with the aid of crosswinds, can travel laterally onto the path of the trail aircraft. As runway separation decreases, the wake has less distance to traverse to reach the path of the trail aircraft. The total system error of each aircraft further reduces this distance. The total system error is often modeled as a probability distribution function. Therefore, Monte-Carlo simulations are a favored tool for assessing a "safe" rear-gate. However, safety for paired approaches typically requires that a catastrophic wake encounter be a rare one-in-a-billion event during normal operation. Using a Monte-Carlo simulation to assert this event rarity with confidence requires a massive number of runs. Such large runs do not lend themselves to rapid turn-around during the early stages of investigation when the goal is to eliminate the infeasible regions of the solution space and to perform trades among the independent variables in the operational concept. One can employ statistical analysis using simplified models more efficiently to narrow the solution space and identify promising trades for more in-depth investigation using Monte-Carlo simulations. These simple, analytical models not only have to address the uncertainty of the total system error but also the uncertainty in navigation sources used to alert an abort of the procedure. This paper presents a method for integrating total system error, procedure abort rates, avionics failures, and surveillance errors into a statistical analysis that identifies the likely feasible runway separations for simultaneous paired approaches.

Madden, Michael M.↗

At least some errors are randomly generated (Freud was wrong)

An experiment was carried out to expose something about human error generating mechanisms. In the context of the experiment, an error was made when a subject pressed the wrong key on a computer keyboard or pressed no key at all in the time allotted. These might be considered, respectively, errors of substitution and errors of omission. Each of seven subjects saw a sequence of three digital numbers, made an easily learned binary judgement about each, and was to press the appropriate one of two keys. Each session consisted of 1,000 presentations of randomly permuted, fixed numbers broken into 10 blocks of 100. One of two keys should have been pressed within one second of the onset of each stimulus. These data were subjected to statistical analyses in order to probe the nature of the error generating mechanisms. Goodness of fit tests for a Poisson distribution for the number of errors per 50 trial interval and for an exponential distribution of the length of the intervals between errors were carried out. There is evidence for an endogenous mechanism that may best be described as a random error generator. Furthermore, an item analysis of the number of errors produced per stimulus suggests the existence of a second mechanism operating on task driven factors producing exogenous errors. Some errors, at least, are the result of constant probability generating mechanisms with error rate idiosyncratically determined for each subject.

Sellen, A. J.↗

The Influence of Observation Errors on Analysis Error and Forecast Skill Investigated with an Observing System Simulation Experiment

The Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework is used to explore the response of analysis error and forecast skill to observation quality. In an OSSE, synthetic observations may be created that have much smaller error than real observations, and precisely quantified error may be applied to these synthetic observations. Three experiments are performed in which synthetic observations with magnitudes of applied observation error that vary from zero to twice the estimated realistic error are ingested into the Goddard Earth Observing System Model (GEOS-5) with Gridpoint Statistical Interpolation (GSI) data assimilation for a one-month period representing July. The analysis increment and observation innovation are strongly impacted by observation error, with much larger variances for increased observation error. The analysis quality is degraded by increased observation error, but the change in root-mean-square error of the analysis state is small relative to the total analysis error. Surprisingly, in the 120 hour forecast increased observation error only yields a slight decline in forecast skill in the extratropics, and no discernable degradation of forecast skill in the tropics.

Observation Error↗