Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Wind-Tunnel Balance Characterization for Hypersonic Research Applications

Wind-tunnel research was recently conducted at the NASA Langley Research Center s 31-Inch Mach 10 Hypersonic Facility in support of the Mars Science Laboratory s aerodynamic program. Researchers were interested in understanding the interaction between the freestream flow and the reaction control system onboard the entry vehicle. A five-component balance, designed for hypersonic testing with pressurized flow-through capability, was used. In addition to the aerodynamic forces, the balance was exposed to both thermal gradients and varying internal cavity pressures. Historically, the effect of these environmental conditions on the response of the balance have not been fully characterized due to the limitations in the calibration facilities. Through statistical design of experiments, thermal and pressure effects were strategically and efficiently integrated into the calibration of the balance. As a result of this new approach, researchers were able to use the balance continuously throughout the wide range of temperatures and pressures and obtain real-time results. Although this work focused on a specific application, the methodology shown can be applied more generally to any force measurement system calibration.

Lynn, Keith C.↗

Experimental Investigations of Non-Stationary Properties In Radiometer Receivers Using Measurements of Multiple Calibration References

Radiometers must be periodically calibrated because the receiver response fluctuates. Many techniques exist to correct for the time varying response of a radiometer receiver. An analytical technique has been developed that uses generalized least squares regression (LSR) to predict the performance of a wide variety of calibration algorithms. The total measurement uncertainty including the uncertainty of the calibration can be computed using LSR. The uncertainties of the calibration samples used in the regression are based upon treating the receiver fluctuations as non-stationary processes. Signals originating from the different sources of emission are treated as simultaneously existing random processes. Thus, the radiometer output is a series of samples obtained from these random processes. The samples are treated as random variables but because the underlying processes are non-stationary the statistics of the samples are treated as non-stationary. The statistics of the calibration samples depend upon the time for which the samples are to be applied. The statistics of the random variables are equated to the mean statistics of the non-stationary processes over the interval defined by the time of calibration sample and when it is applied. This analysis opens the opportunity for experimental investigation into the underlying properties of receiver non stationarity through the use of multiple calibration references. In this presentation we will discuss the application of LSR to the analysis of various calibration algorithms, requirements for experimental verification of the theory, and preliminary results from analyzing experiment measurements.

Racette, Paul↗

Calibration improvements to electronically scanned pressure systems and preliminary statistical assessment

Orifice-to-orifice inconsistencies in data acquired with an electronically-scanned pressure system at the beginning of a wind tunnel experiment forced modifications to the standard, instrument calibration procedures. These modifications included a large increase in the number of calibration points which would allow a critical examination of the calibration curve-fit process, and a subsequent post-test reduction of the pressure data. Evaluation of these data has resulted in an improved functional representation of the pressure-voltage signature for electronically-scanned pressures sensors, which can reduce the errors due to calibration curve fit to under 0.10 percent of reading compared to the manufacturer specified 0.10 percent of full scale. Application of the improved calibration function allows a more rational selection of the calibration set-point pressures. These pressures should be adjusted to achieve a voltage output which matches the physical shape of the pressure-voltage signature of the sensor. This process is conducted in lieu of the more traditional approach where a calibration pressure is specified and the resulting sensor voltage is recorded. The fifteen calibrations acquired over the two-week duration of the wind tunnel test were further used to perform a preliminary, statistical assessment of the variation in the calibration process. The results allowed the estimation of the bias uncertainty for a single instrument calibration; and, they form the precursor for more extensive and more controlled studies in the laboratory.

Everhart, Joel L.↗

Evaluating Statistical Process Control (SPC) techniques and computing the uncertainty of force calibrations

In recent years there has been a push within NASA to use statistical techniques to improve the quality of production. Two areas where statistics are used are in establishing product and process quality control of flight hardware and in evaluating the uncertainty of calibration of instruments. The Flight Systems Quality Engineering branch is responsible for developing and assuring the quality of all flight hardware; the statistical process control methods employed are reviewed and evaluated. The Measurement Standards and Calibration Laboratory performs the calibration of all instruments used on-site at JSC as well as those used by all off-site contractors. These calibrations must be performed in such a way as to be traceable to national standards maintained by the National Institute of Standards and Technology, and they must meet a four-to-one ratio of the instrument specifications to calibrating standard uncertainty. In some instances this ratio is not met, and in these cases it is desirable to compute the exact uncertainty of the calibration and determine ways of reducing it. A particular example where this problem is encountered is with a machine which does automatic calibrations of force. The process of force calibration using the United Force Machine is described in detail. The sources of error are identified and quantified when possible. Suggestions for improvement are made.

Navard, Sharon E.↗

Synchronizing computer clocks using a local area network

Researchers completed the first tests of a method to synchronize the clocks of networked computers to the National Institute of Standards and Technology (NIST) time scale. The method uses a server computer to disseminate the time to other clients on the same local-area network. The server is synchronized to NIST using the ACTS protocol over a dial-up telephone line. The software in both the server and the parameters of this model are used to adjust the time of the local clock and the interval between calibration requests in a statistically optimum way. The algorithm maximizes the time between calibrations while at the same time keeping the time of the local clock correct within a specific tolerance. The method can be extended to synchronize computers linked over wide-area networks, and an experiment to test the performance of the algorithms over such networks is being planned.

Levine, Judah↗

(abstract) Atmospheric Transmission Model Through Autonomous Visibility Measurement

Performance of deep space optical communications is impacted by atmospheric outages. By monitoring known stellar objects with calibrated telescopes, atmospheric attenuation statistics can be recorded. This paper describes a program to develop an atmospheric transmission model for optical communications by making automous visibility measurements of known stellar objects from three locations in the southwestern US. The data will be correlated and infused with weather data to establish the atmospheric transmission model. This model will be sent in link margin analysis for optical communications channels. The statistics will be updated on a quarterly basis and calibrated using data taken over a long period of time. This calibration is expected to allow extrapolation to other ground-based locations through use of global weather databases.

attenuation model↗

A Comparison of Two Balance Calibration Model Building Methods

Simulated strain-gage balance calibration data is used to compare the accuracy of two balance calibration model building methods for different noise environments and calibration experiment designs. The first building method obtains a math model for the analysis of balance calibration data after applying a candidate math model search algorithm to the calibration data set. The second building method uses stepwise regression analysis in order to construct a model for the analysis. Four balance calibration data sets were simulated in order to compare the accuracy of the two math model building methods. The simulated data sets were prepared using the traditional One Factor At a Time (OFAT) technique and the Modern Design of Experiments (MDOE) approach. Random and systematic errors were introduced in the simulated calibration data sets in order to study their influence on the math model building methods. Residuals of the fitted calibration responses and other statistical metrics were compared in order to evaluate the calibration models developed with different combinations of noise environment, experiment design, and model building method. Overall, predicted math models and residuals of both math model building methods show very good agreement. Significant differences in model quality were attributable to noise environment, experiment design, and their interaction. Generally, the addition of systematic error significantly degraded the quality of calibration models developed from OFAT data by either method, but MDOE experiment designs were more robust with respect to the introduction of a systematic component of the unexplained variance.

DeLoach, Richard↗

ERS-1 Investigations of Southern Ocean Sea Ice Geophysics Using Combined Scatterometer and SAR Images

Coregistered ERS-1 SAR and Scatterometer data are presented for the Weddell Sea, Antarctica. Calibrated image backscatter statistics are extracted from data acquired in regions where surface measurements were made during two extensive international Weddell Sea experiments in 1992. Changes in summer ice-surface conditions, due to temperature and wind, are shown to have a large impact on observed microwave backscatter values. Winter calibrated backscatter distributions are also investigated as a way of describing ice thickness conditions in different location during winter. Coregistered SAR and EScat data over a manned drifting ice station are used to illustrate the seasonal signature changes occurring during the fall freeze-up transition.

sea-ice Weddell Sea ice formation↗

Uncertainty Analysis of Instrument Calibration and Application

Experimental aerodynamic researchers require estimated precision and bias uncertainties of measured physical quantities, typically at 95 percent confidence levels. Uncertainties of final computed aerodynamic parameters are obtained by propagation of individual measurement uncertainties through the defining functional expressions. In this paper, rigorous mathematical techniques are extended to determine precision and bias uncertainties of any instrument-sensor system. Through this analysis, instrument uncertainties determined through calibration are now expressed as functions of the corresponding measurement for linear and nonlinear univariate and multivariate processes. Treatment of correlated measurement precision error is developed. During laboratory calibration, calibration standard uncertainties are assumed to be an order of magnitude less than those of the instrument being calibrated. Often calibration standards do not satisfy this assumption. This paper applies rigorous statistical methods for inclusion of calibration standard uncertainty and covariance due to the order of their application. The effects of mathematical modeling error on calibration bias uncertainty are quantified. The effects of experimental design on uncertainty are analyzed. The importance of replication is emphasized, techniques for estimation of both bias and precision uncertainties using replication are developed. Statistical tests for stationarity of calibration parameters over time are obtained.

Tripp, John S.↗

Calibration of the Visible and Near-Infrared Channels of the Advanced Very High Resolution Radiometer (AVHRR) After Launch

The relative degradation in time of the visible(channel 1: approx.0.58-0.6 microns) and near-infrared(channel 2: approx. O.72-1.1 microns) channels of the Advanced Very High Resolution Radiometer(AVHRR), onboard the NOAA Polar-orbiting Operational Environmental Satellites(POES), has been determined, using the southeastern Libyan desert(21-23 deg N latitude; 28- 29 deg E longitude) as a time-invariant calibration target. A statistical procedure was used on the reflectance data for the two channels from the B3 data of the International Satellite Cloud Climatology Project(ISCCP) to obtain the degradation rates for the AVERRs on NOAA-7, -9, and -11 spacecraft. The degradation rates per year for channels 1 and 2 are respectively: 3.6% and 4.3%(NOAA-7); 5.9% and 3.5%(NOAA-9); and 1.2% and 2.0%(NOAA-11). The use of the degradation rates thus determined, in conjunction with 'absolute' calibrations obtained from congruent aircraft and satellite measurements, in the development of correction algorithms is illustrated with the AVHRR on the NOAA-9 spacecraft.

Rao, C. R. Nagaraja↗

Uncertainty Management in Remote Sensing of Climate Data. Summary of A Workshop

Great advances have been made in our understanding of the climate system over the past few decades, and remotely sensed data have played a key role in supporting many of these advances. Improvements in satellites and in computational and data-handling techniques have yielded high quality, readily accessible data. However, rapid increases in data volume have also led to large and complex datasets that pose significant challenges in data analysis (NRC, 2007). Uncertainty characterization is needed for every satellite mission and scientists continue to be challenged by the need to reduce the uncertainty in remotely sensed climate records and projections. The approaches currently used to quantify the uncertainty in remotely sensed data, including statistical methods used to calibrate and validate satellite instruments, lack an overall mathematically based framework.

Remote sensing↗

A Common Calibration Source Framework for Fully-Polarimetric and Interferometric Radiometers

Two types of microwave radiometry--synthetic thinned array radiometry (STAR) and fully-polarimetric (FP) radiometry--have received increasing attention during the last several years. STAR radiometers offer a technological solution to achieving high spatial resolution imaging from orbit without requiring a filled aperture or a moving antenna, and FP radiometers measure extra polarization state information upon which entirely new or more robust geophysical retrieval algorithms can be based. Radiometer configurations used for both STAR and FP instruments share one fundamental feature that distinguishes them from more 'standard' radiometers, namely, they measure correlations between pairs of microwave signals. The calibration requirements for correlation radiometers are broader than those for standard radiometers. Quantities of interest include total powers, complex correlation coefficients, various offsets, and possible nonlinearities. A candidate for an ideal calibration source would be one that injects test signals with precisely controllable correlation coefficients and absolute powers simultaneously into a pair of receivers, permitting all of these calibration quantities to be measured. The complex nature of correlation radiometer calibration, coupled with certain inherent similarities between STAR and FP instruments, suggests significant leverage in addressing both problems together. Recognizing this, a project was recently begun at NASA Goddard Space Flight Center to develop a compact low-power subsystem for spaceflight STAR or FP receiver calibration. We present a common theoretical framework for the design of signals for a controlled correlation calibration source. A statistical model is described, along with temporal and spectral constraints on such signals. Finally, a method for realizing these signals is demonstrated using a Matlab-based implementation.

Kim, Edward J.↗

Searching for the Beginning of the Ozone Turnaround Using a 22-Year Merged Satellite Data Set

We have used the data from six satellite instruments that measure the total column amount of ozone to construct a consistent merged data set extending from late 1978 into 2000. The keys to constructing a merged data set are to minimize potential drift of individual instruments and to accurately establish instrument-to-instrument offsets. We have used the short-wavelength D-pair measurements (306nm-313nm) of the SBUV and SBUV/2 instruments near the equator to establish a relatively drift-free record for these instruments. We have then used their overlap with the Nimbus 7 and EP TOMS instruments to establish the relative calibration of the various instruments. We have evaluated the drift uncertainty in our merged ozone data (MOD) set by examining both the individual instrument drift uncertainty and the uncertainty in establishing the instrument- to-instrument differences. We conclude that the instrumental drift uncertainty over the 22-year data record is 0.9 %/decade (2-sigma). We have compared our MOD record with 37 ground stations that have a continuous record over that time period. We have a mean drift with respect to the stations of +0.3 %/decade which is within 1-sigma of our uncertainty estimate. Using the satellite record as a transfer standard, we can estimate the capability of the ground instruments to establish satellite calibration. Adding the statistical variability of the station drifts with respect to the satellite to an estimate of the overall drift uncertainty of the world standard instrument, we conclude that the stations should be able to be used to establish the drift of the satellite data record to within and uncertainty of 0.6 %/decade (2-sigma). Adding to this an uncertainty due to the-incomplete global coverage of the stations, we conclude that the station data should be able to establish the global trend with an uncertainty of about 0.7 %/decade, slightly better than for the satellite record. We conclude that merging the two records together gives only a slight improvement in the uncertainty. Keeping them separate gives the greater confidence of two independent measures of the ozone trend and potential recovery. We fit the trend in our MOD record through May of 1991 and then extrapolated forward to see if the data at the end of the record was above the statistical model as a measure of ozone recovery as was done in the last WMO/UNEP assessment report. Because our data set drifts with respect to the ground-stations through May of 1991, we calculated a smaller global trend (-1.1 %/decade) than in the WMO/UNEP report. Our data in 1998 and 1999 was, on average 2 DU above the extrapolated statistical model with a 2-sigma uncertainty of 6 DU. For the combined mid-latitudes of the northern and southern hemispheres, the data was 5 DU above the extrapolated statistical model with a 2-sigma uncertainty of 10 DU. These may be signs of recovery, but they are still statistically insignificant.

Stolarski, Richard S.↗

Thermal and Pressure Characterization of a Wind Tunnel Force Balance Using the Single Vector System

Wind tunnel research at NASA Langley Research Center s 31-inch Mach 10 hypersonic facility utilized a 5-component force balance, which provided a pressurized flow-thru capability to the test article. The goal of the research was to determine the interaction effects between the free-stream flow and the exit flow from the reaction control system on the Mars Science Laboratory aeroshell during planetary entry. In the wind tunnel, the balance was exposed to aerodynamic forces and moments, steady-state and transient thermal gradients, and various internal balance cavity pressures. Historically, these effects on force measurement accuracy have not been fully characterized due to limitations in the calibration apparatus. A statistically designed experiment was developed to adequately characterize the behavior of the balance over the expected wind tunnel operating ranges (forces/moments, temperatures, and pressures). The experimental design was based on a Taylor-series expansion in the seven factors for the mathematical models. Model inversion was required to calculate the aerodynamic forces and moments as a function of the strain-gage readings. Details regarding transducer on-board compensation techniques, experimental design development, mathematical modeling, and wind tunnel data reduction are included in this paper.

Lynn, Keith C.↗

Quality Control and Calibration of the Dual-Polarization Radar at Kwajalein, RMI

Weather radars, recording information about precipitation around the globe, will soon be significantly upgraded. Most of today s weather radars transmit and receive microwave energy with horizontal orientation only, but upgraded systems have the capability to send and receive both horizontally and vertically oriented waves. These enhanced "dual-polarimetric" (DP) radars peer into precipitation and provide information on the size, shape, phase (liquid / frozen), and concentration of the falling particles (termed hydrometeors). This information is valuable for improved rain rate estimates, and for providing data on the release and absorption of heat in the atmosphere from condensation and evaporation (phase changes). The heating profiles in the atmosphere influence global circulation, and are a vital component in studies of Earth s changing climate. However, to provide the most accurate interpretation of radar data, the radar must be properly calibrated and data must be quality controlled (cleaned) to remove non-precipitation artifacts; both of which are challenging tasks for today s weather radar. The DP capability maximizes performance of these procedures using properties of the observed precipitation. In a notable paper published in 2005, scientists from the Cooperative Institute for Mesoscale Meteorological Studies (CIMMS) at the University of Oklahoma developed a method to calibrate radars using statistically averaged DP measurements within light rain. An additional publication by one of the same scientists at the National Severe Storms Laboratory (NSSL) in Norman, Oklahoma introduced several techniques to perform quality control of radar data using DP measurements. Following their lead, the Topical Rainfall Measuring Mission (TRMM) Satellite Validation Office at NASA s Goddard Space Flight Center has fine-tuned these methods for specific application to the weather radar at Kwajalein Island in the Republic of the Marshall Islands, approximately 2100 miles southwest of Hawaii and 1400 miles east of Guam in the tropical North Pacific Ocean. This tropical oceanic location is important because the majority of rain, and therefore the majority of atmospheric heating, occurs in the tropics where limited ground-based radar data are available.

Marks, David A.↗

L-/S-band calibration error analysis.

Results of a statistical error analysis performed to determine the degree of uncertainty encountered when calibrating steerable receiving antennas with the solar calibration method. The analysis considers the propagation of precision error indices. It is shown that a worst-case one-sigma (1 sigma) uncertainty of plus or minus 0.8 dB in system noise temperature occurs for a solar calibration at L-band. Somewhat better precision can be achieved by monitoring the antenna gain-to-noise temperature ratio at a station; a worst-case uncertainty of plus or minus 0.5 dB (1 sigma) can be realized. An error analysis is made of a method to determine absolute antenna gain based upon solar flux density. The uncertainty in this type of measurement is plus or minus 0.7 dB (1 sigma) at L- and S-band frequencies.

Taylor, R. E.↗

Vhf/uhf stellar calibration error analysis.

Results of a statistical error analysis performed to determine the degree of uncertainty encountered when calibrating steerable vhf/uhf receiving antennas with the stellar calibration method. The analysis considers the propagation of precision error indices. It is shown that an antenna gain calibration by the stellar method has a one-sigma (1 sigma) uncertainty of plus or minus 0.65 dB at 1440 MHz (L-band), and plus or minus 0.8 dB (1 sigma) at 136 MHz (vhf). Somewhat increased precision can be achieved by monitoring the antenna gain-to-noise temperature ratio at a station; a worst-case uncertainty of plus or minus 0.4 dB (1 sigma) can be realized at both L-band and vhf. Finally, field test measurements of antenna gain, obtained at 136 MHz in the NASA space tracking and data acquisition network, demonstrate an uncertainty of plus or minus 1.0 dB or less, which effectively confirms the analytical result.

Taylor, R. E.↗

Thermocouple Calibration and Accuracy in a Materials Testing Laboratory

A consolidation of information has been provided that can be used to define procedures for enhancing and maintaining accuracy in temperature measurements in materials testing laboratories. These studies were restricted to type R and K thermocouples (TCs) tested in air. Thermocouple accuracies, as influenced by calibration methods, thermocouple stability, and manufacturer's tolerances were all quantified in terms of statistical confidence intervals. By calibrating specific TCs the benefits in accuracy can be as great as 6 C or 5X better compared to relying on manufacturer's tolerances. The results emphasize strict reliance on the defined testing protocol and on the need to establish recalibration frequencies in order to maintain these levels of accuracy.

Lerch, B. A.↗