Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Precision X-band radio Doppler and ranging navigation: Mars Observer interplanetary cruise scenario

This article describes an error covariance analysis based on a Mars Observer mission scenario; the study was performed to establish the navigation performance that can potentially be achieved in a demonstration of precision two-way X-band (8.4-GHz) Doppler and ranging with the Mars Observer spacecraft planned for next year, and to evaluate the sensitivity of the predicted performance to variations in ground system error modeling assumptions. Orbit determination error statistics computed for a 182-day Doppler and ranging data arc predicted Mars approach orbit determination accuracies of about 0.45 micro-rad in an angular sense, using a conservative ground system error model as a baseline. When less-conservative error model assumptions were employed, it was found that orbit determination accuracies of 0.19 to 0.30 micro-rad could be obtained; the level of accuracy of the assumed Mars ephemeris is about 0.11 micro-rad. In comparison, Doppler-only performance with the baseline error model was predicted to be about 1.30 to 1.51 micro-rad, although it was found that when improved station location accuracies and Global Positioning System-based tropospheric calibration accuracies were assumed, accuracies of 0.44 to 0.52 micro-rad were predicted. In the Doppler plus ranging cases, the results were relatively insensitive to variations in ranging system and station delay calibration uncertainties of a few meters and tropospheric zenith delay calibration uncertainties of a few centimeters.

Estefan, J. A.↗

Application of Machine Learning Techniques in Calibration and Data Reduction of Multi-Hole Probes

This work presents procedures for implementing machine learning methods into existing algorithms for multi-hole probe calibration and data reduction. It demonstrates that using artificial neural networks (ANNs) can decrease the amount of calibration data needed to achieve a specific calibration uncertainty by over 50%, while also significantly reducing data reduction times. Instead of surface fitting methods, ANNs are employed. Initially, directional calibration coefficients related to flow angles are computed based on pressure measurements, and then these flow angles serve as input parameters for subsequent ANNs to iteratively define Mach number, static pressure, and total pressure. In an alternative approach, new calibration coefficients directly relate pressure measurements from the five-hole probe to the quantities of interest, thereby eliminating the need for iterative algorithms used in conventional surface fitting methods. This method offers several advantages: an average increase of less than 1%in calibration uncertainty for flow angles and a significant reduction in data reduction times to a few seconds on average. Additionally, the methodology is confirmed to avoid both over- and under-fitting.

Machine Learning↗

HST Multicolor (255-1042 nm) Photometry of Saturn's Main Rings: Radial Profiles, Phase and Opening Angle Variations, and Regional Spectra - 1

The main rings of Saturn were observed with the Planetary Camera of the WFPC2 instrument on the Hubble Space Telescope (HST) from September 1996 to August 2000 as the'ring opening angle to Earth and Sun increased from 4 deg to 24 deg, with a spread of phase angles between 0.3 deg and 6 deg at each opening angle. The rings were routinely observed in the five HST wideband UBVRI filters (F336W, F439W, F555W, F675W, and F814W) and occasionally in the F255W, F785LP, and F1042M filters. The emphasis in this series of papers will be on radial color (implying compositional) variations. In this first paper we describe the analysis technique and calibration procedure, note revisions in a previously published Voyager ring color data analysis, and present new results based on over 100 HST images. In the 300-600 nm spectral range where the rings are red, the 555nm/336nm ratio increases by about 14% as the phase angle increases from 0.3 deg to 6 deg. This effect, never reported previously for the rings, is significantly larger than the phase reddening which characterizes other icy objects, primarily because of the redness of the rings. However, there is no discernible tendency for color to vary with ring opening angle at a given phase angle, and there is no phase variation of color where the spectrum is flat. We infer from this combination of facts that multiple intraparticle scattering, either in a regolith or between facets of an unusually rough surface, is important in these geometries, but that multiple interparticle scattering in a vertically extended layer is not. Voyager color ratios at a phase angle of 14 deg are compatible with this trend, but calibration uncertainties prevent their use in quantitative modeling. Overall ring-average spectra are compatible with those of earlier work within calibration uncertainties, but ring spectra vary noticeably with region. We refine and subdivide the regions previously defined by others. The variation seen between radial profiles of ratios between different wavelength suggests the presence of multiple compositional components with different radial distributions. We present new radial profiles of far UV color ratio (F336W/F255W) showing, substantial global variations having a different radial structure than seen between 555 and 336nm. We also find evidence for absorption in the 850nm spectral range (a feature previously only weakly indicated in ring-averaged spectra) primarily through its radial variation; it is located primarily in the C ring, where the particles are known to have lower albedo, and is consistent with "interplanetary pollution" of the rings.

Cuzzi, Jeffrey N.↗

Application of Machine Learning Techniques in Calibration and Data Reduction of Multi-Hole Probes

This work presents procedures to implement machine learning methods in the existing algorithms for multi-hole probe calibrations and data reduction. It is shown here, that utilizing artificial neural networks (ANNs) can reduce the amount of calibration data that needs to be acquired in order to obtain a specific calibration uncertainty, by more than 50% while simultaneously reducing data reduction times significantly. ANNs were used instead of the surface fitting methods, where first, the directional calibration coefficients related to the flow angles are calculated based on the pressure measurements, and then the flow angles are used as a set of the input parameters for the following ANNs to define Mach number and static and total pressure iteratively. In a second approach, novel calibration coefficients were used to directly relate the pressure measurements from five-hole probe to the quantities of interest thus, eliminating the need for iterative algorithms used in the conventional surface fitting methods. The advantageous features of this method are an average increase of less than 1% in the calibration uncertainty for flow angles and significant reduction of the data reduction times (few seconds). In addition, we confirmed the methodology to avoid over-fitting and under-fitting.

Machine Learning↗

Sensitivity of satellite-derived net shortwave irradiance at the Earth's surface to radiometric calibration

The effect of radiometric calibration uncertainties on satellite-derived net shortwave irradiance at the Earth's surface was examined. Net shortwave irradiance sensitivity to calibration is expressed as a function of two basic components that depend on surface and cloud albedo sensitivities, respectively. The analysis of these sensitivities for a wide range of atmospheric and surface conditions, as well as radiation geometries, shows that a 10 percent uncertainty in the calibration induces up to 40 W/sqm errors in instantaneous net shortwave irradiance (negative when the calibration uncertainty is positive). The maximum relative errors are obtained in overcast conditions when cloud albedos are high. On a monthly time scale, the induced error becomes typically 13 W/sqm in the tropics and 16 W/sqm in higher latitude regions during summer. The error almost vanishes at high latitudes during winter. A 10 percent positive uncertainty in the calibration gives a net shortwave irradiance error similar to that induced by the 3 hr sampling of the ISCCP Project.

Gautier, C.↗

The OLI Radiometric Scale Realization Round Robin Measurement Campaign

A round robin radiometric scale realization was performed at the Ball Aerospace Radiometric Calibration Laboratory in January/February 2011 in support of the Operational Land Imager (OLI) Program. Participants included Ball Aerospace, NIST, NASA Goddard Space Flight Center, and the University of Arizona. The eight day campaign included multiple observations of three integrating sphere sources by nine radiometers. The objective of the campaign was to validate the radiance calibration uncertainty ascribed to the integrating sphere used to calibrate the OLI instrument. The instrument level calibration source uncertainty was validated by quatnifying: (1) the long term stability of the NIST calibrated radiance artifact, (2) the responsivity scale of the Ball Aerospace transfer radiometer and (3) the operational characteristics of the large integrating sphere.

Cutlip, Hansford↗

Effect of Correlated Precision Errors on Uncertainty of a Subsonic Venturi Calibration

An uncertainty analysis performed in conjunction with the calibration of a subsonic venturi for use in a turbine test facility produced some unanticipated results that may have a significant impact in a variety of test situations. Precision uncertainty estimates using the preferred propagation techniques in the applicable American National Standards Institute/American Society of Mechanical Engineers standards were an order of magnitude larger than precision uncertainty estimates calculated directly from a sample of results (discharge coefficient) obtained at the same experimental set point. The differences were attributable to the effect of correlated precision errors, which previously have been considered negligible. An analysis explaining this phenomenon is presented. The article is not meant to document the venturi calibration, but rather to give a real example of results where correlated precision terms are important. The significance of the correlated precision terms could apply to many test situations.

Hudson, S. T.↗

Ultraviolet albedo of Comet West /1976 VI/

The nature of the dust scattered radiation shown in the ultraviolet spectrum of Comet West is analyzed. The continuum of solar radiation scattered by cometary dust is detected to wavelengths as short as 2100 A and is found to follow closely the solar spectrum. The flux from the entire visible coma is included in the spectrometer slit. A comparison of the ultraviolet with the visible solar flux gives the ratio of the albedo at 2700 A to that of 5500 A as about 0.3. Even with all the uncertainties included (the absolute calibration uncertainty is plus or minus 15%), the evidence for strong reddening between the visible and the ultraviolet is clear. A further decrease in albedo is found near 2200 A. The value of the visible albedo of 0.2 is used to derive a value of 0.6 for the cometary albedo at 2700 A. This value is similar to that found for the moon and lunar dust in this spectral region.

Feldman, P. D.↗

A Consistent AVHRR Visible Calibration Record Based on Multiple Methods Applicable for the NOAA Degrading Orbits: Validation - Part 2

Consistent cross-sensor Advanced Very High Resolution Radiometer (AVHRR) calibration coefficients are determined using desert, polar ice, and deep convective cloud (DCC) invariant Earth targets. The greatest AVHRR calibration challenge is the slow orbit degradation of the host satellite, which precesses toward a terminator orbit. This issue is solved by characterizing the invariant targets with NOAA-16 AVHRR observed radiances that have been referenced to the Aqua Moderate Resolution Imaging Spectrometer (MODIS) calibration using simultaneous nadir overpass (SNO) observations. Another benefit of the NOAA-16 invariant target-modeled reflectance method is that, because of the similarities among the AVHRR spectral response functions, a smaller spectral band adjustment factor is required than when establishing calibrations relative to a non-AVHRR reference instrument. The sensor- and band-specific calibration uncertainties, with respect to the calibration reference, are, on average, 2 percent and 3 percent for channels 1 and 2, respectively. The uncertainties are smaller for sensors that are in afternoon orbits, have longer records, and spend less time in terminator conditions. The multiple invariant targets referenced to Aqua MODIS (MITRAM) AVHRR calibration coefficients are evaluated for individual target consistency, compared against Aqua MODIS/AVHRR SNOs, and selected published calibration gains. The MITRAM and SNO relative calibration biases mostly agree to within 1 percent for channels 1 and 2, respectively. The individual invariant target and MITRAM sensor relative calibration biases are mostly consistent to within 1 percent and 2 percent for channels 1 and 2, respectively. The differences between the MITRAM and other published calibrations are mostly attributed to the reference instrument calibration differences.

Doelling, David R.↗

Evaluating Statistical Process Control (SPC) techniques and computing the uncertainty of force calibrations

In recent years there has been a push within NASA to use statistical techniques to improve the quality of production. Two areas where statistics are used are in establishing product and process quality control of flight hardware and in evaluating the uncertainty of calibration of instruments. The Flight Systems Quality Engineering branch is responsible for developing and assuring the quality of all flight hardware; the statistical process control methods employed are reviewed and evaluated. The Measurement Standards and Calibration Laboratory performs the calibration of all instruments used on-site at JSC as well as those used by all off-site contractors. These calibrations must be performed in such a way as to be traceable to national standards maintained by the National Institute of Standards and Technology, and they must meet a four-to-one ratio of the instrument specifications to calibrating standard uncertainty. In some instances this ratio is not met, and in these cases it is desirable to compute the exact uncertainty of the calibration and determine ways of reducing it. A particular example where this problem is encountered is with a machine which does automatic calibrations of force. The process of force calibration using the United Force Machine is described in detail. The sources of error are identified and quantified when possible. Suggestions for improvement are made.

Navard, Sharon E.↗

Monitoring the Calibration of the DSCOVR EPIC Instrument’s Visible Cchannels Using MODIS and VIIRS as a Reference

The Earth Polychromatic Imaging Camera (EPIC) instrument aboard the Deep Space Climate Observatory (DSCOVR) satellite has a constant unique view of the sunlit disk of the Earth from the Lagrange-1 (L1) point nearly a million miles away from the Earth. Due to EPIC not having any on-board calibration systems, the ten spectral channels of EPIC must be inter-calibrated using vicarious on-orbit methods, such as ray-matching with well-calibrated low Earth orbiting satellites like the Aqua-MODIS and SNPP-VIIRS radiometers. The recently released EPIC version 3 L1B data has greatly enhanced the residual navigation errors found in prior versions, thereby decreasing the calibration uncertainty in the aforementioned ray-matching calibration techniques. The automated navigation correction used by these ray-matching methods for further improving the EPIC geolocation will be compared with a new navigation correction method utilizing optical flow between the EPIC and MODIS/VIIRS images. The DSCOVR satellite went into safe mode on June 27, 2019 due to an anomaly with the satellite’s attitude control system, but operations recommenced on March 2, 2020. The calibration of the EPIC instrument before it went into safe mode and after it resumed will be analyzed in order to investigate any potential calibration shifts or discontinuities caused by the spacecraft anomaly.

Conor Haney↗

Calibration and postlaunch performance of the Meteor 3/TOMS instrument

Prelaunch and postlaunch calibration results for the Meteor 3/total ozone mapping spectrometer (TOMS) instrument are presented here. Ozone amounts are retrieved from measurements of Earth albedo in the 312- to 380-nm range. The accuracy of albedo measurements is primarily tied to knowledge of the reflective properties of diffusers used in the calibrations and to the instrument's wavelength selection. These and other important prelaunch calibrations are presented. Their estimated accuracies are within the bounds necessary to determine column ozone to better than 1%. However, postlaunch validation results indicate some prelaunch calibration uncertainties may be larger than originally estimated. Instrument calibrations have been maintained postlaunch to within a corresponding 1% error in retrieved ozone. Onboard calibrations, including wavelength monitoring and a three-diffuser solar measurement system, are described and specific results are presented. Other issues, such as the effects of orbital precession on calibration and recent chopper wheel malfunctions, are also discussed.

Jaross, G.↗

Uncertainty of Passive Imager Cloud Optical Property Retrievals to Instrument Radiometry and Model Assumptions: Examples from MODIS

The optical and microphysical structure of clouds is of fundamental importance for understanding a variety of cloud radiation and precipitation processes. With the advent of MODIS on the NASA EOS Terra and Aqua platforms, simultaneous global-daily 1 km retrievals of cloud optical thickness (COT) and effective particle radius (CER) are provided, as well as the derived water path (WP). The cloud product (MOD06/MYD06 for MODIS Terra and Aqua, respectively) provides separate retrieval datasets for various two-channel retrievals, typically a VISNIR channel paired with a 1.6, 2.1, and 3.7 m spectral channel. The MOD06 forward model is derived from on a homogeneous plane-parallel cloud. In Collection 5 processing (completed in 2007 with a modified Collection 5.1 completed in 2010), pixel-level retrieval uncertainties were calculated for the following non-3-D error sources: radiometry, surface spectral albedo, and atmospheric corrections associated with model analysis uncertainties (water vapor only). The latter error source includes error correlation across the retrieval spectral channels. Estimates of uncertainty in 1 aggregated (Level-3) means were also provided assuming unity correlation between error sources for all pixels in a grid for a single day, and zero correlation of error sources from one day to the next. I n Collection 6 (expected to begin in late summer 2013) we expanded the uncertainty analysis to include: (a) scene-dependent calibration uncertainty that depends on new band and detector-specific Level 1B uncertainties, (b) new model error sources derived from the look-up tables which includes sensitivities associated with wind direction over the ocean and uncertainties in liquid water and ice effective variance, (c) thermal emission uncertainties in the 3.7 m band associated with cloud and surface temperatures that are needed to extract reflected solar radiation from the total radiance signal, (d) uncertainty in the solar spectral irradiance at 3.7 m, and (e) addition of stratospheric ozone uncertainty in visible atmospheric corrections. A summary of the approach and example Collection 6 results will be shown.

Cloud Properties Observations↗

Calibration Plan for the Ocean Color Instrument (OCI) Engineering Test Unit

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission will launch no earlier than summer 2022. The primary payload is the Ocean Color Instrument (OCI). OCI is a hyperspectral imaging radiometer that will measure top-of-atmosphere radiances from 340nm to 2260nm at approximately 1km spatial resolution. The spectral resolution will be 5nm from 340nm to 890nm to enable the production of innovative ocean color products on a global scale (OCI will provide global coverage every 2 days). There are 7 different multispectral bands in the shortwave infrared to support atmospheric correction for ocean color and aerosol and cloud studies. Ocean color applications require state of the art radiometric accuracy (approximately 0.5%, excluding the absolute calibration uncertainty). Considerable effort has been invested in the planning of the prelaunch calibration campaign and the on-orbit calibration capabilities. This paper describes the current plans for the prelaunch calibration and characterization campaign of the OCI Engineering Test Unit (ETU), which is scheduled to begin towards the end of 2019, and expected to conclude April 2020. The prelaunch calibration campaign will characterize all sensor characteristics that are expected to influence radiometric sensitivity: absolute calibration (i.e. radiometric gains), signal to noise ratio, nonlinearity, response versus scan angle, dynamic range, straylight, crosstalk, and sensitivities to polarization and temperature. In addition to these characterization tests (which will only be performed once for the ETU), two types of tests have been developed that monitor the evolution of several OCI radiometric characteristics: a Limited Performance Test (LPT, expected duration about 8 hours), and a Comprehensive Performance Test (CPT, expected duration about 2 days).

Meister, Gerhard↗

Ground-reference site and on-board methods for sensor absolute calibration in the 0.4 to 2.5 micron range

The absolute radiometric calibration uncertainty requirement for several multispectral imaging sensors to be used in the Earth Observing System (EOS) program is +/- 2 percent (one sigma) with respect to the sun. Proposed in-flight absolute calibration methods are reviewed that have this uncertainty as their goal. In particular two methods are described as are recent improvements to them that concern reflectance- and radiance-based calibration using a carefully selected ground reference site. The magnitudes of the error sources are listed. A ratioing radiometer approach to monitoring the reflectance of a solar diffuser used for onboard calibration is discussed.

Slater, P. N.↗

Impacts of Cross-Platform Vicarious Calibration on the Deep Blue Aerosol Retrievals for Moderate Resolution Imaging Spectroradiometer Aboard Terra

The retrieval of aerosol properties from spaceborne sensors requires highly accurate and precise radiometric measurements, thus placing stringent requirements on sensor calibration and characterization. For the Terra/Moderate Resolution Imaging Spedroradiometer (MODIS), the characteristics of the detectors of certain bands, particularly band 8 [(B8); 412 nm], have changed significantly over time, leading to increased calibration uncertainty. In this paper, we explore a possibility of utilizing a cross-calibration method developed for characterizing the Terral MODIS detectors in the ocean bands by the National Aeronautics and Space Administration Ocean Biology Processing Group to improve aerosol retrieval over bright land surfaces. We found that the Terra/MODIS B8 reflectance corrected using the cross calibration method resulted in significant improvements for the retrieved aerosol optical thickness when compared with that from the Multi-angle Imaging Spectroradiometer, Aqua/MODIS, and the Aerosol Robotic Network. The method reported in this paper is implemented for the operational processing of the Terra/MODIS Deep Blue aerosol products.

Jeong, Myeong-Jae↗

Using calibrated SAR data

A number of approaches for calibrating SAR imaging data including data from multipolarization and multifrequency systems developed at the Jet Propulsion Laboratory are discussed. It is shown how calibrated SAR data can be used to improve the understanding of the physical properties of the earth's surface layer and how calibration uncertainties and system noise should be handled by the SAR data user. Examples of calibrated SAR data from the NASA/JPL DC-8 SAR are used to demonstrate use of calibrated data to monitor temporal change and to improve the classification of land cover type.

Freeman, Anthony↗

Uncertainty Analysis of Instrument Calibration and Application

Experimental aerodynamic researchers require estimated precision and bias uncertainties of measured physical quantities, typically at 95 percent confidence levels. Uncertainties of final computed aerodynamic parameters are obtained by propagation of individual measurement uncertainties through the defining functional expressions. In this paper, rigorous mathematical techniques are extended to determine precision and bias uncertainties of any instrument-sensor system. Through this analysis, instrument uncertainties determined through calibration are now expressed as functions of the corresponding measurement for linear and nonlinear univariate and multivariate processes. Treatment of correlated measurement precision error is developed. During laboratory calibration, calibration standard uncertainties are assumed to be an order of magnitude less than those of the instrument being calibrated. Often calibration standards do not satisfy this assumption. This paper applies rigorous statistical methods for inclusion of calibration standard uncertainty and covariance due to the order of their application. The effects of mathematical modeling error on calibration bias uncertainty are quantified. The effects of experimental design on uncertainty are analyzed. The importance of replication is emphasized, techniques for estimation of both bias and precision uncertainties using replication are developed. Statistical tests for stationarity of calibration parameters over time are obtained.

Tripp, John S.↗