SEARCH · Engineering Papers

Results for “uncertainty calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Monitoring the Calibration of the DSCOVR EPIC Instrument’s Visible Cchannels Using MODIS and VIIRS as a Reference

The Earth Polychromatic Imaging Camera (EPIC) instrument aboard the Deep Space Climate Observatory (DSCOVR) satellite has a constant unique view of the sunlit disk of the Earth from the Lagrange-1 (L1) point nearly a million miles away from the Earth. Due to EPIC not having any on-board calibration systems, the ten spectral channels of EPIC must be inter-calibrated using vicarious on-orbit methods, such as ray-matching with well-calibrated low Earth orbiting satellites like the Aqua-MODIS and SNPP-VIIRS radiometers. The recently released EPIC version 3 L1B data has greatly enhanced the residual navigation errors found in prior versions, thereby decreasing the calibration uncertainty in the aforementioned ray-matching calibration techniques. The automated navigation correction used by these ray-matching methods for further improving the EPIC geolocation will be compared with a new navigation correction method utilizing optical flow between the EPIC and MODIS/VIIRS images. The DSCOVR satellite went into safe mode on June 27, 2019 due to an anomaly with the satellite’s attitude control system, but operations recommenced on March 2, 2020. The calibration of the EPIC instrument before it went into safe mode and after it resumed will be analyzed in order to investigate any potential calibration shifts or discontinuities caused by the spacecraft anomaly.

Conor Haney↗

DOE OSTI2021

A comparison of Gaussian processes and neural networks for computer model emulation and calibration

The Department of Energy relies on complex physics simulations for prediction in domains like cosmology, nuclear theory, and materials science. These simulations are often extremely computationally intensive, with some requiring days or weeks for a single simulation. In order to assure their accuracy, these models are calibrated against observational data in order to estimate inputs and systematic biases. Because of their great computational complexity, this process typically requires the construction of an emulator, a fast approximation to the simulation. In this paper, two emulator approaches are compared: Gaussian process regression and neural networks. Their emulation accuracy and calibration performance on three real problems of Department of Energy interest is considered. On these problems, the Gaussian process emulator tends to be more accurate with narrower, but still well-calibrated uncertainty estimates. The neural network emulator is accurate, but tends to have large uncertainty on its predictions. Finally, as a result, calibration with the Gaussian process emulator produces more constrained posteriors that still perform well in prediction.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1995

Calibration and postlaunch performance of the Meteor 3/TOMS instrument

Prelaunch and postlaunch calibration results for the Meteor 3/total ozone mapping spectrometer (TOMS) instrument are presented here. Ozone amounts are retrieved from measurements of Earth albedo in the 312- to 380-nm range. The accuracy of albedo measurements is primarily tied to knowledge of the reflective properties of diffusers used in the calibrations and to the instrument's wavelength selection. These and other important prelaunch calibrations are presented. Their estimated accuracies are within the bounds necessary to determine column ozone to better than 1%. However, postlaunch validation results indicate some prelaunch calibration uncertainties may be larger than originally estimated. Instrument calibrations have been maintained postlaunch to within a corresponding 1% error in retrieved ozone. Onboard calibrations, including wavelength monitoring and a three-diffuser solar measurement system, are described and specific results are presented. Other issues, such as the effects of orbital precession on calibration and recent chopper wheel malfunctions, are also discussed.

Jaross, G.↗

NASA NTRS2013

Uncertainty of Passive Imager Cloud Optical Property Retrievals to Instrument Radiometry and Model Assumptions: Examples from MODIS

The optical and microphysical structure of clouds is of fundamental importance for understanding a variety of cloud radiation and precipitation processes. With the advent of MODIS on the NASA EOS Terra and Aqua platforms, simultaneous global-daily 1 km retrievals of cloud optical thickness (COT) and effective particle radius (CER) are provided, as well as the derived water path (WP). The cloud product (MOD06/MYD06 for MODIS Terra and Aqua, respectively) provides separate retrieval datasets for various two-channel retrievals, typically a VISNIR channel paired with a 1.6, 2.1, and 3.7 m spectral channel. The MOD06 forward model is derived from on a homogeneous plane-parallel cloud. In Collection 5 processing (completed in 2007 with a modified Collection 5.1 completed in 2010), pixel-level retrieval uncertainties were calculated for the following non-3-D error sources: radiometry, surface spectral albedo, and atmospheric corrections associated with model analysis uncertainties (water vapor only). The latter error source includes error correlation across the retrieval spectral channels. Estimates of uncertainty in 1 aggregated (Level-3) means were also provided assuming unity correlation between error sources for all pixels in a grid for a single day, and zero correlation of error sources from one day to the next. I n Collection 6 (expected to begin in late summer 2013) we expanded the uncertainty analysis to include: (a) scene-dependent calibration uncertainty that depends on new band and detector-specific Level 1B uncertainties, (b) new model error sources derived from the look-up tables which includes sensitivities associated with wind direction over the ocean and uncertainties in liquid water and ice effective variance, (c) thermal emission uncertainties in the 3.7 m band associated with cloud and surface temperatures that are needed to extract reflected solar radiation from the total radiance signal, (d) uncertainty in the solar spectral irradiance at 3.7 m, and (e) addition of stratospheric ozone uncertainty in visible atmospheric corrections. A summary of the approach and example Collection 6 results will be shown.

Cloud Properties Observations↗

DOE OSTI2022

Cosmology with the Roman Space Telescope – Synergies with CMB lensing

ABSTRACT We explore synergies between the Nancy Grace Roman Space Telescope and CMB lensing data to constrain dark energy and modified gravity scenarios. A simulated likelihood analysis of the galaxy clustering and weak lensing data from the Roman Space Telescope High Latitude Survey combined with CMB lensing data from the Simons Observatory is undertaken, marginalizing over important astrophysical effects and calibration uncertainties. Included in the modelling are the effects of baryons on small-scale clustering, scale-dependent growth suppression by neutrinos, as well as uncertainties in the galaxy clustering biases, in the intrinsic alignment contributions to the lensing signal, in the redshift distributions, and in the galaxy shape calibration. The addition of CMB lensing roughly doubles the dark energy figure-of-merit from Roman photometric survey data alone, varying from a factor of 1.7 to 2.4 improvement depending on the particular Roman survey configuration. Alternatively, the inclusion of CMB lensing information can compensate for uncertainties in the Roman galaxy shape calibration if it falls below the design goals. Furthermore, we report the first forecast of Roman constraints on a model-independent structure growth, parametrized by σ8(z), and on the Hu-Sawicki f(R) gravity as well as an improved forecast of the phenomenological (Σ0, μ0) model. We find that CMB lensing plays a crucial role in constraining σ8(z) at z > 2, with percent-level constraints forecasted out to z = 4. CMB lensing information does not improve constraints on the f(R) model substantially. It does, however, increase the (Σ0, μ0) figure-of-merit by a factor of about 1.5.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2019

Calibration Plan for the Ocean Color Instrument (OCI) Engineering Test Unit

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission will launch no earlier than summer 2022. The primary payload is the Ocean Color Instrument (OCI). OCI is a hyperspectral imaging radiometer that will measure top-of-atmosphere radiances from 340nm to 2260nm at approximately 1km spatial resolution. The spectral resolution will be 5nm from 340nm to 890nm to enable the production of innovative ocean color products on a global scale (OCI will provide global coverage every 2 days). There are 7 different multispectral bands in the shortwave infrared to support atmospheric correction for ocean color and aerosol and cloud studies. Ocean color applications require state of the art radiometric accuracy (approximately 0.5%, excluding the absolute calibration uncertainty). Considerable effort has been invested in the planning of the prelaunch calibration campaign and the on-orbit calibration capabilities. This paper describes the current plans for the prelaunch calibration and characterization campaign of the OCI Engineering Test Unit (ETU), which is scheduled to begin towards the end of 2019, and expected to conclude April 2020. The prelaunch calibration campaign will characterize all sensor characteristics that are expected to influence radiometric sensitivity: absolute calibration (i.e. radiometric gains), signal to noise ratio, nonlinearity, response versus scan angle, dynamic range, straylight, crosstalk, and sensitivities to polarization and temperature. In addition to these characterization tests (which will only be performed once for the ETU), two types of tests have been developed that monitor the evolution of several OCI radiometric characteristics: a Limited Performance Test (LPT, expected duration about 8 hours), and a Comprehensive Performance Test (CPT, expected duration about 2 days).

Meister, Gerhard↗

NASA NTRS1991

Ground-reference site and on-board methods for sensor absolute calibration in the 0.4 to 2.5 micron range

The absolute radiometric calibration uncertainty requirement for several multispectral imaging sensors to be used in the Earth Observing System (EOS) program is +/- 2 percent (one sigma) with respect to the sun. Proposed in-flight absolute calibration methods are reviewed that have this uncertainty as their goal. In particular two methods are described as are recent improvements to them that concern reflectance- and radiance-based calibration using a carefully selected ground reference site. The magnitudes of the error sources are listed. A ratioing radiometer approach to monitoring the reflectance of a solar diffuser used for onboard calibration is discussed.

Slater, P. N.↗

NASA NTRS2012

Impacts of Cross-Platform Vicarious Calibration on the Deep Blue Aerosol Retrievals for Moderate Resolution Imaging Spectroradiometer Aboard Terra

The retrieval of aerosol properties from spaceborne sensors requires highly accurate and precise radiometric measurements, thus placing stringent requirements on sensor calibration and characterization. For the Terra/Moderate Resolution Imaging Spedroradiometer (MODIS), the characteristics of the detectors of certain bands, particularly band 8 [(B8); 412 nm], have changed significantly over time, leading to increased calibration uncertainty. In this paper, we explore a possibility of utilizing a cross-calibration method developed for characterizing the Terral MODIS detectors in the ocean bands by the National Aeronautics and Space Administration Ocean Biology Processing Group to improve aerosol retrieval over bright land surfaces. We found that the Terra/MODIS B8 reflectance corrected using the cross calibration method resulted in significant improvements for the retrieved aerosol optical thickness when compared with that from the Multi-angle Imaging Spectroradiometer, Aqua/MODIS, and the Aerosol Robotic Network. The method reported in this paper is implemented for the operational processing of the Terra/MODIS Deep Blue aerosol products.

Jeong, Myeong-Jae↗

DOE OSTI2022

Mapping variations of redshift distributions with probability integral transforms

We present a method for mapping variations between probability distribution functions and apply this method within the context of measuring galaxy redshift distributions from imaging survey data. This method, which we name PITPZ for the probability integral transformations it relies on, uses a difference in curves between distribution functions in an ensemble as a transformation to apply to another distribution function, thus transferring the variation in the ensemble to the latter distribution function. This procedure is broadly applicable to the problem of uncertainty propagation. In the context of redshift distributions, for example, the uncertainty contribution due to certain effects can be studied effectively only in simulations, thus necessitating a transfer of variation measured in simulations to the redshift distributions measured from data. We illustrate the use of PITPZ by using the method to propagate photometric calibration uncertainty to redshift distributions of the Dark Energy Survey Year 3 weak lensing source galaxies. For this test case, we find that PITPZ yields a lensing amplitude uncertainty estimate due to photometric calibration error within 1 per cent of the truth, compared to as much as a 30 per cent underestimate when using traditional methods.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Gap-filling eddy covariance methane fluxes: Comparison of machine learning model predictions and uncertainties at FLUXNET-CH4 wetlands

Time series of methane fluxes measured by eddy-covariance require gap-filling to estimate annual emissions. Gap-filling methane fluxes is challenging because of high variability and complex responses to multiple drivers. To date, there is no widely established gap-filling standard for methane, with regards both to the best model algorithms and predictors. In this study, we address the need for standardization by synthesizing results of gap-filling methods applied at 17 wetland sites spanning boreal to tropical regions including all major wetlands classes and two rice paddies. We introduce new procedures for: 1) creating realistic artificial gap scenarios, 2) training and evaluating gap-filling models without overstating performance, and 3) predicting half-hourly methane fluxes and annual emissions with robust uncertainty estimates. We tested a conventional method (marginal distribution sampling) and four machine learning algorithms - penalized linear regression, artificial neural networks, random forests, and boosted decision trees - and four predictor sets, including temporal, meteorological, ecosystem carbon and energy flux, and soil predictors. We find that the conventional method can achieve similar median performance to the machine learning models but is worse than the best machine learning models and relatively insensitive to predictor choices. Of the machine learning models, decision tree algorithms performed the best in cross-validation experiments, even with a baseline predictor set, and artificial neural networks showed comparable performance when using all predictors. Soil temperature was frequently the most important predictor whilst water table depth was important at sites with substantial water table fluctuations, highlighting the value of data on soil conditions. Raw gap-filling uncertainties from the machine learning models were underestimated and we propose a method to calibrate uncertainties to observations. Finally, we gap-fill and provide summary evaluation metrics for all 81 sites in the FLUXNET-CH4 community dataset and publicly release the python code for model development, evaluation, and uncertainty estimation.

42 ENGINEERING↗

DOE OSTI2026

Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials

Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Stellar Population Properties in the Stellar Streams around SPRC047

Abstract We have investigated the properties (e.g., age, metallicity) of the stellar populations of a ringlike tidal stellar stream (or streams) around the edge-on galaxy SPRC047 (z= 0.031) using spectral energy distribution (SED) fits to integrated broadband aperture flux densities. We used visual images in six different bands and Spitzer/IRAC 3.6μm data. We have attempted to derive best-fit stellar population parameters (metallicity, age) in three noncontiguous segments of the stream. Due to the very low surface brightness of the stream, we have performed a deconvolution with a Richardson–Lucy–type algorithm of the low spatial resolution 3.6μm IRAC image, thereby reducing the effect of the point-spread function aliasedemissionfrom the bright edge-on central galaxy at the locations of our three stream segments. Our SED fits that used several different star formation (SF) history priors, from an exponentially decaying SF burst to continuous SF, indicate that the age–metallicity–dust degeneracy is not resolved, most likely because of inadequate wavelength coverage and low signal-to-noise ratios of the low surface brightness features. We also discuss how future deep visual–near-infrared observations, combined with absolute flux calibration uncertainties at or below the 1% level, complemented by equally well absolute flux-calibrated observations in ultraviolet and mid-infrared bands, would improve the accuracy of broadband SED fitting results for low surface brightness targets, such as stellar streams around nearby galaxies that are not resolved into stars.

Astronomy & Astrophysics↗

NASA NTRS1992

Using calibrated SAR data

A number of approaches for calibrating SAR imaging data including data from multipolarization and multifrequency systems developed at the Jet Propulsion Laboratory are discussed. It is shown how calibrated SAR data can be used to improve the understanding of the physical properties of the earth's surface layer and how calibration uncertainties and system noise should be handled by the SAR data user. Examples of calibrated SAR data from the NASA/JPL DC-8 SAR are used to demonstrate use of calibrated data to monitor temporal change and to improve the classification of land cover type.

Freeman, Anthony↗

NASA NTRS1999

Uncertainty Analysis of Instrument Calibration and Application

Experimental aerodynamic researchers require estimated precision and bias uncertainties of measured physical quantities, typically at 95 percent confidence levels. Uncertainties of final computed aerodynamic parameters are obtained by propagation of individual measurement uncertainties through the defining functional expressions. In this paper, rigorous mathematical techniques are extended to determine precision and bias uncertainties of any instrument-sensor system. Through this analysis, instrument uncertainties determined through calibration are now expressed as functions of the corresponding measurement for linear and nonlinear univariate and multivariate processes. Treatment of correlated measurement precision error is developed. During laboratory calibration, calibration standard uncertainties are assumed to be an order of magnitude less than those of the instrument being calibrated. Often calibration standards do not satisfy this assumption. This paper applies rigorous statistical methods for inclusion of calibration standard uncertainty and covariance due to the order of their application. The effects of mathematical modeling error on calibration bias uncertainty are quantified. The effects of experimental design on uncertainty are analyzed. The importance of replication is emphasized, techniques for estimation of both bias and precision uncertainties using replication are developed. Statistical tests for stationarity of calibration parameters over time are obtained.

Tripp, John S.↗

DOE OSTI2025

Uncertainty based Online Ensemble on Non-Stationary Data for Fusion Science

Machine Learning (ML) is poised to play a pivotal role in the development and operation of next-generation fusion devices. Fusion data shows non-stationary behavior due to drifts in the data. The drifts can arise from both experimental evolution and machine wear-and-tear. ML models assume stationary distribution and fail to maintain performance when encountered with non-stationary data streams.Online learning can be used to continuously adapt the models with new data as it is acquired. However, traditional online learning can suffer from short-term performance degradation, as ground truth are not available before making the prediction. To address this challenge, we propose uncertainty aware ensemble approach for online learning. We use Deep Gaussian Process Approximation (DGPA) technique for calibrated uncertainty estimation and use the uncertainty values to guide a meta-algorithm that produces predictions based on ensemble of learners. Moreover, DGPA also provides uncertainty estimation along with the predictions for decision makers. This paper demonstrates that the proposed method outperforms traditional online learning approach, and a naive ensemble without uncertainty guidance by about 7% and 6%, respectively, on B-coil deflection prediction at DIII-D Fusion Facility.

Rajput, Kishansingh [Thomas Jefferson National Acc↗

NASA NTRS2016

Assessment of MODIS On-Orbit Calibration Using a Deep Convective Cloud Technique

The MODerate Resolution Imaging Spectroradiometer (MODIS) sensors onboard Terra and Aqua satellites are calibrated on-orbit with a solar diffuser (SD) for the reflective solar bands (RSB). The MODIS sensors are operating beyond their designed lifetime and hence present a major challenge to maintain the calibration accuracy. The degradation of the onboard SD is tracked by a solar diffuser stability monitor (SDSM) over a wavelength range from 0.41 to 0.94 micrometers. Therefore, any degradation of the SD beyond 0.94 micrometers cannot be captured by the SDSM. The uncharacterized degradation at wavelengths beyond this limit could adversely affect the Level 1B (L1B) product. To reduce the calibration uncertainties caused by the SD degradation, invariant Earth-scene targets are used to monitor and calibrate the MODIS L1B product. The use of deep convective clouds (DCCs) is one such method and particularly significant for the short-wave infrared (SWIR) bands in assessing their long-term calibration stability. In this study, we use the DCC technique to assess the performance of the Terra and Aqua MODIS Collection-6 L1B for RSB 1 3- 7, and 26, with spectral coverage from 0.47 to 2.13 micrometers. Results show relatively stable trends in Terra and Aqua MODIS reflectance for most bands. Careful attention needs to be paid to Aqua band 1, Terra bands 3 and 26 as their trends are larger than 1% during the study time period. We check the feasibility of using the DCC technique to assess the stability in MODIS bands 17-19. The assessment test on response versus scan angle (RVS) calibration shows substantial trend difference for Aqua band 1between different angles of incidence (AOIs). The DCC technique can be used to improve the RVS calibration in the future.

Mu, Qiaozhen↗

DOE OSTI2025

Uncertainty based Online Ensemble on Non-Stationary Data for Fusion Science

Rajput, Kishansingh [Thomas Jefferson National Acc↗

NASA NTRS2015

Estimating Uncertainties in the Multi-Instrument SBUV Profile Ozone Merged Data Set

The MOD data set is uniquely qualified for use in long-term ozone analysis because of its long record, high spatial coverage, and consistent instrument design and algorithm. The estimated MOD uncertainty term significantly increases the uncertainty over the statistical error alone. Trends in the post-2000 period are generally positive in the upper stratosphere, but only significant at 1-1.6 hPa. Remaining uncertainties not yet included in the Monte Carlo model are Smoothing Error ( 1 from 10 to 1 hPa) Relative calibration uncertainty between N11 and N17Seasonal cycle differences between SBUV records.

Uncertainties↗