Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

SeaWiFS Postlaunch Technical Report Series: The SeaBOARR-98 Field Campaign - Volume 3

This report documents the scientific activities during the first Sea-viewing Wide Field-of-view Sensor (SeaWiFS) Bio-Optical Algorithm Round-Robin (SeaBOARR-98) experiment, which took place from 5-17 July 1998, at the Acqua Alta Oceanographic Tower (AAOT) in the northern Adriatic Sea off the coast of Italy. The ultimate objective of the SeaBOARR activity is to evaluate the effect of different measurement protocols on bio-optical algorithms using data from a variety of field campaigns. The SeaBOARR-98 field campaign was concerned with collecting a high quality data set of simultaneous in-water and above-water radiometric measurements. The deployment goals documented in this report were to: a) use four different surface glint correction methods to compute water-leaving radiances, L W (lambda), from above-water data; b) use two different in-water profiling systems and three different methods to compute L W (lambda) from in-water data (one making measurements at a fixed distance from the tower, 7.5 m, and the other at variable distances up to 29 m away); c) use instruments with a common calibration history to minimize intercalibration uncertainties; d) monitor the calibration drift of the instruments in the field with a second generation SeaWiFS Quality Monitor (SQM-II), to separate differences in methods from changes in instrument performance; and e) compare the L W (lambda) values estimated from the above-water and in-water measurements. In addition to describing the instruments deployed and the data collected, a preliminary analysis of the data is presented, and the kind of follow-on work that is needed to completely assess the estimation of L W (lambda) from above-water and in-water measurements is discussed.

Zibordi, Giuseppe↗
NASA NTRS2000

Sea WiFS Postlaunch Technical Report Series: The SeaBOARR-99 Field Campaign - Volume 8

This report documents the scientific activities during the second Sea-viewing Wide Field-of-view Sensor (Sea- WIFS) Bio-Optical Algorithm Round-Robin (SeaBOARR-99) field campaign, which took place from 2 May to 7 June 1999 on board the Royal Research Ship James Clark Ross during the eighth Atlantic Meridional Transect cruise (AMT-8). The ultimate objective of the SeaBOARR activity is to evaluate the effect of different measurement protocols on bio-optical algorithms using data from a variety of field campaigns. The SeaBOARR-99 field campaign was concerned with collecting a high quality data set of simultaneous in-water and above-water radiometric measurements. The deployment goals documented in this report were to: a) use four different surface glint correction methods to compute water-leaving radiances, Lw(lambda), from above-water data; b) use two different in-water profiling systems and three different methods to compute Lw(lambda) from in-water data; c) use instruments with a common calibration history to minimize intercalibration uncertainties; d) monitor the calibration stability of the instruments in the field with the original SeaWiFS Quality Monitor (SQM) and a commercial, second-generation device called the SQM-II, thereby allowing a distinction between differences in methods from changes in instrument performance; and e) compare the Lw(lambda) values estimated from the above- water and in- water measurements. In addition to describing the instruments deployed and the data collected, a preliminary analysis of part of the SeaBOARR-99 data set is presented (using only the data collected during clear sky, calm sea, and Case-I waters).

Hooker, Stanford B.↗
NASA NTRS2011

Using Reliability to Meet Z540.3's 2 percent Rule

NASA's Kennedy Space Center (KSC) undertook implementation of ANSI/NCSL Z540.3-2006 in October 2008. Early in the implementation, KSC identified that the largest cost driver of Z540.3 implementation is measurement uncertainty analyses for legacy calibration processes. NASA, like other organizations, has a significant inventory of measuring and test equipment (MTE) that have documented calibration procedures without documented measurement uncertainties. This paper provides background information to support the rationale for using high in-tolerance reliability as evidence of compliance to the 2% probability of false acceptance (PFA) quality metric of ANSI/NCSL Z540.3-2006 allowing use of qualifying legacy processes. NASA is adopting this as policy and is recommending NCSL International consider this as a method of compliance to Z540.3. Topics covered include compliance issues, using end-of-period reliability (EOPR) to estimate test point uncertainty, reliability data influences within the PFA model, the validity of EOPR data, and an appendix covering "observed" versus "true" EOPR.

Mimbs, Scott M.↗
NASA NTRSDate not supplied

Uncertainty Quantification and Sensitivity Analysis in Process-Structure-Property Simulations for Laser Powder Bed Fusion Additive Manufacturing

Process variations and process-induced defects like porosity cause significant uncertainty in the microstructure and mechanical behavior of additively manufactured metals. Establishing process-structure-property (PSP) relationships and quantifying uncertainty using experiments alone is costly, especially for structural applications where mechanical allowables must be established for qualification and certification. This work presents a PSP simulation framework for laser powder bed fusion with a focus on uncertainty quantification through probabilistic calibration and multi-fidelity uncertainty propagation. Motivated by phenomenological input parameters related to grain nucleation and growth that are difficult to characterize, a global sensitivity analysis (GSA) is completed. Through GSA, the most important input parameters are identified based on their influence on the statistical distributions of microstructural metrics that influence mechanical behavior, including grain size, morphology, and crystallographic texture. The results provide insight on what experiments are necessary to quantify and control PSP uncertainties, particularly those associated with the more challenging input parameters.

additive manufacturing↗
NASA NTRS1971

Vhf/uhf stellar calibration error analysis.

Results of a statistical error analysis performed to determine the degree of uncertainty encountered when calibrating steerable vhf/uhf receiving antennas with the stellar calibration method. The analysis considers the propagation of precision error indices. It is shown that an antenna gain calibration by the stellar method has a one-sigma (1 sigma) uncertainty of plus or minus 0.65 dB at 1440 MHz (L-band), and plus or minus 0.8 dB (1 sigma) at 136 MHz (vhf). Somewhat increased precision can be achieved by monitoring the antenna gain-to-noise temperature ratio at a station; a worst-case uncertainty of plus or minus 0.4 dB (1 sigma) can be realized at both L-band and vhf. Finally, field test measurements of antenna gain, obtained at 136 MHz in the NASA space tracking and data acquisition network, demonstrate an uncertainty of plus or minus 1.0 dB or less, which effectively confirms the analytical result.

Taylor, R. E.↗
NASA NTRS2024

Mock Truss-Braced Wing Loads Calibration Research Utilizing Fiber-Optic Sensors

In support of the National Aeronautics and Space Administration Advanced Air Transonic Transport Truss-Braced Wing structural research, the Armstrong Flight Research Center Flight Loads Laboratory is performing pathfinder tests on a small, scaled test article (dubbed the mock Truss-Braced Wing) to study the application of a loads calibration on a truss-braced wing structure. The addition of a truss to the wing structure, as opposed to a purely cantilever beam setup, changes the strain-gage-based loads calibration techniques. In a truss-braced configuration, the internal shear and moments, inboard of the truss-wing connection, are not directly representative of the external aerodynamic loading as is the case for a traditional cantilever configuration. A 3-axis load cell was used at the wing-to-strut interface to estimate the load sharing between the two structural members. Crosstalk within the 3-axis load cell is added to the measurement uncertainties of the calibration effort, and the results, including crosstalk uncertainties, are presented. The calibration tests presented in this report are used as a pathfinder for developing an understanding how to perform loads calibration on a truss-braced wing structural configuration. The use of distributed fiber-optic strain sensors is leveraged to provide a near-full-span strain profile along the leading and trailing edge of the wing structure for strain-based loads calibration.

Francisco Peña↗
DOE OSTI2022

Training calibration-based counterfactual explainers for deep learning models in medical image analysis

The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
NASA NTRS2021

Sensor Calibration Impacts on Dust Detection Based On MODIS And VIIRS Thermal Emissive Bands

Dust detection using remotely sensed measurements has been one of the challenging problems encountered by atmospheric scientists. MODerate Resolution Imaging Spectroradiometer (MODIS) on the Terra (T)and Aqua (A) platforms have been a versatile sensor for well over 21 and 18 years respectively and have been extremely useful in the retrieval of aerosol information over the entire globe. The MODIS radiances from the Level1B in general are expected to be within 5% accuracy in the reflective wavelengths and within 1% in the thermal emissive wavelengths. In this paper, we evaluate the sensitivity of previously developed dust detection technique based on thermal emissive wavelengths, which correspond to MODIS bands 20, 29, 31, and 32 respectively. The Thermal Emissive Dust Index (TEDI) performed very comparably to the traditional Aerosol Optical Thickness (AOT) retrievals by MODIS reflective channels. Since the MODIS Thermal Emissive Bands (TEB) are well calibrated on-orbit using a BlackBody (BB) source, the calibration of these long wave infrared bands is quite robust. As A-MODIS continues to perform well beyond its designed lifetime of 6 years, the instrument has undergone various levels of degradation during its mission time. As a consequence, it is imperative to check the impacts of calibration on the higher-level retrievals. In this paper, we rigorously analyze the sensitivity of TEDI due to the impact of calibration by the afore-mentioned TEB. The perturbation of the dominant (linear) calibration term demonstrated the following: first, there was a correlation in the sensitivity of the TEDI due to the uncertainty in the linear calibration term. Based on a perturbation in the linear calibration term for all aforementioned bands over a range of ± 5 % yielded the TEDI sensitivity to vary from approximately -3.2 % to about -3.6 %. When considering the uncertainty in each individual band significant changes were observed. The least change was observed for the perturbation in the calibration of band 20 with the TEDI sensitivity and the largest sensitivity in TEDI was observed in the perturbation of band 31 calibration. Thus, in the case of TEDI, noticeable sensitivity due to calibration uncertainty was observed in bands 29, 31, and 32, reiterating the importance of the TEB calibration in these bands. Also, the dust detection scheme based on A-MODIS was successfully transferred to the follow-on sensors such as Suomi (SNPP) and NOAA 20 (N20) VIIRS. The results presented in this paper would be extremely helpful in understanding impacts of calibration on the higher-level products for both current and future missions based on the MODIS heritage. Finally, the work also identifies the importance of radiometric fidelity in maintaining the accuracy of the dust detection. Results presented will show drastic improvement of the Saharan dust detection after the reduction of the electronic crosstalk in the 8.5 μm channel of T-MODIS.

Sriharsha Madhavan↗
NASA NTRS2002

Participation in the TOMS Science Team

Because of the nominal funding provided by this grant, some of the relevant research is partially funded by other sources. Research performed for this funding period included the following items: We have investigated errors in TOMS ozone measurements caused by the uncertainty in wavelength calibration, coupled with the ozone cross sections in the Huggins bands and their temperature dependence. Preliminary results show that 0.1 nm uncertainty in TOMS wavelength calibration at the ozone active wavelengths corresponds to approx. 1% systematic error in O3, and thus potential 1% biases among ozone trends from the various TOMS instruments. This conclusion will be revised for absolute O3 Measurements as cross sections are further investigated for inclusion in the HITRAN database at the SAO, but the potential for relative errors remains. In order to aid further comparisons among TOMS and GOME ozone measurements, we have implemented our method of direct fitting of GOME radiances (BOAS) for O3, and now obtain the best fitting precision to date for GOME O3 Columns. This will aid in future comparisons of the actual quantities measured and fitted for the two instrument types. We have made comparisons between GOME ICFA cloud fraction and cloud fraction determined from GOME data using the Ring effect in the Ca II lines. There is a strong correlation, as expected, but there are substantial systematic biases between the determinations. This study will be refined in the near future using the recently-developed GOME Cloud Retrieval Algorithm (GOMECAT). We have improved the SAO Ring effect determination to include better convolution with instrument transfer functions and inclusion of interferences by atmospheric absorbers (e.g., O3). This has been made available to the general community.

Chance, Kelly↗
DOE OSTI2024

SAIL-Isotopologue (SAIL-iso) Field Campaign Report

The SAIL-iso project took place from November 19, 2022 to June 3, 2023 as part of the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s Surface Atmosphere Integrated Field Laboratory (SAIL) project at the main project site in Gothic, Colorado. The project sought to use measurements of the stable isotopic composition of water vapor to better understand cloud-aerosol interactions in a remote mountainous watershed. Water vapor isotopologue and humidity measurements were determined using a Los Gatos Research Triple Water Vapor Isotope Analyzer (TWVIA). The instrument was deployed in the guest van and consists of three main components: a water vapor isotope analyzer, a Los Gatos Research Water Vapor Isotope Standard Source (WVISS), and a Los Gatos Research Dry Air Source. Ambient air samples were collected through an inlet located about one meter above roof of the shipping container. Samples were then delivered to the analyzer through Teflon tubing by use of an external pump to minimize the transport time between the inlet and analyzer. The inlet tubing was surrounded by a Briskheat heat trace and insulating material to ensure ambient air samples did not fall below the dew point and result in condensation. The analyzer uses cavity ringdown spectroscopy to report isotopic ratios of ambient air samples at a frequency of 1 Hz. The calibration unit of the instrument was used in conjunction with the dry air source to periodically measure the δ values of standard waters. It uses a nebulizer to push small water droplets into a hot chamber that vaporizes the water without fractionation. This vapor was then transported to the analyzer using a built-in compressor and the dry air source, which allows each standard with known δ values to be measured at a wide range of humidity values for post-measurement calibration of ambient air samples. Multiple sources of uncertainty are introduced at different stages during the data collection and processing. These include (1) instrument precision, (2) uncertainty in the secondary standards, (3) humidity-correction uncertainty, and (4) Vienna Standard Mean Ocean Water – Standard Light Antarctic Precipitation (VSMOW-SLAP) calibration uncertainty. Uncertainty from each step is propagated in quadrature to calculate a total uncertainty of each isotopologue. Uncertainty was determined to be 2.3‰ for δD and 0.4‰ for δ 18 O.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2021

Uncertainty Analysis of the CE-12 Free-Jet Probe Calibration Facility

This paper presents methods and results of a detailed measurement uncertainty analysis thf at was performed for the Free Jet Calibration Facility (CE-12) located at the NASA Glenn Research Center. Results for systematic uncertainty estimates in a number of fluid properties of the free jet flow are presented. Systematic uncertainty captures inaccuracies due to measurement process, calibration, installation effects or other similar sources which may introduce bias. MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation uncertainty and engineering judgment was used to quantify other systematic uncertainty sources. The Monte Carlo method was used to propagate systematic uncertainties to determine the uncertainties of various calculated variables of interest.

CE-12↗
NASA NTRS2016

Regional Changes in Earths Color and Texture as Observed From Space Over a 15-Year Period

Earth-observing satellites provide global observations of many geophysical variables. As these variables are derived from measured radiances, the underlying radiance data are the most reliable sources of information for change detection. Here, we identify statistically significant trends in the color and spatial texture of the Earth as viewed from multiple directions from the Multi-angle Imaging SpectroRadiometer (MISR), which has been sampling the angular distribution of scattered sunlight since 2000. Globally, our results show that the Earth has been appearing relatively bluer (up to 1.6 % per decade from both nadir and oblique views) and smoother (up to 1.5 % per decade only from oblique views) over the past 15 years. The magnitude of the global blueing trends is comparable to that of uncertainties in radiometric calibration stability. Regional shifts in color and texture, which are significantly larger than global means, are observed, particularly over polar regions, along the boundaries of the subtropical highs, the tropical western Pacific, Southwestern Asia, and Australia. We demonstrate that the large regional trends cannot be explained either by uncertainties in radiometric calibration or variability in total or spectral solar irradiance; hence, they reflect changes internal to the Earths climate system. The 15-year-mean true color composites and texture images of the Earth at both nadir and oblique views are also presented for the first time.

regional trends↗
NASA NTRS2020

Sensitivity of Satellite Ocean Color Data to System Vicarious Calibration of the Long Near Infrared Band

Satellite ocean color missions require accurate (< 1% uncertainties) system vicarious calibrations (SVC) in order to retrieve the relatively small remote sensing reflectance (Rrs, sr-1) from the at-sensor radiance. However, current atmospheric correction and SVC procedures do not include calibration of the “long” near infrared band (NIRL–869nm for MODIS), partially because earlier studies indicated that accuracy in the retrieved Rrsis insensitive to moderate changes in the NIRLvicarious gain (g). However, the sensitivity of ocean color data products to g(NIRL) has not been thoroughly examined. Here, we first derived 10 SVC ‘gain configurations’ (vicarious gains for all visible and NIR bands) for MODIS/Aqua using current operational NASA protocols, each time assuming a different g(869). From these, we derived a suite of ~1.4E6 unique gain configurations with g(869) ranging from 0.85 to 1.2. All MODIS/A data for 25locations within each of five ocean gyres were then processed using each of these gain configurations. Such time series show substantial variability inthe dominant Rrs(547) patterns in response to changes in g(869). Overall gyre mean Rrs(547) generally decreased with increasing g(869), while the standard deviations around those means show gyre-specific minima for 0.97 < g(869) < 1.02. Following these sensitivity analyses, we assess the potential to resolve g(869) using suchtime series, finding g(869) = 1.025 most closely comports with expectations. This approach is broadly applicable to other ocean color sensors, and highlights the importance of rigorous cross-sensor calibration of the NIRLbands, with implications on consistency of merged-sensor datasets.

vicarious calibration↗
NASA NTRS1977

Calibration analysis for a multi-channel infrared scanning radiometer

A procedure for calibrating an infrared scanning spectroradiometer by a computerized parametric error analysis technique was developed. The uncertainties in the radiometric measurements of scene radiance and (for the case of a blackbody scene) temperature due to possible uncertainties in the calibration target temperature, calibration target emissivity, and instrument temperature were calculated for a range of uncertainty levels in the parameters, as well as for a gamut of scent temperatures corresponding to a given spectral channel. This technique is applicable to the radiometric calibration of any infrared radiometer. It was applied specifically to the Cloud-Top Scanning (C.T.S) Radiometer, a three-channel instrument designed for aircraftborne cloud radiance measurements in the 6.75 and 11.5 micron thermal emission spectral regions.

Walden, H.↗
NASA NTRS1996

Model Insensitive and Calibration Independent Method for Determination of the Downstream Neutral Hydrogen Density Through Ly-alpha Glow Observations

Our knowledge of the various heliospheric phenomena (location of the solar wind termination shock, heliopause configuration and very local interstellar medium parameters) is limited by uncertainties in the available heliospheric plasma models and by calibration uncertainties in the observing instruments. There is, thus, a strong motivation to develop model insensitive and calibration independent methods to reduce the uncertainties in the relevant heliospheric parameters. We have developed such a method to constrain the downstream neutral hydrogen density inside the heliospheric tail. In our approach we have taken advantage of the relative insensitivity of the downstream neutral hydrogen density profile to the specific plasma model adopted. We have also used the fact that the presence of an asymmetric neutral hydrogen cavity surrounding the sun, characteristic of all neutral densities models, results in a higher multiple scattering contribution to the observed glow in the downstream region than in the upstream region. This allows us to approximate the actual density profile with one which is spatially uniform for the purpose of calculating the downstream backscattered glow. Using different spatially constant density profiles, radiative transfer calculations are performed, and the radial dependence of the predicted glow is compared with the observed I/R dependence of Pioneer 10 UV data. Such a comparison bounds the large distance heliospheric neutral hydrogen density in the downstream direction to a value between 0.05 and 0.1/cc.

Gangopadhyay, P.↗
DOE OSTI2025

Sensitivity of an integrated experiment to uncertainty in the high explosive equations of state

Traditionally, hydrodynamics simulations are performed with a single equation-of-state (EOS) to describe each material. These EOSs typically have a physics-informed functional form with adjustable parameters that are calibrated in order to replicate small-scale data. However, because the calibration data have uncertainty and there are typically inherent degeneracies in fitting the EOS, there are actually multiple EOSs that might be consistent with calibration data. In this work, we perform uncertainty quantification (UQ) for the reactant and product equations of state for the high explosive PBX 9501 to yield an ensemble of EOSs that match the uncertain small-scale calibration data. We then simulate an experiment of an explosively formed penetrator repeatedly with different EOSs to both validate the UQ analysis and determine the effects of EOS uncertainty on the prediction of quantities of interest in the experiment. In general, we find good agreement between the simulation predictions and the experimental measurements, and we identify an EOS variable that contributes most directly to the spread in the predictions as the EOSs are varied.

36 MATERIALS SCIENCE↗
NASA NTRS2011

The Extreme Spin of the Black Hole in Cygnus X-1

The compact primary in the X-ray binary Cygnus X-1 was the first black hole to be established via dynamical observations. We have recently determined accurate values for its mass and distance, and for the orbital inclination angle of the binary. Building on these results, which are based on our favored (asynchronous) dynamical model, we have measured the radius of the inner edge of the black hole s accretion disk by fitting its thermal continuum spectrum to a fully relativistic model of a thin accretion disk. Assuming that the spin axis of the black hole is aligned with the orbital angular momentum vector, we have determined that Cygnus X-1 contains a near-extreme Kerr black hole with a spin parameter a* > 0.95 (3(sigma)). For a less probable (synchronous) dynamical model, we find a. > 0.92 (3 ). In our analysis, we include the uncertainties in black hole mass, orbital inclination angle, and distance, and we also include the uncertainty in the calibration of the absolute flux via the Crab. These four sources of uncertainty totally dominate the error budget. The uncertainties introduced by the thin-disk model we employ are particularly small in this case given the extreme spin of the black hole and the disk s low luminosity.

Gou, Lijun↗
NASA NTRS2005

The Extreme Spin of the Black Hole in Cygnus X-1

The compact primary in the X-ray binary Cygnus X-1 was the first black hole to be established via dynamical observatIOns. We have recently determined accurate values for its mass and distance, and for the orbital inclination angle of the binary. Building on these.results, which are based on our favored (asynchronous) dynamical model, we have measured the radius of the inner edge of the black hole's accretion disk by fitting its thermal continuum.spectrum to a fully relativistic model of a thin accretion disk. Assuming that the spin axis of the black hole is aligned with the orbital angular momentum vector, we have determined that Cygnus X-I contains a near-extreme Kerr black hole with a spin parameter a* > 0.95 (3(sigma)). For a less probable (synchronous) dynamIcal model, we find a* > 0.92 (3(sigma)). In our analysis, we include the uncertainties in black hole mass orbital inclination angle and distance, and we also include the uncertainty in the calibration of the absolute flux via the Crab. These four sources of uncertainty totally dominate the error budget. The uncertainties introduced by the thin-disk model we employ are particularly small in this case given the extreme spin of the black hole and the disk's low luminosity.

Gou, Lijun↗