Using near–surface temperature data to vicariously calibrate high-resolution thermal infrared imagery and estimate physical surface properties
Explore the source record for details and available documents.
Timothy N. Titus↗
SEARCH · Engineering Papers
Results for “calibration estimator”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Formulation and solution approach for calibrating activity-based travel demand model-system via microsimulation
This study addresses the problem of calibrating utility-maximizing nested logit activity-based travel demand model-systems. After estimation, it is common practice to use aggregate measurements to calibrate the estimated model-system’s parameters prior to their application in transportation planning, policy making, and operations. However, calibration of activity-based model-systems has received much less attention. Existing calibration approaches are myopic heuristics in the sense that they do not consider the fundamental inter-dependencies among choice-models and do not have a systematic way to adjust model parameters. Also, other purely simulation-based approaches do not perform well in large-scale applications. In this study, we focus on utility-maximizing nested logit activity-based model-systems and calibrating aggregate statistics such as activity shares, mode shares, time-dependent & mode-specific OD flows, and time-dependent & mode-specific sensor counts. We formulate the calibration problem as a simulation-based optimization problem and propose a stochastic gradient-based solution procedure to solve it. The solution procedure relies on microsimulation to calculate expectations of the aggregate statistics of interest to the calibration problem. Additionally, we derive approximate analytical expressions for the gradient of the objective function —that are evaluated through microsimulation on mini-batches of the population. The proposed solution procedure is sensitive to the fundamental structure of the activity-based model-system and is non-myopic in considering the dependencies across its model components. The formulated optimization problem is non-convex, highly nonlinear, and potentially has multiple-minima. Lastly, we show —through a real-world application— that the proposed solution procedure outperforms other state-of-the-art purely simulation-based optimization approaches in terms of computational efficiency, stability, and convergence. We also compare various gradient-based solution algorithms to determine the best algorithm to update the parameters. This work has the potential to facilitate wider and easier application of activity-based model-systems.
97 MATHEMATICS AND COMPUTING↗
Implicit Spacecraft Gyro Calibration
This paper presents an implicit algorithm for spacecraft onboard instrument calibration, particularly to onboard gyro calibration. This work is an extension of previous work that was done where an explicit gyro calibration algorithm was applied to the AQUA spacecraft gyros. The algorithm presented in this paper was tested using simulated data and real data that were downloaded from the Microwave Anisotropy Probe (MAP) spacecraft. The calibration tests gave very good results. A comparison between the use of the implicit calibration algorithm used here with the explicit algorithm used for AQUA spacecraft indicates that both provide an excellent estimation of the gyro calibration parameters with similar accuracies.
Harman, Richard↗
Robust and scalable uncertainty estimation with conformal prediction for machine-learned interatomic potentials
Abstract Uncertainty quantification (UQ) is important to machine learning (ML) force fields to assess the level of confidence during prediction, as ML models are not inherently physical and can therefore yield catastrophically incorrect predictions. Established a-posteriori UQ methods, including ensemble methods, the dropout method, the delta method, and various heuristic distance metrics, have limitations such as being computationally challenging for large models due to model re-training. In addition, the uncertainty estimates are often not rigorously calibrated. In this work, we propose combining the distribution-free UQ method, known as conformal prediction (CP), with the distances in the neural network’s latent space to estimate the uncertainty of energies predicted by neural network force fields. We evaluate this method (CP+latent) along with other UQ methods on two essential aspects, calibration, and sharpness, and find this method to be both calibrated and sharp under the assumption of independent and identically-distributed (i.i.d.) data. We show that the method is relatively insensitive to hyperparameters selected, and test the limitations of the method when the i.i.d. assumption is violated. Finally, we demonstrate that this method can be readily applied to trained neural network force fields with traditional and graph neural network architectures to obtain estimates of uncertainty with low computational costs on a training dataset of 1 million images to showcase its scalability and portability. Incorporating the CP method with latent distances offers a calibrated, sharp and efficient strategy to estimate the uncertainty of neural network force fields. In addition, the CP approach can also function as a promising strategy for calibrating uncertainty estimated by other approaches.
74 ATOMIC AND MOLECULAR PHYSICS↗
A comparison of Gaussian processes and neural networks for computer model emulation and calibration
The Department of Energy relies on complex physics simulations for prediction in domains like cosmology, nuclear theory, and materials science. These simulations are often extremely computationally intensive, with some requiring days or weeks for a single simulation. In order to assure their accuracy, these models are calibrated against observational data in order to estimate inputs and systematic biases. Because of their great computational complexity, this process typically requires the construction of an emulator, a fast approximation to the simulation. In this paper, two emulator approaches are compared: Gaussian process regression and neural networks. Their emulation accuracy and calibration performance on three real problems of Department of Energy interest is considered. On these problems, the Gaussian process emulator tends to be more accurate with narrower, but still well-calibrated uncertainty estimates. The neural network emulator is accurate, but tends to have large uncertainty on its predictions. Finally, as a result, calibration with the Gaussian process emulator produces more constrained posteriors that still perform well in prediction.
97 MATHEMATICS AND COMPUTING↗
A TRMM-Calibrated Infrared Technique for Convective and Stratiform Rainfall: Analysis and Validation
A satellite infrared technique with passive microwave calibration has been developed for estimating convective and stratiform. rainfall. The Convective-Stratiform Technique, calibrated by coincident, physically retrieved rain rates from the TRMM Microwave Imager (TMI), has been applied to 30 min interval GOES infrared data and aggregated over seasonal and yearly periods over northern South America. The diurnal cycle of rainfall, as well as the division between convective and stratiform rainfall is presented. For the period Jan-April 1999, analysis revealed significant effects of local circulations (river breeze, land/sea breeze, mountain/valley) on both the total rainfall and it's diurnal cycle. Results compared well (a one-hour lag) with the diurnal cycle derived from TOGA radar-estimated rainfall in Rondonia. The satellite estimates revealed that the convective rain constituted 24% of the rain area while accounting for 67% of the rain volume. Estimates of the diurnal cycle (both total rainfall and convective/stratiform) for an area encompassing the Amazon Basin (3 x 10(exp 6) square km) were in phase with those from the TRMM Precipitation Radar, despite the latter's limited sampling. Results will be presented comparing the yearly (2000) diurnal cycle for large regions (including the Amazon Basin), and an intercomparison of January-March estimates for three years, 1999-2001. We hope to demonstrate the utility of using the TRMM PR observations as verification for infrared estimates of the diurnal cycle, and as verification of the apportionment of rainfall into convective and stratiform components.
Negri, Andrew↗
A TRMM-Calibrated Infrared Technique for Convective and Stratiform Rainfall: Analysis and Validation
A satellite infrared technique with passive microwave calibration has been developed for estimating convective and stratiform rainfall. The Convective-Stratiform Technique, calibrated by coincident, physically retrieved rain rates from the TRMM Microwave Imager (TMI), has been applied to 30 min interval GOES infrared data and aggregated over seasonal and yearly periods over northern South America. The diurnal cycle of rainfall, as well as the division between convective and stratiform rainfall is presented. For the period Jan-April 1999, analysis revealed significant effects of local circulations (river breeze, land/sea breeze, mountain/valley) on both the total rainfall and it's diurnal cycle. Results compared well (a one-hour lag) with the diurnal cycle derived from TOGA radar-estimated rainfall in Rondonia. The satellite estimates revealed that the convective rain constituted 24% of the rain area while accounting for 67% of the rain volume. Estimates of the diurnal cycle (both total rainfall and convective/stratiform) for an area encompassing the Amazon Basin (3 x 10(exp 6) sq km) were in phase with those from the TRMM Precipitation Radar, despite the latter's limited sampling. Results will be presented comparing the yearly (2000) diurnal cycle for large regions (including the Amazon Basin), and an intercomparison of January-March estimates for three years, (1999-2001). We hope to demonstrate the utility of using the TRMM PR observations as verification for infrared estimates of the diurnal cycle, and as verification of the apportionment of rainfall into convective and stratiform components.
Negri, Andrew↗
Emulator-based Bayesian calibration of a subglacial drainage model
Subglacial drainage models, often motivated by the relationship between hydrology and ice flow, sensitively depend on numerous unconstrained parameters. We explore using borehole water-pressure time series to calibrate the uncertain parameters of a popular subglacial drainage model, taking a Bayesian perspective to quantify the uncertainty in parameter estimates and in the calibrated model predictions. To reduce the computation time associated with Markov Chain Monte Carlo sampling, we construct a fast Gaussian process emulator to stand in for the subglacial drainage model. We first carry out a calibration experiment using synthetic observations consisting of model simulations with hidden parameter values as a demonstration of the method. Using real borehole water pressures measured in western Greenland, we find meaningful constraints on four of the eight model parameters and a factor-of-three reduction in uncertainty of the calibrated model predictions. These experiments illustrate Gaussian process-based Bayesian inference as a useful tool for calibration and uncertainty quantification of complex glaciological models using field data. However, significant differences between the calibrated model and the borehole data suggest that structural limitations of the model, rather than poorly constrained parameters or computational cost, remain the most important constraint on subglacial drainage modelling.
58 GEOSCIENCES↗
Electric Field Reconstruction in the Image Plane of a High-Contrast Coronagraph Using a Set of Pinholes Around the Lyot Plane
The pair-wise estimation has been used now on various testbeds with different coronagraphs with the best contrast results to date. Pinholes estimate has been implemented and ready to be tested in closed loop correction. Pinholes estimate offers an independent method. We hope to improve the calibration process to gain better estimates.
Coronagraphy↗
Recalibrating Best Practices, Challenges, and Limitations of Estimating Tree Transpiration Via Sap Flow
Purpose: Transpiration dominates hydrologic fluxes from terrestrial ecosystems to the atmosphere. Sap flow is the most widely used method to quantify transpiration, and calibrations can improve the accuracy of these estimates. Despite numerous suggestions to perform and apply sap flow calibrations, seemingly few reports apply these recommendations. Here, we sought to determine the prevalence of calibration across sap flow methodology. Recent Findings: In this work, we reviewed tree sap flow literature over the past nine years and determined that only 5.3% of these publications documented the performance of calibrations, the application of coefficients from previous calibrations, or the application of correction factors using calibration data to ensure or improve accuracy of transpiration estimates. These data indicate that calibration has not been adopted as a best practice. However, these data may also reflect challenges to the performance and application of calibration indicating fundamental limitations of sap flow methods. Summary: We highlight the need for testing critical assumptions regarding calibration; specifically, that coefficients derived from calibrations on small stems are suitable for application to large stems and that different calibration approaches yield similar transpiration estimates. We encourage researchers to adopt calibration as a best practice for sap flow data and to explain how calibration was performed, how calibration data were applied, and to acknowledge and justify circumstances that preclude or do not necessitate calibration. Without the adoption of calibration and an improved understanding of its limitations, our understanding of transpiration and ability to quantify it using this technology will remain inadequate.
54 ENVIRONMENTAL SCIENCES↗
First Measurements of Ambient PM2.5 in Kinshasa, Democratic Republic of Congo and Brazzaville, Republic of Congo Using Field-calibrated Low-cost Sensors
Estimates of air pollution mortality in sub-Saharan Africa are limited by a lack of surface observations of fine particulate matter (PM2.5). Despite being large metropolises, Kinshasa, Democratic Republic of the Congo (DRC), population 14.3 million, and Brazzaville, Republic of the Congo (ROC), population 2.4 million, have no reference air pollution monitors at the time of writing. Recently, a few reference monitors have been deployed in other parts of sub-Saharan Africa, including Kampala, Uganda. A low-cost PurpleAir PM2.5 monitor was collocated next to the Kampala US Embassy BAM-1020 (Met One Beta Attenuation Monitor) starting in August 2019. Raw PurpleAir data are strongly correlated with the BAM (r(exp 2) = 0.88), but have a mean absolute error of approximately 14 μg/cu.m. Two calibration models, multiple linear regression and a random forest approach, decrease mean absolute error (MAE) from 14.3 μg/cu.m to 3.4 µg/cu.m or less and improve the the r(exp 2) from 0.88 to 0.96. Given )the similarity in climate and emissions in Kampala, we apply the collocated field correction factors to four PurpleAir sensors in Kinshasa, DRC and one in neighboring Brazzaville, ROC deployed beginning April 2018. Annual average PM2.5 for 2019 in Kinshasa is estimated at 43.5 µg/cu.m, more than 4 times higher than WHO Interim Target 1 of 10 µg/cu.m. Surface PM2.5 and aerosol optical depth were each about 40% lower during the 2020 COVID19 lockdown period compared to the same time period in 2019, which cannot be explained by changes in meteorology or wildfire emissions alone. Our results highlight the need for clean air solutions implementation in the Congo.
Celeste McFarlane↗
GPCP Version 3.2 Products and Results
The Global Precipitation Climatology Project (GPCP) products address the need for long-term precipitation products that emphasize homogeneity, following Climate Data Record (CDR) principles. The new-generation Version 3.2 provides key improvements over the operational Version 2.3 such as: finer spatial resolution of 0.5°x0.5°; wider geosynchronous infrared estimation (58°N-S) upgraded with the PERSIANN-CDR algorithm; upgraded retrievals from selected passive microwave sensors (GPROF algorithm) that calibrate the IR input; revised intercalibrations of TOVS and AIRS data (used at high latitudes); climatologies based on CloudSat, TRMM, and GPM to provide overall calibration by modern satellite estimates; the latest Global Precipitation Climatology Centre (GPCC) precipitation gauge analyses over land areas; regional modifications to the gauge undercatch correction; and IMERG half-hourly data input to the Daily V3.2 product. We will show sample analyses that demonstrate aspects of the Version 3.2 precipitation record, such as the global climatology, the time series for global land and ocean total precipitation and snowfall, and the time series of tropical land and ocean daily precipitation rate histograms. For selected analyses we will show improvements in both the Monthly and Daily products in Version 3.2 compared to the operational Version 2.3. In particular, the climatological zonal profile of precipitation in the Southern Ocean, extending south of 40°S, improves a suspected artifact in V2.3. Similarly, the Daily histograms over ocean in Version 3.2 lack the jump in the predecessor Version 1.3 Daily over ocean at the start of 2009, although a smaller jump is introduced in June 2014. The presentation will conclude with a prospectus for the future satellites/sensors and community datasets necessary to continue computation of a consistent CDR product on the one hand, while also potentially contributing to improvements in the historical record.
Global Precipitation Measurement↗
Calibration of a COTS Integration Cost Model Using Local Project Data
The software measures and estimation techniques appropriate to a Commercial Off the Shelf (COTS) integration project differ from those commonly used for custom software development. Labor and schedule estimation tools that model COTS integration are available. Like all estimation tools, they must be calibrated with the organization's local project data. This paper describes the calibration of a commercial model using data collected by the Flight Dynamics Division (FDD) of the NASA Goddard Spaceflight Center (GSFC). The model calibrated is SLIM Release 4.0 from Quantitative Software Management (QSM). By adopting the SLIM reuse model and by treating configuration parameters as lines of code, we were able to establish a consistent calibration for COTS integration projects. The paper summarizes the metrics, the calibration process and results, and the validation of the calibration.
Boland, Dillard↗
Dark Energy Survey Identification of A Low-Mass Active Galactic Nucleus at Redshift 0.823 from Optical Variability
We report the identification of a low-mass active galactic nucleus (AGN), DES J0218−0430, in a redshift z = 0.823 galaxy in the Dark Energy Survey (DES) Supernova field. We select DES J0218−0430 as an AGN candidate by characterizing its long-term optical variability alone based on DES optical broad-band light curves spanning over 6 yr. An archival optical spectrum from the fourth phase of the Sloan Digital Sky Survey shows both broad Mg ii and broad H β lines, confirming its nature as a broad-line AGN. Archival XMM–Newton X-ray observations suggest an intrinsic hard X-ray luminosity of |$L_{{\rm 2-12\, keV}}\approx 7.6\pm 0.4\times 10^{43}$| erg s^−1, which exceeds those of the most X-ray luminous starburst galaxies, in support of an AGN driving the optical variability. Based on the broad H β from SDSS spectrum, we estimate a virial black hole (BH) mass of M_• ≈ 10^6.43–10^6.72 M_⊙ (with the error denoting the systematic uncertainty from different calibrations), consistent with the estimation from OzDES, making it the lowest mass AGN with redshift > 0.4 detected in optical. We estimate the host galaxy stellar mass to be M_* ≈ 10^10.5 ± 0.3 M_⊙ based on modelling the multiwavelength spectral energy distribution. DES J0218−0430 extends the M_•–M_* relation observed in luminous AGNs at z ∼ 1 to masses lower than being probed by previous work. Our work demonstrates the feasibility of using optical variability to identify low-mass AGNs at higher redshift in deeper synoptic surveys with direct implications for the upcoming Legacy Survey of Space and Time at Vera C. Rubin Observatory.
79 ASTRONOMY AND ASTROPHYSICS↗
Calibration of CDM-Based Creep Constitutive Model Using Accelerated Creep Test (ACT) Data
In conventional creep testing (CCT) a specimen is subject to constant load and temperature for a long-duration until creep rupture occurs. Conventional testing can be costly when considering the number of experiments needed to characterize the creep response of a material over a range of stress and temperature. To predict long-term creep-rupture properties, the time-temperature-stress superposition principle (TTSSP) approach has been employed where stress and/or temperature is applied at an elevated level; the result of which are extrapolated down to low stress and/or temperature conditions. These methods have been successful in predicting minimum-creep-strain-rate (MCSR) and stress-rupture (SR) but suffer from an inability to predict the creep deformation curve or account for changes in deformation mechanisms or aging that occurs at long-duration. An accelerated technique, termed the Stepped isostress method (SSM) allows the accelerated testing of materials to determine their creep deformation response. Unlike TTSSP tests, the SSM test employs a single specimen where the stress is periodically step increased until rupture. The SSM creep deformation curve is processed (time and strain shifted) to produce an accelerated creep deformation curve that represent the creep deformation curve at the initial stress level in SSM. A processing procedure for metals has yet to be developed. The research objective of this study is to develop a processing procedure for SSM test data using a creep-damage constitutive model. Triplicate SSM tests were conducted on Ni-based superalloy Inconel 718 at 650°C with stress being periodically increased until rupture. Triplicate CCT tests were conducted at the initial stress level of the SSM tests. The Sine-hyperbolic (Sinh) creep-damage model was employed in this study. The Sinh creep-damage constitutive model is based on coupled creep strain rate and damage evolution equations; where both rates are dependent on the current state of damage. Calibration is two-step: analytical and numerical optimization. Each stepped creep deformation curve is tackled quasi-analytically to determine MCSR and SR related material constants and accumulated damage. The damage accumulated at the end of each step was then passed onto subsequent steps to calibrate the MCSR, rupture prediction, and damage evolution. Numerical optimization was applied to optimize model constants involved in the creep strain constitutive equations in order to generate best-fitted Sinh creep deformation curves. The Sinh model predictions were compared to the SSM and CCT data. The Sinh model satisfactorily predicts the SSM data and thus the calibrated material constants provides a good estimate of rupture found in the CCT data. Calibration using SSM data reduces the number of tests needed to calibrate a model; significantly reducing costs. A single SSM test replaces numerous creep tests at different stresses.
36 MATERIALS SCIENCE↗
Uncertainty Evaluation of Computational Model Used to Support the Integrated Powerhead Demonstration Project
NASA and the U.S. Air Force are working on a joint project to develop a new hydrogen-fueled, full-flow, staged combustion rocket engine. The initial testing and modeling work for the Integrated Powerhead Demonstrator (IPD) project is being performed by NASA Marshall and Stennis Space Centers. A key factor in the testing of this engine is the ability to predict and measure the transient fluid flow during engine start and shutdown phases of operation. A model built by NASA Marshall in the ROCket Engine Transient Simulation (ROCETS) program is used to predict transient engine fluid flows. The model is initially calibrated to data from previous tests on the Stennis E1 test stand. The model is then used to predict the next run. Data from this run can then be used to recalibrate the model providing a tool to guide the test program in incremental steps to reduce the risk to the prototype engine. In this paper, they define this type of model as a calibrated model. This paper proposes a method to estimate the uncertainty of a model calibrated to a set of experimental test data. The method is similar to that used in the calibration of experiment instrumentation. For the IPD example used in this paper, the model uncertainty is determined for both LOX and LH flow rates using previous data. The successful use of this model is then demonstrated to predict another similar test run within the uncertainty bounds. The paper summarizes the uncertainty methodology when a model is continually recalibrated with new test data. The methodology is general and can be applied to other calibrated models.
Steele, W. G.↗
An assessment of the Nimbus-7/CZCS calibration for May 1986 using satellite and in situ data from the Arabian Sea
A hydrographic survey of the central Arabian Sea was conducted in May 1986 and stations were correlated with Nimbus-7/Coastal Zone Color Scanner (CZCS) overpasses. As calibration of the CZCS degraded severely during its lifetime, pigment concentrations from samples at four sites in the Arabian Sea were used to refine the calibration of the CZCS. This vicarious calibration technique provided a final estimate of the sensor's sensitivity loss for sensor Gain 2. Calibration using normalized water-leaving radiance for the 520 nm and 550 nm bands showed considerable final sensor degradation. Future missions must incorporate calibration validation programs in order to maintain derived product accuracy requirements. Profiles of pigment concentration, salinity, temperature, and light attenuation are used to describe the bio-optical characteristics of the Arabian Sea during the intermonsoon period.
Hay, Bernward J.↗
Cutting out the Middleman: Calibrating and Validating a Dynamic Vegetation Model (ED2-PROSPECT5) Using Remotely Sensed Surface Reflectance
Canopy radiative transfer is the primary mechanism by which models relate vegetation composition and state to the surface energy balance, which is important to light- and temperature-sensitive plant processes as well as understanding land–atmosphere feedbacks. In addition, certain parameters (e.g., specific leaf area, SLA) that have an outsized influence on vegetation model behavior can be constrained by observations of shortwave reflectance, thus reducing model predictive uncertainty. Importantly, calibrating against radiative transfer outputs allows models to directly use remote sensing reflectance products without relying on highly derived products (such as MODIS leaf area index) whose assumptions may be incompatible with the target vegetation model and whose uncertainties are usually not well quantified. Here, we created the EDR model by coupling the two-stream representation of canopy radiative transfer in the Ecosystem Demography model version 2 (ED2) with a leaf radiative transfer model (PROSPECT-5) and a simple soil reflectance model to predict full-range, high-spectral-resolution surface reflectance that is dependent on the underlying ED2 model state. We then calibrated this model against estimates of hemispherical reflectance (corrected for directional effects) from the NASA Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) and survey data from 54 temperate forest plots in the northeastern United States. The calibration significantly reduced uncertainty in model parameters related to leaf biochemistry and morphology and canopy structure for five plant functional types. Using a single common set of parameters across all sites, the calibrated model was able to accurately reproduce surface reflectance for sites with highly varied forest composition and structure. However, the calibrated model's predictions of leaf area index (LAI) were less robust, capturing only 46 % of the variability in the observations. Comparing the ED2 radiative transfer model with another two-stream soil–leaf–canopy radiative transfer model commonly used in remote sensing studies (PRO4SAIL) illustrated structural errors in the ED2 representation of direct radiation backscatter that resulted in systematic underestimation of reflectance. In addition, we also highlight that, to directly compare with a two-stream radiative transfer model like EDR, we had to perform an additional processing step to convert the directional reflectance estimates of AVIRIS to hemispherical reflectance (also known as “albedo”). In future work, we recommend that vegetation models add the capability to predict directional reflectance, to allow them to more directly assimilate a wide range of airborne and satellite reflectance products. We ultimately conclude that despite these challenges, using dynamic vegetation models to predict surface reflectance is a promising avenue for model calibration and validation using remote sensing data.
Alexey N Shiklomanov↗