Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model calibration techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Gravity field determination and error assessment techniques

Linear estimation theory, along with a new technique to compute relative data weights, was applied to the determination of the Earth's geopotential field and other geophysical model parameters using a combination of satellite ground-based tracking data, satellite altimetry data, and the surface gravimetry data. The relative data weights for the inhomogeneous data sets are estimated simultaneously with the gravity field and other geophysical and orbit parameters in a least squares approach to produce the University of Texas gravity field models. New techniques to perform calibration of the formal covariance matrix for the geopotential solution were developed to obtain a reliable gravity field error estimate. Different techniques, which include orbit residual analysis, surface gravity anomaly residual analysis, subset gravity solution comparisons and consider covariance analysis, were applied to investigate the reliability of the calibration.

Yuan, D. N.↗

Estimating Material Properties Under Extreme Conditions by Using Bayesian Model Calibration with Functional Outputs

Summary Dynamic material properties experiments provide access to the most extreme temperatures and pressures attainable in a laboratory setting; the data from these experiments are often used to improve our understanding of material models at these extreme conditions. We apply Bayesian model calibration to dynamic material property applications where the experimental output is a function: velocity over time. This framework can accommodate more uncertainties and facilitate analysis of new types of experiments relative to techniques traditionally used to analyse dynamic material experiments. However, implementation of Bayesian model calibration requires more sophisticated statistical techniques, because of the functional nature of the output as well as parameter and model discrepancy identifiability. We propose a novel Bayesian model calibration process to simplify and improve the estimation of the material property calibration parameters. Specifically, we propose scaling the likelihood function by an effective sample size rather than modelling the auto-correlation function to accommodate the functional output. Additionally, we propose sensitivity analyses by using the notion of 'modularization' to assess the effect of experiment-specific nuisance input parameters on estimates of the physical parameters. The Bayesian model calibration framework proposed is applied to dynamic compression of tantalum to extreme pressures, and we conclude that the procedure results in simple, fast and valid inferences on the material properties for tantalum.

36 MATERIALS SCIENCE↗

Trial-based calibration for audio-based identification, recognition, and detection system

The disclosed technologies include methods for generating a calibration model using data that is selected to match the conditions of a particular trial that involves an automated comparison of data samples, such as a comparison-based trial performed by an audio-based recognition, identification, or detection system. The disclosed technologies also include improved methods for selecting candidate data used to build the calibration model. The disclosed technologies further include methods for evaluating the performance of the calibration model and for rejecting a trial when not enough matched candidate data is available to build the calibration model. The disclosed technologies additionally include the use of regularization and automated data generation techniques to further improve the robustness of the calibration model.

McLaren, Mitchell Leigh↗

An Integrated Approach to Weather Radar Calibration and Monitoring Using Ground Clutter and Satellite Comparisons

Abstract The stability and accuracy of weather radar reflectivity calibration are imperative for quantitative applications, such as rainfall estimation, severe weather monitoring and nowcasting, and assimilation in numerical weather prediction models. Various radar calibration and monitoring techniques have been developed, but only recently have integrated approaches been proposed, that is, using different calibration techniques in combination. In this paper the following three techniques are used: 1) ground clutter monitoring, 2) comparisons with spaceborne radars, and 3) the self-consistency of polarimetric variables. These techniques are applied to a C-band polarimetric radar (CPOL) located in the Australian tropics since 1998. The ground clutter monitoring technique is applied to each radar volumetric scan and provides a means to reliably detect changes in calibration, relative to a baseline. It is remarkably stable to within a standard deviation of 0.1 dB. To obtain an absolute calibration value, CPOL observations are compared to spaceborne radars on board TRMM and GPM using a volume-matching technique. Using an iterative procedure and stable calibration periods identified by the ground echoes technique, we improve the accuracy of this technique to about 1 dB. Finally, we review the self-consistency technique and constrain its assumptions using results from the hybrid TRMM–GPM and ground echo technique. Small changes in the self-consistency parameterization can lead to 5 dB of variation in the reflectivity calibration. We find that the drop-shape model of Brandes et al. with a standard deviation of the canting angle of 12° best matches our dataset.

54 ENVIRONMENTAL SCIENCES↗

An Integrated Approach to Weather Radar Calibration and Monitoring Using Ground Clutter and Satellite Comparisons

The stability and accuracy of weather radar reflectivity calibration are imperative for quantitative applications, such as rainfall estimation, severe weather monitoring and nowcasting, and assimilation in numerical weather prediction models. Various radar calibration and monitoring techniques have been developed, but only recently have integrated approaches been proposed, that is, using different calibration techniques in combination. In this paper the following three techniques are used: 1) ground clutter monitoring, 2) comparisons with spaceborne radars, and 3) the self-consistency of polarimetric variables. These techniques are applied to a C-band polarimetric radar (CPOL) located in the Australian tropics since 1998. The ground clutter monitoring technique is applied to each radar volumetric scan and provides a means to reliably detect changes in calibration, relative to a baseline. It is remarkably stable to within a standard deviation of 0.1 dB (decibels). To obtain an absolute calibration value, CPOL observations are compared to spaceborne radars on board TRMM (Tropical Rainfall Measuring Mission) and GPM (Global Precipitation Measurement) using a volume-matching technique. Using an iterative procedure and stable calibration periods identified by the ground echoes technique, we improve the accuracy of this technique to about 1 dB. Finally, we review the self-consistency technique and constrain its assumptions using results from the hybrid TRMM-GPM and ground echo technique. Small changes in the self-consistency parameterization can lead to 5 dB of variation in the reflectivity calibration. We find that the drop-shape model of Brandes et al. with a standard deviation of the canting angle of 12 degrees best matches our dataset.

Louf, Valentin↗

Digital image correlation and infrared thermography data for seven unique geometries of 304L stainless steel

Material Testing 2.0 (MT2.0) is a paradigm that advocates for the use of rich, full-field data, such as from digital image correlation and infrared thermography, for material identification. By employing heterogeneous, multi-axial data in conjunction with sophisticated inverse calibration techniques such as finite element model updating and the virtual fields method, MT2.0 aims to reduce the number of specimens needed for material identification and to increase confidence in the calibration results. To support continued development, improvement, and validation of such inverse methods—specifically for rate-dependent, temperature-dependent, and anisotropic metal plasticity models—we provide here a thorough experimental data set for 304L stainless steel sheet metal. The data set includes full-field displacement, strain, and temperature data for seven unique specimen geometries tested at different strain rates and in different material orientations. Commensurate extensometer strain data from tensile dog bones is provided as well for comparison. We believe this complete data set will be a valuable contribution to the experimental and computational mechanics communities, supporting continued advances in material identification methods.

36 MATERIALS SCIENCE↗

Effects of RAM Exposure on a Low Earth Orbit BroadBand Radiometer (BBR): CERES Experience and Implications for EarthCARE

In order to best detect real changes in the Earth's climate system it is estimated that space based instrumentation measuring the global Earth Radiation Budget (ERB) must remain calibrated with a stability of 0.3% per decade. This level of stability is beyond the specified accuracy of existing ERB programs such as the Clouds and the Earth's Radiant Energy System (CERES, using three broadband radiometric scanning channels: the shortwave (SW 0.3 - 5?m), total (0.3 - >100 micron), and window (8 - 12 micron)). When in low earth orbit, it has been shown that optical response to blue-UV radiance can be reduced significantly (> 3%) due to UV hardened contaminants deposited on the surface of the optics. Evidence suggests that exposure of telescope optics to the forward looking ram direction is the primary cause of this contamination build up. With typical onboard calibration lamps emitting very low energy in the blue-UV region, this darkening is not directly measurable using standard internal calibration techniques. This paper describes a study using a model of ram exposure induced contaminant deposition and darkening, in conjunction standard established in-flight vicarious and internal calibration techniques to derive the spectral shape of the darkening to which a broadband instrument is subjected. The results of the model when applied to the CERES instruments are shown. These findings are of great importance to the EarthCARE project, whose BBR uses one broadband telescope permanently looking forward at 45 degrees, with continual exposure to the ram direction. Specific attention may therefore be needed in the design of BBR optics and on-board calibration in order to prevent or compensate for the spectral darkening seen in the CERES project.

Matthews, Grant↗

Verification, Validation, and Calibration Through a Causal Lens

While typical validation and verification approaches focus on identifying the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on identifying causal relationships between data elements. Statistical and machine-learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between data sets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify, and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles, it is known as a directed acyclic graph. A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts can identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

The effects of AVIRIS atmospheric calibration methodology on identification and quantitative mapping of surface mineralogy, Drum Mountains, Utah

The Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) measures reflected light in 224 contiguous spectra bands in the 0.4 to 2.45 micron region of the electromagnetic spectrum. Numerous studies have used these data for mineralogic identification and mapping based on the presence of diagnostic spectral features. Quantitative mapping requires conversion of the AVIRIS data to physical units (usually reflectance) so that analysis results can be compared and validated with field and laboratory measurements. This study evaluated two different AVIRIS calibration techniques to ground reflectance: an empirically-based method and an atmospheric model based method to determine their effects on quantitative scientific analyses. Expert system analysis and linear spectral unmixing were applied to both calibrated data sets to determine the effect of the calibration on the mineral identification and quantitative mapping results. Comparison of the image-map results and image reflectance spectra indicate that the model-based calibrated data can be used with automated mapping techniques to produce accurate maps showing the spatial distribution and abundance of surface mineralogy. This has positive implications for future operational mapping using AVIRIS or similar imaging spectrometer data sets without requiring a priori knowledge.

Kruse, Fred A.↗

MTF Analysis of LANDSAT-4 Thematic Mapper

A research program to measure the LANDSAT 4 Thematic Mapper (TM) modulation transfer function (MTF) is described. Measurement of a satellite sensor's MTF requires the use of a calibrated ground target, i.e., the spatial radiance distribution of the target must be known to a resolution at least four to five times greater than that of the system under test. A small reflective mirror or a dark light linear pattern such as line or edge, and relatively high resolution underflight imagery are used to calibrate the target. A technique that utilizes an analytical model for the scene spatial frequency power spectrum will be investigated as an alternative to calibration of the scene. The test sites and analysis techniques are also described.

Schowengerdt, R.↗

Investigation of assumptions and approximations in the virtual fields method for a viscoplastic material model

The Virtual Fields Method (VFM) is an inverse technique used for parameter estimation and calibration of constitutive models. Many assumptions and approximations—such as plane stress, incompressible plasticity, and spatial and temporal derivative calculations—are required to use VFM with full-field deformation data, for example, from Digital Image Correlation (DIC). Here, this work presents a comprehensive discussion of the effects of these assumptions and approximations on parameters identified by VFM for a viscoplastic material model for 304L stainless steel. We generated synthetic data from a Finite-Element Analysis (FEA) in order to have a reference solution with a known material model and known model parameters, and we investigated four cases in which successively more assumptions and approximations were included in the data. We found that VFM is tolerant to small deviations from the plane stress condition in a small region of the sample, and that the incompressible plasticity assumption can be used to estimate thickness changes with little error. A local polynomial fit to the displacement data was successfully employed to compute the spatial displacement gradients. The choice of temporal derivative approximation (i.e., backwards difference versus central difference) was found to have a significant influence on the computed rate of deformation and on the VFM results for the rate-dependent model used in this work. Finally, the noise introduced into the displacement data from a stereo-DIC simulator was found to have negligible influence on the VFM results. Evaluating the effects of assumptions and approximations using synthetic data is a critical first step for verifying and validating VFM for specific applications. Finally, the results of this work provide the foundation for confidently using VFM for experimental data.

304L stainless steel↗

Initial comparison of SSPM ground test results and flight data to NASCAP simulations

The satellite surface potential monitor (SSPM) has been developed for the P78-2 SCATHA (Spacecraft Charging At The High Altitudes) satellite to determine the response of selected spacecraft materials to charged-particle environmental fluxes. Since the monitor infers total surface voltages from a single point on the interior side of insulators, a ground simulation program was undertaken to develop analytical techniques to model the monitors and to obtain an experimental calibration of the relationship between the flight measurement techniques and actual measurements. The experimental testing was conducted using monoenergetic electron beams irradiating samples in the dark. An analytical computer model was developed in the NASCAP (NASA Charging Analyzer Program) code. The analytical model material properties for Kapton that controlled backscatter and secondary yield were adjusted to obtain a single set of values that produced reasonable fits for both voltages and currents. The analytical techniques developed in the ground technology investigation have been applied to space flight conditions. Predictions were compared with limited flight data. The agreement is very good indicating that the technique, and NASCAP, can be used to predict spacecraft material charging behavior. Details of the testing, the analytical modelling technique and flight data comparisons are presented.

Stevens, N. J.↗

Improved modeling of β electronic recoils in liquid xenon using LUX calibration data

We report here methods and techniques for creating and improving a model that reproduces the scintillation and ionization response of a dual-phase liquid and gaseous xenon time-projection chamber. Starting with the recent release of the Noble Element Simulation Technique (NEST v2.0), electronic recoil data from the $\beta$ decays of ${}^3$H and ${}^{14}$C in the Large Underground Xenon (LUX) detector were used to tune the model, in addition to external data sets that allow for extrapolation beyond the LUX data-taking conditions. This paper also presents techniques used for modeling complicated temporal and spatial detector pathologies that can adversely affect data using a simplified model framework. The methods outlined in this report show an example of the robust applications possible with NEST v2.0, while also providing the final electronic recoil model and detector parameters that will used in the new analysis package, the LUX Legacy Analysis Monte Carlo Application (LLAMA), for accurate reproduction of the LUX data. As accurate background reproduction is crucial for the success of rare-event searches, such as dark matter direct detection experiments, the techniques outlined here can be used in other single-phase and dual-phase xenon detectors to assist with accurate ER background reproduction.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Benchmarking of Planning Models Using Recorded Dynamics

Power system planning extensively uses model simulation to understand the dynamic behaviors and determine the operating limits of a power system. Model quality is key to the safety and reliability of electricity delivery. Planning model benchmarking, or model validation, has been one of the central topics in power engineering studies for years. As model validation aims at obtaining reasonable models to represent dynamic behavior of power system components, it has been essential to validate models against actual measurements. The development of phasor technology provides such measurements and represents a new opportunity for model validation as phasor measurements can capture power system dynamics with high-speed, time-synchronized data. Previously, methods for rigorous comparison of model simulation and recorded dynamics have been developed and applied to quantify model quality of power plants in the Western Electricity Coordinating Council (WECC). These methods can locate model components which need improvement. Recent work continues this effort and focuses on how model parameters may be calibrated to match recorded dynamics after the problematic model components are identified. A calibration method using Extended Kalman Filter technique is being developed. This paper provides an overview of prior work on model validation and presents new development on the calibration method and initial results of model parameter calibration.

Huang, Zhenyu↗

Climate Science for a Sustainable Energy Future Atmospheric Radiation Measurement Best Estimate (CSSEFARMBE)

The Climate Science for a Sustainable Energy Future (CSSEF) project is working to improve the representation of the hydrological cycle in global climate models, critical information necessary for decision-makers to respond appropriately to predictions of future climate. In order to accomplish this objective, CSSEF is building testbeds to implement uncertainty quantification (UQ) techniques to objectively calibrate and diagnose climate model parameterizations and predictions with respect to local, process-scale observations. In order to quantify the agreement between models and observations accurately, uncertainty estimates on these observations are needed. The DOE Atmospheric Radiation Measurement (ARM) program takes atmospheric and climate related measurements at three permanent locations worldwide. The ARM VAP called the ARM Best Estimate (ARMBE) [Xie et al., 2010] collects a subset of ARM observations, performs quality control checks, averages them to one hour temporal resolution, and puts them in a standard format for ease of use by climate modelers. ARMBE has been widely used by the climate modeling community as a summary product of many of the ARM observations. However, the ARMBE product does not include uncertainty estimates on the data values. Thus, to meet the objectives of the CSSEF project and enable better use of this data with UQ techniques, we created the CSSEFARMBE data set. Only a subset of the variables contained in ARMBE is included in CSSEFARMBE. Currently only surface meteorological observations are included, though this may be expanded to include other variables in the future. The CSSEFARMBE VAP is produced for all extended facilities at the ARM Southern Great Plains (SGP) site that contain surface meteorological equipment. This extension of the ARMBE data set to multiple facilities at SGP allows for better comparison between model grid boxes and the ARM point observations. In the future, CSSEFARMBE may also be created for other ARM sites. As each site has slightly different instrumentation, this will require additional development to understand the uncertainty characterization associated with instrumentation at those sites. The uncertainty assignment process is implemented into the ARM program’s new Integrated Software Development Environment (ISDE) so that many of the key steps can be used in the future to screen data based on ARM Data Quality Reports (DQRs), propagate uncertainties when transforming data from one time scale into another, and convert names and units into NetCDF Climate and Forecast (CF) standards. These processes are described in more detail in the following sections.

atmospheric↗

Sequentially calibrating a Bayesian microsimulation model to incorporate new information and assumptions

Background: Microsimulation models are mathematical models that simulate event histories for individual members of a population. They are useful for policy decisions because they simulate a large number of individuals from an idealized population, with features that change over time, and the resulting event histories can be summarized to describe key population-level outcomes. Model calibration is the process of incorporating evidence into the model. Calibrated models can be used to make predictions about population trends in disease outcomes and effectiveness of interventions, but calibration can be challenging and computationally expensive. Methods: This paper develops a technique for sequentially updating models to take full advantage of earlier calibration results, to ultimately speed up the calibration process. A Bayesian approach to calibration is used because it combines different sources of evidence and enables uncertainty quantification which is appealing for decision-making. We develop this method in order to re-calibrate a microsimulation model for the natural history of colorectal cancer to include new targets that better inform the time from initiation of preclinical cancer to presentation with clinical cancer (sojourn time), because model exploration and validation revealed that more information was needed on sojourn time, and that the predicted percentage of patients with cancers detected via colonoscopy screening was too low. Results: The sequential approach to calibration was more efficient than recalibrating the model from scratch. Incorporating new information on the percentage of patients with cancers detected upon screening changed the estimated sojourn time parameters significantly, increasing the estimated mean sojourn time for cancers in the colon and rectum, providing results with more validity. Conclusions: A sequential approach to recalibration can be used to efficiently recalibrate a microsimulation model when new information becomes available that requires the original targets to be supplemented with additional targets.

60 APPLIED LIFE SCIENCES↗

Rapid and high-throughput determination of sorghum ( Sorghum bicolor ) biomass composition using near infrared spectroscopy and chemometrics

Compositional characterization of biomass is vital for the biofuel industry. Traditional wet chemistry-based methods for analyzing biomass composition are laborious, time-consuming, and require extensive use of chemical reagents as well as highly skilled personnel. In this study, near-infrared (NIR) spectroscopy was used to quickly assess the composition of above-ground vegetative biomass from 113 diverse, photoperiod-sensitive, biomass-type sorghum (Sorghum bicolor) accessions cultivated under field conditions in Central Illinois. Biomass samples were analyzed using NIR spectra collected in the spectral range of 867–2536 nm, with their chemical compositions determined following the National Renewable Energy Laboratory (NREL) protocol. Advanced spectral pre-treatment and band selection techniques were utilized to develop calibration models using partial least squares regression (PLSR). The models’ effectiveness was assessed through cross-validation and independent data tests. The predictions for moisture, ash, extractives, glucan, xylan, acid-soluble lignin (ASL), acid-insoluble lignin (AIL), and total lignin were accurate and reliable, demonstrating the capability of NIR spectroscopy to provide rapid and precise characterization of sorghum biomass. The results demonstrated that NIR spectroscopy is an efficient tool for rapidly characterizing sorghum biomass, making it a sustainable option for screening desirable feedstock for biofuel or bioproduct production.

09 BIOMASS FUELS↗