Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

Error handling strategies in multiphase inverse modeling

Parameter estimation by inverse modeling involves the repeated evaluation of a function of residuals. These residuals represent both errors in the model and errors in the data. In practical applications of inverse modeling of multiphase flow and transport, the error structure of the final residuals often significantly deviates from the statistical assumptions that underlie standard maximum likelihood estimation using the least-squares method. Large random or systematic errors are likely to lead to convergence problems, biased parameter estimates, misleading uncertainty measures, or poor predictive capabilities of the calibrated model. The multiphase inverse modeling code iTOUGH2 supports strategies that identify and mitigate the impact of systematic or non-normal error structures. We discuss these approaches and provide an overview of the error handling features implemented in iTOUGH2.

54 ENVIRONMENTAL SCIENCES↗

Urban Air Mobility Conflict Resolution: Centralized or Decentralized?

This work begins to address one of the critical questions in the urban air mobility and small unmanned aircraft communities: Should the en-route conflict resolution function in an urban air mobility traffic system be centralized or decentralized? Three conflict resolution architectures are modeled and analyzed: centralized, decentralized with uniform rules, and decentralized with mixed rules. This study compares these architectures and investigates their robustness to communication and state information errors in terms of safety and efficiency metrics. Experiments are conducted using a high-fidelity Monte Carlo traffic simulator and a generic set of traffic scenarios with increasing traffic density. When no errors were modeled, the centralized architecture marginally outperformed the decentralized architecture. However, performance of the centralized architecture was found to be adversely affected by the modeled input errors to a greater degree than was the decentralized architecture. Performance of the centralized architecture also was degraded significantly by the modeled transmission errors of the centralized resolution maneuvers. In the decentralized architecture, uniform rules outperformed mixed rules because, in the mixed rules case, system safety performance was undermined and dominated by the poor performers.

Urban Air Mobility (UAM) traffic system↗

Data-Driven Robust M-LS-SVR-Based NARX Modeling for Estimation and Control of Molten Iron Quality Indices in Blast Furnace Ironmaking

Optimal operation of an industrial blast furnace (BF) ironmaking process largely depends on a reliable measurement of molten iron quality (MIQ), which is not feasible using the conventional sensors. This paper proposes a novel data-driven robust modeling method for online estimation and control of MIQ indices. First, to completely capture the nonlinear dynamics of the BF process, the nonlinear autoregressive exogenous (NARX) model is constructed for the MIQ indices. Then, considering that the standard least-squares support vector regression (LS-SVR) cannot directly cope with the multi-output problem, the multi- task transfer learning is proposed to design a novel multi-output LS-SVR (M-LS-SVR) for learning of the NARX model. Furthermore, a novel M-estimator is proposed to reduce the interference of outliers and improve the robustness of the M-LS- SVR model. Since the weights of different outlier data are properly given by the weight function, their corresponding contributions on modeling can be properly distinguished, thus a robust modeling result can be achieved. Finally, a novel multi- objective evaluation index on modeling performance is developed by comprehensively considering the root mean square error of modeling and the correlation coefficient on trend fitting, based on which the NSGA-II algorithm is used to globally optimize the model parameters. Both experiments using industrial data and industrial applications illustrate that the proposed method can eliminate the adverse effect caused by the fluctuation of data in BF process efficiently, which indicates its stronger robustness and higher accuracy. Moreover, control testing shows that the developed model can be well applied to realize data-driven control of the BF process.

blast cavities, Control↗

Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility

One compelling vision of the future of materials discovery and design involves the use of machine learning (ML) models to predict materials properties and then rapidly find materials tailored for specific applications. However, realizing this vision requires both providing detailed uncertainty quantification (model prediction errors and domain of applicability) and making models readily usable. At present, it is common practice in the community to assess ML model performance only in terms of prediction accuracy (e.g. mean absolute error), while neglecting detailed uncertainty quantification and robust model accessibility and usability. Here, we demonstrate a practical method for realizing both uncertainty and accessibility features with a large set of models. We develop random forest ML models for 33 materials properties spanning an array of data sources (computational and experimental) and property types (electrical, mechanical, thermodynamic, etc). All models have calibrated ensemble error bars to quantify prediction uncertainty and domain of applicability guidance enabled by kernel-density-estimate-based feature distance measures. All data and models are publicly hosted on the Garden-AI infrastructure, which provides an easy-to-use, persistent interface for model dissemination that permits models to be invoked with only a few lines of Python code. We demonstrate the power of this approach by using our models to conduct a fully ML-based materials discovery exercise to search for new stable, highly active perovskite oxide catalyst materials.

domain of applicability↗

Mathematical analysis study for radar data processing and enchancement. Part 2: Modeling of propagation path errors

A study is performed under NASA contract to evaluate data from an AN/FPS-16 radar installed for support of flight programs at Dryden Flight Research Facility of NASA Ames Research Center. The purpose of this study is to provide information necessary for improving post-flight data reduction and knowledge of accuracy of derived radar quantities. Tracking data from six flights are analyzed. Noise and bias errors in raw tracking data are determined for each of the flights. A discussion of an altitude bias error during all of the tracking missions is included. This bias error is defined by utilizing pressure altitude measurements made during survey flights. Four separate filtering methods, representative of the most widely used optimal estimation techniques for enhancement of radar tracking data, are analyzed for suitability in processing both real-time and post-mission data. Additional information regarding the radar and its measurements, including typical noise and bias errors in the range and angle measurements, is also presented. This report is in two parts. This is part 2, a discussion of the modeling of propagation path errors.

James, R.↗

TROPOMI Methane Validation in the GeoCarb Domain

Objective: GeoCarb validation •Purpose: •Do the four TCCON sites in the GeoCarb domain characterize satellite validation? •Method: •Assess the error estimates globally vs. in the GeoCarb domain •Assess the use of GML/DOE aircraft for CH4 validation •Systematic error estimate (from Kulawik, 2016): •+ regional bias (stdevof average bias versus validation at each station) •+ correlated error (stdev of daily average versus validation) •-co-location error (above quantities for model@satelliteminus model@valid) •-validation error (systematic error of validation estimates, e.g. model extension) Aircraft validation error •CH4 profile extension error estimate: 7 ppb •Extend aircraft observations to the top of the atmosphere with different model configurations •CAMS, scaling to stratosphere, then taking stratosphere •Extend by repeating top aircraft value to the troposphere, then taking CAMS •Extend with GEOS-Chem run (from 2010). •Difference CAMS-Scale vs. CAMS-Tropo: •3.6 +-5.5 ppb •Systematic error: 6.6 ppb •Extending aircraft to tropopause is blatantly wrong, but these two have the same stratosphere. •Difference CAMS-Scale vs. GEOS-Scale: •6.2 +-8.7 ppb •Do not consider bias since model is 10 years off. Systematic error ~8.7 ppb. •Estimate of systematic error from profile extension (possibly underestimated, resulting in possibly higher TROPOMI error estimate) •7 ppb •Would likely vary some by season, site, other conditions •Aircraft measurement error: 1 ppb •1 ppb from measurement error3

TROMPOMI↗

Estimating optimal sampling unit sizes for satellite surveys

This paper reports on an approach for minimizing data loads associated with satellite-acquired data, while improving the efficiency of global crop area estimates using remotely sensed, satellite-based data. Results of a sampling unit size investigation are given that include closed-form models for both nonsampling and sampling error variances. These models provide estimates of the sampling unit sizes that effect minimal costs. Earlier findings from foundational sampling unit size studies conducted by Mahalanobis, Jessen, Cochran, and others are utilized in modeling the sampling error variance as a function of sampling unit size. A conservative nonsampling error variance model is proposed that is realistic in the remote sensing environment where one is faced with numerous unknown nonsampling errors. This approach permits the sampling unit size selection in the global crop inventorying environment to be put on a more quantitative basis while conservatively guarding against expected component error variances.

Hallum, C. R.↗

Effects of error covariance structure on estimation of model averaging weights and predictive performance

When conducting model averaging for assessing groundwater conceptual model uncertainty, the averaging weights are often evaluated using model selection criteria such as AIC, AICc, BIC, and KIC (Akaike Information Criterion, Corrected Akaike Information Criterion, Bayesian Information Criterion, and Kashyap Information Criterion, respectively). However, this method often leads to an unrealistic situation in which the best model receives overwhelmingly large averaging weight (close to 100%), which cannot be justified by available data and knowledge. It was found in this study that this problem was caused by using the covariance matrix, CE, of measurement errors for estimating the negative log likelihood function common to all the model selection criteria. This problem can be resolved by using the covariance matrix, Cek, of total errors (including model errors and measurement errors) to account for the correlation between the total errors. An iterative two-stage method was developed in the context of maximum likelihood inverse modeling to iteratively infer the unknown Cek from the residuals during model calibration. The inferred Cek was then used in the evaluation of model selection criteria and model averaging weights. While this method was limited to serial data using time series techniques in this study, it can be extended to spatial data using geostatistical techniques. The method was first evaluated in a synthetic study and then applied to an experimental study, in which alternative surface complexation models were developed to simulate column experiments of uranium reactive transport. It was found that the total errors of the alternative models were temporally correlated due to the model errors. The iterative two-stage method using Cek resolved the problem that the best model receives 100% model averaging weight, and the resulting model averaging weights were supported by the calibration results and physical understanding of the alternative models. Using Cek obtained from the iterative two-stage method also improved predictive performance of the individual models and model averaging in both synthetic and experimental studies.

error correlation↗

Automatic Time Stepping with Global Error Control for Groundwater Flow Models

An automatic time stepping with global error control is proposed for the time integration of the diffusion equation to simulate groundwater flow in confined aquifers. The scheme is based on an a posteriori error estimate for the discontinuous Galerkin (dG) finite element methods. A stability factor is involved in the error estimate and it is used to adapt the time step and control the global temporal error for the backward difference method. The stability factor can be estimated by solving a dual problem. The stability factor is not sensitive to the accuracy of the dual solution and the overhead computational cost can be minimized by solving the dual problem using large time steps. Numerical experiments are conducted to show the application and the performance of the automatic time stepping scheme. Implementation of the scheme can lead to improvement in accuracy and efficiency for groundwater flow models.

54 ENVIRONMENTAL SCIENCES↗

Using Computational Cognitive Modeling to Diagnose Possible Sources of Aviation Error

We present a computational model of a closed-loop, pilot-aircraft-visual scene-taxiway system created to shed light on possible sources of taxi error. Creating the cognitive aspects of the model using ACT-R required us to conduct studies with subject matter experts to identify experiential adaptations pilots bring to taxiing. Five decision strategies were found, ranging from cognitively-intensive but precise, to fast, frugal but robust. We provide evidence for the model by comparing its behavior to a NASA Ames Research Center simulation of Chicago O'Hare surface operations. Decision horizons were highly variable; the model selected the most accurate strategy given time available. We found a signature in the simulation data of the use of globally robust heuristics to cope with short decision horizons as revealed by errors occurring most frequently at atypical taxiway geometries or clearance routes. These data provided empirical support for the model.

Pilots↗

Active learning using hybrid surrogate tool life modeling for machining process optimization

Here, this paper describes an active learning approach for part-to-part iterative machining process optimization using a hybrid surrogate tool life model. A probabilistic interpolating tool life model is developed by combining the empirical Taylor-type tool life equation and the model fit error. The probabilistic tool life model is then used to calculate the machining cost per part distribution. The optimal machining parameters are selected using an expected improvement in machining cost per part criterion. The method is validated numerically using experimental results; the results show a median convergence error of 2.2% after three tests over 400 simulations. The method is validated experimentally on two industrial applications for Ti-6Al-4V roughing resulting in a cost per part reduction greater than 23% after two tests. The described method is a robust solution for rapid convergence to optimal machining parameters in an industrial production environment.

Active learning↗

Error magnitude estimation in model-reference adaptive systems

A second order approximation is derived from a linearized error characteristic equation for Lyapunov designed model-reference adaptive systems and is used to estimate the maximum error between the model and plant states, and the time to reach this peak following a plant perturbation. The results are applicable in the analysis of plants containing magnitude-dependent nonlinearities.

Colburn, B. K.↗

Response Surface Modeling Tolerance and Inference Error Risk Specifications: Proposed Industry Standards

This paper reviews the derivation of an equation for scaling response surface modeling experiments. The equation represents the smallest number of data points required to fit a linear regression polynomial so as to achieve certain specified model adequacy criteria. Specific criteria are proposed which simplify an otherwise rather complex equation, generating a practical rule of thumb for the minimum volume of data required to adequately fit a polynomial with a specified number of terms in the model. This equation and the simplified rule of thumb it produces can be applied to minimize the cost of wind tunnel testing.

DeLoach, Richard↗

Extending accurate spectral induced polarization measurements into the kHz range: modelling and removal of errors from interactions between the parasitic capacitive coupling and the sample holder

SUMMARY Spectral induced polarization (SIP), describing the measurement of the frequency domain electrical impedance magnitude and phase of porous materials, has been widely used to characterize subsurface hydrological/biogeochemical properties and processes. SIP data collected at frequencies higher than 100 Hz are expected to describe the polarization of small particles providing insights into the physicochemical properties of clays, nanoparticles and microorganisms. However, the phase measurements at these high frequencies are often contaminated by errors due to the parasitic capacitive coupling of the SIP instrument, especially for lower conductivity samples. We developed a model showing the measured phase is the sum of the true sample phase and an error term ωCinZx, where ω is the angular frequency; Cin is the instrument input capacitance and Zx is a measurable impedance function related to the sample holder properties and the reference resistor. Based on this model, a new phase correction method is proposed that results in highly accurate SIP data up to 20 kHz as well as the determination of Cin. We tested the correction method using electric circuits, NaCl fluids and three unconsolidated samples (sand, sand-clay and sand-pyrite mixtures). The corrected phase for the circuit and NaCl fluid experiments showed excellent agreement with the theoretical phase response across the studied frequency range (errors <1 mrad). For unconsolidated samples, removal of errors results in phase spectra more consistent with expected polarization mechanisms, as based on phase peaks recorded for small pyrite and clay particles at high frequencies. These phase peaks could not be identified in the uncorrected data. Our approach can substantially enhance the value of the SIP method for the characterization of fine-grained sediments and rocks.

58 GEOSCIENCES↗

Effects of natural zeolites on field-scale geologic noble gas transport

Improving predictive models for noble gas transport through natural materials at the field-scale is an essential component of improving US nuclear monitoring capabilities. Several field-scale experiments with a gas transport component have been conducted at the Nevada National Security Site (Non-Proliferation Experiment, Underground Nuclear Explosion Signatures Experiment). However, the models associated with these experiments have not treated zeolite minerals as gas adsorbing phases. This is significant as zeolites are a common alteration mineral with a high abundance at these field sites and are shown here to significantly fractionate noble gases during field-scale transport. This fractionation and associated retardation can complicate gas transport predictions by reducing the signal-to-noise ratio to the detector (e.g. mass spectrometers or radiation detectors) enough to mask the signal or make the data difficult to interpret. Omitting adsorption-related retardation data of noble gases in predictive gas transport models therefore results in systematic errors in model predictions where zeolites are present.Herein is presented noble gas adsorption data collected on zeolitized and non-zeolitized tuff. Experimental results were obtained using a unique piezometric adsorption system designed and built for this study. Data collected were then related to pure-phase mineral analyses conducted on clinoptilolite, mordenite, and quartz. These results quantify the adsorption capacity of materials present in field-scale systems, enabling the modeling of low-permeability rocks as significant sorption reservoirs vital to bulk transport predictions.

58 GEOSCIENCES↗

Sunyaev-Zel'dovich Effect and X-ray Scaling Relations from Weak-Lensing Mass Calibration of 32 SPT Selected Galaxy Clusters

Uncertainty in mass-observable scaling relations is currently the limiting factor for galaxy-cluster-based cosmology. Weak gravitational lensing can provide direct mass calibration and reduce the mass uncertainty. We present new ground-based weak lensing observations of 19 South Pole Telescope (SPT) selected clusters at redshifts 0.29 <= z <= 0.61 and combine them with previously reported space-based observations of 13 galaxy clusters at redshifts 0.576 <= z <= 1.132 to constrain the cluster mass scaling relations with the Sunyaev-Zel'dovich effect (SZE), the cluster gas mass M-gas and Y-X, the product of M-gas and X-ray temperature. We extend a previously used framework for the analysis of scaling relations and cosmological constraints obtained from SPT-selected clusters to make use of weak lensing information. We introduce a new approach to estimate the effective average redshift distribution of background galaxies and quantify a number of systematic errors affecting the weak lensing modelling. These errors include a calibration of the bias incurred by fitting a Navarro-Frenk-White profile to the reduced shear using N-body simulations. We blind the analysis to avoid confirmation bias. We are able to limit the systematic uncertainties to 5.6% in cluster mass (68% confidence). Our constraints on the mass-X-ray observable scaling relation parameters are consistent with those obtained by earlier studies and our constraints for the mass-SZE scaling relation are consistent with the simulation-based prior used in the most recent SPT-SZ cosmology analysis. We can now replace the external mass calibration priors used in previous SPT-SZ cosmology studies with a direct, internal calibration obtained for the same clusters.

cosmology: observations↗

A Systematic Approach to Isolating the Causes and Impacts of Climate Model Bias Employing Analysis Increments

One of the most promising approaches to isolating the causes and understanding the impacts of climate model formulation errors is through the utilization of information contained in short-term forecast errors. The underlying assumption being that by capturing the errors at the very early stages of growth (before nonlinearities develop), we should be able to associate those errors with specific deficiencies in the model's formulation of the relevant physical processes. Here, we provide an example of utilizing the long-term mean of the 6-hourly analysis increments (first guess forecast minus analysis) produced by MERRA-2 to correct the NASA/GEOS AGCM over well-defined regions, thereby allowing us to quantify how the reduced tendency errors in these regions manifest themselves both locally and remotely through large-scale teleconnections to reduce the model's climatological biases. We extend previous work (focused on boreal summer) to address the full annual cycle of model bias. A key result is the large seasonality of the errors over the Tibet region and their impacts on the Northern Hemisphere jet biases, and related precipitation and temperature biases over North American. Attempts to correct the phase and amplitude errors of the climatological boreal winter ridge over western North America (a likely key requirement for improving winter climate forecasts over North America) reveal a surprising complexity in the sources of the errors in what is otherwise manifest as a rather simple PNA-like bias structure.

Schubert, S.↗