Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Stellar chemical abundances: in pursuit of the highest achievable precision

The achievable level of precision on photospheric abundances of stars is a major limiting factor on investigations of exoplanet host star characteristics, the chemical histories of star clusters, and the evolution of the Milky Way and other galaxies. While model-induced errors can be minimized through the differential analysis of spectrally similar stars, the maximum achievable precision of this technique has been debated. As a test, we derive differential abundances of 19 elements from high-quality asteroid-reflected solar spectra taken using a variety of instruments and conditions. We treat the solar spectra as being from unknown stars and use the resulting differential abundances, which are expected to be zero, as a diagnostic of the error in our measurements. Our results indicate that the relative resolution of the target and reference spectra is a major consideration, with use of different instruments to obtain the two spectra leading to errors up to 0.04 dex. Use of the same instrument at different epochs for the two spectra has a much smaller effect (∼0.007 dex). The asteroid used to obtain the solar standard also has a negligible effect (∼0.006 dex). Assuming that systematic errors from the stellar model atmospheres have been minimized, as in the case of solar twins, we confirm that differential chemical abundances can be obtained at sub-0.01 dex precision with due care in the observations, data reduction, and abundance analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Understanding Global Model Systematic Shortwave Radiation Errors in Subtropical Marine Boundary Layer Cloud Regimes

Abstract Global numerical weather prediction and climate models are subject to long‐standing systematic shortwave radiation errors due to deficiencies in the representation of boundary layer clouds over the ocean. In the subtropics, clouds are typically too reflective in the cumulus regime and not reflective enough in the stratocumulus regime. Potential sources of error include cloud cover, liquid water path, effective radius, and subgrid heterogeneity, but diagnosing the absolute contributions of each to the radiation bias is hampered by uncertainties and sometimes contradictory information from different observational products. This paper draws on a set of ship‐based observations of boundary layer clouds obtained during the ARM MAGIC campaign along a northeast Pacific Ocean transect, crossing both stratocumulus and shallow cumulus cloud regimes. The surface‐based observations of cloud properties are compared with various satellite products, taking account of the diurnal cycle, to provide an improved quantitative assessment of the deficiencies in the European Centre for Medium‐Range Weather Forecasts global numerical weather prediction model. A series of off‐line radiation calculations are then performed to assess the impact on the shortwave radiation bias of correcting each of the model's deficiencies in cloud characteristics along the transect. A reduction in the bias is achieved by improving the agreement between modeled and observed in‐cloud liquid water path frequency distributions. In the cumulus regime, this is accomplished primarily by reducing the all‐sky water path, while for the stratocumulus regime, an underestimate of cloud cover and liquid water and an overestimate in effective radius and subgrid heterogeneity all contribute to a lack of reflected shortwave radiation.

54 ENVIRONMENTAL SCIENCES↗

Bayesian inference of nonlinear unsteady aerodynamics from aeroelastic limit cycle oscillations

A Bayesian model selection and parameter estimation algorithm is applied to investigate the influence of nonlinear and unsteady aerodynamic loads on the limit cycle oscillation (LCO) of a pitching airfoil in the transitional Reynolds number regime. At small angles of attack, laminar boundary layer trailing edge separation causes negative aerodynamic damping leading to the LCO. The fluid–structure interaction of the rigid, but elastically mounted, airfoil and nonlinear unsteady aerodynamics is represented by two coupled nonlinear stochastic ordinary differential equations containing uncertain parameters and model approximation errors. Several plausible aerodynamic models with increasing complexity are proposed to describe the aeroelastic system leading to LCO. The likelihood in the posterior parameter probability density function (pdf) is available semi-analytically using the extended Kalman filter for the state estimation of the coupled nonlinear structural and unsteady aerodynamic model. The posterior parameter pdf is sampled using a parallel and adaptive Markov Chain Monte Carlo (MCMC) algorithm. The posterior probability of each model is estimated using the Chib–Jeliazkov method that directly uses the posterior MCMC samples for evidence (marginal likelihood) computation. The Bayesian algorithm is validated through a numerical study and then applied to model the nonlinear unsteady aerodynamic loads using wind-tunnel test data at various Reynolds numbers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Review of Human Reliability Needs in the U.S. Nuclear Industry

In this survey, 34 subject matter experts from the U.S. nuclear industry were interviewed to determine specific needs for human reliability analysis (HRA). Conclusions from the interviews are detailed in this article. A summary of the findings includes: (1) The need for improved guidance on the use of HRA methods generally and for specific applications. (2) The need for additional training in HRA to provide more hands-on experience in the application of HRA methods. (3) Thedevelopment of HRA approaches suitable for advanced reactors, severe accident situations, and low-power and shutdown applications. (4) The refinement of HRA methods to account forfactors such as crew variability, latent errors, more sophisticated dependency modeling, and errors of commission. (5) The continued need for simplified HRA methods appropriate for field applications. (6) The need for tighter coupling of HRA and human factors. (7) The need for improvements in the quantitative basis of HRA methods. These findings suggest the field of HRA is mature but still benefits from refinements.

human reliability analysis↗

Bi-Level Arbitrage Potential Evaluation for Grid-Scale Energy Storage Considering Wind Power and LMP Smoothing Effect

Our paper deals with extended-term energy storage (ES) arbitrage problems to maximize the annual revenue in deregulated power systems with high penetration wind power. The conventional ES arbitrage model takes the locational marginal prices (LMP) as an input and is unable to account for the impacts of ES operations on system LMPs. This paper proposes a bi-level ES arbitrage model, where the upper level maximizes the ES arbitrage revenue and the lower level simulates the market clearing process considering wind power and ES. The bi-level model is formulated as a mathematical program with equilibrium constraints (MPEC) and then recast into a mixed-integer linear programming (MILP) using strong duality theory. Wind power fluctuations are characterized by the GARCH forecast model and the forecast error is modeled by forecast-bin based Beta distributions. Case studies are performed on a modified PJM 5-bus system and an IEEE 118-bus system with a weekly time horizon over an annual term to show the validity of the proposed bi-level model. The results from the conventional model and the bi-level model are compared under different ES power and energy ratings, and also various load and wind penetration levels.

17 WIND ENERGY↗

Back to Basics: First Principles of HRA

Human Reliability Analysis (HRA) continues to suffer from a myriad of technical gaps in its foundations. Core issues have been widely discussed but remain largely unaddressed, although the path taken to this point was paved with good intentions. Now, while this characterization may seem dramatic it is not intended to throw doubt onto HRA as a discipline or to diminish the value it has on increasing safety and resilience in nuclear power. Rather, it is intended to communicate that HRA has some serious challenges and is desperately in need of a critical evaluation. To quote Dougherty [1], “the misrepresentations that will undoubtedly arise may serve to provoke the necessary creativity.” What bears noting is that in the last thirty years since Alan Swain declared that “no adequate HRA had ever been done,” there has been little effort to correct the issues he highlighted. Human factors practice is still poorly implemented, many complex systems are fundamentally incompatible with reliable human performance, and there remains poor foundational support for many of the assumptions within HRA. We propose three categories of issues in HRA, philosophical, theoretical, and empirical and potential solutions to these issues.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Development of a High Fidelity System Analysis Code for Generation IV Reactors

Traditional nuclear reactor system analysis codes such as RELAP and TRAC employ an operator split methodology. In this approach, each of the physics (fluid flow, heat conduction and neutron diffusion) is solved separately and the coupling terms are done explicitly. This approach limits accuracy (first order in time at best) and makes the codes slow in running since the explicit coupling imposes stability restrictions on the time step size. These codes have been extensively tested and validated for the existing LWRs. However, for GEN IV nuclear reactor designs which tend to have long lasting transients resulting from passive safety systems, the performance is questionable and modern high fidelity simulation tools will be required. The requirement for accurate predictability is the motivation for a large scale overhaul of all of the models and assumptions in transient nuclear reactor safety simulation software. At INL we have launched an effort with the long term goal of developing a high fidelity system analysis code that employs modern physical models, numerical methods, and computer science for transient safety analysis of GEN IV nuclear reactors. Modern parallel solution algorithms will be employed through utilizing the nonlinear solution software package PETSc developed by Argonne National Laboratory. The physical models to be developed will have physically realistic length scales and time scales. The solution algorithm will be based on the physics-based preconditioned Jacobian-free Newton-Krylov solution methods. In this approach all of the physical models are solved implicitly and simultaneously in a single nonlinear system. This includes the coolant flow, nonlinear heat conduction, neutron kinetics, and thermal radiation, etc. Including modern physical models and accurate space and time discretizations will allow the simulation capability to be second order accurate in space and in time. This paper presents the current status of the development efforts as well as some results from analyzing a simplified primary system model of GNEP’s advanced burner test reactor (ABTR) designed by Argonne. Various transient analyses are performed with this simplified ABTR model to study two fundamental issues related to system analysis codes – accuracy of numeric algorithm and efficiency. The accuracy study is carried by comparing the second order method with the first order method. The results show that numerical errors in the first order method are large and it is very difficult to distinguish numerical errors from physical modeling errors. On the other hand, second order method yields small numerical errors and it is very easy to spot physical modeling errors. The efficiency study is carried out by comparing the time steps for the fully implicit solution algorithm versus CFL stability limit methods. The dynamic time steps used in a fully implicit method will adjust the time step to resolve the time scale during the various stages of a long lasting transient. This will make a computer code based on fully implicit methods run more efficiently versus a CFL stability limit method code like RELAP, in which a particle of fluid cannot cross a control volume in a single time step.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A surrogate-based uncertainty quantification with quantifiable errors

Surrogate models are often employed to reduce the computational cost required to complete uncertainty quantification, where one is interested in propagating input parameters uncertainties throughout a complex engineering model to estimate responses uncertainties. An improved surrogate construction approach is introduced here which places a premium on reducing the associated computational cost. Unlike existing methods where the surrogate is constructed first, then employed to propagate uncertainties, the new approach combines both sensitivity and uncertainty information to render further reduction in the computational cost. Mathematically, the reduction is described by a range finding algorithm that identifies a subspace in the parameters space, whereby parameters uncertainties orthogonal to the subspace contribute negligible amount to the propagated uncertainties. Moreover, the error resulting from the reduction can be upper-bounded. The new approach is demonstrated using a realistic nuclear assembly model and compared to existing methods in terms of computational cost and accuracy of uncertainties. Although we believe the algorithm is general, it will be applied here for linear-based surrogates and Gaussian parameters uncertainties. The generalization to nonlinear models will be detailed in a separate article. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

PRECISION MEASUREMENTS OF THE CLUSTER RED SEQUENCE USING AN ERROR-CORRECTED GAUSSIAN MIXTURE MODEL

The red sequence is an important feature of galaxy clusters and plays a crucial role in optical cluster detection. Measurement of the slope and scatter of the red sequence are affected both by selection of red sequence galaxies and measurement errors. In this paper, we describe a new error-corrected Gaussian Mixture Model for red sequence galaxy identification. Using this technique, we can remove the effects of measurement error and extract unbiased information about the intrinsic properties of the red sequence. We use this method to select red sequence galaxies in each of the 13,823 clusters in the maxBCG catalog, and measure the red sequence ridgeline location and scatter of each. These measurements provide precise constraints on the variation of the average red galaxy populations in the observed frame with redshift. We find that the scatter of the red sequence ridgeline increases mildly with redshift, and that the slope decreases with redshift. We also observe that the slope does not strongly depend on cluster richness. Using similar methods, we show that this behavior is mirrored in a spectroscopic sample of field galaxies, further emphasizing that ridgeline properties are independent of environment. These precise measurements serve as an important observational check on simulations and mock galaxy catalogs. The observed trends in the slope and scatter of the red sequence ridgeline with redshift are clues to possible intrinsic evolution of the cluster red sequence itself. Most importantly, the methods presented in this work lay the groundwork for further improvements in optically based cluster cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗

Alternatives to accuracy and bias metrics based on percentage errors for radiation belt modeling applications

This report reviews existing literature describing forecast accuracy metrics, concentrating on those based on relative errors and percentage errors. We then review how the most common of these metrics, the mean absolute percentage error (MAPE), has been applied in recent radiation belt modeling literature. Finally, we describe metrics based on the ratios of predicted to observed values (the accuracy ratio) that address the drawbacks inherent in using MAPE. Specifically, we define and recommend the median log accuracy ratio as a measure of bias and the median symmetric accuracy as a measure of accuracy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Multi-fidelity thermal modeling of laser powder bed additive manufacturing

Laser powder bed fusion (LPBF) Additive manufacturing (AM) has attracted interest as an agile method of building production metal parts to reduce design-build-test cycle times for systems. However, predicting part performance is difficult due to inherent process variabilities. This makes qualification challenging. Computational process models have attempted to address some of these challenges, including mesoscale, full physics models and reduced fidelity conduction models. The goal of this work is credible multi-fidelity modeling of the LPBF process by investigating methods for estimating the error between models of two different fidelities. Two methods of error estimation are investigated, adjoint-based error estimation and Bayesian calibration. Adjoint-based error estimation is found to effectively bounding the error between the two models, but with very conservative bounds, making predictions highly uncertain. Bayesian parameter calibration applied to conduction model heat source parameters is found to effectively bound the observed error between the models for melt pool morphology quantities of interest. However, the calibrations do not effectively bound the error in heat distribution.

36 MATERIALS SCIENCE↗

Error handling strategies in multiphase inverse modeling

Parameter estimation by inverse modeling involves the repeated evaluation of a function of residuals. These residuals represent both errors in the model and errors in the data. In practical applications of inverse modeling of multiphase flow and transport, the error structure of the final residuals often significantly deviates from the statistical assumptions that underlie standard maximum likelihood estimation using the least-squares method. Large random or systematic errors are likely to lead to convergence problems, biased parameter estimates, misleading uncertainty measures, or poor predictive capabilities of the calibrated model. The multiphase inverse modeling code iTOUGH2 supports strategies that identify and mitigate the impact of systematic or non-normal error structures. We discuss these approaches and provide an overview of the error handling features implemented in iTOUGH2.

54 ENVIRONMENTAL SCIENCES↗

Data-Driven Robust M-LS-SVR-Based NARX Modeling for Estimation and Control of Molten Iron Quality Indices in Blast Furnace Ironmaking

Optimal operation of an industrial blast furnace (BF) ironmaking process largely depends on a reliable measurement of molten iron quality (MIQ), which is not feasible using the conventional sensors. This paper proposes a novel data-driven robust modeling method for online estimation and control of MIQ indices. First, to completely capture the nonlinear dynamics of the BF process, the nonlinear autoregressive exogenous (NARX) model is constructed for the MIQ indices. Then, considering that the standard least-squares support vector regression (LS-SVR) cannot directly cope with the multi-output problem, the multi- task transfer learning is proposed to design a novel multi-output LS-SVR (M-LS-SVR) for learning of the NARX model. Furthermore, a novel M-estimator is proposed to reduce the interference of outliers and improve the robustness of the M-LS- SVR model. Since the weights of different outlier data are properly given by the weight function, their corresponding contributions on modeling can be properly distinguished, thus a robust modeling result can be achieved. Finally, a novel multi- objective evaluation index on modeling performance is developed by comprehensively considering the root mean square error of modeling and the correlation coefficient on trend fitting, based on which the NSGA-II algorithm is used to globally optimize the model parameters. Both experiments using industrial data and industrial applications illustrate that the proposed method can eliminate the adverse effect caused by the fluctuation of data in BF process efficiently, which indicates its stronger robustness and higher accuracy. Moreover, control testing shows that the developed model can be well applied to realize data-driven control of the BF process.

blast cavities, Control↗

Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility

One compelling vision of the future of materials discovery and design involves the use of machine learning (ML) models to predict materials properties and then rapidly find materials tailored for specific applications. However, realizing this vision requires both providing detailed uncertainty quantification (model prediction errors and domain of applicability) and making models readily usable. At present, it is common practice in the community to assess ML model performance only in terms of prediction accuracy (e.g. mean absolute error), while neglecting detailed uncertainty quantification and robust model accessibility and usability. Here, we demonstrate a practical method for realizing both uncertainty and accessibility features with a large set of models. We develop random forest ML models for 33 materials properties spanning an array of data sources (computational and experimental) and property types (electrical, mechanical, thermodynamic, etc). All models have calibrated ensemble error bars to quantify prediction uncertainty and domain of applicability guidance enabled by kernel-density-estimate-based feature distance measures. All data and models are publicly hosted on the Garden-AI infrastructure, which provides an easy-to-use, persistent interface for model dissemination that permits models to be invoked with only a few lines of Python code. We demonstrate the power of this approach by using our models to conduct a fully ML-based materials discovery exercise to search for new stable, highly active perovskite oxide catalyst materials.

domain of applicability↗

Effects of error covariance structure on estimation of model averaging weights and predictive performance

When conducting model averaging for assessing groundwater conceptual model uncertainty, the averaging weights are often evaluated using model selection criteria such as AIC, AICc, BIC, and KIC (Akaike Information Criterion, Corrected Akaike Information Criterion, Bayesian Information Criterion, and Kashyap Information Criterion, respectively). However, this method often leads to an unrealistic situation in which the best model receives overwhelmingly large averaging weight (close to 100%), which cannot be justified by available data and knowledge. It was found in this study that this problem was caused by using the covariance matrix, CE, of measurement errors for estimating the negative log likelihood function common to all the model selection criteria. This problem can be resolved by using the covariance matrix, Cek, of total errors (including model errors and measurement errors) to account for the correlation between the total errors. An iterative two-stage method was developed in the context of maximum likelihood inverse modeling to iteratively infer the unknown Cek from the residuals during model calibration. The inferred Cek was then used in the evaluation of model selection criteria and model averaging weights. While this method was limited to serial data using time series techniques in this study, it can be extended to spatial data using geostatistical techniques. The method was first evaluated in a synthetic study and then applied to an experimental study, in which alternative surface complexation models were developed to simulate column experiments of uranium reactive transport. It was found that the total errors of the alternative models were temporally correlated due to the model errors. The iterative two-stage method using Cek resolved the problem that the best model receives 100% model averaging weight, and the resulting model averaging weights were supported by the calibration results and physical understanding of the alternative models. Using Cek obtained from the iterative two-stage method also improved predictive performance of the individual models and model averaging in both synthetic and experimental studies.

error correlation↗

Automatic Time Stepping with Global Error Control for Groundwater Flow Models

An automatic time stepping with global error control is proposed for the time integration of the diffusion equation to simulate groundwater flow in confined aquifers. The scheme is based on an a posteriori error estimate for the discontinuous Galerkin (dG) finite element methods. A stability factor is involved in the error estimate and it is used to adapt the time step and control the global temporal error for the backward difference method. The stability factor can be estimated by solving a dual problem. The stability factor is not sensitive to the accuracy of the dual solution and the overhead computational cost can be minimized by solving the dual problem using large time steps. Numerical experiments are conducted to show the application and the performance of the automatic time stepping scheme. Implementation of the scheme can lead to improvement in accuracy and efficiency for groundwater flow models.

54 ENVIRONMENTAL SCIENCES↗

Active learning using hybrid surrogate tool life modeling for machining process optimization

Here, this paper describes an active learning approach for part-to-part iterative machining process optimization using a hybrid surrogate tool life model. A probabilistic interpolating tool life model is developed by combining the empirical Taylor-type tool life equation and the model fit error. The probabilistic tool life model is then used to calculate the machining cost per part distribution. The optimal machining parameters are selected using an expected improvement in machining cost per part criterion. The method is validated numerically using experimental results; the results show a median convergence error of 2.2% after three tests over 400 simulations. The method is validated experimentally on two industrial applications for Ti-6Al-4V roughing resulting in a cost per part reduction greater than 23% after two tests. The described method is a robust solution for rapid convergence to optimal machining parameters in an industrial production environment.

Active learning↗

Extending accurate spectral induced polarization measurements into the kHz range: modelling and removal of errors from interactions between the parasitic capacitive coupling and the sample holder

SUMMARY Spectral induced polarization (SIP), describing the measurement of the frequency domain electrical impedance magnitude and phase of porous materials, has been widely used to characterize subsurface hydrological/biogeochemical properties and processes. SIP data collected at frequencies higher than 100 Hz are expected to describe the polarization of small particles providing insights into the physicochemical properties of clays, nanoparticles and microorganisms. However, the phase measurements at these high frequencies are often contaminated by errors due to the parasitic capacitive coupling of the SIP instrument, especially for lower conductivity samples. We developed a model showing the measured phase is the sum of the true sample phase and an error term ωCinZx, where ω is the angular frequency; Cin is the instrument input capacitance and Zx is a measurable impedance function related to the sample holder properties and the reference resistor. Based on this model, a new phase correction method is proposed that results in highly accurate SIP data up to 20 kHz as well as the determination of Cin. We tested the correction method using electric circuits, NaCl fluids and three unconsolidated samples (sand, sand-clay and sand-pyrite mixtures). The corrected phase for the circuit and NaCl fluid experiments showed excellent agreement with the theoretical phase response across the studied frequency range (errors <1 mrad). For unconsolidated samples, removal of errors results in phase spectra more consistent with expected polarization mechanisms, as based on phase peaks recorded for small pyrite and clay particles at high frequencies. These phase peaks could not be identified in the uncorrected data. Our approach can substantially enhance the value of the SIP method for the characterization of fine-grained sediments and rocks.

58 GEOSCIENCES↗