Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Error analysis of low-fidelity models for wake steering based on field measurements

The observations collected by two scanning lidars deployed on the roof of a 2.8-MW turbine undergoing a series of imposed yaw offsets are analyzed. The wake lateral displacement detected by the rear-facing lidar correlates well with the yaw offset sensed by the forward-facing lidar. We find that the high-frequency part of the yaw offset signal is connected to wake meandering, whereas the low frequency component is a good predictor for wake displacement due to yaw misalignment. Conditionally averaged wake velocity data for different yaw offsets are used as benchmarks for the validation of a linearized Reynolds-averaged Navier-Stokes and an empirical wake model. A mean error as low as 2% and a good prediction of the wake trajectory are achieved, provided that the wake recovery rate matches the observations.

17 WIND ENERGY↗

Stellar chemical abundances: in pursuit of the highest achievable precision

The achievable level of precision on photospheric abundances of stars is a major limiting factor on investigations of exoplanet host star characteristics, the chemical histories of star clusters, and the evolution of the Milky Way and other galaxies. While model-induced errors can be minimized through the differential analysis of spectrally similar stars, the maximum achievable precision of this technique has been debated. As a test, we derive differential abundances of 19 elements from high-quality asteroid-reflected solar spectra taken using a variety of instruments and conditions. We treat the solar spectra as being from unknown stars and use the resulting differential abundances, which are expected to be zero, as a diagnostic of the error in our measurements. Our results indicate that the relative resolution of the target and reference spectra is a major consideration, with use of different instruments to obtain the two spectra leading to errors up to 0.04 dex. Use of the same instrument at different epochs for the two spectra has a much smaller effect (∼0.007 dex). The asteroid used to obtain the solar standard also has a negligible effect (∼0.006 dex). Assuming that systematic errors from the stellar model atmospheres have been minimized, as in the case of solar twins, we confirm that differential chemical abundances can be obtained at sub-0.01 dex precision with due care in the observations, data reduction, and abundance analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Understanding Global Model Systematic Shortwave Radiation Errors in Subtropical Marine Boundary Layer Cloud Regimes

Abstract Global numerical weather prediction and climate models are subject to long‐standing systematic shortwave radiation errors due to deficiencies in the representation of boundary layer clouds over the ocean. In the subtropics, clouds are typically too reflective in the cumulus regime and not reflective enough in the stratocumulus regime. Potential sources of error include cloud cover, liquid water path, effective radius, and subgrid heterogeneity, but diagnosing the absolute contributions of each to the radiation bias is hampered by uncertainties and sometimes contradictory information from different observational products. This paper draws on a set of ship‐based observations of boundary layer clouds obtained during the ARM MAGIC campaign along a northeast Pacific Ocean transect, crossing both stratocumulus and shallow cumulus cloud regimes. The surface‐based observations of cloud properties are compared with various satellite products, taking account of the diurnal cycle, to provide an improved quantitative assessment of the deficiencies in the European Centre for Medium‐Range Weather Forecasts global numerical weather prediction model. A series of off‐line radiation calculations are then performed to assess the impact on the shortwave radiation bias of correcting each of the model's deficiencies in cloud characteristics along the transect. A reduction in the bias is achieved by improving the agreement between modeled and observed in‐cloud liquid water path frequency distributions. In the cumulus regime, this is accomplished primarily by reducing the all‐sky water path, while for the stratocumulus regime, an underestimate of cloud cover and liquid water and an overestimate in effective radius and subgrid heterogeneity all contribute to a lack of reflected shortwave radiation.

54 ENVIRONMENTAL SCIENCES↗

Bayesian inference of nonlinear unsteady aerodynamics from aeroelastic limit cycle oscillations

A Bayesian model selection and parameter estimation algorithm is applied to investigate the influence of nonlinear and unsteady aerodynamic loads on the limit cycle oscillation (LCO) of a pitching airfoil in the transitional Reynolds number regime. At small angles of attack, laminar boundary layer trailing edge separation causes negative aerodynamic damping leading to the LCO. The fluid–structure interaction of the rigid, but elastically mounted, airfoil and nonlinear unsteady aerodynamics is represented by two coupled nonlinear stochastic ordinary differential equations containing uncertain parameters and model approximation errors. Several plausible aerodynamic models with increasing complexity are proposed to describe the aeroelastic system leading to LCO. The likelihood in the posterior parameter probability density function (pdf) is available semi-analytically using the extended Kalman filter for the state estimation of the coupled nonlinear structural and unsteady aerodynamic model. The posterior parameter pdf is sampled using a parallel and adaptive Markov Chain Monte Carlo (MCMC) algorithm. The posterior probability of each model is estimated using the Chib–Jeliazkov method that directly uses the posterior MCMC samples for evidence (marginal likelihood) computation. The Bayesian algorithm is validated through a numerical study and then applied to model the nonlinear unsteady aerodynamic loads using wind-tunnel test data at various Reynolds numbers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Review of Human Reliability Needs in the U.S. Nuclear Industry

In this survey, 34 subject matter experts from the U.S. nuclear industry were interviewed to determine specific needs for human reliability analysis (HRA). Conclusions from the interviews are detailed in this article. A summary of the findings includes: (1) The need for improved guidance on the use of HRA methods generally and for specific applications. (2) The need for additional training in HRA to provide more hands-on experience in the application of HRA methods. (3) Thedevelopment of HRA approaches suitable for advanced reactors, severe accident situations, and low-power and shutdown applications. (4) The refinement of HRA methods to account forfactors such as crew variability, latent errors, more sophisticated dependency modeling, and errors of commission. (5) The continued need for simplified HRA methods appropriate for field applications. (6) The need for tighter coupling of HRA and human factors. (7) The need for improvements in the quantitative basis of HRA methods. These findings suggest the field of HRA is mature but still benefits from refinements.

human reliability analysis↗

Bi-Level Arbitrage Potential Evaluation for Grid-Scale Energy Storage Considering Wind Power and LMP Smoothing Effect

Our paper deals with extended-term energy storage (ES) arbitrage problems to maximize the annual revenue in deregulated power systems with high penetration wind power. The conventional ES arbitrage model takes the locational marginal prices (LMP) as an input and is unable to account for the impacts of ES operations on system LMPs. This paper proposes a bi-level ES arbitrage model, where the upper level maximizes the ES arbitrage revenue and the lower level simulates the market clearing process considering wind power and ES. The bi-level model is formulated as a mathematical program with equilibrium constraints (MPEC) and then recast into a mixed-integer linear programming (MILP) using strong duality theory. Wind power fluctuations are characterized by the GARCH forecast model and the forecast error is modeled by forecast-bin based Beta distributions. Case studies are performed on a modified PJM 5-bus system and an IEEE 118-bus system with a weekly time horizon over an annual term to show the validity of the proposed bi-level model. The results from the conventional model and the bi-level model are compared under different ES power and energy ratings, and also various load and wind penetration levels.

17 WIND ENERGY↗

Back to Basics: First Principles of HRA

Human Reliability Analysis (HRA) continues to suffer from a myriad of technical gaps in its foundations. Core issues have been widely discussed but remain largely unaddressed, although the path taken to this point was paved with good intentions. Now, while this characterization may seem dramatic it is not intended to throw doubt onto HRA as a discipline or to diminish the value it has on increasing safety and resilience in nuclear power. Rather, it is intended to communicate that HRA has some serious challenges and is desperately in need of a critical evaluation. To quote Dougherty [1], “the misrepresentations that will undoubtedly arise may serve to provoke the necessary creativity.” What bears noting is that in the last thirty years since Alan Swain declared that “no adequate HRA had ever been done,” there has been little effort to correct the issues he highlighted. Human factors practice is still poorly implemented, many complex systems are fundamentally incompatible with reliable human performance, and there remains poor foundational support for many of the assumptions within HRA. We propose three categories of issues in HRA, philosophical, theoretical, and empirical and potential solutions to these issues.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

An investigation of error characteristics and coding performance

The first year's effort on NASA Grant NAG5-2006 was an investigation to characterize typical errors resulting from the EOS dorn link. The analysis methods developed for this effort were used on test data from a March 1992 White Sands Terminal Test. The effectiveness of a concatenated coding scheme of a Reed Solomon outer code and a convolutional inner code versus a Reed Solomon only code scheme has been investigated as well as the effectiveness of a Periodic Convolutional Interleaver in dispersing errors of certain types. The work effort consisted of development of software that allows simulation studies with the appropriate coding schemes plus either simulated data with errors or actual data with errors. The software program is entitled Communication Link Error Analysis (CLEAN) and models downlink errors, forward error correcting schemes, and interleavers.

Ebel, William J.↗

A Comparison of Land Surface Model Soil Hydraulic Properties Estimated by Inverse Modeling and Pedotransfer Functions

Soil hydraulic properties (SHPs) regulate the movement of water in the soil. This in turn plays an important role in the water and energy cycles at the land surface. At present, SHPS are commonly defined by a simple pedotransfer function from soil texture class, but SHPs vary more within a texture class than between classes. To examine the impact of using soil texture class to predict SHPS, we run the Noah land surface model for a wide variety of measured SHPs. We find that across a range of vegetation cover (5 - 80% cover) and climates (250 - 900 mm mean annual precipitation), soil texture class only explains 5% of the variance expected from the real distribution of SHPs. We then show that modifying SHPs can drastically improve model performance. We compare two methods of estimating SHPs: (1) inverse method, and (2) soil texture class. Compared to texture class, inverse modeling reduces errors between measured and modeled latent heat flux from 88 to 28 w/m(exp 2). Additionally we find that with increasing vegetation cover the importance of SHPs decreases and that the van Genuchten m parameter becomes less important, while the saturated conductivity becomes more important.

Gutmann, Ethan D.↗

An Optimal-Estimation-Based Aerosol Retrieval Algorithm Using OMI Near-UV Observations

An optimal-estimation(OE)-based aerosol retrieval algorithm using the OMI (Ozone Monitoring Instrument) near-ultraviolet observation was developed in this study. The OE-based algorithm has the merit of providing useful estimates of errors simultaneously with the inversion products. Furthermore, instead of using the traditional lookup tables for inversion, it performs online radiative transfer calculations with the VLIDORT (linearized pseudo-spherical vector discrete ordinate radiative transfer code) to eliminate interpolation errors and improve stability. The measurements and inversion products of the Distributed Regional Aerosol Gridded Observation Network campaign in northeast Asia (DRAGON NE-Asia 2012) were used to validate the retrieved aerosol optical thickness (AOT) and single scattering albedo (SSA). The retrieved AOT and SSA at 388 nm have a correlation with the Aerosol Robotic Network (AERONET) products that is comparable to or better than the correlation with the operational product during the campaign. The OEbased estimated error represented the variance of actual biases of AOT at 388 nm between the retrieval and AERONET measurements better than the operational error estimates. The forward model parameter errors were analyzed separately for both AOT and SSA retrievals. The surface reflectance at 388 nm, the imaginary part of the refractive index at 354 nm, and the number fine-mode fraction (FMF) were found to be the most important parameters affecting the retrieval accuracy of AOT, while FMF was the most important parameter for the SSA retrieval. The additional information provided with the retrievals, including the estimated error and degrees of freedom, is expected to be valuable for relevant studies. Detailed advantages of using the OE method were described and discussed in this paper.

Air Pollution↗

Development of a High Fidelity System Analysis Code for Generation IV Reactors

Traditional nuclear reactor system analysis codes such as RELAP and TRAC employ an operator split methodology. In this approach, each of the physics (fluid flow, heat conduction and neutron diffusion) is solved separately and the coupling terms are done explicitly. This approach limits accuracy (first order in time at best) and makes the codes slow in running since the explicit coupling imposes stability restrictions on the time step size. These codes have been extensively tested and validated for the existing LWRs. However, for GEN IV nuclear reactor designs which tend to have long lasting transients resulting from passive safety systems, the performance is questionable and modern high fidelity simulation tools will be required. The requirement for accurate predictability is the motivation for a large scale overhaul of all of the models and assumptions in transient nuclear reactor safety simulation software. At INL we have launched an effort with the long term goal of developing a high fidelity system analysis code that employs modern physical models, numerical methods, and computer science for transient safety analysis of GEN IV nuclear reactors. Modern parallel solution algorithms will be employed through utilizing the nonlinear solution software package PETSc developed by Argonne National Laboratory. The physical models to be developed will have physically realistic length scales and time scales. The solution algorithm will be based on the physics-based preconditioned Jacobian-free Newton-Krylov solution methods. In this approach all of the physical models are solved implicitly and simultaneously in a single nonlinear system. This includes the coolant flow, nonlinear heat conduction, neutron kinetics, and thermal radiation, etc. Including modern physical models and accurate space and time discretizations will allow the simulation capability to be second order accurate in space and in time. This paper presents the current status of the development efforts as well as some results from analyzing a simplified primary system model of GNEP’s advanced burner test reactor (ABTR) designed by Argonne. Various transient analyses are performed with this simplified ABTR model to study two fundamental issues related to system analysis codes – accuracy of numeric algorithm and efficiency. The accuracy study is carried by comparing the second order method with the first order method. The results show that numerical errors in the first order method are large and it is very difficult to distinguish numerical errors from physical modeling errors. On the other hand, second order method yields small numerical errors and it is very easy to spot physical modeling errors. The efficiency study is carried out by comparing the time steps for the fully implicit solution algorithm versus CFL stability limit methods. The dynamic time steps used in a fully implicit method will adjust the time step to resolve the time scale during the various stages of a long lasting transient. This will make a computer code based on fully implicit methods run more efficiently versus a CFL stability limit method code like RELAP, in which a particle of fluid cannot cross a control volume in a single time step.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A surrogate-based uncertainty quantification with quantifiable errors

Surrogate models are often employed to reduce the computational cost required to complete uncertainty quantification, where one is interested in propagating input parameters uncertainties throughout a complex engineering model to estimate responses uncertainties. An improved surrogate construction approach is introduced here which places a premium on reducing the associated computational cost. Unlike existing methods where the surrogate is constructed first, then employed to propagate uncertainties, the new approach combines both sensitivity and uncertainty information to render further reduction in the computational cost. Mathematically, the reduction is described by a range finding algorithm that identifies a subspace in the parameters space, whereby parameters uncertainties orthogonal to the subspace contribute negligible amount to the propagated uncertainties. Moreover, the error resulting from the reduction can be upper-bounded. The new approach is demonstrated using a realistic nuclear assembly model and compared to existing methods in terms of computational cost and accuracy of uncertainties. Although we believe the algorithm is general, it will be applied here for linear-based surrogates and Gaussian parameters uncertainties. The generalization to nonlinear models will be detailed in a separate article. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

PRECISION MEASUREMENTS OF THE CLUSTER RED SEQUENCE USING AN ERROR-CORRECTED GAUSSIAN MIXTURE MODEL

The red sequence is an important feature of galaxy clusters and plays a crucial role in optical cluster detection. Measurement of the slope and scatter of the red sequence are affected both by selection of red sequence galaxies and measurement errors. In this paper, we describe a new error-corrected Gaussian Mixture Model for red sequence galaxy identification. Using this technique, we can remove the effects of measurement error and extract unbiased information about the intrinsic properties of the red sequence. We use this method to select red sequence galaxies in each of the 13,823 clusters in the maxBCG catalog, and measure the red sequence ridgeline location and scatter of each. These measurements provide precise constraints on the variation of the average red galaxy populations in the observed frame with redshift. We find that the scatter of the red sequence ridgeline increases mildly with redshift, and that the slope decreases with redshift. We also observe that the slope does not strongly depend on cluster richness. Using similar methods, we show that this behavior is mirrored in a spectroscopic sample of field galaxies, further emphasizing that ridgeline properties are independent of environment. These precise measurements serve as an important observational check on simulations and mock galaxy catalogs. The observed trends in the slope and scatter of the red sequence ridgeline with redshift are clues to possible intrinsic evolution of the cluster red sequence itself. Most importantly, the methods presented in this work lay the groundwork for further improvements in optically based cluster cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗

Alternatives to accuracy and bias metrics based on percentage errors for radiation belt modeling applications

This report reviews existing literature describing forecast accuracy metrics, concentrating on those based on relative errors and percentage errors. We then review how the most common of these metrics, the mean absolute percentage error (MAPE), has been applied in recent radiation belt modeling literature. Finally, we describe metrics based on the ratios of predicted to observed values (the accuracy ratio) that address the drawbacks inherent in using MAPE. Specifically, we define and recommend the median log accuracy ratio as a measure of bias and the median symmetric accuracy as a measure of accuracy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Dynamic Modeling using Output-Error Parameter Estimation based on Frequency Responses Estimated with Multisine Inputs

A method is developed for estimating model parameters, such as nondimensional stability and control derivatives, by fitting transfer function or state-space models to empirical frequency response data using the output-error approach. The frequency response data were computed using Fourier transforms of measured input and output data. The control surfaces were excited with periodic multisine inputs which facilitated time-ecient estimation of multiple-input multiple-output frequency responses. The method was applied to lateral data from a nonlinear flight dynamics simulation of the F-16 aircraft, and to longitudinal data from multiple repeated flight test maneuvers of the NASA T-2 subscale aircraft. Results using simulation data showed the frequency response method compared well to other standard methods for parameter estimation. In addition to including all the available inputs, outputs, and harmonic frequencies in the estimation, relatively small subsets of the measured data could also be used to focus on identifying specific parts of the model. Results from flight test data showed that parameter estimates and uncertainties determined from repeated maneuvers were accurate and in statistical agreement with each other.

Grauer, Jared A.↗

Multi-fidelity thermal modeling of laser powder bed additive manufacturing

Laser powder bed fusion (LPBF) Additive manufacturing (AM) has attracted interest as an agile method of building production metal parts to reduce design-build-test cycle times for systems. However, predicting part performance is difficult due to inherent process variabilities. This makes qualification challenging. Computational process models have attempted to address some of these challenges, including mesoscale, full physics models and reduced fidelity conduction models. The goal of this work is credible multi-fidelity modeling of the LPBF process by investigating methods for estimating the error between models of two different fidelities. Two methods of error estimation are investigated, adjoint-based error estimation and Bayesian calibration. Adjoint-based error estimation is found to effectively bounding the error between the two models, but with very conservative bounds, making predictions highly uncertain. Bayesian parameter calibration applied to conduction model heat source parameters is found to effectively bound the observed error between the models for melt pool morphology quantities of interest. However, the calibrations do not effectively bound the error in heat distribution.

36 MATERIALS SCIENCE↗

The Impact of Truth Surrogate Variance on Quality Assessment/Assurance in Wind Tunnel Testing

Minimum data volume requirements for wind tunnel testing are reviewed and shown to depend on error tolerance, response model complexity, random error variance in the measurement environment, and maximum acceptable levels of inference error risk. Distinctions are made between such related concepts as quality assurance and quality assessment in response surface modeling, as well as between precision and accuracy. Earlier research on the scaling of wind tunnel tests is extended to account for variance in the truth surrogates used at confirmation sites in the design space to validate proposed response models. A model adequacy metric is presented that represents the fraction of the design space within which model predictions can be expected to satisfy prescribed quality specifications. The impact of inference error on the assessment of response model residuals is reviewed. The number of sites where reasonably well-fitted response models actually predict inadequately is shown to be considerably less than the number of sites where residuals are out of tolerance. The significance of such inference error effects on common response model assessment strategies is examined.

DeLoach, Richard↗