Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

Model Evaluation by Measurements from Collocated Remote Sensors in Complex Terrain

Model improvement efforts involve an evaluation of changes in model skill in response to changes in model physics and parameterization. When using wind measurements from various remote sensors to determine model forecast accuracy, it is important to understand the effects of measurement-uncertainty differences among the sensors resulting from differences in the methods of measurement, the vertical and temporal resolution of the measurements, and the spatial variability of these differences. Here we quantify instrument measurement variability in 80-m wind speed during WFIP2 and its impact on the calculated errors and the change in error from one model version to another. Here the model versions tested involved updates in model physics from HRRRv1 to HRRRv4, and reductions in grid interval from 3 km to 750 m. Model errors were found to be 2–3 m s –1 . Differences in errors as determined by various instruments at each site amounted to about 10% of this value, or 0.2–0.3 m s –1 . Changes in model skill due to physics or grid-resolution updates also differed depending on the instrument used to determine the errors; most of the instrument-to-instrument differences were ~0.1 m s –1 , but some reached 0.3 m s –1 . All instruments at a given site mostly showed consistency in the sign of the change in error. In two examples, though, the sign changed, illustrating a consequence of differences in measurements: errors determined using one instrument may show improvement in model skill, whereas errors determined using another instrument may indicate degradation. This possibility underscores the importance of having accurate measurements to determine the model error.

54 ENVIRONMENTAL SCIENCES↗

Comparison of Optical Modelling Tools for Sunshape and Surface Slope Error

The sunshape and mirror surface slope error are two main factors that influence the characteristics of incoming and reflected solar beams in a solar concentrator. Different optical modelling tools, however, address these two factors with different methods and simplifications. In this study, simulation methods are reviewed in five optical modelling tools, namely SolTrace, Tonatiuh, Tracer, Heliosim and SolarPILOT. A series of simple test cases are simulated in each tool to compare and verify the implementation of sunshape and slope error models separately. This strategy has successfully identified discrepancies among the tools and contributed to a better understanding of their reasons. It has also uncovered few glitches in some of those tools and contributed to improve them. It is our hope that this study will help to resolve common misconceptions, to build confidence amongst CSP researches on the accuracy of tools with which they have less experience, and to ensure better agreement in optical modelling work in future.

14 SOLAR ENERGY↗

Fitting dynamic models to the Geosat sea level observations in the tropical Pacific Ocean. I - A free wave model

Free, equatorially trapped sinusoidal wave solutions to a linear model on an equatorial beta plane are used to fit the Geosat altimetric sea level observations in the tropical Pacific Ocean. The Kalman filter technique is used to estimate the wave amplitude and phase from the data. The estimation is performed at each time step by combining the model forecast with the observation in an optimal fashion utilizing the respective error covariances. The model error covariance is determined such that the performance of the model forecast is optimized. It is found that the dominant observed features can be described qualitatively by basin-scale Kelvin waves and the first meridional-mode Rossby waves. Quantitatively, however, only 23 percent of the signal variance can be accounted for by this simple model.

Fu, Lee-Lueng↗

Inspection error and its adverse effects - A model with implications for practitioners

Inspection error has clearly been shown to have adverse effects upon the results desired from a quality assurance sampling plan. These effects upon performance measures have been well documented from a statistical point of view. However, little work has been presented to convince the QC manager of the unfavorable cost consequences resulting from inspection error. This paper develops a very general, yet easily used, mathematical cost model. The basic format of the well-known Guthrie-Johns model is used. However, it is modified as required to assess the effects of attributes sampling errors of the first and second kind. The economic results, under different yet realistic conditions, will no doubt be of interest to QC practitioners who face similar problems daily. Sampling inspection plans are optimized to minimize economic losses due to inspection error. Unfortunately, any error at all results in some economic loss which cannot be compensated for by sampling plan design; however, improvements over plans which neglect the presence of inspection error are possible. Implications for human performance betterment programs are apparent, as are trade-offs between sampling plan modification and inspection and training improvements economics.

Collins, R. D., Jr.↗

Evaluating skill in predicting the Interdecadal Pacific Oscillation in initialized decadal climate prediction hindcasts in E3SMv1 and CESM1 using two different initialization methods and a small set of start years

Abstract It is a daunting challenge to conduct initialized hindcasts with enough ensemble members and associated start years to form a drifted climatology from which to compute the anomalies necessary to quantify the skill of the hindcasts when compared to observations. This limits the ability to experiment with case studies and other applications where only a few initial years are needed. Here we run a set of hindcasts with CESM1 and E3SMv1 using two different initialization methods for a limited set of start years and use the respective uninitialized free-running historical simulations to form the model climatologies. Since the drifts from the observed initial states in the hindcasts toward the uninitialized model state are large and rapid, after a few years the drifted initialized models approach the uninitialized model climatological errors. Therefore, hindcasts from the limited start years can use the uninitialized climatology to represent the drifted model states after about lead year 3, providing a means to compute forecast anomalies in the absence of a large hindcast sample. There is comparable skill for predicting spatial patterns of multi-year Pacific sea surface temperature anomalies in the domain of the Interdecadal Pacific Oscillation using this method compared to the conventional methodology with a large hindcast data set, though there is a model dependence to the drifts in the two initialization methods.

54 ENVIRONMENTAL SCIENCES↗

Joint Seasonal ARMA Approach for Modeling of Load Forecast Errors in Planning Studies

To make informed and robust decisions in the probabilistic power system operation and planning process, it is critical to conduct multiple simulations of the generated combinations of wind and load parameters and their forecast errors to handle the variability and uncertainty of these time series. In order for the simulation results to be trustworthy, the simulated series must preserve the salient statistical characteristics of the real series. In this paper, we analyze day-ahead load forecast error data from multiple balancing authority locations and characterize statistical properties such as mean, standard deviation, autocorrelation, correlation between series, time-of-day bias, and time-of-day autocorrelation. We then construct and validate a seasonal autoregressive moving average (ARMA) model to model these characteristics, and use the model to jointly simulate day-ahead load forecast error series for all BAs.

Power system planning, Operations, Probabilistic m↗

A model for the prediction of latent errors using data obtained during the development process

A model implemented in a program that runs on the IBM PC for estimating the latent (or post ship) content of a body of software upon its initial release to the user is presented. The model employs the count of errors discovered at one or more of the error discovery processes during development, such as a design inspection, as the input data for a process which provides estimates of the total life-time (injected) error content and of the latent (or post ship) error content--the errors remaining a delivery. The model presented presumes that these activities cover all of the opportunities during the software development process for error discovery (and removal).

Gaffney, J. E., Jr.↗

Macquarie Island Cloud and Radiation Experiment (MICRE) Science Plan

Clouds over the Southern Ocean are poorly represented in present day reanalysis products and global climate model simulations. Errors in top-of-atmosphere (TOA) broadband radiative fluxes in this region are among the largest globally, with large implications for modeling both regional and global scale climate responses (e.g., Trenberth and Fasullo 2010, Ceppi et al. 2012). Recent analyses of model simulations suggest that model radiative errors in the Southern Ocean are due to a lack of low-level postfrontal clouds (including clouds well behind the front) and perhaps a lack of supercooled liquid water that contribute most to the model biases (Bodas-Salcedo et al. 2013, Huang et al. 2014). These assessments of model performance, as well as our knowledge of cloud and aerosol properties over the Southern Ocean, rely heavily on satellite data sets. Satellite data sets are incomplete in that the observations are not continuous (i.e., they are acquired only when the satellite passes nearby), generally do not sample the diurnal cycle, and view primarily the tops of cloud systems (especially for the passive instruments). This is especially problematic for retrievals of aerosol, low-cloud properties, and layers of supercooled water embedded within (rather than at the top of) clouds, as well as estimates of surface shortwave and longwave fluxes based on these properties.

Marchand, RT↗

New error calibration tests for gravity models using subset solutions and independent data - Applied to GEM-T3

A new method has been developed to provide a direct test of the error calibrations of gravity models based on actual satellite observations. The basic approach projects the error estimates of the gravity model parameters onto satellite observations, and the results of these projections are then compared with data residual computed from the orbital fits. To allow specific testing of the gravity error calibrations, subset solutions are computed based on the data set and data weighting of the gravity model. The approach is demonstrated using GEM-T3 to show that the gravity error estimates are well calibrated and that reliable predictions of orbit accuracies can be achieved for independent orbits.

Lerch, F. J.↗

[MODIS Investigation]

Our first activity is based on delivery of code to Bob Evans (University of Miami) for integration and eventual delivery to the MODIS Science Data Support Team. As we noted in our previous semi-annual report, coding required the development and analysis of an end-to-end model of fluorescence line height (FLH) errors and sensitivity. This model is described in a paper in press in Remote Sensing of the Environment. Once the code was delivered to Miami, we continue to use this error analysis to evaluate proposed changes in MODIS sensor specifications and performance. Simply evaluating such changes on a band by band basis may obscure the true impacts of changes in sensor performance that are manifested in the complete algorithm. This is especially true with FLH that is sensitive to band placement and width. The error model will be used by Howard Gordon (Miami) to evaluate the effects of absorbing aerosols on the FLH algorithm performance. Presently, FLH relies only on simple corrections for atmospheric effects (viewing geometry, Rayleigh scattering) without correcting for aerosols. Our analysis suggests that aerosols should have a small impact relative to changes in the quantum yield of fluorescence in phytoplankton. However, the effect of absorbing aerosol is a new process and will be evaluated by Gordon.

Abbott, Mark R.↗

A new adaptive modeling strategy based on optimal control for atomic-to-continuum coupling simulations

A new adaptive method based on an optimal control approach is proposed for adaptive modeling of an atomic-to-continuum coupling method constructed from the Arlequin framework. The coupling method provides for an approximation of the solution to a fully atomic model in which errors may arise due to the misplacement of the overlap region. The objective is thus to determine, a posteriori, the best position of this overlap region. More precisely, the problem is to find the optimal size of the atomic region that one needs to consider in the coupled formulation in order to accurately estimate predefined quantities of interest. In this new adaptive process, the position of the overlapping domain between the two models is conveniently parameterized and iteratively determined by searching for the optimal parameters. The performance of the method is demonstrated on one-dimensional and two-dimensional test problems. In particular, it is observed that the approach yields better convergence with respect to quantities of interest when compared to a classical adaptive approach based on a posteriori estimates of the modeling error.

97 MATHEMATICS AND COMPUTING↗

Analysis of a Shock-Associated Noise Prediction Model Using Measured Jet Far-Field Noise Data

A code for predicting supersonic jet broadband shock-associated noise was assessed using a database containing noise measurements of a jet issuing from a convergent nozzle. The jet was operated at 24 conditions covering six fully expanded Mach numbers with four total temperature ratios. To enable comparisons of the predicted shock-associated noise component spectra with data, the measured total jet noise spectra were separated into mixing noise and shock-associated noise component spectra. Comparisons between predicted and measured shock-associated noise component spectra were used to identify deficiencies in the prediction model. Proposed revisions to the model, based on a study of the overall sound pressure levels for the shock-associated noise component of the measured data, a sensitivity analysis of the model parameters with emphasis on the definition of the convection velocity parameter, and a least-squares fit of the predicted to the measured shock-associated noise component spectra, resulted in a new definition for the source strength spectrum in the model. An error analysis showed that the average error in the predicted spectra was reduced by as much as 3.5 dB for the revised model relative to the average error for the original model.

Dahl, Milo D.↗

Analysis of a Shock-Associated Noise Prediction Model Using Measured Jet Far-Field Noise Data

A code for predicting supersonic jet broadband shock-associated noise was assessed us- ing a database containing noise measurements of a jet issuing from a convergent nozzle. The jet was operated at 24 conditions covering six fully expanded Mach numbers with four total temperature ratios. To enable comparisons of the predicted shock-associated noise component spectra with data, the measured total jet noise spectra were separated into mixing noise and shock-associated noise component spectra. Comparisons between predicted and measured shock-associated noise component spectra were used to identify de ciencies in the prediction model. Proposed revisions to the model, based on a study of the overall sound pressure levels for the shock-associated noise component of the mea- sured data, a sensitivity analysis of the model parameters with emphasis on the de nition of the convection velocity parameter, and a least-squares t of the predicted to the mea- sured shock-associated noise component spectra, resulted in a new de nition for the source strength spectrum in the model. An error analysis showed that the average error in the predicted spectra was reduced by as much as 3.5 dB for the revised model relative to the average error for the original model.

Dahl, Milo D.↗

Using the Diffusion Equation to Predict CST Resin Breakthroughs - 19051

The crystalline silicotitanate, CST, resin manufactured by UOP Honeywell is well-suited for single-use decontamination of caustic liquid wastes at Hanford and Savannah River Sites. There are many measurements of column loading and breakthrough for CST resin decontamination of Cs-137 in various Hanford and SRS waste simulants. Such measurements provide a very good basis for estimating CST resin demand and these more refined predictions make the CST column loading as efficient as possible given the very expensive CST resin. Although there are a variety of tools for predicting chromatographic resin column performance, [1-4], there is a particularly useful method that is suitable as a simple spreadsheet model [4]. This spreadsheet model is an analytical error function for the mass transfer zone (mtz) diffusion width in resin columns and is well-suited for resin breakthrough and column loading. This paper describes just such an error function spreadsheet model and how well the error function agrees with more traditional models and fits the observed small scale breakthrough curves for CST that can then better predict large scale column loading efficiency. The very high sorption of Cs onto CST tends to be slower than that of other lower sorption resins and as a result of the slow CST kinetics, there is also a marked asymmetry in many CST breakthrough curves. The CST breakthrough asymmetry is largely due to the distribution of CST particle sizes because smaller particles sorb much faster than larger particles. It is then the smaller particles that determine the leading mtz at a decontamination factor of 1,000 breakthrough and therefore the decontamination efficiency for a given loading. The larger CST particles correspondingly determine the tailing mtz width and therefore the overall loading efficiency and it is important to model both leading and tailing mtz widths to best optimize CST for a particular Cs-137 decontamination application. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Multiscale analysis in solids with unseparated scales: fine-scale recovery, error estimation, and coarse-scale adaptivity

There are several engineering applications in which the assumptions of homogenization and scale separation may be violated, in particular, for metallic structures constructed through additive manufacturing. Instead of resorting to direct numerical simulation of the macroscale system with an embedded fine scale, an alternative approach is to use an approximate macroscale constitutive model, but then estimate the model-form error using a posteriori error estimation techniques and subsequently adapt the macroscale model to reduce the error for a given boundary value problem and quantity of interest. Here, we investigate this approach to multiscale analysis in solids with unseparated scales using the example of an additively manufactured metallic structure consisting of a polycrystalline microstructure that is neither periodic nor statistically homogeneous. As a first step to the general nonlinear case, we focus here on linear elasticity in which each grain within the polycrystal is linear elastic but anisotropic.

42 ENGINEERING↗

FOREGROUND MODEL AND ANTENNA CALIBRATION ERRORS IN THE MEASUREMENT OF THE SKY-AVERAGED λ21 cm SIGNAL AT z∼ 20

The most promising near-term observable of the cosmic dark age prior to widespread reionization (z ∼ 15-200) is the sky-averaged λ21 cm background arising from hydrogen in the intergalactic medium. Though an individual antenna could in principle detect the line signature, data analysis must separate foregrounds that are orders of magnitude brighter than the λ21 cm background (but that are anticipated to vary monotonically and gradually with frequency, e.g., they are considered {sup s}pectrally smooth{sup )}. Using more physically motivated models for foregrounds than in previous studies, we show that the intrinsic spectral smoothness of the foregrounds is likely not a concern, and that data analysis for an ideal antenna should be able to detect the λ21 cm signal after subtracting a ∼fifth-order polynomial in log ν. However, we find that the foreground signal is corrupted by the angular and frequency-dependent response of a real antenna. The frequency dependence complicates modeling of foregrounds commonly based on the assumption of spectral smoothness. Our calculations focus on the Large-aperture Experiment to detect the Dark Age, which combines both radiometric and interferometric measurements. We show that statistical uncertainty remaining after fitting antenna gain patterns to interferometric measurements is not anticipated to compromise extraction of the λ21 cm signal for a range of cosmological models after fitting a seventh-order polynomial to radiometric data. Our results generalize to most efforts to measure the sky-averaged spectrum.

79 ASTRONOMY AND ASTROPHYSICS↗

TU-H-CAMPUS-JeP3-05: Adaptive Determination of Needle Sequence HDR Prostate Brachytherapy with Divergent Needle-By-Needle Delivery

Purpose: To develop a new method which adaptively determines the optimal needle insertion sequence for HDR prostate brachytherapy involving divergent needle-by-needle dose delivery by e.g. a robotic device. A needle insertion sequence is calculated at the beginning of the intervention and updated after each needle insertion with feedback on needle positioning errors. Methods: Needle positioning errors and anatomy changes may occur during HDR brachytherapy which can lead to errors in the delivered dose. A novel strategy was developed to calculate and update the needle sequence and the dose plan after each needle insertion with feedback on needle positioning errors. The dose plan optimization was performed by numerical simulations. The proposed needle sequence determination optimizes the final dose distribution based on the dose coverage impact of each needle. This impact is predicted stochastically by needle insertion simulations. HDR procedures were simulated with varying number of needle insertions (4 to 12) using 11 patient MR data-sets with PTV, prostate, urethra, bladder and rectum delineated. Needle positioning errors were modeled by random normally distributed angulation errors (standard deviation of 3 mm at the needle’s tip). The final dose parameters were compared in the situations where the needle with the largest vs. the smallest dose coverage impact was selected at each insertion. Results: Over all scenarios, the percentage of clinically acceptable final dose distribution improved when the needle selected had the largest dose coverage impact (91%) compared to the smallest (88%). The differences were larger for few (4 to 6) needle insertions (maximum difference scenario: 79% vs. 60%). The computation time of the needle sequence optimization was below 60s. Conclusion: A new adaptive needle sequence determination for HDR prostate brachytherapy was developed. Coupled to adaptive planning, the selection of the needle with the largest dose coverage impact increases chances of reaching the clinical constraints. M. Borot de Battisti is funded by Philips Medical Systems Nederland B.V.; M. Moerland is principal investigator on a contract funded by Philips Medical Systems Nederland B.V.; G. Hautvast and D. Binnekamp are fulltime employees of Philips Medical Systems Nederland B.V.

60 APPLIED LIFE SCIENCES↗

Membrane Distillation Modeling Progress Report Fiscal Year 2016

Membrane distillation is a water purification technology which uses a porous hydrophobic membrane. Liquid water cannot penetrate the membrane at operational pressures but vapor flows through the membrane if there is a vapor pressure difference across the membrane. Many configurations for membrane distillation have been investigated over the last several decades. In this modeling effort, two successful direct contact membrane model development using steady-state control volume balances on energy and mass are presented. Verification and validation of the models is applied to the extent necessary to use the models for comparative design purposes. Significant errors between modeling and experimental membrane distillation data are argued to be due to uncertainty in membrane material property measurements. A second effort to model a vacuum membrane distillation system designed by Memsys® is still progressing. Two efforts have not yet produced output mass flow comparable to the literature. Even so, much of the framework needed to model the Memsys® system is complete.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗