Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Analyzing the Calibration History of Radiometers for Determining Optimal Calibration Day(s)

This study investigates the effects of calibrating radiometers using one day or multiple cloudless days as recommended by ASTM and ISO standards. The results demonstrate good responsivity agreement with estimated uncertainty error bars over the years for various radiometers under various Broadband Outdoor Radiometer Calibration (BORCAL) events at both the National Renewable Energy Laboratory and the Southern Great Plains facility. The BORCAL method appears to justify the use of a single calibration day with enough data points to attain repeatable calibration results.

BORCAL↗

Utilizing the SACADA system to collect simulator training data to inform human reliability analyses - 169

Lack of appropriate human performance data for the development of human reliability analysis (HRA) methods has been identified as a key issue contributing to the method-to-method variability among the HRA methods. The United States Nuclear Regulatory Commission (NRC) worked with domain experts to develop the Scenario Authoring, Characterization, and Debriefing Application (SACADA) system to collect nuclear power plants' licensed operator simulator training and examination data to inform HRA. In the past two decades, significant improvements in understanding and modelling human performance in HRA have affected the perspectives of the types of data to be collected for HRA. A significant change is that human performance is strongly dependent on the context of the tasks to be performed. To incorporate this understanding, the SACADA data taxonomy collects the context and actual performance information of the training objective elements (TOEs) in nuclear plant operator simulator training. This provides a framework consistent with HRA to use context to estimate human error probabilities. It is recognized that measuring crew performance is equally important as improving operator training. SACADA is designed to support the nuclear trainers in capturing this important information that is used to identify training weaknesses and drive continuous improvement. This paper discusses the SACADA taxonomy, the SACADA system's functions, and the supporting software design to enable the SACADA system to be practically implemented in the nuclear power plants' operator simulator training program to collect data for tracking operator performance and HRA analysis. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Anomaly detection for cyber-physical systems

An anomaly detector is configured to construct cyber and/or physical features comprising information configured to characterize the cyber and/or physical state of a cyber-physical system. The physical features may be based on physical and/or physics-based relationships between a plurality of physical state attributes. A health of the cyber-physical system may be based on an error between estimates of one or more of the physical state attributes and measurements of the one or more physical state attributes. The relationships may be incorporated into machine learning membership functions used to classify cyber and/or physical behavior of the system.

Rieger, Craig G.↗

LHC Abort Gap Cleaning with the Transverse Damper

In the Large Hadron Collider –LHC, particles not captured by the RF system at injection or leaking out of the RF bucket may quench the superconducting magnets during beam abort. The problem, common to other superconducting machines, is particularly serious for the LHC due to the very large stored energy in the beam. For the LHC a way of removing the unbunched beam has been studied and it uses the existing damper kickers to excite resonantly the particles travelling along the abort gap. In this paper we describe the results of simulations performed with MAD-X for various LHC optics configurations, including the estimated multipolar errors.

Gianfelice-Wendt, E.↗

Qualitative and Quantitative Evaluation for Representative Human Reliability Analysis Methods

The Korea Institute of Nuclear Safety (KINS) is the regulatory expert organization established by the Korean government to strengthen the nation’s technical capabilities relating to nuclear safety regulation. KINS oversees the technical aspects of nuclear safety regulation, including safety reviews, inspections, education, and safety research—all conducted based on technical knowledge and accumulated regulatory experience. In 2023, KINS requested that Idaho National Laboratory (INL) validates representative human reliability analysis (HRA) methods used throughout the world, thus affording KINS with a basis for determining an HRA method adequate for its domestic regulatory purposes. The present paper mainly examines INL’s efforts in this regard. The resulting INL study covered four representative HRA methods widely used by nuclear utilities and regulatory institutes. These methods were qualitatively evaluated by applying specific evaluation criteria and determining how well each method reflected critical HRA issues. For this assessment, INL benchmarked the Halden International HRA Empirical Study. Using the Halden empirical data, along with information on human failure events (HFEs), the present study employed the selected HRA methods to estimate human error probabilities (HEPs) for the HFEs. It also performed statistical analyses to compare the HEPs predicted via the HRA methods against those from the Halden empirical data.

99 - GENERAL AND MISCELLANEOUS↗

Variational reactivity estimates: new analyses and new results

A modified form of the variational estimate of the reactivity worth ofa perturbation was previously developed to extend the range of applicability of variational perturbation theory for perturbations leading to negative reactivity worths. Recent numerical results challenged the assumptions behind the modified form. In this paper, more results are obtained, leading to the conclusion that sometimes the modified form extends the range ofapplicability of variational perturbation theory for positive reactivity worths as well, and sometimes the standard variational form is more accurate for negative-reactivity perturbations. In addition, this paper proves that using the exact generalized adjoint function would lead to an inaccurate variational reactivity estimate when the error in the first-order estimate is large; the standard generalized adjoint function, an approximation to the exact one, leads to Lore accurate results. This conclusion is also demonstrated numerically. Transport calculations use the PARTISN multi group discrete ordinates code

97 MATHEMATICS AND COMPUTING↗

Structure classification and melting temperature prediction in octet AB solids via machine learning

Machine learning methods are being increasingly used in condensed matter physics and materials science to classify crystals structures and predict material properties. However, the reliability of these methods for a given problem, especially when large data sets are unavailable, has not been well studied. By addressing the tasks of classifying crystal structure and predicting melting temperatures of the octet subset of AB solids, we performed such a study and found potential problems with using machine learning methods on relatively small data sets. At the same time, however, we can reaffirm the potential power of such methods for these tasks. In particular, we uncovered an important new material feature, the excess Born effective charge, that significantly increased the accuracy of the predictions for the classification problem we defined. This discovery leads us to propose a new scale for the degree of ionicity and covalency in these solids. More specifically, we partitioned the crystal structures of a set of 75 octet solids into those that are ionic and covalent bonded and thus performed a binary classification task. We found that using the standard indices (r σ ,r π ), suggested by St. John and Bloch several decades ago, enabled an average success in classification of 92%. Using just r σ and the excess Born effective charge ΔZ A of the A atom enabled an average success of 97%, but we also found relatively large variations about these averages that were dependent on how certain machine learning methods were used and for which a standard deviation was not a proper measure of the degree of confidence we can place in either average. Instead, we calculated and report with 95 % confidence that the traditional classification pair predicts an accuracy in the interval [ 89%, 95%] and the accuracy of the new pair lies in the interval [96 %, 99%]. For melting temperature predictions, the size of our data set was 46. We estimate the root-mean-squared error of our resulting model to be 11% of the mean melting temperature of the data, but we note that if the accuracy of this predicted error is itself measured, our estimated fitting error itself has a root-mean-square error of 50%. In short, what we illustrate is that classification and regression predictions can vary significantly, depending on the details of how machine learning methods are applied to small data sets. This variation makes it important, if not essential, to average the predictions and compute confidence intervals about these averages to report results meaningfully. However, when properly used, these statistical methods can advance our understanding and improve predictions of material properties even for small data sets.

36 MATERIALS SCIENCE↗

Learning concave-convex profiles of data transport over dedicated connections

Dedicated data transport infrastructures are increasingly being deployed to support distributed big-data and high-performance computing scenarios. These infrastructures employ data transfer nodes that use sophisticated software stacks to support network transport among sites, which often house distributed file and storage systems. Throughput measurements collected over such infrastructures for a range of round trip times (RTTs) reflect the underlying complex end-to-end connections, and have revealed dichotomous throughput profiles as functions of RTT. In particular, concave regions of throughput profiles at lower RTTs indicate near-optimal performance, and convex regions at higher RTTs indicate bottlenecks due to factors such as buffer or credit limits. We present a machine learning method that explicitly infers these concave and convex regions and transitions between them using sigmoid functions. We also provide distribution-free confidence estimates for the generalization error of these concave-convex profile estimates. Throughput profiles for data transfers over 10 Gbps connections with 0–366 ms RTT provide important performance insights, including the near optimality of transfers performed with the XDD tool between XFS filesystems, and the performance limits of wide-area Lustre extensions using LNet routers. A direct application of generic machine learning packages does not adequately highlight these critical performance regions or provide as precise confidence estimates.

Rao, Nageswara↗

Quantifying Rates of Erosion Using Historical Aerial Photos - 19478

Erosion can play an important role in the fate and transport of waste at sites where disposal of long-lived waste is anticipated. The statistical characterization of key processes related to erosion is essential to the understanding of site stability through time. In this work multi-temporal historical aerial images are analyzed in conjunction with orthophotography and Lidar data to develop probability distributions for variables representing important erosion processes. Scans of photographic negatives were obtained for multiple photographs and several negatives were scanned with a calibrated photogrammetric scanner by Geomni (formerly Blue Skies Consulting) in Belen, New Mexico. Other negatives were provided by USDA or scanned on a high-resolution, large format media scanner in the United States National Archives Cartographic Research Room, College Park, Maryland (1939). An additional set of aerial photographs was obtained from the USGS EROS Data Center web site. For other years, photographic prints were available for aerial photography. Several prints were scanned with a large-format media scanner at 1200 dpi. Ground control points for selected digital images used in the stereoscopic analyses were identified in ArcMap. Ground control points were collected by matching features which could be identified in the aerial photography as well as the orthophotography or shaded relief imagery from the Lidar dataset. Such features included fence line intersections, road intersections, railroad bridges, and structures, depending on the age of the photography. Many old fence lines and abandoned roads remained visible in the shaded relief imagery while they were completely obscured by tree canopy in modern photography. Ground control elevations were sampled from the Lidar-based DEM or directly from point clouds. The image coordinates and matching three-dimensional projected coordinates of the ground control points were exported to IDL where parameters for a three-dimensional direct linear transformation (DLT) were obtained. Built-in singular value decomposition routines were used to solve an overdetermined set of equations for the eleven parameters of the DLT for a particular historical photograph. A solution to the DLT parameters was obtained for each historical aerial photograph in which features of interest were identified using the stereoscope. Ultimately, this process resulted in the identification of locations for features like gully heads using both the Lidar dataset and projection of the estimated location from the historical aerial photo under consideration back to the Lidar dataset. The distance between the estimate of the location from the historical image and that of the Lidar dataset was the estimated distance the feature has moved. This distance was then divided by the number of years between the Lidar dataset and the year of the historical aerial image of interest to get a rate of movement through time. This was done for several dozen points on each historical aerial image. There was inevitable uncertainty associated with the estimation of points from the historical aerial imagery. This includes estimation of changes in locations of features like gully heads through time. In this work a method to estimate the uncertainty associated with measurements of locations of features using the stereoscopic analysis is developed and applied. For features with locations in space that do not change (e.g., road intersections, etc.) the difference in measurements of locations from the Lidar dataset and that of the estimate from the historical aerial image provides an observation of the measurement error. These points used to estimate the measurement error are referred to as control points. For each of the historical aerial images, a different measurement error distribution is estimated using control points. These measurement errors are combined with the estimated distances from the stereoscopic analyses to produce distributions of gully retreat rates and hillslope erosion rates used along with output from Erosion Working Group (EWG) Landscape Evolution Models (LEMs) to provide statistical probability distributions for input into the PPA Model. Specifically, gully head retreat rate and gully widening rate were characterized using statistical probability distributions. The central limit theorem was then applied to develop rates that represent long-term averages that are used to inform a PPA Model built in GoldSim. The importance of these rates with respect to characterization of future risk can then assessed using sensitivity analyses. This provides an approach to determine if subsequent reduction of the uncertainty associated with the probability distributions of erosion rates will correspond to meaningful reduction in the estimation of future risk from the site. Ultimately this is a general method that utilizes historical aerial imagery to estimate rates of erosion with uncertainty. This information can be used to inform PPA models to project future risks from a given site. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Mass imbalances in EPANET water-quality simulations

EPANET is widely employed to simulate water quality in water distribution systems. However, in general, the time-driven simulation approach used to determine concentrations of water-quality constituents provides accurate results only for short water-quality time steps. Overly long time steps can yield errors in concentration estimates and can result in situations in which constituent mass is not conserved. The use of a time step that is sufficiently short to avoid these problems may not always be feasible. The absence of EPANET errors or warnings does not ensure conservation of mass. This paper provides examples illustrating mass imbalances and explains how such imbalances can occur because of fundamental limitations in the water-quality routing algorithm used in EPANET. In general, these limitations cannot be overcome by the use of improved water-quality modeling practices. This paper also presents a preliminary event-driven approach that conserves mass with a water-quality time step that is as long as the hydraulic time step. Results obtained using the current approach converge, or tend to converge, toward those obtained using the preliminary event-driven approach as the water-quality time step decreases. Improving the water-quality routing algorithm used in EPANET could eliminate mass imbalances and related errors in estimated concentrations. Furthermore, the results presented in this paper should be of value to those who perform water-quality simulations using EPANET or use the results of such simulations, including utility managers and engineers.

54 ENVIRONMENTAL SCIENCES↗

Extreme metrics from large ensembles: investigating the effects of ensemble size on their estimates

Abstract. We consider the problem of estimating the ensemble sizes required to characterize the forced component and the internal variability of a number of extreme metrics. While we exploit existing large ensembles, our perspective is that of a modeling center wanting to estimate a priori such sizes on the basis of an existing small ensemble (we assume the availability of only five members here). We therefore ask if such a small-size ensemble is sufficient to estimate accurately the population variance (i.e., the ensemble internal variability) and then apply a well-established formula that quantifies the expected error in the estimation of the population mean (i.e., the forced component) as a function of the sample size n, here taken to mean the ensemble size. We find that indeed we can anticipate errors in the estimation of the forced component for temperature and precipitation extremes as a function of n by plugging into the formula an estimate of the population variance derived on the basis of five members. For a range of spatial and temporal scales, forcing levels (we use simulations under Representative Concentration Pathway 8.5) and two models considered here as our proof of concept, it appears that an ensemble size of 20 or 25 members can provide estimates of the forced component for the extreme metrics considered that remain within small absolute and percentage errors. Additional members beyond 20 or 25 add only marginal precision to the estimate, and this remains true when statistical inference through extreme value analysis is used. We then ask about the ensemble size required to estimate the ensemble variance (a measure of internal variability) along the length of the simulation and – importantly – about the ensemble size required to detect significant changes in such variance along the simulation with increased external forcings. Using the F test, we find that estimates on the basis of only 5 or 10 ensemble members accurately represent the full ensemble variance even when the analysis is conducted at the grid-point scale. The detection of changes in the variance when comparing different times along the simulation, especially for the precipitation-based metrics, requires larger sizes but not larger than 15 or 20 members. While we recognize that there will always exist applications and metric definitions requiring larger statistical power and therefore ensemble sizes, our results suggest that for a wide range of analysis targets and scales an effective estimate of both forced component and internal variability can be achieved with sizes below 30 members. This invites consideration of the possibility of exploring additional sources of uncertainty, such as physics parameter settings, when designing ensemble simulations.

54 ENVIRONMENTAL SCIENCES↗

Wrinkles in the rare biosphere: Pyrosequencing errors can lead to artificial inflation of diversity estimates

Massively parallel pyrosequencing of the small subunit (16S) ribosomal RNA gene has revealed that the extent of rare microbial populations in several environments, the 'rare biosphere', is orders of magnitude higher than previously thought. One important caveat with this method is that sequencing error could artificially inflate diversity estimates. Although the per-base error of 16S rDNA amplicon pyrosequencing has been shown to be as good as or lower than Sanger sequencing, no direct assessments of pyrosequencing errors on diversity estimates have been reported. Using only Escherichia coli MG1655 as a reference template, we find that 16S rDNA diversity is grossly overestimated unless relatively stringent read quality filtering and low clustering thresholds are applied. In particular, the common practice of removing reads with unresolved bases and anomalous read lengths is insufficient to ensure accurate estimates of microbial diversity. Furthermore, common and reproducible homopolymer length errors can result in relatively abundant spurious phylotypes further confounding data interpretation. We suggest that stringent quality-based trimming of 16S pyrotags and clustering thresholds no greater than 97% identity should be used to avoid overestimates of the rare biosphere.

59 BASIC BIOLOGICAL SCIENCES↗

Quantitative Measurement of Integrated Band Intensities of Benzene Vapor in the Mid-Infrared at 278, 298, and 323 K

Pressure broadened (1 atm. N2) laboratory spectra of benzene vapor (in natural abundance) were recorded at 278, 298, and 323 K, covering 600-6500 cm-1. The spectra were recorded at a resolution of 0.112 cm-1 using a commercial Fourier transform spectrometer. The pressure of each benzene vapor sample was measured using high precision capacitance manometers and a minimum of nine sample pressures were recorded for each temperature. The samples were introduced into a temperature-stabilized static cell (19.94(1) cm pathlength) that was hard-mounted into the spectrometer. From these data a fit composite spectrum was calculated for each temperature. The number density for the three composite spectra was normalized to 296 K. The spectra give the absorption cross section (cm2 molecule-1, naperian units) as a function of wavenumber. From these spectra integrated band intensities (cm molecule-1 and atm-1 cm-2) for intervals corresponding to the stronger benzene bands were calculated and are compared with previously reported values. We discuss and quantify error sources and estimate our systematic (NIST Type-B) errors to be 3% for the stronger bands. The measured absorption coefficients and integrated band intensities are useful for remote sensing applications such as measurements of planetary atmospheres and assessment of the environmental impact of terrestrial oil fire emissions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Shadow Lagrangian dynamics for superfluidity

Motivated by a similar approach for Born-Oppenheimer molecular dynamics, this paper proposes an extended "shadow" Lagrangian density for quantum states of superfluids. The extended Lagrangian contains an additional field variable that is forced to follow the wave function of the quantum state through a rapidly oscillating extended harmonic oscillator. By considering the adiabatic limit for large frequencies of the harmonic oscillator, we can derive the two equations of motions, a Schrödinger-type equation for the quantum state and a wave equation for the extended field variable. The equations are coupled in a nonlinear way, but each equation individually is linear with respect to the variable that it defines. The computational advantage of this new system is that it can be easily discretized using linear time stepping methods, where we propose to use a Crank-Nicolson-type approach for the Schrödinger equation and an extended leapfrog scheme for the wave equation. Furthermore, the difference between the quantum state and the extended field variable defines a consistency error that should go to zero if the frequency tends to infinity. By coupling the time-step size in our discretization to the frequency of the harmonic oscillator we can extract an easily computable consistency error indicator that can be used to estimate the numerical error without additional costs. The findings are illustrated in numerical experiments.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

An Adaptive Bayesian Parameter Estimation of a Synchronous Generator Under Gross Errors

Polynomial-chaos-expansion-based surrogate models have recently been advocated in the literature for power system dynamic parameter estimation. Regarding the estimation of the uncertain generator parameters, a Bayesian inference framework has been proposed based on a polynomial-based reduced-order representation of the synchronous machines using assumed parameter values. Then, the non-Gaussian posterior probability distribution functions (pdfs) of these parameters are recovered through the stochastic sampling approach efficiently. However, facing very large parameter errors, the reliability of the surrogate model decreases, yielding biased estimation results. To overcome this problem, here we develop hierarchical Bayesian inference framework that processes the measurements provided by phasor measurement units, while making use of multifidelity surrogates together with the importance sampling method. The latter allows us to estimate in an efficient manner the posterior pdfs of the uncertain parameters through the normalized weights of the prior samples. To improve the accuracy of the posterior pdfs, an adaptive procedure is further adopted in the importance sampling for the gradual evolution of its proposal functions. The new proposals assist in fine-tuning the sample space and thereby help to construct surrogates with higher fidelity. Through an iterative process, this approach is able to estimate accurately and efficiently non-Gaussian posterior pdfs of the uncertain generator parameters subject to gross errors.

42 ENGINEERING↗

2020 IEEE PES Innovative Smart Grid Technologies Europe (ISGT-Europe)

Recent proliferation of distributed energy sources in distribution or sub-transmission systems necessitates close monitoring of these three-phase power grids which typically operate under unbalanced loading conditions. Unlike the transmission systems where the network equations are commonly based on the positive sequence component models, a detailed three phase model will have to be used in implementing network applications for these systems. In the specific case of the state estimator, where measurement and parameter errors may bias the solution, bad data and parameter error detection algorithms should also be incorporated. Implementing the state estimator and error detection algorithms for three-phase systems impose additional computational burden and modifications to the state estimation code. This paper proposes a practical solution to avoid these issues by using synchronized phasor measurements and modal decoupling. The previously developed parameter error detection algorithm based on the normalized Lagrange multipliers (NLM) test is applied to the measurements independently in each mode in parallel, not only saving CPU time but also avoiding new code development for a three-phase estimator. Different parameter error scenarios are created and tested to verify the effectiveness of the proposed error detection approach.

Khalili, Ramtin↗

Stability analysis of an approximate scheme for moving horizon estimation.

We analyze the stability properties of an approximate algorithm for moving horizon estimation (MHE). The strategy provides instantaneous state estimates and is thus suitable for large-scale feedback control. In particular, we study the interplay between numerical approximation errors and the convergence of the estimator error. In addition, we establish connections between the numerical properties of the Hessian of the MHE problem and traditional observability definitions. We demonstrate the developments through a simulation case study.

99 GENERAL AND MISCELLANEOUS↗

A machine learning approach for efficient multi-dimensional integration

Many physics problems involve integration in multi-dimensional space whose analytic solution is not available. The integrals can be evaluated using numerical integration methods, but it requires a large computational cost in some cases, so an efficient algorithm plays an important role in solving the physics problems. We propose a novel numerical multi-dimensional integration algorithm using machine learning (ML). After training a ML regression model to mimic a target integrand, the regression model is used to evaluate an approximation of the integral. Then, the difference between the approximation and the true answer is calculated to correct the bias in the approximation of the integral induced by ML prediction errors. Because of the bias correction, the final estimate of the integral is unbiased and has a statistically correct error estimation. Three ML models of multi-layer perceptron, gradient boosting decision tree, and Gaussian process regression algorithms are investigated. The performance of the proposed algorithm is demonstrated on six different families of integrands that typically appear in physics problems at various dimensions and integrand difficulties. The results show that, for the same total number of integrand evaluations, the new algorithm provides integral estimates with more than an order of magnitude smaller uncertainties than those of the VEGAS algorithm in most of the test cases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗