SEARCH · Engineering Papers

Results for “Error estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Qualitative and Quantitative Evaluation for Representative Human Reliability Analysis Methods

The Korea Institute of Nuclear Safety (KINS) is the regulatory expert organization established by the Korean government to strengthen the nation’s technical capabilities relating to nuclear safety regulation. KINS oversees the technical aspects of nuclear safety regulation, including safety reviews, inspections, education, and safety research—all conducted based on technical knowledge and accumulated regulatory experience. In 2023, KINS requested that Idaho National Laboratory (INL) validates representative human reliability analysis (HRA) methods used throughout the world, thus affording KINS with a basis for determining an HRA method adequate for its domestic regulatory purposes. The present paper mainly examines INL’s efforts in this regard. The resulting INL study covered four representative HRA methods widely used by nuclear utilities and regulatory institutes. These methods were qualitatively evaluated by applying specific evaluation criteria and determining how well each method reflected critical HRA issues. For this assessment, INL benchmarked the Halden International HRA Empirical Study. Using the Halden empirical data, along with information on human failure events (HFEs), the present study employed the selected HRA methods to estimate human error probabilities (HEPs) for the HFEs. It also performed statistical analyses to compare the HEPs predicted via the HRA methods against those from the Halden empirical data.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

Extreme metrics from large ensembles: investigating the effects of ensemble size on their estimates

Abstract. We consider the problem of estimating the ensemble sizes required to characterize the forced component and the internal variability of a number of extreme metrics. While we exploit existing large ensembles, our perspective is that of a modeling center wanting to estimate a priori such sizes on the basis of an existing small ensemble (we assume the availability of only five members here). We therefore ask if such a small-size ensemble is sufficient to estimate accurately the population variance (i.e., the ensemble internal variability) and then apply a well-established formula that quantifies the expected error in the estimation of the population mean (i.e., the forced component) as a function of the sample size n, here taken to mean the ensemble size. We find that indeed we can anticipate errors in the estimation of the forced component for temperature and precipitation extremes as a function of n by plugging into the formula an estimate of the population variance derived on the basis of five members. For a range of spatial and temporal scales, forcing levels (we use simulations under Representative Concentration Pathway 8.5) and two models considered here as our proof of concept, it appears that an ensemble size of 20 or 25 members can provide estimates of the forced component for the extreme metrics considered that remain within small absolute and percentage errors. Additional members beyond 20 or 25 add only marginal precision to the estimate, and this remains true when statistical inference through extreme value analysis is used. We then ask about the ensemble size required to estimate the ensemble variance (a measure of internal variability) along the length of the simulation and – importantly – about the ensemble size required to detect significant changes in such variance along the simulation with increased external forcings. Using the F test, we find that estimates on the basis of only 5 or 10 ensemble members accurately represent the full ensemble variance even when the analysis is conducted at the grid-point scale. The detection of changes in the variance when comparing different times along the simulation, especially for the precipitation-based metrics, requires larger sizes but not larger than 15 or 20 members. While we recognize that there will always exist applications and metric definitions requiring larger statistical power and therefore ensemble sizes, our results suggest that for a wide range of analysis targets and scales an effective estimate of both forced component and internal variability can be achieved with sizes below 30 members. This invites consideration of the possibility of exploring additional sources of uncertainty, such as physics parameter settings, when designing ensemble simulations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Shadow Lagrangian dynamics for superfluidity

Motivated by a similar approach for Born-Oppenheimer molecular dynamics, this paper proposes an extended "shadow" Lagrangian density for quantum states of superfluids. The extended Lagrangian contains an additional field variable that is forced to follow the wave function of the quantum state through a rapidly oscillating extended harmonic oscillator. By considering the adiabatic limit for large frequencies of the harmonic oscillator, we can derive the two equations of motions, a Schrödinger-type equation for the quantum state and a wave equation for the extended field variable. The equations are coupled in a nonlinear way, but each equation individually is linear with respect to the variable that it defines. The computational advantage of this new system is that it can be easily discretized using linear time stepping methods, where we propose to use a Crank-Nicolson-type approach for the Schrödinger equation and an extended leapfrog scheme for the wave equation. Furthermore, the difference between the quantum state and the extended field variable defines a consistency error that should go to zero if the frequency tends to infinity. By coupling the time-step size in our discretization to the frequency of the harmonic oscillator we can extract an easily computable consistency error indicator that can be used to estimate the numerical error without additional costs. The findings are illustrated in numerical experiments.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2020

2020 IEEE PES Innovative Smart Grid Technologies Europe (ISGT-Europe)

Recent proliferation of distributed energy sources in distribution or sub-transmission systems necessitates close monitoring of these three-phase power grids which typically operate under unbalanced loading conditions. Unlike the transmission systems where the network equations are commonly based on the positive sequence component models, a detailed three phase model will have to be used in implementing network applications for these systems. In the specific case of the state estimator, where measurement and parameter errors may bias the solution, bad data and parameter error detection algorithms should also be incorporated. Implementing the state estimator and error detection algorithms for three-phase systems impose additional computational burden and modifications to the state estimation code. This paper proposes a practical solution to avoid these issues by using synchronized phasor measurements and modal decoupling. The previously developed parameter error detection algorithm based on the normalized Lagrange multipliers (NLM) test is applied to the measurements independently in each mode in parallel, not only saving CPU time but also avoiding new code development for a three-phase estimator. Different parameter error scenarios are created and tested to verify the effectiveness of the proposed error detection approach.

Khalili, Ramtin↗

DOE OSTI2021

A machine learning approach for efficient multi-dimensional integration

Many physics problems involve integration in multi-dimensional space whose analytic solution is not available. The integrals can be evaluated using numerical integration methods, but it requires a large computational cost in some cases, so an efficient algorithm plays an important role in solving the physics problems. We propose a novel numerical multi-dimensional integration algorithm using machine learning (ML). After training a ML regression model to mimic a target integrand, the regression model is used to evaluate an approximation of the integral. Then, the difference between the approximation and the true answer is calculated to correct the bias in the approximation of the integral induced by ML prediction errors. Because of the bias correction, the final estimate of the integral is unbiased and has a statistically correct error estimation. Three ML models of multi-layer perceptron, gradient boosting decision tree, and Gaussian process regression algorithms are investigated. The performance of the proposed algorithm is demonstrated on six different families of integrands that typically appear in physics problems at various dimensions and integrand difficulties. The results show that, for the same total number of integrand evaluations, the new algorithm provides integral estimates with more than an order of magnitude smaller uncertainties than those of the VEGAS algorithm in most of the test cases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2024

MultiPEM Toolbox: User Manual [Rev. 2]

This document explains use of the Multi-Phenomenology Explosion Monitoring (Multi PEM) Toolbox, a collection of R scripts for estimating the unknown device parameters of a new event with uncertainty quantification. The methodology and application used for illustration in this user manual are fully documented in a Los Alamos National Laboratory technical report hereafter designated “WPA” for reference. Additional details on the application are found in a recent journal article. Two assessment types are available: rapid and complete. Rapid assessments are conducted in two stages, as described in Section 2. In the first stage, calibration data are used to estimate forward and error model parameters (WPA, §5.1) and (if relevant) errors-in-variables yield values for calibration sources (WPA, §3, Equation (3)). In the second stage, new event data are used to estimate the unknown new event device parameters (WPA, §5.2) with uncertainty quantification. Two options for treating the inferred first stage parameters in second stage Bayesian analysis are available: fixing them at their maximum likelihood estimate (default), or multiple imputation. Multiple imputation involves utilizing several posterior samples (imputations) of the first stage parameters as fixed values in the second stage posterior sampling of the new event device parameters. Second stage sampling is conducted across imputations in parallel to improve computational efficiency. This method produces improved uncertainty quantification of the new event device parameters compared with the default treatment of the first stage parameters, at the expense of additional computation. Complete assessments are conducted in a single stage, as described in Section 3. Calibration and (if relevant) new event data are used simultaneously to estimate all forward model, error model, and (if relevant) new event device parameters with uncertainty quantification on the latter. As the name suggests, rapid assessments generally run substantially faster than complete assessments (even with multiple imputation), because the results of first stage analysis can be stored and incorporated into estimating a relatively low-dimensional space of new event device parameters whenever relevant new event data becomes available. On the other hand, complete assessments must be run on the full set of model and device parameters with calibration and new event data every time the latter becomes available.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Methods to determine the radiated power in SPI-mitigated disruptions in JET

Here we present techniques for evaluating the radiated power in JET disruptions. Disrupting plasmas are shown to have non-axisymmetric radiation profiles, motivating the re-evaluation of the standard techniques for calculating the total radiated power at JET using bolometry. Four single-channel bolometers at different toroidal locations are exploited to quantify the radiation asymmetry. Toroidal radiation peaking factors integrated over the entire disruption of up to 1.5 have been observed when varying the quantity of neon in pellets used in disruptions mitigated by shattered pellet injection. Using synthetic bolometer diagnostics developed with the Cherab spectroscopy modeling framework, we can estimate the systematic error on total power calculations for relevant radiation profiles and improve estimates of the total radiated power. We show that the component of the systematic error on the total power due to the poloidal radiation profile can be reduced from 70% to 10% with suitable assumptions about the structure of the poloidal profile.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Reactor Power Level Estimation by Fusing Multi-Modal Sensor Measurements

Estimates of the power level of a nuclear reactor based on measurements from an independent monitoring sensor system can help in the compliance verification of its declared operations. We present a three-level fusion method to estimate the power level of a nuclear reactor using features derived from infrared, electromagnetic, and acoustic sensor measurements collected in proximity to the reactor. Based on a simplified analytical model of the secondary coolant system of the reactor, we identify partial regression functions of the power level in terms of the temperature difference between inlet and outlet of coolant pipes, and the activity levels of four fans and four pumps, which are estimated as features from the sensor measurements. The power level estimator employs a combination of aggregate and complementary fusion steps at three levels to incorporate the multi-modal features in a structure that reflects the secondary cooling system and its partial regression functions. Using the measurements from a test campaign at an operational reactor, we show that this estimator achieves 3.47% or lower root mean square error under 5-fold cross validation. More generally, these results illustrate a progressive reduction in estimation error as additional modalities are appropriately incorporated, and that the fuser outperforms single modality features and their sub-combinations.

Rao, Nageswara↗

DOE OSTI2021

Clustering of CODEX clusters

The clustering of galaxy clusters links the spatial nonuniformity of dark matter halos to the growth of the primordial spectrum of perturbations. The amplitude of the clustering signal is widely used to estimate the halo mass of astrophysical objects. The advent of cluster mass calibrations enables using clustering in cosmological studies. Aims. We analyze the autocorrelation function of a large contiguous sample of galaxy clusters, the Constrain Dark Energy with X-ray (CODEX) sample, in which we take particular care of cluster definition. These clusters were X-ray selected using the ROentgen SATellite All-Sky Survey and then identified as galaxy clusters using the code redMaPPer run on the photometry of the Sloan Digital Sky Survey. We develop methods for precisely accounting for the sample selection effects on the clustering and demonstrate their robustness using numerical simulations. Methods. Using the clean CODEX sample, which was obtained by applying a redshift-dependent richness selection, we computed the two-point autocorrelation function of galaxy clusters in the 0.1 < z < 0.3 and 0.3 < z < 0.5 redshift bins. We compared the bias in the measured correlation function with values obtained in numerical simulations using a similar cluster mass range. Results. By fitting a power law, we measured a correlation length r 0 = 18.7 ± 1.1 and slope γ = 1.98 ± 0.14 for the correlation function in the full redshift range. By fixing the other cosmological parameters to their nine-year Wilkinson Microwave Anisotropy Probe values, we reproduced the observed shape of the correlation function under the following cosmological conditions: Ω m0 = $0.22_{-0.03}^{+0.04}$ and S 8 = σ 8 (Ω m0 /0.3)0.5 = $0.85_{-0.08}^{+0.10}$ with estimated additional systematic errors of σ Ω m0 = 0.02 and σS 8 = 0.20. We illustrate the complementarity of clustering constraints by combining them with CODEX cosmological constraints based on the X-ray luminosity function, deriving Ωm = 0.25 ± 0.01 and σ 8 = $0.81_{-0.02}^{+0.01}$ with an estimated additional systematic error of σ Ω m0 = 0.07 and σ σ8 = 0.04. The mass calibration and statistical quality of the mass tracers are the dominant source of uncertainty.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

New Insights Into Error Decomposition for Precipitation Products

Abstract It is very important to quantify errors of precipitation estimation products. However, the existing methods do not describe all error components and are therefore not comprehensive enough. In this study, we propose a four‐component error decomposition method (4CED) that decomposes the total errors of precipitation products into four independent parts: hit positive bias, hit negative bias, false bias, and missed bias. And we use it to evaluate the performance of the three latest satellite precipitation products in the eastern monsoon region of China. Our study reveals 4CED has apparent improvements compared with the previous method. Results also provide new insights for tracking error sources and quantifying the error magnitudes of precipitation products. Moreover, the proposed 4CED can be extended to different spatial and temporal scales. Our new method will not only contribute to product upgrades, but also provide guidance for potential applications.

58 GEOSCIENCES↗

DOE OSTI2022

A Variational Method for Analyzing Vortex Flows in Radar-Scanned Tornadic Mesocyclones. Part III: Sensitivities to Vortex Center Location Errors

Abstract When the vortex center location is estimated from a radar-scanned tornadic mesocyclone, the estimated location is not error-free. This raises an important issue concerning the sensitivities of analyzed vortex flow (VF) fields by the VF-Var (formulated in Part I of this paper series and tested in Part II) to vortex center location errors, denoted by Δ x c . Numerical experiments are performed to address this issue with the following findings: The increase of |Δ x c | from zero to a half of vortex core radius causes large analysis error increases in the vortex core but the increased analysis errors decrease rapidly away from the vortex core especially for dual-Doppler analyses. The increased horizontal-velocity errors in the vortex core are mainly in the Δ x c -normal component, because this component varies much more rapidly than the other component along the Δ x c direction in the vortex core. The vertical variations of Δ x c distort the vertical correlation structure of Δ x c -dislocated VF-dependent background error covariance, which can increase the analysis errors in the vortex core. The dual-Doppler analyses have adequate accuracies outside the vortex core even when |Δ x c | increases to a half of vortex core radius, while single-Doppler analyses can also have adequate accuracies outside the vortex core mainly for the single-Doppler-observed velocity component. The sensitivities to Δ x c are largely unaffected by the vortex slanting. The above findings are important and useful for assessing the accuracies of analyzed VFs for real radar-observed tornadic mesocyclones. Significance Statement When the vortex center location is estimated from a radar-scanned tornadic mesocyclone, the estimated location is not error-free. This raises an issue concerning the sensitivity of analyzed vortex flow (VF) by the VF-Var (formulated in Part I of this paper series and tested with simulated radar observations in Part II) to vortex center location error. This issue and its required investigations are very important for the VF-Var to be applied to real radar-observed tornadic mesocyclones, especially in an operational setting with the WSR-88Ds. Numerical experiments are performed to address this issue. The findings from these experiments are important and useful for assessing the accuracies of VF-Var analyzed VF fields for real radar-observed tornadic mesocyclones.

Xu, Qin↗

DOE OSTI2023

A study of examiner accuracy in cartridge case comparisons. Part 1: Examiner error rates

This report describes a study undertaken to estimate examiner (not laboratory) error rates for false Identifications and false Eliminations when comparing an unknown to a collection of three known cartridge cases. Volunteer active examiners with Association of Firearm and Toolmark Examiners (AFTE) membership or working in laboratories that participate in the Association of Crime Laboratory Directors (ASCLD) were provided with 15 sets of three known and one questioned cartridge cases fired from a collection of 25 new Ruger SR9 handguns. Remington 9-mm Luger (manufacturer designation L9MM3) ammunition was used and comparison sets were made up of cartridge cases fired within 100 cartridges of each other for each gun. Examiners were provided with a background survey, an answer sheet allowing for the AFTE Range of Conclusions, and return shipping materials. In addition to determining whether the known and questioned cartridge cases were fired with the same handgun, examiners were also asked to assess how many of the three knowns in each set were suitable for comparison, providing an estimated rate of how often each firearm used in the study produces useable, quality marks. The participating examiners were provided with both same-source and different-source comparison sets allowing the study to assess both error rates. Responses were received from 218 participating examiners. The overall rate of false Eliminations was estimated as 0.367% from comparisons known to be from the same firearm but reported as Eliminations. The overall rate of false Identifications was estimated as 1.01% from comparisons known to be from different firearms but reported as Identifications. The rates are not uniform across the sample population with a few examiners providing most of the false Identification responses. Rates of poor-quality mark production varied across the 25 sample handguns; those rates were 2.3% (±1.4%). Both false Elimination and false Identification rates are comparable to or lower than the rate of production of poor-quality marks by the firearms used in this study.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2020

High-Pressure Apparatus for Monitoring Solid–Liquid Phase Transitions

This work presents a new technique for observing the solid–liquid phase transformations in complex diesel fuel blends and diesel surrogates under high-pressure conditions intended to simulate those occurring in vehicle fuel injectors. A high-pressure apparatus based on a visual identification of freezing and thawing has been designed and built to monitor phase behavior and determine the crystallization temperature of complex fuels to predict wax precipitation. The proposed methodology was validated using pure substances—n-hexadecane (C16H34), cyclohexane (C6H12), and a binary cyclohexane/n-hexadecane mixture—all of which have been well-characterized previously. The crystallization temperatures of these compounds were measured from atmospheric pressure to 400 MPa for temperatures varying from 290 to 363 K and compared to those reported in the literature. The standard error of the estimated temperatures, based on a given pressure, between the experimental data obtained in this work was compared to data in the literature from Domanska et al. This methodology is being extended to investigate the properties of more complex fuel mixtures.

High-Pressure, phase change, diesel, solidificatio↗

DOE OSTI2022

Machine Learning Derived Dynamic Operating Reserve Requirements in High-Renewable Power Systems

Accurately forecasting wind and solar power output poses challenges for deeply decarbonized electricity systems. Grid operators must commit resources to provide reserves to ensure reliable operations in the face of forecast errors, a process which can increase fuel consumption and emissions. We apply neural network-based machine learning to expand the usefulness of median point forecast data by creating probabilistic distributions of short-term uncertainty in demand, wind, and solar forecasts that adapt to prevailing grid conditions. Machine learning derived estimates of forecast errors compare favorably to estimates based on incumbent methods. Reserves derived from machine learning are usually smaller than values derived using incumbent methods, which enables fuel savings during most hours. Machine learning reserves are generally larger than incumbent reserves during times of higher forecast error, potentially improving system reliability. Performance is tested using multi-stage production simulation modeling of the California Independent System Operator (CAISO) system. Machine learning reserves provide production cost and greenhouse gas (GHG) emission reductions of approximately 0.3% relative to historical 2019 requirements. Savings in the 2030 timeframe are highly dependent on battery storage capacity. At lower levels of battery capacity, savings of 0.4% from machine learning reserves are shown. Significant quantities of battery storage are expected to be added to meet California's resource adequacy needs and GHG reduction targets. Addition of these batteries saturate reserve needs and results in minimal within-hour balancing costs in 2030.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

A probability density function model describing height estimation uncertainty due to image pixel intensity noise in digital fringe projection measurements

Digital fringe projection is a surface-profiling technique used for highly accurate non-contact measurements. As with any measurement technique, a variety of sources degrade to the measurement accuracy of the method. Here, this paper presents an analytically-derived probability density function that explicitly models the surface height measurement error due to inevitable phase measurement error, and it includes the specific case of pixel noise inducing the phase measurement error that ultimately leads to the height estimation error. The accuracy of the model was validated through Monte-Carlo simulations of resultant height distributions subject to arbitrarily correlated pixel intensity noise and experimental digital fringe projection measurements where the pixel-by-pixel height uncertainty estimations were compared to the predictions of the derived model.

42 ENGINEERING↗

DOE OSTI2023

Enter Gaussian Mixture Modeling Extensions for Improved False Discovery Rate Estimation in GC-MS Metabolomics

Identifying small molecules (e.g., metabolites) is key towards driving scientific advancement in metabolomics, and gas chromatography–mass spectrometry (GC-MS) is an analytic method that may be applied to facilitate this process. The typical GC-MS identification workflow involves quantifying the similarity of an observed sample spectrum and other features (e.g. retention index) to that of several references, noting the compound of the best-matching reference spectrum as the identified metabolite. While a deluge of similarity metrics exists, none characterize the error rate of generated identifications, thereby presenting an unknown risk of false identification or discovery. To quantify this unknown risk, we propose a model-based framework for estimating the false discovery rate (FDR) among a set of identifications. Extending the traditional mixture modeling framework, our method incorporates both similarity score and experimental information in estimating the FDR. We apply these models to identification lists derived from across 548 samples of varying complexity and sample type (e.g., fungal species, standard mixtures, etc.), comparing their performance to that of the traditional Gaussian mixture model (GMM). Through simulation, we additionally assess the impact of reference library size on the accuracy of FDR estimates. In comparing the best performing model extensions to the GMM, our results indicate relative decreases in median absolute estimation error (MAE) ranging from 12% to 70%, based on comparisons of the median MAEs across all hit-lists. Results indicate that these relative performance improvements generally hold despite library size, however FDR estimation error typically worsens as the set of reference compounds diminishes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

\texttt{qec\_code\_sim}: An open-source Python framework for estimating the effectiveness of quantum-error correcting codes on superconducting qubits

Quantum computers are highly susceptible to errors due to unintended interactions with their environment. It is crucial to correct these errors without gaining information about the quantum state, which would result in its destruction through back-action. Quantum Error Correction (QEC) provides information about occurred errors without compromising the quantum state of the system. However, the implementation of QEC has proven to be challenging due to the current performance levels of qubits -- break-even requires fabrication and operation quality that is beyond the state-of-the-art. Understanding how qubit performance factors into the success of a QEC code is a valuable exercise for tracking progress towards fault-tolerant quantum computing. Here we present \texttt{qec\_code\_sim}, an open-source, lightweight Python framework for studying the performance of small quantum error correcting codes under the influence of a realistic error model appropriate for superconducting transmon qubits, with the goal of enabling useful hardware studies and experiments. \texttt{qec\_code\_sim} requires minimal software dependencies and prioritizes ease of use, ease of change, and pedagogy over execution speed. As such, it is a tool well-suited to small teams studying systems on the order of one dozen qubits.

Lopez, Santiago↗

DOE OSTI2024

Towards optimal sensor placement for inverse problems in spaces of measures

The objective of this work is to quantify the reconstruction error in sparse inverse problems with measures and stochastic noise, motivated by optimal sensor placement. To be useful in this context, the error quantities must be explicit in the sensor configuration and robust with respect to the source, yet relatively easy to compute in practice, compared to a direct evaluation of the error by a large number of samples. In particular, we consider the identification of a measure consisting of an unknown linear combination of point sources from a finite number of measurements contaminated by Gaussian noise. The statistical framework for recovery relies on two main ingredients: first, a convex but non-smooth variational Tikhonov point estimator over the space of Radon measures and, second, a suitable mean-squared error based on its Hellinger–Kantorovich distance to the ground truth. To quantify the error, we employ a non-degenerate source condition as well as careful linearization arguments to derive a computable upper bound. This leads to asymptotically sharp error estimates in expectation that are explicit in the sensor configuration. Thus they can be used to estimate the expected reconstruction error for a given sensor configuration and guide the placement of sensors in sparse inverse problems.

97 MATHEMATICS AND COMPUTING↗