Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error estimation and analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Microkinetic Modeling: A Tool for Rational Catalyst Design

The design of heterogeneous catalysts relies on understanding the fundamental surface kinetics that controls catalyst performance, and microkinetic modeling is a tool that can help the researcher in streamlining the process of catalyst design. Microkinetic modeling is used to identify critical reaction intermediates and rate-determining elementary reactions, thereby providing vital information for designing an improved catalyst. In this review, we summarize general procedures for developing microkinetic models using reaction kinetics parameters obtained from experimental data, theoretical correlations, and quantum chemical calculations. We examine the methods required to ensure the thermodynamic consistency of the microkinetic model. We describe procedures required for parameter adjustments to account for the heterogeneity of the catalyst and the inherent errors in parameter estimation. We discuss the analysis of microkinetic models to determine the rate determining reactions using the degree of rate control and reversibility of each elementary reaction. We introduce incorporation of Brønsted–Evans–Polanyi relations and scaling relations in microkinetic models and the effects of these relations on catalytic performance and formation of volcano curves. We review the analysis of reaction schemes in terms of the maximum rate of elementary reactions, and we outline a procedure to identify kinetically significant transition states and adsorbed intermediates. Here, we explore the application of generalized rate expressions for the prediction of optimal binding energies of important surface intermediates and to estimate the extent of potential rate improvement. We also explore the application of microkinetic modeling in homogeneous catalysis, electro-catalysis, and transient reaction kinetics. We conclude by highlighting the challenges and opportunities in the application of microkinetic modeling for catalyst design.

42 ENGINEERING↗
DOE OSTI2021

System Calibration Including Time Delay Estimation for GNSS/INS-Assisted Pushbroom Scanners Onboard UAV Platforms

Unmanned aerial vehicles (UAVs ) equipped with imaging sensors and integrated global navigation satellite system/inertial navigation system (GNSS/INS ) units are used for numerous applications. Deriving reliable 3D coordinates from such UAVs is contingent on accurate geometric calibration, which encompasses the estimation of mounting parameters and synchronization errors. Through a rigorous impact analysis of such systematic errors, this article proposes a direct approach for spatial and temporal calibration (estimating system parameters through a bundle adjustment procedure) of a GNSS/INS -assisted pushbroom scanner onboard a UAV platform. The calibration results show that the horizontal and vertical accuracies are within the ground sampling distance of the sensor. Unlike for frame camera systems, this article also shows that the indirect approach is not a feasible solution for pushbroom scanners due to their limited ability for decoupling system parameters. This finding provides further support that the direct approach is recommended for spatial and temporal calibration of UAV pushbroom scanner systems.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

A Modeling Toolkit for Comparing AC and DC Electrical Distribution Efficiency in Buildings

Recently, there has been considerable research interest in the potential for DC distribution systems in buildings instead of the traditional AC distribution systems. Due to the need for performing power conversions between DC and AC electricity, DC distribution may provide electrical efficiency advantages in some systems. To support comparative evaluations of AC-only, DC-only, and hybrid AC/DC distribution systems in buildings, a new modeling toolkit called the Building Electrical Efficiency Analysis Model (BEEAM) was developed and is described in this paper. To account for harmonics in currents or voltages arising from nonlinear devices, the toolkit implements harmonic power flow, along with nonlinear device behavioral descriptions derived from empirical measurements. This paper describes the framework, network equations, device representations, and an implementation of the toolkit in an open source software package, including a component library and graphical interface for creating circuits. Simulations of electrical behavior and device and system efficiencies using the toolkit are compared with experimental measurements of a small office environment in a variety of operating and load configurations. A detailed analysis of uncertainty estimation is also provided. Key findings were that a comparison of predicted versus measured efficiencies and power losses in the validation testbed using the initial toolkit implementation predicted device- and system-level efficiencies with reasonably good accuracy under both balanced and unbalanced AC scenarios. An uncertainty analysis also revealed that the maximum estimated error for system efficiency across all scenarios was 3%, and measured and modeled system efficiency agreed within the experimental uncertainty in approximately half of the scenarios. Based on the correspondence between simulation and measurement, the toolkit is proposed by the authors as a potentially useful tool for comparing efficiency in AC, DC, and hybrid AC/DC distribution systems in buildings.

DC distribution↗
DOE OSTI2024

Optimal 1D Ly α forest power spectrum estimation – III. DESI early data

ABSTRACT The 1D power spectrum P1D of the Ly α forest provides important information about cosmological and astrophysical parameters, including constraints on warm dark matter models, the sum of the masses of the three neutrino species, and the thermal state of the intergalactic medium. We present the first measurement of P1D with the quadratic maximum likelihood estimator (QMLE) from the Dark Energy Spectroscopic Instrument (DESI) survey early data sample. This early sample of 54 600 quasars is already comparable in size to the largest previous studies, and we conduct a thorough investigation of numerous instrumental and analysis systematic errors to evaluate their impact on DESI data with QMLE. We demonstrate the excellent performance of the spectroscopic pipeline noise estimation and the impressive accuracy of the spectrograph resolution matrix with 2D image simulations of raw DESI images that we processed with the DESI spectroscopic pipeline. We also study metal line contamination and noise calibration systematics with quasar spectra on the red side of the Ly α emission line. In a companion paper, we present a similar analysis based on the Fast Fourier Transform estimate of the power spectrum. We conclude with a comparison of these two approaches and discuss the key sources of systematic error that we need to address with the upcoming DESI Year 1 analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Red–green–blue Boolean image analysis of particulate debris laced with luminescent tracers

Abstract Particulate mass estimation from 3-pixel images is desirable in many fields. Red–green–blue (RGB) analysis and Boolean logic were shown to estimate the mass of luminescent tracers in microscopic images. With a controlled background intensity, an estimation error of 1.8 to 3.5% was achieved; in uncontrolled backgrounds, an error of about 18% was achieved. RGB analysis is a valuable tool for spatial location of particulates. This work shows it is possible to estimate the particulate mass in an image and gives RGB an extension into mass quantification that has far-reaching impacts in fields involving the fate and transport of particulate matter. Graphical abstract

36 MATERIALS SCIENCE↗
DOE OSTI2026

Measuring orbit responses with oscillating trajectories in the Fermilab Linac

Recording changes in beam transverse positions and longitudinal phase reported by Beam Position Monitors (BPMs) in response to a beam deflection by an upstream dipole corrector or RF cavity phase (orbit response) is a powerful tool for analysis of accelerator optics and assisting with machine tuning. In Fermilab Linac, orbit responses were recorded by oscillating the corrector currents and cavity phases in a sinusoidal manner parasitically during regular operation, simultaneously oscillating up to 19 correctors and 7 cavities at distinct frequencies, providing faster, drift-resistant measurements through frequency-domain analysis. This report describes the technique, including error estimations and consistency checks and shows examples of the measurements.

Shemyakin, Alexander [Fermilab] (ORCID:00000001501↗
DOE OSTI2025

Measuring Orbit Responses with Oscillating Trajectories in the Fermilab Linac

Recording changes in beam transverse positions re-ported by Beam Position Monitors (BPMs) in response to a beam deflection by an upstream dipole corrector (orbit response) is a powerful tool for analysis of accelerator optics and assisting with machine tuning. In the Fermilab Linac, orbit responses are recorded by oscillating the currents of up to 19 correctors, providing faster, drift-resistant measurements through frequency-domain analysis. This report describes the technique, including error estimations and consistency checks and shows an example of the measurements.

Shemyakin, Alexander V. [Fermilab] (ORCID:00000001↗
DOE OSTI2023

A study of examiner accuracy in cartridge case comparisons. Part 2: Examiner use of the AFTE range of conclusions

Here, this report describes an analysis of how examiners used the Association of Firearm and Toolmark Examiners (AFTE) Range of Conclusions in a controlled study undertaken to estimate examiner error rates in comparing cartridge cases. Results of the error rate analysis are reported in [1]; this paper focuses on a broader analysis of how the entire collection of classification categories, especially those in the Inconclusive range, were used by the participating examiners. Volunteer active examiners with AFTE membership or working in laboratories that participate in Association of Crime Laboratory Directors (ASCLD) were provided with 15 sets of three known and one questioned cartridge cases fired from a collection of 25 new Ruger SR9 handguns. Remington 9-mm Luger (manufacturer designation L9MM3) ammunition was used and comparison sets were made up of cartridge cases fired within 100 cartridges of each other for each gun. Examiners were provided with a background survey, an answer sheet allowing for the AFTE Range of Conclusions, and return shipping materials. The participating examiners were provided with both same-source and different-source comparison sets allowing the study to assess both error rates. Responses were received from 218 participating examiners. The overall rate of false-negatives was estimated as 0.367 % from comparisons known to be from the same firearm but reported as eliminations. The overall rate of false-positives was estimated as 1.01 % from comparisons known to be from different firearms but reported as identifications. In the case of true different-source examinations, it is clear that the three Inconclusive categories and the Elimination category are not used consistently by all examiners. We identify five different apparent patterns of use of the AFTE Range of Conclusions scale, and discuss possible reasons for and implications of these differences.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

A 1 km soil moisture dataset over eastern CONUS generated by assimilating SMAP data into the Noah-MP land surface model

An improved fine-scale soil moisture (SM) dataset at 1 km grid spacing, covering much of the eastern continental US, was generated by assimilating 9 km Soil Moisture Active Passive (SMAP) SM data into the v4.0.1 Noah-MP land surface model. With 12 ensemble members, the assimilation was carried out using the ensemble Kalman filter algorithm within NASA's Land Information System. The SM analysis for 2016 was fully validated against in situ observations from four different networks and compared with four other existing datasets. Results indicate that this SM analysis surpasses other datasets in top-layer SM distribution, including a machine-learning-based product, despite all SM estimates being less heterogeneous than observed. The analysis of anomalous errors suggests that large similarity in intrinsic errors is likely due to overlapping data sources among the selected SM datasets. More detailed evaluations were performed over two geographic areas. The observations collected by the Atmospheric Radiation Measurement facility in Oklahoma suggest that soil temperature and surface heat fluxes are concurrently simulated with good accuracy. Investigation into the 2016 southeastern US drought response further indicates drier conditions and higher evapotranspiration estimates compared to GLEAMv4.1. Notably, large errors are associated with grids having clay soil textures, underscoring the need for refined model treatments for specific soil types to further improve SM estimates. The dataset is publicly available on Zenodo at https://doi.org/10.5281/zenodo.14370563 (Tai et al., 2024).

Tai, Sheng-Lun [Pacific Northwest National Laborat↗
DOE OSTI2026

Unsupervised anomaly detection in MeV ultrafast electron diffraction

MeV ultrafast electron diffraction (MUED) is a pump-probe technique used to study the dynamic structural evolution of materials. An ultrashort laser pulse triggers structural changes, which are then probed by an ultrashort relativistic electron beam. To overcome low signal-to-noise ratios, diffraction patterns are averaged over thousands of shots. However, shot-to-shot instabilities in the electron beam can distort individual patterns, introducing uncertainty. Improving MUED accuracy requires detecting and removing these anomalous patterns from large datasets. In this work, we developed a fully unsupervised methodology for the detection of anomalous diffraction patterns. Using a convolutional autoencoder, we calculate the reconstruction mean squared error of the diffraction patterns. Based on the statistical analysis of this error, we provide the user an estimation of the probability that the pattern is normal, which also allows a posterior visual inspection of the images that are difficult to classify. This method has been trained with only 100 diffraction patterns and tested on 1521 patterns, resulting in a false positive rate between 0.2% and 0.4%, with a training time of 10 s per image and a test time of about 1 s per image. Here, the proposed methodology can also be applied to other diffraction techniques in which large datasets are collected that include faulty images due to instrumental instabilities.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Real-Time Distribution System State Estimation with Asynchronous Measurements

We report state estimation is a fundamental task in power systems. Although distribution systems are increasingly equipped with sensing devices and smart meters, measurements are typically reported at different rates and asynchronously; these aspects pose severe strains on workhorse state estimation algorithms, which are designed to process batches of data collected in a synchronous manner from all the measurement units. In this paper, we develop a novel state estimation algorithm to continuously update the estimate of the state based on measurements received in an asynchronous manner from measurement units. The synthesis of the algorithm hinges on a proximal-point type method, implemented in an online fashion, and capable of processing measurements received sequentially from sensors. A performance analysis is presented by providing bounds on the estimation error in terms of the mean and variance that hold at each iteration and asymptotically. The scheme is also compared with a more traditional Weighted Least Squares estimator that compensates for the lack of measurement data by using, as pseudo measurements, the measurement retrieved during a certain time window. Numerical simulations on the IEEE 37-bus feeder corroborate the analytical findings.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Estimating the Contributions to Human Error Probability from the Convolution of the Distribution of Time Available and Time Required

As part of their duties, Human Reliability Analysis must often evaluate if crews in nuclear power plants (NPPs) can complete tasks associated with a human-failure event within time limits. For example, the time required in NPP scenarios is determined by systematic and structured walkthroughs, feasibility studies, recorded times from training exercises, and interviews with experienced operators and experts. Typically, a point estimate is derived for the estimate (mean, maximum, or 95th percentile of time required). Using point-estimate values can mask the risk associated with variability among crews, plant conditions and set-up, environmental conditions, and other impact factors under which these actions are executed. While point estimates for time required and time available have served the industry well, without considering the uncertainty they could lead to biased understanding about the risk. The Integrated Human Event Analysis System - General Methodology (IDHEAS-G) model (developed by the US Nuclear Regulatory Commission, NRC) for human error probability calculates human error probability by summing two probabilities: insufficient time and cognitive error. As such, the model takes a more holistic approach by considering the full distributions for time required and time available to calculate the human error probability because the time available to complete the task is insufficient. In this study, we expand on the work of the NRC and discuss methods for estimating these time considerations. For example, for the time required, the impact of Performance Influencing Factors (PIFs) on the distribution was divided into impacts that are aleatory in nature, such as crew-to-crew variability, and those that are epistemic (i.e., the PIFs). Starting with the factors that introduce aleatory uncertainty, a first-order distribution was developed from a large set of time required (i.e., NPP task completion times) data for the range of operator actions that occur in the NPP control room under simulated accident conditions. The first-order distribution can then be adjusted to account for epistemic uncertainty using research associated with the impact of applicable PIFs on the time required. We also develop guidance for analysts to address the probability distributions for the time available. The guidance we developed on how to estimate time required and time available distributions is based on the identification of pertinent research and data, data analyses, and expert knowledge elicitation.

human error probability, human performance, time e↗
DOE OSTI2022

A Framework to Integrate Human Reliability Data Obtained from Different Sources Based on the Complexity Scores of Proceduralized Tasks

For many decades, PSA (Probabilistic Safety Assessment) or PRA (Probabilistic Risk Assessment) techniques have been used to enhance the operational safety of nuclear power plants (NPPs) based on the consideration of potential hazards that could result in an unexpected consequence. As human error is one of the potential hazards, diverse human reliability analysis (HRA) methods have been proposed to provide a systematic way to estimate the likelihood of human errors (i.e., human error probability, HEP) in specific task contexts. Accordingly, it is evident that the quality of HRA results strongly depends on the credibility of HEP estimations. This implies that, in terms of enhancing this credibility, the collection of raw information (HRA data) that is helpful for understating when and why human errors occur is a crucial issue. In order to address this issue, in this study, the feasibility of a framework to integrate HRA data obtained from different sources is investigated based on the complexity of proceduralized tasks.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

FPDetect: Efficient Reasoning About Stencil Programs Using Selective Direct Evaluation

We present FPDetect, a low-overhead approach for detecting logical errors and soft errors affecting stencil computations without generating false positives. We develop an offline analysis that tightly estimates the number of floating-point bits preserved across stencil applications. This estimate rigorously bounds the values expected in the data space of the computation. Violations of this bound can be attributed with certainty to errors. FPDetect helps synthesize error detectors customized for user-specified levels of accuracy and coverage. FPDetect also enables overhead reduction techniques based on deploying these detectors coarsely in space and time. Experimental evaluations demonstrate the practicality of our approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Gate Set Tomography

Gate set tomography (GST) is a protocol for detailed, predictive characterization of logic operations (gates) on quantum computing processors. Early versions of GST emerged around 2012-13, and since then it has been refined, demonstrated, and used in a large number of experiments. This paper presents the foundations of GST in comprehensive detail. The most important feature of GST, compared to older state and process tomography protocols, is that it is calibration-free . GST does not rely on pre-calibrated state preparations and measurements. Instead, it characterizes all the operations in a gate set simultaneously and self-consistently, relative to each other. Long sequence GST can estimate gates with very high precision and efficiency, achieving Heisenberg scaling in regimes of practical interest. In this paper, we cover GST's intellectual history, the techniques and experiments used to achieve its intended purpose, data analysis, gauge freedom and fixing, error bars, and the interpretation of gauge-fixed estimates of gate sets. Our focus is fundamental mathematical aspects of GST, rather than implementation details, but we touch on some of the foundational algorithmic tricks used in the pyGSTi implementation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Dedicated beam position monitor pair for model-independent lattice characterization at NSLS-II

This paper reports recent lattice characterization results obtained at the National Synchrotron Light Source II (NSLS-II) storage ring, conducted without reliance on a lattice model. A pair of beam position monitors (BPMs) with bunch-by-bunch (B$\times$B) resolution, were recently installed in a section of the storage ring free of magnetic fields. The new BPM pair measured the beam, or bunch’s transverse Poincaré map precisely after the beam was excited. Linear one-turn-matrices (OTM) were then derived, and from these, the 4-dimensional coupled Twiss parameters were extracted at the locations of the BPM pair. By normalizing beam oscillation amplitudes with the Twiss parameters, the global action-variables were obtained. Additionally, these action-variables facilitated the measurement of the local Twiss parameters observed by other BPMs independent on lattice model. This method is general, and particularly useful in certain scenarios such as a round beam mode in a diffraction-limited light source ring. We applied it to assess both weakly and strongly coupled lattices at the NSLS-II ring. Through analysis of the strongly coupled lattice, the quadrupole tilt errors were estimated to be less than 400 μrad. Utilizing the BPMs’ B$\times$B resolution, for the first time we observed the variations of the linear lattice along a long bunch-train.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Automated label flows for excited states of correlation functions in lattice gauge theory

Extracting excited states from lattice gauge theory correlation functions can be achieved through $χ^2$ minimization fits or algebraic approaches such as the variational method and Prony's method. Performing any kind of error analysis often leads to overlapping confidence regions of model parameters, even when the spectrum is not particularly dense. To correctly estimate errors, one must beware of mislabeling the states. In this work, we provide an algorithm that we call automated label flows which consistently and systematically identifies a deterministic labeling of states. This is a black-box approach in the sense that it gives a sensible set of labels without user guidance. Further, as an example, we pair one black box method with another, analyzing a lattice correlation function from real data using automated label flows in the context of Prony's method.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗