Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A Data-Fusion Method using Bayesian Approach to Enhance Raw Data Accuracy of Position and Distance Measurements for Connected Vehicles

Accurate positioning of vehicles is a critical element of autonomous and connected vehicle systems. Most of other studies heavily focused on enhancing simultaneous localization and mapping (SLAM) methods, i.e., constructing or updating a map of an unknown environment and tracking an object within the map. This paper provides a method that can, in addition to existing SLAM or relevant methods, enhance the raw measurements of position and distance. The basic idea of this study is to identify and update the error distribution of each data source by combining all available information. A Bayesian approach was incorporated to estimate and update the error distribution of individual data sources or sensors. The proposed method can be conducted in real-time environments, and a self-learning scheme determines whether enough data has been collected to further improve the accuracy of such measurements. The simulated experiments show that the proposed model noticeably improves the accuracy of position and distance measurements. Especially, the estimated biases of position coordinates and distance measures are very close to the biases of true error distributions, with the R-squared over 0.98. A similar approach can also be utilized to enhance accuracy of other sensors or measurements in connected vehicle or relevant systems, where multi-data sources are available.

Lim, Hyeonsup↗
DOE OSTI2021

Robust Distributed State Estimator for Interconnected Transmission and Distribution Networks (Final Report RPPR-1)

This project’s objective is to develop a combined transmission and distribution state estimator which accounts for very large system size and model complexity (by way of distributing the computations) and large number of solar PV units connected to the distribution system on multiple feeders. The project not only provides a robust formulation and solution to this problem but also tests the solution by implementing it on a well-established large utility system. It introduces several improvements with respect to the state of the art in existing state estimation software: (a) The developed state estimator (SE) allows robust and accurate monitoring of bidirectional flows in distribution systems which result due to the distributed energy sources which are not observable and thus not incorporated in generation dispatch; (b) Large utility systems with tens of thousands of transmission buses and hundreds of thousands of distribution nodes are difficult to model as a single integrated system. This shortcoming is addressed by developing a “scalable distributed computational framework” which allows splitting the ultra large system models into several small subsystems and coordinating their solution by a robust and practical state estimation formulation; (c) Measurement errors irrespective of their locations are detected and removed by the developed state estimator. Historically, transmission and distribution systems were analyzed and operated as two independent systems. Given the non-transposed short feeder sections, unevenly loaded phases, strictly radial configuration and unidirectional power flows in the absence of remote generation, distribution system analysis was customized to account for these characteristics. However, some of these assumptions are no longer valid (non-radial configuration, bidirectional power flows) and thus distribution system analysis should be revisited. Furthermore, in the past, the interaction between the transmission and distribution systems was quite passive, where distribution substations were modeled as lumped loads in the transmission system model. With substantial generation injected by renewable generation located in the distribution systems, such modeling will no longer be accurate. The developed state estimator facilitates proper monitoring of the interactions between the transmission and distribution systems and enables smart dispatch of these units which are made observable by the state estimator.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

On the convergence of statistics in simulations of stationary incompressible turbulent flows

When reporting statistics from simulations of statistically stationary chaotic phenomenon, it is important to verify that the simulations are time-converged. This condition is connected with the statistical error or number of digits with which statistics can be reliably reported. In this work we consider numerical experiments of low Reynolds number incompressible homogeneous and isotropic turbulence as a model problem to investigate statistical convergence over finite simulation times. Specifically, we investigate the time integration requirements that allow meaningful reporting of the statistical error associated with finiteness of the temporal domain. We address two key questions: (1) How long should a simulation be performed in terms of large eddy time, and (2) How should the simulation time be divided among temporal windows over which a quantity of interest is estimated so that its statistical error could be reliably reported? We find that reliable reporting of statistical errors requires simulations on the order of 10 4 large eddy times, which is orders of magnitude longer than typically performed. Additionally, data post-processing should employ windows of at least ten times the large eddy time scale, with the most robust computation of statistical error of the mean requiring window sizes of an additional factor of ten. For practical simulations, we demonstrate that it is possible to estimate the statistical error within a factor of two under a less stringent condition in which a minimum of four windows with size at least ten large eddy times are used. In conclusion, our observations for homogeneous isotropic turbulence are also shown to hold in turbulent channel flow.

42 ENGINEERING↗
DOE OSTI2021

Success of digital adiabatic simulation with large Trotter step

The simulation of adiabatic evolution has deep connections with adiabatic quantum computation, the quantum approximate optimization algorithm, and adiabatic state preparation. Here we address the error analysis problem in quantum simulation of adiabatic process using Trotter formulas. Here we show that with additional conditions, the circuit depth can be linear in simulation time T. The improvement comes from the observation that the fidelity error here can't be estimated by the norm distance between evolution operators. This phenomenon is termed the robustness of discretization in digital adiabatic simulation. It can be explained in three steps, from analytical and numerical evidence: (1) The fidelity error should be estimated by applying adiabatic theorem on the effective Hamiltonian instead. (2) Because of the specialty of Riemann-Lebesgue lemma, most adiabatic process is naturally robust against discretization. (3) As the Trotter step gets larger, the spectral gap of effective Hamiltonian tends to close, which results in the failure of digital adiabatic simulation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Measurements of Effective Optical Depth in the Lyα Forest from the BOSS DR12 Quasar Sample

We measure the effective optical depth in the Lyα forest using 40,035 quasar spectra from the Twelfth Data Release (DR12) of the Baryon Oscillation Spectroscopic Survey of Sloan Digital Sky Survey IV. A rigorous selection based on spectral index and the equivalent width of the C iv emission line is applied to choose seven uniform samples with minimal intrinsic variations across redshifts. Modeling the redshift evolution of the effective optical depth with a power law, ${\tau }_{\mathrm{eff}}={\tau }_{0}{(1+z)}^{\gamma },$ produces ${\tau }_{0}=(5.54\pm 0.64)\times {10}^{-3}$ and $\gamma =3.182\pm 0.074$. The 2.2% precision estimate on γ is dominated by systematic errors, likely arising from the bias and uncertainties in spectral index estimates. Even after incorporating the systematic errors, this work provides the most precise estimates of optical depth parameters to date. Finally, using the reconstructed Lyα forest continuum to directly measure the transmitted flux ratio as a function of redshift, we find deviations of less than 2.5% from the predictions from the global model and no convincing evidence for signal associated with He ii reionization.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Is Knowledge about Running Applications Helping Improve Runtime Prediction of HPC Jobs?

High-performance computing systems rely upon scheduling algorithms to achieve high utilization. These schedulers rely upon user estimates of job resource requirements, such as runtime, to determine optimal scheduling of incoming jobs. These user estimates, however, are prone to error. To mitigate this error, significant research has been directed at providing better estimates of job runtime, usually employing machine learning techniques. These techniques are dependent upon the input features selected. Among the possible features is the primary application used by the job. In a survey of more than 20 papers directed at improving runtime prediction, only four included primary application as an input feature. We focus this investigation specifically on the value of adding primary application as an input feature, and find that it does improve model performance, especially for jobs with longer runtimes, though this improvement varies based on the application used. We recommend further research to determine the cause of this variability as well as an optimal strategy for employing a mixture of models both including and not including primary application as a feature.

MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Is Knowledge About Running Applications Helping Improve Runtime Prediction of HPC Jobs?

High-performance computing systems rely upon scheduling algorithms to achieve high utilization. These schedulers rely upon user estimates of job resource requirements, such as runtime, to determine optimal scheduling of incoming jobs. These user estimates, however, are prone to error. To mitigate this error, significant research has been directed at providing better estimates of job runtime, usually employing machine learning techniques. These techniques are dependent upon the input features selected. Among the possible features is the primary application used by the job. In a survey of more than 20 papers directed at improving runtime prediction, only four included primary application as an input feature. We focus this investigation specifically on the value of adding primary application as an input feature, and find that it does improve model performance, especially for jobs with longer runtimes, though this improvement varies based on the application used. We recommend further research to determine the cause of this variability as well as an optimal strategy for employing a mixture of models both including and not including primary application as a feature.

feature selection↗
DOE OSTI2025

Reducing model error using optimized galaxy selection: weak lensing cluster mass estimation

Galaxy clusters are one of the most powerful probes to study extensions of General Relativity and the Standard Cosmological Model. Upcoming surveys like the Vera Rubin Observatory’s Legacy Survey of Space and Time are expected to revolutionise the field, by enabling the analysis of cluster samples of unprecedented size and quality. To reach this era of high-precision cluster cosmology, the mitigation of sources of systematic error is crucial. A particularly important challenge is bias in cluster mass measurements induced by the mismodelling of photometric redshift estimates of source galaxies. This work proposes a method to optimise the source sample selection in cluster weak lensing analyses drawn from wide-field survey lensing catalogs to reduce the bias on reconstructed cluster masses. We use a combinatorial optimisation scheme and methods from variational inference to select galaxies in latent space to produce a probabilistic galaxy source sample catalog for highly accurate cluster mass estimation. We show that our method reduces the critical surface mass density Σ crit relative modelling bias on the 60-70% level, while maintaining up to 90% of galaxies. We highlight that our methodology has applications beyond cluster mass estimation as an approach to jointly combine galaxy selection and model inference under sources of systematics.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

A framework for measuring weak-lensing magnification using the Fundamental Plane

ABSTRACT Galaxy–galaxy lensing is an essential tool for probing dark matter haloes and constraining cosmological parameters. While galaxy–galaxy lensing measurements usually rely on shear, weak-lensing magnification contains additional constraining information. Using the Fundamental Plane (FP) of elliptical galaxies to anchor the size distribution of a background population is one method that has been proposed for performing a magnification measurement. We present a formalism for using the FP residuals of elliptical galaxies to jointly estimate the foreground mass and background redshift errors for a stacked lens scenario. The FP residuals include information about weak-lensing magnification κ, and therefore foreground mass, since to first order, non-zero κ affects galaxy size but not other FP properties. We also present a modular, extensible code that implements the formalism using emulated galaxy catalogues of a photometric galaxy survey. We find that combining FP information with observed number counts of the source galaxies constrains mass and photo-z error parameters significantly better than an estimator that includes number counts only. In particular, the constraint on the mass is 17.0 per cent if FP residuals are included, as opposed to 27.7 per cent when only number counts are included. The effective size noise for a foreground lens of mass $M_\mathrm{ H}=10^{14}\, \mathrm{M}_\odot$, with a conservative selection function in size and surface brightness applied to the source population, is σκ, eff = 0.250. We discuss the improvements to our FP model necessary to make this formalism a practical companion to shear analyses in weak-lensing surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Improving precision and accuracy of genetic mapping with genotyping‐by‐sequencing data in outcrossing species

Abstract Genotyping‐by‐sequencing (GBS) is a widely used strategy for obtaining large numbers of genetic markers in model and non‐model organisms. In crop plants, GBS‐derived marker datasets are frequently used to perform quantitative trait locus (QTL) mapping. In some plant species, however, high heterozygosity and complex genome structure mean that researchers must use care in handling GBS data to conduct QTL mapping most effectively. Such outbred crops include most of the perennial grass and tree species used for bioenergy. To identify strategies for increasing accuracy and precision of QTL mapping using GBS data in outbred crops, we conducted an empirical study of SNP‐calling and genetic map‐building pipeline parameters in a Miscanthus sinensis population, and a complementary simulation study to estimate the relationship between genome‐wide error rate, read depth, and marker number. The bioenergy grass Miscanthus is an obligate outcrossing species with a recent (diploidized) whole‐genome duplication. For the study of empirical M. sinensis data, we compared two SNP‐calling methods (one non‐reference‐based and one reference‐based), a series of depth filters (12×, 20×, 30×, and 40×) and two map‐construction methods (i.e., marker ordering: linkage‐only and order‐corrected based on a reference genome). We found that correcting the order of markers on a linkage map by using a high‐quality reference genome improved QTL precision (shorter confidence intervals). For typical GBS datasets of between 1000 and 5000 markers to build a genetic map for biparental populations, a depth filter set at 30× to 40× applied to outbred populations provided a genome‐wide genotype‐calling error rate of less than 1%, improved accuracy of QTL point estimates and minimized type I errors for identifying QTL. Based on these results, we recommend using a reference genome to correct the marker order of genetic maps and a robust genotype depth filter to improve QTL mapping for outbred crops.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Quantification of regional net CO 2 flux errors in the Orbiting Carbon Observatory-2 (OCO-2) v10 model intercomparison project (MIP) ensemble using airborne measurements

Inverse model intercomparison projects (MIPs) provide a chance to assess the uncertainties in inversion estimates arising from various sources. However, accurately quantifying ensemble CO 2 flux errors remains challenging and often relies on the ensemble spread. This study proposes a method for quantifying the errors in regional net surface–atmosphere CO 2 flux estimates from models taken from the Orbiting Carbon Observatory-2 (OCO-2) v10 MIP by using independent airborne CO 2 measurements for the period 2015–2017. We first calculate the root mean square error (RMSE) between the ensemble mean of posterior CO 2 concentrations and airborne observations and then isolate the CO 2 concentration errors caused solely by the ensemble mean of posterior net fluxes by subtracting the observation, representation, and transport errors from seven regions. Our analysis reveals that the flux errors projected onto CO 2 space account for 55 %–85 % of the regional average RMSE over the 3 years, ranging from 0.88 to 1.91 ppm. In five regions, the error estimates based on observations exceed those computed from the ensemble spread of posterior fluxes by a factor of 1.33–1.93, implying an underestimation of the actual flux errors, while their magnitudes are comparable in two regions. The adjoint sensitivity analysis identifies that the underestimation of flux errors is prominent where the magnitudes of fossil fuel emissions exceed those of terrestrial-biosphere fluxes by a factor of 3–31 over the 3 years. This suggests the presence of systematic biases in the inversion estimates associated with errors in the prescribed fossil fuel emissions common to all models. Our study emphasizes the value of airborne measurements for quantifying regional errors in ensemble net CO 2 flux estimates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Enhanced shear stabilization of turbulence in NSTX

In studying a particular non-stationary NSTX L-mode plasma, we observed unexpectedly high levels of flux—first with quasilinear (TGLF) modeling and subsequently with nonlinear gyrokinetic simulations. Upon more detailed analysis, a novel confinement regime was discovered in which a modest increase in E x B shear (beyond baseline experimental estimates) rapidly reduced turbulent transport to levels consistent with power balance. This modest increase is plausible given the errors inherent to the estimation of shearing rates, and the added complexity of the non-stationary (time-dependent) power balance. Remarkably, an additional small increase in shear yields the familiar ion-neoclassical transport level with what appears to be the onset of high-k electron transport only. Although analyses using the TGLF-SAT2 model successfully capture numerous parametric dependencies of this plasma, TGLF does not reproduce the rapid E x B stabilization seen in CGYRO. We believe the results presented should help to better characterize the nonlinear physics of spherical tokamak confinement regimes, provide useful ST datasets for reduced model development, and motivate more accurate experimental diagnosis of E x B shearing rates.

Atomic and molecular collisions↗
DOE OSTI2026

Performance Evaluation of an Offshore Wave Measurement Buoy in Monochromatic Waves

The accurate measurement of waves underpins marine energy resource characterization, device design, and project development. Datawell wave buoys are widely deployed and have long served as a trusted standard for wave measurements. We quantify the measurement performance, including wave elevation and energy flux estimation, of a Datawell DWR-MkIII buoy using prescribed monochromatic heave motions on a large-amplitude six-degree-of-freedom motion platform at the National Laboratory of the Rockies, assuming the buoy behaves as an ideal wave follower. Commanded motions were validated with an optical motion tracking system while buoy elevation and raw acceleration were recorded. Wave elevations were propagated to wave energy flux estimation using four methods, including one frequency-domain method and three time-domain methods. The Bayesian optimization was applied for design of experiments, and records from three test sites were also applied and evaluated in the present study. Results show two error regions within the nominal period range of 1.6 s to 30 s. For wave periods between 5 s and 25 s, the buoy provides accurate wave height measurements. For short periods less than 5 s, the 1.28 Hz sampling frequency induces sub-Nyquist artifacts that bias elevation and can drive maximum energy flux estimation errors above 100%. For long periods exceeding 25 s, the buoy reported elevation is underpredicted with error depending on period but relatively independent of wave height, with maximum wave height and wave energy flux errors reaching 64% and 87%, respectively. Furthermore, analysis of three field-derived cases shows that frequency-domain estimates at 1.28 Hz agree within 2% of the corresponding 100 Hz estimates, while larger method-dependent differences are observed for the Hilbert method.

16 TIDAL AND WAVE POWER↗
DOE OSTI2023

BEYONDPLANCK X. Planck Low Frequency Instrument frequency maps with sample-based error propagation

We present Planck Low Frequency Instrument (LFI) frequency sky maps derived within the BEYONDPLANCK framework. This framework draws samples from a global posterior distribution that includes instrumental, astrophysical, and cosmological parameters, and the main product is an entire ensemble of frequency sky map samples, each of which corresponds to one possible realization of the various modeled instrumental systematic corrections, including correlated noise, time-variable gain, as well as far sidelobe and bandpass corrections. This ensemble allows for computationally convenient end-to-end propagation of low-level instrumental uncertainties into higher-level science products, including astrophysical component maps, angular power spectra, and cosmological parameters. We show that the two dominant sources of LFI instrumental systematic uncertainties are correlated noise and gain fluctuations, and the products presented here support – for the first time – full Bayesian error propagation for these effects at full angular resolution. We compared our posterior mean maps with traditional frequency maps delivered by the Planck Collaboration, and find generally good agreement. The most important quality improvement is due to significantly lower calibration uncertainties in the new processing, as we find a fractional absolute calibration uncertainty at 70 GHz of Δg 0 /g 0 = 5 x 10 -5 , which is nominally 40 times smaller than that reported by Planck 2018. However, we also note that the original Planck 2018 estimate has a nontrivial statistical interpretation, and this further illustrates the advantage of the new framework in terms of producing self-consistent and well-defined error estimates of all involved quantities without the need of ad hoc uncertainty contributions. We describe how low-resolution data products, including dense pixel-pixel covariance matrices, may be produced from the posterior samples directly, without the need for computationally expensive analytic calculations or simulations. We conclude that posterior-based frequency map sampling provides unique capabilities in terms of low-level systematics modeling and error propagation, and may play an important role for future Cosmic Microwave Background (CMB) B-mode experiments aiming at nanokelvin precision.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Characterizing non-Markovian and coherent errors in quantum simulation

Quantum simulation of many-body systems, particularly using ultracold atoms and trapped ions, presents a unique form of quantum control—it is a direct implementation of a multi-qubit gate generated by the Hamiltonian. As a consequence, it also faces a unique challenge in terms of benchmarking, because the well-established gate benchmarking techniques are unsuitable for this form of quantum control. Here we show that the symmetries of the target many-body Hamiltonian can be used not only to benchmark but to characterize experimental errors in the quantum simulation. We use our results to develop protocols to characterize these errors, which can be implemented using state-of-the-art technology. We consider two forms of errors: (i) unitary errors arising out of systematic errors in the applied Hamiltonian and (ii) canonical non-Markovian errors arising out of random shot-to-shot fluctuations in the applied Hamiltonian. We show that the dynamics of the expectation value of the target Hamiltonian itself, which is ideally constant in time, can be used to characterize these errors. In the presence of errors, the expectation value of the target Hamiltonian shows a characteristic thermalization dynamics, when it satisfies the operator thermalization hypothesis (OTH). That is, an oscillation in the short time followed by relaxation to a steady-state value in the long time limit. We show that while the steady-state value can be used to characterize the coherent errors, the amplitude of the oscillations can be used to estimate the non-Markovian errors. We prove a sandwich theorem to establish a linear relation between the amplitude of the oscillations and the magnitude of the non-Markovian errors. Moreover, by varying the initial state, we show that the steady state values can be used to completely construct the generator of the coherent errors. Using these results, we develop two experimental protocols to characterize the unitary errors based on these results, one of which requires single-qubit addressing and the other one doesn't. We also develop a protocol to characterize non-Markovian errors. Published by the American Physical Society 2024

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

A Nonlinear Least Squares Phasor Estimation Algorithm with a Trust Metric

The paper presents a separable nonlinear least squares (NLLS)-based approach for estimation of fundamental-frequency phasors from sampled point-on-wave measurements. An analytical connection is established between the NLLS cost function and the discrete Fourier transform (DFT)-based periodogram of the input signal. This periodogram-based interpretation of the cost function offers an intuitive and easy-to-implement solution for the frequency estimate. Using the residual error of the NLLS-fit, the paper also presents an insightful measure for ascertaining the quality of the phasor estimates and their validity, especially for data windows containing signal transients.

Chatterjee, Kaustav↗