Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A bootstrapping approach to social media quantification

Abstract This work considers the use of classifiers in a downstream aggregation task estimating class proportions, such as estimating the percentage of reviews for a movie with positive sentiment. We derive the bias and variance of the class proportion estimator when taking classification error into account to determine how to best trade off different error types when tuning a classifier for these tasks. Additionally, we propose a method for constructing confidence intervals that correctly adjusts for classification error when estimating these statistics. We conduct experiments on four document classification tasks comparing our methods to prior approaches across classifier thresholds, sample sizes, and label distributions. Prior approaches have focused on providing the most accurate point estimate while this work focuses on the creation of correct confidence intervals that appropriately account for classifier error. Compared to the prior approaches, our methods provide lower error and more accurate confidence intervals.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

Calibrating Bayesian generative machine learning for Bayesiamplification

Recently, combinations of generative and Bayesian deep learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated distribution originating from limited training statistics. The interpretation of a distribution-wide uncertainty however remains ill-defined. We show a clear scheme for quantifying the calibration of Bayesian generative machine learning models. For a Continuous Normalizing Flow applied to a low-dimensional toy example, we evaluate the calibration of Bayesian uncertainties from either a mean-field Gaussian weight posterior, or Monte Carlo sampling network weights, to gauge their behaviour on unsteady distribution edges. Well calibrated uncertainties can then be used to roughly estimate the number of uncorrelated truth samples that are equivalent to the generated sample and clearly indicate data amplification for smooth features of the distribution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Target Detection via Cognitive Radars Using Change-Point Detection, Learning, and Adaptation

Many radar detection algorithms that assume a stationary environment (clutter) have been proposed and analyzed over the years. However, in practice, changes in the nonstationary environment can perturb the parameters of the clutter distribution, or even alter the clutter distribution family, which can greatly deteriorate the target detection capability. To avoid such potential performance degradation, cognitive radar systems are envisioned which are required to rapidly realize the nonstationarity, accurately learn the new characteristics of the environments, and adaptively update the detector. In this paper, aiming to develop a fully cognitive radar for target detection in nonstationary environments, we propose a unifying framework that integrates (i) change-point detection of clutter distributions by using a data-driven cumulative sum (CUSUM) algorithm and its extended version, (ii) learning/identification of clutter distribution by applying sparse theory and kernel density estimation methods, and (iii) adaptive target detection by automatically modifying the likelihood-ratio test and corresponding detection threshold. Further, with extensive numerical examples, we demonstrate the achieved improvements in detection performance due to the proposed framework in comparison to a nonadaptive case, an adaptive matched filter (AMF) method, and the clairvoyant case. Herein, we also use Wilcoxon rank-sum tests to evaluate the statistical significance of the performance improvements

42 ENGINEERING↗
DOE OSTI2022

Estimation of process steady state with autoregressive models and Bayesian inference

To improve efficiency, separations engineers will typically design process circuits containing recirculating streams, which mix one or more of the process outputs with the feed material. Doing so can improve efficiency, but will cause a delay in the system reaching steady state conditions until the recirculating load mass flows stabilize. In testing separation circuits, engineers will often test a variety of factors and complete an analysis from sample results. Knowledge of if a process is at steady state, as well as the steady state conditions of a process, is essential for a valid techno-economic analysis. However, the definition of process steady state is often poorly defined, or does not include uncertainty quantification. If the performance of a process operating under two different sets of conditions are compared, an engineer who does not test for steady state or quantify steady state conditions risks producing a faulty analysis. In this work, a Bayesian statistical method for testing if all streams are at steady state is further motivated and then derived. Then after testing for steady state, the same model is used with a prior distribution that enforces a steady state assumption to estimate steady state conditions. Further, these methods were validated in a solvent extraction pilot plant where steady state conditions for all outflows were inferred with uncertainty quantification. Analysis is completed with functions available to the reader as part of the BayesMassBal (V 1.1.0) software package written in R.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2026

The Poisson tensor completion parametric estimator

We introduce the Poisson tensor completion (PTC) estimator that exploits inter-sample relationships to compute a low-rank Poisson tensor decomposition of the frequency histogram for samples of a multivariate distribution. Our crucial observation is that the histogram bins are an instance of a space partitioning of counts and thus can be identified with a spatial non-homogeneous Poisson process. The Poisson tensor decomposition leads to a completion of the mean measure over all bins—including those containing few to no samples—and leads to our proposed estimator. A Poisson tensor decomposition models the underlying distribution of the count data and guarantees non-negative estimated values obviating the need for additional constraints to ensure non-negativity. Furthermore, we demonstrate that our PTC estimator is a substantial improvement over standard histogram-based estimators for sub-Gaussian probability distributions because of the concentration of norm phenomenon.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Robust and scalable uncertainty estimation with conformal prediction for machine-learned interatomic potentials

Abstract Uncertainty quantification (UQ) is important to machine learning (ML) force fields to assess the level of confidence during prediction, as ML models are not inherently physical and can therefore yield catastrophically incorrect predictions. Established a-posteriori UQ methods, including ensemble methods, the dropout method, the delta method, and various heuristic distance metrics, have limitations such as being computationally challenging for large models due to model re-training. In addition, the uncertainty estimates are often not rigorously calibrated. In this work, we propose combining the distribution-free UQ method, known as conformal prediction (CP), with the distances in the neural network’s latent space to estimate the uncertainty of energies predicted by neural network force fields. We evaluate this method (CP+latent) along with other UQ methods on two essential aspects, calibration, and sharpness, and find this method to be both calibrated and sharp under the assumption of independent and identically-distributed (i.i.d.) data. We show that the method is relatively insensitive to hyperparameters selected, and test the limitations of the method when the i.i.d. assumption is violated. Finally, we demonstrate that this method can be readily applied to trained neural network force fields with traditional and graph neural network architectures to obtain estimates of uncertainty with low computational costs on a training dataset of 1 million images to showcase its scalability and portability. Incorporating the CP method with latent distances offers a calibrated, sharp and efficient strategy to estimate the uncertainty of neural network force fields. In addition, the CP approach can also function as a promising strategy for calibrating uncertainty estimated by other approaches.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2020

Distributed non-negative matrix factorization with determination of the number of latent features

The holistic analysis and understanding of the latent (that is, not directly observable) variables and patterns buried in large datasets is crucial for data-driven science, decision making and emergency response. Such exploratory analyses require devising unsupervised learning methods for data mining and extraction of the latent features, and non-negative matrix factorization (NMF) is one of the prominent such methods. NMF is based on compute-intense non-convex constrained minimization, which, for large datasets requires fast and distributed algorithms. However, current parallel implementations of NMF fail to estimate the number of latent features. In practice, identifying these features is both difficult and significant for pattern recognition and latent feature analysis, especially for large dense matrices. Here, we introduce a distributed NMF algorithm coupled with distributed custom clustering followed by a stability analysis on dense data, which we call DnMFk, to determine the number of latent variables. The results on synthetic data and the classical Swimmer data set demonstrate the accuracy of model determination while scaling nearly linearly across multiple processors for large data. Further, we employ DnMFk to determine the number of hidden features from a terabyte matrix.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Assessing the difficulty of capturing the distribution function of neutrinos in neutron star merger simulations

The collision of two neutron stars is a rich source of information about nuclear physics. In particular, the kilonova signal following a merger can help us elucidate the role of neutron stars in nucleosynthesis, and informs us about the properties of matter above nuclear saturation. Approximate modeling of neutrinos remains an important limitation to our ability to make predictions for these observables. Part of the problem is the fermionic nature of neutrinos. By the exclusion principle, the expected value 𝑓 𝜈 for the number of neutrinos in a quantum state is at most 1. Any process producing neutrinos is suppressed by a blocking factor (1 −𝑓 𝜈 ). Recent simulations focused on neutrino physics mostly use a gray two-moment scheme to evolve neutrinos. This evolves integrals of 𝑓 𝜈 over momentum space, preventing direct calculations of blocking factors. Monte Carlo methods may be an attractive alternative, providing access to the full distribution of neutrinos. Their current implementation is, however, inadequate to estimate 𝑓 𝜈 : in our most recent simulations, a single Monte Carlo packet causes, in the worst cases, estimates of 𝑓 𝜈 to jump from 𝑓 𝜈 =0 to 𝑓 𝜈 ∼10 5 . While this is concerning, this brazen violation of the fermionic nature of neutrinos has been largely inconsequential, as the interactions used in simulations avoid direct calculations of 𝑓 𝜈 . We are, however, reaching a level of modeling at which this problem can no longer be ignored. Here, we discuss the relatively simple origin of this issue. We then show that very rough estimates of 𝑓 𝜈 can in theory be obtained in merger simulations, but that they will require a combination of unintuitive weighting schemes for Monte Carlo packets and smoothing of the neutrino distribution at coarser resolution than what the merger simulation uses.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

An efficient method to estimate the probability density of seismic Green's functions

We present a computationally efficient method to approximate the probability distribution of seismic Green's functions given the uncertainty of an Earth model. The method is based on the Karhunen-Loève (KL) theorem and an approximation of the Green's function (or seismogram) covariance. Using Monte Carlo (MC) simulations as a control case, we demonstrate that our KL-based method can accurately reproduce a probability distribution of seismograms that results from an uncertain Earth model for a MC-derived seismogram covariance. We then describe a method to estimate the covariance of the seismograms resulting from those Earth models that is not based on MC simulations. We use the estimated Green's function covariance in conjunction with our KL-based method to produce a Green's function probability distribution, and compare that distribution to a Green's function probability distribution produced using a MC finite difference method. We find that the Green's function probability distribution approximated using our KL-based method generally mimics that produced using the MC simulations, especially for direct-arriving body waves. However the accuracy of the KL-based method generally decreases for later times in the simulated Green's function distribution.

58 GEOSCIENCES↗
DOE OSTI2024

Hydrologic applicability of satellite-based precipitation estimates for irrigation water management in the data-scarce region

Reliable precipitation estimates are crucial for planning and managing water resources, monitoring hydrologic extremes, and fulfilling irrigation water requirements. Accurate precipitation estimates are particularly challenging in complex mountain terrains, where monitoring gauges are often sparsely distributed due to their remote locations, and high installation and long-term operation costs. Recent advances in satellite-based precipitation estimates offer promising opportunities to improve our understanding of hydrologic processes and their applications for irrigation water management. Several datasets are available varying considerably in terms of their data sources, quality control methods, estimation procedure, and spatiotemporal resolutions. Choosing the most suitable dataset for a particular application is a complex task. In this study, we (1) evaluate the performance of six satellite-based precipitation estimates (SPEs): i) CHIRPS v2.0, ii) CMORPH v1.0, iii) ERA5, iv) IMERG v6, v) MSWEP v2.8, and vi) PERSIANN-CDR against the gauge precipitation using continuous statistical and categorical indices, (2) integrate SPEs with a calibrated semi-distributed hydrologic model to predict streamflow, and (3) demonstrate practical implications of improved streamflow prediction for irrigation water management in the central Himalayan region, Nepal. Our results illustrate that satellite-based precipitation estimates have competitive performance in capturing a wide range of rainfall characteristics, with demonstrated variability across river basins and time scales. Further, there are no significant discrepancies observed in satellite-based precipitation estimates for estimating irrigation water requirements for the three major crops (maize, wheat, and paddy) during the cropping period across the selected river basins, showing a greater promise for irrigation water management planning and decision making.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Regional Real-Time PV Spinning Reserve Estimator

Curtailed photovoltaic (PV) generation is a zero-marginal-cost spinning reserve that can be used for a number of active power control services. Unlike traditional spinning reserve providers, however, i.e., fossil-fueled generators, which have well-defined operating characteristics, e.g., available headroom or potential high limit (PHL), PV plants have by nature variable and uncertain operating characteristics. To ensure the effective coordination between PV plants and the system operator during an active power control event, accurate knowledge of the PV PHL is essential. It ensures that enough headroom is reserved by the PV plants to deliver the award services in real time and informs feasible dispatch decisions made by the market operator. To tackle this challenge, a novel reference-control grouping-based PV plant reserve estimation method has been proposed by the National Renewable Energy Laboratory under past projects funded by the U.S. Department of Energy Office of Energy Efficiency and Renewable Energy Solar Energy Technologies Office. The estimation method separates inverters within a plant into two groups: a control group and a reference group. While the reference group is reserved to operate at its PHL, the control group can be curtailed to provide the grid services. Real-time outputs from the reference inverters are used to estimate the PHL for the whole plant based on the ratio between capacities of the reference group and of the plant. This work further enhances the methodology by (1) improving the model accuracy through machine learning; (2) automating the reference inverter selection through correlation analysis; (3) considering estimation look-ahead windows; and (4) applying to regional spinning reserve estimation. Significant performance improvement has been observed based on real-world data collected by CAISO, Southern Company, and Terabase Energy. Compared with the original scaling method, the newly proposed machine learning-based approach reduces the estimation errors by 30% and 13% at the plant level and region level, respectively. Results obtained from this project are intended to be used by grid operators, market operators, balancing authorities, and PV plant owners and operators to facilitate PV participation in ancillary service markets. Regulators, policymakers, and system planners can also consider the results of this work in their decision-making processes. In addition to the performance improvement on the existing reference-control based grouping method, we also investigated how the variability of PV generation from a single PV inverter can be used to represent the variability of PV generation at the plant level.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

High-Resolution PM2.5 Concentrations Estimation Based on Stacked Ensemble Learning Model Using Multi-Source Satellite TOA Data

Nepal has experienced severe fine particulate matter (PM2.5) pollution in recent years. However, few studies have focused on the distribution of PM2.5 and its variations in Nepal. Although many researchers have developed PM2.5 estimation models, these models have mainly focused on the kilometer scale, which cannot provide accurate spatial distribution of PM2.5 pollution. Based on Gaofen-1/6 and Landsat-8/9 satellite data, we developed a stacked ensemble learning model (named XGBLL) combined with meteorological data, ground PM2.5 concentrations, ground elevation, and population data. The model includes two layers: a XGBoost and Light GBM model in the first layer, and a linear regression model in the second layer. The accuracy of XGBLL model is better than that of a single model, and the fusion of multi-source satellite remote sensing data effectively improves the spatial coverage of PM2.5 concentrations. Besides, the spatial distribution of the daily mean PM2.5 concentrations in the Kathmandu region under different air conditions was analyzed. The validation results showed that the monthly averaged dataset was accurate (R2 = 0.80 and root mean square error = 7.07). In addition, compared to previous satellite PM2.5 datasets in Nepal, the dataset produced in this study achieved superior accuracy and spatial resolution.

Environmental Sciences & Ecology↗
DOE OSTI2020

Subsurface Nitrogen Dissociation Kinetics in Lithium Metal from Metadynamics

The dissociation of molecular nitrogen in lithium is of interest for several promising technologies, such as the catalytic synthesis of ammonia in ambient or mild conditions. In this work we simulate nitrogen dissociation in the lithium BCC (110) surface at ambient and elevated temperatures using density functional theory (DFT) metadynamics simulations. The rate constants at temperatures of 300, 400, and 500 K are calculated by statistical analysis of the reaction time distributions from the accelerated simulations. This approach finds and estimates rate constants for transition pathways out of the initial state; the required input is the stable initial state and a reasonable choice of collective variable. A single collective variable is used in this case: the N–N distance. The results are robust to changes in metadynamics parameters, and the reaction time distributions follow the expected exponential distribution. We show that the metadynamics-derived rate constants are in agreement with results from the conventional harmonic approximation approach using a climbing image nudged elastic band (NEB) transition state search. The reaction barriers from metadynamics and the NEB/harmonic approximation agree to within 0.02–0.04 eV at all temperatures studied. This paper demonstrates that the harmonic approximation provides an accurate description of the rate constants for nitrogen dissociation in lithium metal, even at temperatures near or above the melting point of lithium, lending credence to previous and future theoretical studies using this approximation. Moreover, this work demonstrates a step toward the automated exploration and discovery of reaction mechanisms and associated rate constants for elementary surface-catalyzed reactions using DFT-based metadynamics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Field validation of dynamic mechanical torque measurements using fiber-optic strain sensors for geared wind turbines

Abstract Accurate knowledge of the mechanical loads of wind turbine gearboxes has become essential in modern, highly loaded gearbox designs, as maintaining or even improving gearbox reliability with increasing torque density demands is proving to be challenging. Unfortunately, the traditional method of measuring dynamic mechanical torque using strain gauges placed on the outer surface of a rotating shaft and transmitting the resulting signal is unsuitable for serial deployment due to technical and economic constraints. An alternative method based on fiber-optic strain sensors placed on the stationary outer surface of the gearbox ring gear has been proposed. Like shaft torsion, the radial deformation of the ring gear is proportionate to the rotor torque. Placing the sensors on a stationary component is a cost-effective alternative for serial implementation because the need for complex and expensive data transfer via wireless transmission or a slip ring is eliminated. In this paper, we present the results of an extensive field experiment conducted to evaluate the torque measurement accuracy of this novel sensing solution installed on the gearbox of a Gamesa G97 2-MW wind turbine at the National Renewable Energy Laboratory’s Flatirons Campus. Torque measurements derived from fiber-optic strain sensors placed on the ring gear of the planetary stage are compared to conventional torque measurements from strain gauges placed on the main shaft. Two different torque estimation data processing methods were evaluated, with the method based on operational deflection shapes providing the most accurate results with an average normalized root mean square error below 0.7% for a load revolution distribution analysis. The effect of operating conditions on the torque estimate was also investigated, and the third planet-passing operational deflection shape was found to be the least sensitive to nontorque load-related effects. The fiber-optic strain sensors’ successful operation during the complete test campaign has demonstrated a robust and accurate solution for fleet-wide enhanced gearbox remaining useful life estimation.

17 WIND ENERGY↗
DOE OSTI2025

Field Validation of Dynamic Mechanical Torque Measurements for Geared Wind Turbines

Accurate knowledge of the mechanical loads of wind turbine gearboxes has become essential in modern, highly loaded gearbox designs, as maintaining or even improving gearbox reliability with increasing torque density demands is proving to be challenging. Unfortunately, the traditional method of measuring dynamic mechanical torque using strain gauges placed on the outer surface of a rotating shaft and transmitting the resulting signal is unsuitable for serial deployment due to technical and economic constraints. An alternative method based on fiber-optic strain sensors placed on the stationary outer surface of the gearbox ring gear has been proposed. Like shaft torsion, the radial deformation of the ring gear is proportionate to the rotor torque. Placing the sensors on a stationary component is a cost-effective alternative for serial implementation because the need for complex and expensive data transfer via wireless transmission or a slip ring is eliminated. In this paper, we present the results of an extensive field experiment conducted to evaluate the torque measurement accuracy of this novel sensing solution installed on the gearbox of a Gamesa G97 2-MW wind turbine at the National Renewable Energy Laboratory's Flatirons Campus. Torque measurements derived from fiber-optic strain sensors placed on the ring gear of the planetary stage are compared to conventional torque measurements from strain gauges placed on the main shaft. Two different torque estimation data processing methods were evaluated, with the method based on operational deflection shapes providing the most accurate results with an average normalized root mean square error below 0.7% for a load revolution distribution analysis. The effect of operating conditions on the torque estimate was also investigated, and the third planet-passing operational deflection shape was found to be the least sensitive to nontorque load-related effects. The fiber-optic strain sensors' successful operation during the complete test campaign has demonstrated a robust and accurate solution for fleet-wide enhanced gearbox remaining useful life estimation.

17 WIND ENERGY↗
DOE OSTI2024

A variance deconvolution estimator for efficient uncertainty quantification in Monte Carlo radiation transport applications

Monte Carlo simulations are at the heart of many high-fidelity simulations and analyses for radiation transport systems. As is the case with any complex computational model, it is important to propagate sources of input uncertainty and characterize how they affect model output. Unfortunately, uncertainty quantification (UQ) is made difficult by the stochastic variability that Monte Carlo transport solvers introduce. The standard method to avoid corrupting the UQ statistics with the transport solver noise is to increase the number of particle histories, resulting in very high computational costs. In this contribution, we propose and analyze a sampling estimator based on the law of total variance to compute UQ variance even in the presence of residual noise from Monte Carlo transport calculations. Here, we rigorously derive the statistical properties of the new variance estimator, compare its performance to that of the standard method, and demonstrate its use on neutral particle transport model problems involving both attenuation and scattering physics. We illustrate, both analytically and numerically, the estimator’s statistical performance as a function of available computational budget and the distribution of that budget between UQ samples and particle histories. We show analytically and corroborate numerically that the new estimator is unbiased, unlike the standard approach, and is more accurate and precise than the standard estimator for the same computational budget.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

HOD-dependent systematics for luminous red galaxies in the DESI 2024 BAO analysis

In this paper, we present the estimation of systematics related to the halo occupation distribution (HOD) modeling in the baryon acoustic oscillations (BAO) distance measurement of the Dark Energy Spectroscopic Instrument (DESI) 2024 analysis. This paper focuses on the study of HOD systematics for luminous red galaxies (LRG). We consider three different HOD models for LRGs, including the base 5-parameter vanilla model and two extensions to it, that we refer to as baseline and extended models. The baseline model is described by the 5 vanilla HOD parameters, an incompleteness factor and a velocity bias parameter, whereas the extended one also includes a galaxy assembly bias and a satellite profile parameter. We utilize the 25 dark matter simulations available in the AbacusSummit simulation suite at z=0.8 and generate mock catalogs for our different HOD models. To test the impact of the HOD modeling in the position of the BAO peak, we run BAO fits for all these sets of simulations and compare the best-fit BAO-scaling parameters α iso and α AP between every pair of HOD models. Furthermore, we do this for both Fourier and configuration spaces independently, using post-reconstruction measurements. We find a 3.3σ detection of HOD systematic for α AP in configuration space with an amplitude of 0.19%. For the other cases, we did not find a 3σ detection, and we decided to compute a conservative estimation of the systematic using the ensemble of shifts between all pairs of HOD models. By doing this, we quote a systematic with an amplitude of 0.07% in α iso for both Fourier and configuration spaces; and of 0.09% in α AP for Fourier space.

79 ASTRONOMY AND ASTROPHYSICS↗