Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Novel estimation of aerosol processes with particle size distribution measurements: a case study with the TOMAS algorithm v1.0.0

Atmospheric aerosol microphysical processes are a significant source of uncertainty in predicting climate change. Specifically, aerosol nucleation, emissions, and growth rates, which are simulated in chemical transport models to predict the particle size distribution, are not understood well. However, long-term size distribution measurements made at several ground-based sites across Europe implicitly contain information about the processes that created those size distributions. This work aims to extract that information by developing and applying an inverse technique to constrain aerosol emissions as well as nucleation and growth rates based on hourly size distribution measurements. We developed an inverse method based upon process control theory into an online estimation technique to scale aerosol nucleation, emissions, and growth so that the model–measurement bias in three measured aerosol properties exponentially decays. The properties, which are calculated from the measured and predicted size distributions, used to constrain aerosol nucleation, emission, and growth rates are the number of particles with a diameter between 3 and 6 nm, the number with a diameter greater than 10 nm, and the total dry volume of aerosol ( N 3–6 , N 10 , V dry ), respectively. In this paper, we focus on developing and applying the estimation methodology in a zero-dimensional “box” model as a proof of concept before applying it to a three-dimensional simulation in subsequent work. The methodology is first tested on a dataset of synthetic and perfect measurements that span diverse environments in which the true particle emissions, growth, and nucleation rates are known. The inverse technique accurately estimates the aerosol microphysical process rates with an average and maximum error of 2 % and 13 %, respectively. Next, we investigate the effect that measurement noise has on the estimated rates. The method is robust to typical instrument noise in the aerosol properties as there is a negligible increase in the bias of the estimated process rates. Finally, the methodology is applied to long-term datasets of in situ size distribution measurements in western Europe from May 2006 through June 2007. At Melpitz, Germany, and Hyytiälä, Finland, the average diurnal profiles of estimated 3 nm particle formation rates are reasonable, having peaks near noon local time with average peak values of 1 and 0.15 cm –3 s –1 , respectively. The normalized absolute error in estimated N 3–6 , N 10 , and V dry at three European measurement sites is less than 15 %, showing that the estimation framework developed here has potential to decrease model–measurement bias while constraining uncertain aerosol microphysical processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Updated distribution maps of predominant Culex mosquitoes across the Americas

Abstract Background Estimates of the geographical distribution of Culex mosquitoes in the Americas have been limited to state and provincial levels in the United States and Canada and based on data from the 1980s. Since these estimates were made, there have been many more documented observations of mosquitoes and new methods have been developed for species distribution modeling. Moreover, mosquito distributions are affected by environmental conditions, which have changed since the 1980s. This calls for updated estimates of these distributions to understand the risk of emerging and re-emerging mosquito-borne diseases. Methods We used contemporary mosquito data, environmental drivers, and a machine learning ecological niche model to create updated estimates of the geographical range of seven predominant Culex species across North America and South America: Culex erraticus , Culex nigripalpus , Culex pipiens , Culex quinquefasciatus , Culex restuans , Culex salinarius , and Culex tarsalis . Results We found that Culex mosquito species differ in their geographical range. Each Culex species is sensitive to both natural and human-influenced environmental factors, especially climate and land cover type. Some prefer urban environments instead of rural ones, and some are limited to tropical or humid areas. Many are found throughout the Central Plains of the USA. Conclusions Our updated contemporary Culex distribution maps may be used to assess mosquito-borne disease risk. It is critical to understand the current geographical distributions of these important disease vectors and the key environmental predictors structuring their distributions not only to assess current risk, but also to understand how they will respond to climate change. Since the environmental predictors structuring the geographical distribution of mosquito species varied, we hypothesize that each species may have a different response to climate change. Graphical abstract

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Bayesian Structural Time Series for Behind-the-Meter Photovoltaic Disaggregation: Preprint

Distributed photovoltaic (PV) generation often occurs ``behind the meter": a grid operator can only observe the net load, which is the sum of the gross load and distributed PV generation. This lack of observability poses a challenge to system operation at both bulk level and distribution level. The lack of real-time or near-future disaggregated estimates of gross load and PV generation will lead to over scheduling of energy production and regulation reserves, reliability constraints violations, wear and tear of controller devices, and potentially cascading failures of a system. In this paper we propose the use of a Bayesian Structural Time Series (BSTS) model with local solar irradiance measurements to disaggregate the summed PV generation and gross load signals at a downstream measurement site. BSTSs are a highly expressive model class that blends classic time series models with the powerful Bayesian state space estimation framework. Disaggregation is done probabilistically, which automatically quantifies the uncertainties of the estimated PV generation and gross load consumption. Depending on the data availability in real-time, it can be used to disaggragate PV and gross load at customer site, or can be used at the feeder level. In this paper, we focus on solving the problem at feeder level. We compare the performance of a BSTS model as well as a handful of state-of-the-art methods on a Pecan Street AMI dataset, using the National Solar Radiation Database (NSRDB) to estimate local irradiance.

Bayesian structural time series↗
DOE OSTI2025

Joint Modeling of Wind Speed and Wind Direction Through a Conditional Approach

Atmospheric near surface wind speed and wind direction play an important role in many applications, ranging from air quality modeling, building design, wind turbine placement to climate change research. It is therefore crucial to accurately estimate the joint probability distribution of wind speed and direction. In this work, we develop a conditional approach to model these two variables, where the joint distribution is decomposed into the product of the marginal distribution of wind direction and the conditional distribution of wind speed given wind direction. To accommodate the circular nature of wind direction, a von Mises mixture model is used; the conditional wind speed distribution is modeled as a directional dependent Weibull distribution via a two-stage estimation procedure, consisting of a directional binned Weibull parameter estimation, followed by a harmonic regression to estimate the dependence of the Weibull parameters on wind direction. A Monte Carlo simulation study indicates that our method outperforms two other approaches in estimation efficiency: one that utilizes periodic spline quantile regression and another that generates data from the commonly used Abe-Ley distribution for cylindrical data. We illustrate our method by using the output from a regional climate model to investigate how the joint distribution of wind speed and direction may change under some future climate scenarios. Our method indicates significant changes in the variation of wind speed with respect to some directions.

17 WIND ENERGY↗
DOE OSTI2025

A novel framework for increasing research transparency: Exploring the connection between diversity and innovation

A split sample/dual method research protocol is demonstrated to increase transparency while reducing the probability of false discovery. We apply the protocol to examine whether diversity in ownership teams increases or decreases the likelihood of a firm reporting a novel innovation using data from the 2018 United States Census Bureau’s Annual Business Survey. Transparency is increased in three ways: 1) all specification testing and identifying potentially productive models is done in an exploratory subsample that 2) preserves the validity of hypothesis test statistics fromde novoestimation in the holdout confirmatory sample with 3) all findings publicly documented in an earlier registered report and in this journal publication. Bayesian estimation procedures that leverage information from the exploratory stage included in the confirmatory stage estimation replace traditional frequentist null hypothesis significance testing. In addition to increasing statistical power by using information from the full sample, Bayesian methods directly estimate a probability distribution for the magnitude of an effect, allowing much richer inference. Estimated magnitudes of diversity along academic discipline, race, ethnicity, and foreign-born status dimensions are positively associated with innovation. A maximally diverse ownership team on these dimensions would be roughly six times more likely to report new-to-market innovation than a homophilic team.

Science & Technology - Other Topics↗
DOE OSTI2022

J-PLUS: Spectral evolution of white dwarfs by PDF analysis

We estimated the spectral evolution of white dwarfs with effective temperature using the Javalambre Photometric Local Universe Survey (J-PLUS) second data release (DR2), which provides 12 photometric optical passbands over 2176 deg 2 . We analyzed 5926 white dwarfs with r ≤ 19.5 mag in common between a white dwarf catalog defined from Gaia EDR3 and J-PLUS DR2. We performed a Bayesian analysis by comparing the observed J-PLUS photometry with theoretical models of hydrogen- and helium-dominated atmospheres. We estimated the probability distribution functions for effective temperature (T eff ), surface gravity, parallax, and composition; and the probability of having a H-dominated atmosphere (p H ) for each source. We applied a prior in parallax, using Gaia EDR3 measurements as a reference, and derived a self-consistent prior for the atmospheric composition as a function of T eff . We described the fraction of white dwarfs with a He-dominated atmosphere (f He ) with a linear function of the effective temperature at 5000 < T eff < 30 000 K. We find f He = 0.24 ± 0.01 at T eff = 10 000 K, a change rate along the cooling sequence of 0.14 ± 0.02 per 10 kK, and a minimum He-dominated fraction of 0.08 ± 0.02 at the high-temperature end. We tested the obtained p H by comparison with spectroscopic classifications, finding that it is reliable. We estimated the mass distribution for the 351 sources with distance d < 100 pc, mass M > 0.45 M ⊙ , and T eff > 6000 K. The result for H-dominated white dwarfs agrees with previous studies, with a dominant M = 0.59 M ⊙ peak and the presence of an excess at M ~ 0.8 M ⊙ . This high-mass excess is absent in the He-dominated distribution, which presents a single peak. The J-PLUS optical data provide a reliable statistical classification of white dwarfs into H- and He-dominated atmospheres. We find a 21 ± 3% increase in the fraction of He-dominated white dwarfs from T eff = 20 000 K to T eff = 5000 K.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Anthropogenic Perturbations to the Atmospheric Molybdenum Cycle

Abstract Molybdenum (Mo) is a key cofactor in enzymes used for nitrogen (N) fixation and nitrate reduction, and the low availability of Mo can constrain N inputs, affecting ecosystem productivity. Natural atmospheric Mo aerosolization and deposition from sources such as desert dust, sea‐salt spray, and volcanoes can affect ecosystem function across long timescales, but anthropogenic activities such as combustion, motor vehicles, and agricultural dust have accelerated the natural Mo cycle. Here we combined a synthesis of global atmospheric concentration observations and modeling to identify and estimate anthropogenic sources of atmospheric Mo. To project the impact of atmospheric Mo on terrestrial ecosystems, we synthesized soil Mo data and estimated the global distribution of soil Mo using two approaches to calculate turnover times. We estimated global emissions of atmospheric Mo in aerosols (<10 μm in diameter) to be 23 Gg Mo yr −1 , with 40%–75% from anthropogenic sources. We approximated that for the top meter of soil, Mo turnover times range between 1,000 and 1,000,000 years. In some industrialized regions, anthropogenic inputs have enhanced Mo deposition 100‐fold, lowering the soil Mo turnover time considerably. Our synthesis of global observational data, modeling, and a mass balance comparison with riverine Mo exports suggest that anthropogenic activity has greatly accelerated the Mo cycle, with potential to influence N‐limited ecosystems.

Wong, Michelle Y.↗
DOE OSTI2021

Radar-Based Bayesian Estimation of Ice Crystal Growth Parameters within a Microphysical Model

The potential for polarimetric Doppler radar measurements to improve predictions of ice microphysical processes within an idealized model–observational framework is examined. In an effort to more rigorously constrain ice growth processes (e.g., vapor deposition) with observations of natural clouds, a novel framework is developed to compare simulated and observed radar measurements, coupling a bulk adaptive-habit model of vapor growth to a polarimetric radar forward model. Bayesian inference on key microphysical model parameters is then used, via a Markov chain Monte Carlo sampler, to estimate the probability distribution of the model parameters. The statistical formalism of this method allows for robust estimates of the optimal parameter values, along with (non-Gaussian) estimates of their uncertainty. To demonstrate this framework, observations from Department of Energy radars in the Arctic during a case of pristine ice precipitation are used to constrain vapor deposition parameters in the adaptive habit model. The resulting parameter probability distributions provide physically plausible changes in ice particle density and aspect ratio during growth. A lack of direct constraint on the number concentration produces a range of possible mean particle sizes, with the mean size inversely correlated to number concentration. Consistency is found between the estimated inherent growth ratio and independent laboratory measurements, increasing confidence in the parameter PDFs and demonstrating the effectiveness of the radar measurements in constraining the parameters. Furthermore, the combined Doppler and polarimetric observations produce the highest-confidence estimates of the parameter PDFs, with the Doppler measurements providing a stronger constraint for this case.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Dark Energy Survey Year 3 results: calibration of lens sample redshift distributions using clustering redshifts with BOSS/eBOSS

ABSTRACT We present clustering redshift measurements for Dark Energy Survey (DES) lens sample galaxies used in weak gravitational lensing and galaxy clustering studies. To perform these measurements, we cross-correlate with spectroscopic galaxies from the Baryon Acoustic Oscillation Survey (BOSS) and its extension, eBOSS. We validate our methodology in simulations, including a new technique to calibrate systematic errors that result from the galaxy clustering bias, and we find that our method is generally unbiased in calibrating the mean redshift. We apply our method to the data, and estimate the redshift distribution for 11 different photometrically selected bins. We find general agreement between clustering redshift and photometric redshift estimates, with differences on the inferred mean redshift found to be below |Δz| = 0.01 in most of the bins. We also test a method to calibrate a width parameter for redshift distributions, which we found necessary to use for some of our samples. Our typical uncertainties on the mean redshift ranged from 0.003 to 0.008, while our uncertainties on the width ranged from 4 to 9 per cent. We discuss how these results calibrate the photometric redshift distributions used in companion papers for DES Year 3 results.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Taylor approximation variance reduction for approximation errors in PDE-constrained Bayesian inverse problems

In numerous applications, surrogate models are used as a replacement for accurate parameter-to-observable mappings when solving large-scale inverse problems governed by partial differential equations (PDEs). The surrogate model may be a computationally cheaper alternative to the accurate parameter-to-observable mappings and/or may ignore additional unknowns or sources of uncertainty. The Bayesian approximation error (BAE) approach provides a means to account for the induced uncertainties and approximation errors, i.e. the errors between the accurate parameter-to-observable mapping and the surrogate. The statistics of these errors are, however, in general unknown a priori, and are thus calculated using Monte Carlo sampling. Although the sampling is typically carried out offline, i.e. before considering the data, the process can still represent a computational bottleneck. In this work, we develop a scalable computational approach for reducing the costs associated with the sampling stage of the BAE approach. Specifically, we consider the Taylor expansion of the accurate and surrogate forward models with respect to the uncertain parameter fields either as a control variate for variance reduction or as a means to directly and efficiently approximate the mean and covariance of the approximation errors. We propose efficient methods for evaluating the expressions for the mean and covariance of the Taylor approximations based on linear(-ized) PDE solves. Furthermore, the proposed approach is independent of the dimension of the uncertain parameter, depending instead on the intrinsic dimension of the data, ensuring scalability to high-dimensional problems. The potential benefits of the proposed approach are demonstrated for two high-dimensional inverse problems governed by PDE examples, namely for the estimation of a distributed Robin boundary coefficient in a linear diffusion problem, and for a coefficient estimation problem governed by a nonlinear diffusion problem.

Bayesian approximation error↗
DOE OSTI2023

Approximate Boltzmann distributions in quantum approximate optimization

Approaches to compute or estimate the output probability distributions from the quantum approximate optimization algorithm (QAOA) are needed to assess the likelihood it will obtain a quantum computational advantage. We analyze output from QAOA circuits solving 7200 random MaxCut instances, with $n$ = 14–23 qubits and depth parameter $p$ ≤ 12 and find that the average basis state probabilities follow approximate Boltzmann distributions: The average probabilities scale exponentially with their energy (cut value), with a peak at the optimal solution. Furthermore, we describe the rate of exponential scaling or effective temperature in terms of a series with a leading-order term $T$ ~ $C$ min /$n$ $\sqrt{p}$, with $C$ min the optimal solution energy. Using this scaling, we generate approximate output distributions with up to 38 qubits and find these give accurate accounts of important performance metrics in cases we can simulate exactly.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Ultrasonic measurement of temperature distributions in extreme environments: Electrical power plants testing in utility-scale steam generators

Thermal heterogeneities within energy conversion and storage, material processing, nuclear processes, aerospace, and military applications are often inaccessible to characterization by insertion sensors. When sensor deployment is possible, conventional pointwise temperature probes quickly degrade when inserted into harsh environments typical of such processes. We developed spatially-resolved ultrasonic thermometry to noninvasively measure the spatial distributions of thermal properties in such applications, even when sizable thermal gradients are present. Our method divides the path of ultrasonic propagation into segments bound by echogenic features, which create echoes in pulse-echo mode, encoding the information about interior temperature distributions. We use the acquired ultrasonic responses to estimate the internal temperature distributions by solving an inverse problem or concatenating segmental estimates. This work describes the implementation and industrial testing of the developed method at a coal-fired electrical power generation plant. We inserted an echogenically segmented Inconel 625 waveguide into the combustion zone of the utility-scale boiler and continuously acquired ultrasonic data while keeping sensitive components away from the damaging combustion environment. The accuracy of the time-dependent temperature distributions reconstructed from the ultrasonic measurements was comparable to that of thermocouples. The resiliency of ultrasonic thermometry to harsh combustion conditions was far superior to conventional insertion sensors. The measurements obtained during plant operation captured daily steam generation cycles in response to changing customer demand and intermittent contributions of renewable power sources to the power grid. These measurements have revealed new insights into the relationship between the dynamic power generation load and the conditions inside the steam generator. As a result, the successful industrial testing of spatially-resolved ultrasonic thermometry in solids indicates that the developed technology has matured to become an attractive alternative to conventional sensing in solving challenging problems of long-term thermal characterizations in extreme environments.

42 ENGINEERING↗
DOE OSTI2020

Probabilistic Zonal Reserve Requirements for Improved Energy Deliverability with Wind Power

In power systems with high penetration of renewable energy resources, uncertainty and variability of these stochastic resources introduce additional challenges for the operation of power systems. To improve the power system's reliability in the face of uncertainty, reserves are required as additional generation capacity to rebalance the power system following random disturbances. However, reserve deliverability is not guaranteed, because it may encounter potential transmission line congestion. Zonal reserve requirements can address this issue, but operators lack efficient ways to allocate reserves to zones while accounting for wind power forecast uncertainty. Herein we propose a methodology for probabilistic zonal reserve requirements to address wind power forecast uncertainties. This method estimates the probability distribution of line flows based on the system generation margin and injection shift factor. This estimate is then used to construct pre-defined and post-zonal reserve requirements. Case studies demonstrate that the proposed method efficiently schedules energy and reserves to balance energy and manage deliverability with wind power forecast uncertainty.We also discuss operational implications of the proposed method.

17 WIND ENERGY↗
DOE OSTI2025

Estimation of extreme temperatures in direct solar methane pyrolysis within a porous medium

Porous media have wide application in renewable energy conversion processes, such as solar-thermal fuels production and decarbonization. Heat transport mechanisms within porous media can be highly complex, particularly under extreme conditions encountered in concentrated solar thermal reactors in which direct measurement of temperature is challenging. Here, we implement and report an inverse heat conduction model to estimate the temperature distribution throughout a porous substrate domain in a direct solar methane pyrolysis process. By solving a two-dimensional heat transfer problem and applying an inverse optimization algorithm, we estimate the quasi-steady state spatial temperature distribution in a fibrous porous carbon substrate. The results are validated indirectly by experimentally measured graphite deposition and a simplified reaction kinetic model.

finite difference method↗
DOE OSTI2022

Dynamic signal recovery in distribution grids using compressive lossy measurements

Distribution system state estimation requires reliable aggregation of the measured data. However, the large volume of the measured data imposes a significant stress on the underlying communication infrastructure. With the challenges associated with measurement availability, current distribution systems are typically unobservable. To cope with the unobservability issue, compressive sensing theory allows us to recover system state information from a small number of measurements provided the states of the distribution system exhibit sparsity. In this paper, we evaluate the robustness of an updated Kalman filtered modified compressive sensing (KF-ModCS) technique that dynamically estimates the grid states using a small fraction of measured data. In practice, measurements used for sparsity based state estimation may also be intermittent due to communication network induced losses. Further, to understand the effect of packet losses on KF-ModCS, we provide an upper bound for the expected variances of the state estimation error for a given rate of information loss. This upper bound is further improved if the support set of the sparse signal that characterizes the state dynamics does not change over time and/or the reduced model is observable. Simulations based on two practical data sets collected from actual customers in a distribution grid validate the theoretical results.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Adversarial sampling of unknown and high-dimensional conditional distributions

Many engineering problems require the prediction of realization-to-realization variability or a refined description of modeled quantities. In that case, it is necessary to sample elements from unknown high-dimensional spaces with possibly millions of degrees of freedom. While there exist methods able to sample elements from probability density functions (PDF) with known shapes, several approximations need to be made when the distribution is unknown. In this paper the sampling method, as well as the inference of the underlying distribution, are both handled with a data-driven method known as generative adversarial networks (GAN), which trains two competing neural networks to produce a network that can effectively generate samples from the training set distribution. In practice, it is often necessary to draw samples from conditional distributions. When the conditional variables are continuous, only one (if any) data point corresponding to a particular value of a conditioning variable may be available, which is not sufficient to estimate the conditional distribution. This work handles this problem using an a priori estimation of the conditional moments of a PDF. Herein, two approaches, stochastic estimation, and an external neural network are compared for computing these moments; however, any preferred method can be used. The algorithm is demonstrated in the case of the deconvolution of a filtered turbulent flow field. It is shown that all the versions of the proposed algorithm effectively sample the target conditional distribution with minimal impact on the quality of the samples compared to state-of-the-art methods. Additionally, the procedure can be used as a metric for the diversity of samples generated by a conditional GAN (cGAN) conditioned with continuous variables.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗